beremote: Crash at startup after update to fedora 15

[mtournoij]

After updating to fedora 15 beremote will no longer start.

There is no *clear* error message at what exactly is going wrong ... And the friendly mister Google doesn't have a whole lot to say on this either.

I disabled IPv6 on my system (caused problems in the past) and tried disabling the "Follow local mount point" option -- Both to no avail.

Any assistance would be greatly appreciated!

Thanks.
Martin

-----------------------------------------------------

Console output:

GetIfAddrs(LINUX): failed err = 11 
*** glibc detected *** /opt/VRTSralus/bin/beremote: munmap_chunk(): invalid pointer: 0x00007ff46ac82e98 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x7703a)[0x7ff464fce03a]
/opt/VRTSralus/bin/libbesocket.so(_Z11freeifaddrsP7ifaddrs+0x1f)[0x7ff466ac72bf]
/opt/VRTSralus/bin/libbesocket.so(_Z10getifaddrsPP7ifaddrs+0x6bf)[0x7ff466ac726f]
/opt/VRTSralus/bin/libbesocket.so(_Z20GetAdaptersAddressesjjPvP21_IP_ADAPTER_ADDRESSESPj+0x56)[0x7ff466ac7b26]
/opt/VRTSralus/bin/libbesocket.so(_ZN8BESocket13BENetConfigEx18RefreshInformationEPKb+0x3a)[0x7ff466ad0d5a]
/opt/VRTSralus/bin/libbesocket.so(_ZN8BESocket13BENetConfigExC1Eb+0xff)[0x7ff466ad0c0f]
/opt/VRTSralus/bin/libbesocket.so(_ZN8BESocket13BENetConfigEx23GetNetworkConfigurationEb+0x2d)[0x7ff466ad119d]
/opt/VRTSralus/bin/libbedsvx.so(_Z14VX_EnumSelfDLEP6BE_CFGP8HEAD_DLE+0x31a)[0x7ff467e0745a]
/opt/VRTSralus/bin/libndmpcomm.so(+0x28bbb)[0x7ff467150bbb]
/opt/VRTSralus/bin/libndmpcomm.so(+0x28feb)[0x7ff467150feb]
/opt/VRTSralus/bin/libndmpcomm.so(_Z20NrdsAdvertiserThreadPv+0x147)[0x7ff4671526c7]
/opt/VRTSralus/bin/libvxACEI.so.3(_ZN18ACE_Thread_Adapter8invoke_iEv+0x50)[0x7ff46a9eeee0]
/opt/VRTSralus/bin/libvxACEI.so.3(_ZN18ACE_Thread_Adapter6invokeEv+0x5a)[0x7ff46a9eee4a]
/opt/VRTSralus/bin/libvxACEI.so.3(ace_thread_adapter+0x9)[0x7ff46a9b6e69]
/lib64/libpthread.so.0(+0x7b31)[0x7ff46917bb31]
/lib64/libc.so.6(clone+0x6d)[0x7ff465036d2d]

Starting with ./beremote --log-file gives me the following output:

a83df720 Fri Sep 16 17:54:15 2011 : Starting BE Remote Agent
a83df720 Fri Sep 16 17:54:15 2011 : Log file: /var/VRTSralus/log
a83df720 Fri Sep 16 17:54:15 2011 : No configuration file specified. Using default.
a83df720 Fri Sep 16 17:54:15 2011 : Log to console: disabled
a83df720 Fri Sep 16 17:54:15 2011 : Successfully set the supplementary groups of the process
a83df720 Fri Sep 16 17:54:15 2011 : Initialized locks for SSL callbacks
a83df720 Fri Sep 16 17:54:15 2011 : Starting NDMP processor
a83df720 Fri Sep 16 17:54:15 2011 : NDMPDMainThreadFunc spawned: grpid=1, tid=-1576737024
a204e700 Fri Sep 16 17:54:15 2011 : FS_InitFileSys
a204e700 Fri Sep 16 17:54:15 2011 : libbedsnt5.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedssql2.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsxchg.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsxese.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsmbox.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedspush.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsnote.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsmdoc.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedssps2.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedssps3.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsupfs.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsshadow.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsoffhost.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : loaded libbedsvx.so
a204e700 Fri Sep 16 17:54:15 2011 : loaded libbedsrman.so
a204e700 Fri Sep 16 17:54:15 2011 : loaded libbedssms.so
a204e700 Fri Sep 16 17:54:15 2011 : loaded libbedssmsp.so
a204e700 Fri Sep 16 17:54:15 2011 : libbedsra.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : libbedsdb2.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : loaded libbedsedir.so
a204e700 Fri Sep 16 17:54:15 2011 : libbedsvmesx.so could not be loaded: 0x 2 (2)
a204e700 Fri Sep 16 17:54:15 2011 : Initializing FSs
a204e700 Fri Sep 16 17:54:15 2011 : FS 1 failed to initialize: 0xE000FE46
a204e700 Fri Sep 16 17:54:15 2011 : Function called: RMAN_InitFileSys
a204e700 Fri Sep 16 17:54:15 2011 : Using 'UTF-8' Encoding.
a204e700 Fri Sep 16 17:54:15 2011 : Using vfm path /opt/VRTSralus/VRTSvxms from config.
a204e700 Fri Sep 16 17:54:15 2011 : Sucessfully set VFM_PRIVATE_ROOT env to /opt/VRTSralus/VRTSvxms.
a204e700 Fri Sep 16 17:54:15 2011 : VFM_PRIVATE_ROOT was set with value /opt/VRTSralus/VRTSvxms
a204e700 Fri Sep 16 17:54:15 2011 : VXMS Initialization OK.
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <rootfs> mounted at </>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <proc> mounted at </proc>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <sysfs> mounted at </sys>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <devtmpfs> mounted at </dev>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <devpts> mounted at </dev/pts>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <tmpfs> mounted at </dev/shm>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <tmpfs> mounted at </run>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <ext4> mounted at </>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <tmpfs> mounted at </sys/fs/cgroup>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/systemd>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/cpuset>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/cpu>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/cpuacct>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/memory>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/devices>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/freezer>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/net_cls>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/blkio>
a 204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <cgroup> mounted at </sys/fs/cgroup/perf_event>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <autofs> mounted at </sys/kernel/security>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <autofs> mounted at </sys/kernel/debug>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <autofs> mounted at </dev/mqueue>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <autofs> mounted at </dev/hugepages>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <autofs> mounted at </proc/sys/fs/binfmt_misc>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <tmpfs> mounted at </var/run>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <tmpfs> mounted at </media>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <tmpfs> mounted at </var/lock>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <ext4> mounted at </boot>
a204e700 Fri Sep 16 17:54:15 2011 : Detected Mounted Filesystem: type <rpc_pipefs> mounted at </var/lib/nfs/rpc_pipefs>
a204e700 Fri Sep 16 17:54:15 2011 : INFORMATIONAL: Zero value found for 'DisableRMAL' from ralus.cfg, allowing RMAL to initialize
a204e700 Fri Sep 16 17:54:15 2011 : Successfully resolved the "ndmp" service to port: 10000 (host order)
a204e700 Fri Sep 16 17:54:15 2011 : BETCPListener successfully installed a signal handler for SIGTERM
a204e700 Fri Sep 16 17:54:15 2011 : Could not create an IPv6 socket at this time, reason:An error occurred during a socket creation operation: Error Code: 97, System Error Message: Address family not supported by protocol
a204e700 Fri Sep 16 17:54:15 2011 : SocketService::IsSystemDualIP: No support found for IPv6 currently
a204e700 Fri Sep 16 17:54:15 2011 : Started NDMP Listener on port 10000
a0aa7700 Fri Sep 16 17:54:25 2011 : NrdsAdvertiserThread: advertisement cycle started.
a0aa7700 Fri Sep 16 17:54:25 2011 : RMAN_EnumSelfDLE: AgentConfig GetOracleDBNames returned error. If Oracle Agent is installed, please run AgentConfig.
a0aa7700 Fri Sep 16 17:54:25 2011 : NrdsAdvertiserThread: EnumSelfDLE for file system 14 returned 0(0x0) and 0 DLEs

Assorted syste m information:

[ /var/VRTSralus]# uname -a
Linux hostname.example.com 2.6.40.4-5.fc15.x86_64 #1 SMP Tue Aug 30 14:38:32 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux 

[/var/VRTSralus]# cat /etc/redhat-release
 Fedora release 15 (Lovelock)

[/var/VRTSralus]# cat ralus.ver
r alus=5204.4
mdm=MDM_v0.0.5248
vxms=VxMS_4.4_038a

[/var/VRTSralus]# mount -v
/proc on /proc type proc (rw,relatime)
/sys on /sys type sysfs (rw,relatime)
udev on /dev type devtmpfs (rw,nosuid,relatime,size=760760k,nr_inodes=190190,mode=755)
devpts on /dev/pts type devpts (rw,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /dev/shm type tmpfs (rw,relatime)
 tmpfs on /run type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
/dev/mapper/vg_aragornweb01-lv_root on / type ext4 (rw,relatime,user_xattr,barrier=1,data=ordered)
tmpfs on /sys/fs/cgroup type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu type cgroup (rw,nosuid,nodev,noexec,relatime,cpu)
cgroup on /sys/fs/cgroup/cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuacct)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
systemd-1 on /sys/kernel/security type autofs (rw,relatime,fd=27,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
systemd-1 on /sys/kernel/debug type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
systemd-1 on /dev/mqueue type autofs (rw,relatime,fd=29,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
systemd-1 on /dev/hugepages type autofs (rw,relatime,fd=30,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=32,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
tmpfs on /var/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
tmpfs on /var/run type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
tmpfs on /media type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755)
/dev/sda1 on /boot type ext4 (rw,relatime,user_xattr,barrier=1,data=ordered)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime

 [/var/VRTSralus]# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:50:56:B4:00:05
inet addr:192.168.1.15 Bcast:192.168.1.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:31382 errors:0 dropped:192 overruns:0 frame:0
TX packets:30284 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:6548459 (6.2 MiB) TX bytes:2693063 (2.5 MiB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:2 errors:0 dropped:0 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:276 (276.0 b) TX bytes:276 (276.0 b)

[pkh · Accepted solution]

Fedora is not supported by BE 2010.  See the SCL below

BE 2010|2010 R2|2010 R3 Software (SCL)

[mtournoij]

The most recent "RedHat-ish" distribution which is supported is RedHat 5.4. Which is no longer supported by RedHat (supported until July 31, 2011). This makes sense ...

Downgrading to from kernel 2.6.40 to 2.6.35 got me a bit further, no crases, but repeating messages:

7a7bb700 Mon Sep 19 18:45:12 2011 : NrdsAdvertiserThread: Security is enabled!!!
 7a7bb700 Mon Sep 19 18:45:12 2011 : This instance of BETCPListener was not requested to install a signal handler and hence w
ill not install one!
7a7bb700 Mon Sep 19 18:45:12 2011 : BENetConfigEx: Successfully refreshed adapter information.
7a7bb700 Mon Sep 19 18:45:12 2011 : NrdsAdvertiserThread: connect to target=backup.example.com port=6101 failed
7a7bb700 Mon Sep 19 18:45:12 2011 : NrdsAdvertiserThread: Retrying in 60 seconds

I also tried kernel 2.6.32 with the same results.

I can reach backup.example.com without problems with telnet. I added backup.example.com to /etc/hosts to no avail.

If I check with tcpdump on eth0 or lo0, I see no traffic on port 6101 or to/from backup.example.com -- Not even DNS lookups or ARP requests ...