bparchive not running

[richs24]

Hi,

when trying to run manual bparchives or bpbackups, nothing happens!
Literally, it returns to the prompt, and nothing ever appears in the activity monitor.  i've enabled logging for bpcd, bprd, bptm, bparchive, bpbkar, and the only log with any entries is bparchive.  But nothing very useful, as shown below

11:46:49.499 [6154] <2> logparams: -s User_Arch_7W -S nbu-server.backup.local -f /tmp/temp_filelist
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/cciss/c0d0p2 on /
11:46:49.500 [6154] <2> mount build_mount_list: Processing (proc) none on /proc
11:46:49.500 [6154] <2> mount build_mount_list: Processing (sysfs) none on /sys
11:46:49.500 [6154] <2> mount build_mount_list: Processing (devpts) none on /dev/pts
11:46:49.500 [6154] <2> mount build_mount_list: Processing (usbfs) usbfs on /proc/bus/usb
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/cciss/c0d0p1 on /boot
11:46:49.500 [6154] <2> mount build_mount_list: Processing (tmpfs) none on /dev/shm
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/cciss/c0d0p3 on /home
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext2) /dev/cciss/c0d0p7 on /tmp
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/cciss/c0d0p5 on /usr
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/cciss/c0d0p8 on /var
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/mapper/usr_localvg-usr_localvol on /usr/local
11:46:49.500 [6154] <2> mount build_mount_list: Processing (binfmt_misc) none on /proc/sys/fs/binfmt_misc
11:46:49.500 [6154] <2> mount build_mount_list: Processing (autofs) automount(pid6566) on /nfs
11:46:49.500 [6154] <2> mount build_mount_list: Processing (rpc_pipefs) sunrpc on /var/lib/nfs/rpc_pipefs
11:46:49.500 [6154] <2> mount build_mount_list: Processing (NFS) nfsd on /proc/fs/nfsd
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/mapper/mhds1vg-mhds1vol on /MHDS1
11:46:49.500 [6154] <2> mount build_mount_list: Processing (ext3) /dev/mapper/mhds2vg-mhds2vol on /MHDS2
11:46:49.500 [6154] <2> mount build_mount_list: Processing (NFS) client-p12x1:/filesystem/cccms/pme/data on /nfs/pme
11:46:49.500 [6154] <2> mount build_mount_list: Processing (NFS) client-p12x1:/filesystem/cccms/cas/data on /nfs/cas
11:46:49.501 [6154] <2> vauth_get_user_name: vauth_comm.c.687: cached_user_name: root
11:46:49.501 [6154] <2> vauth_get_user_name: vauth_comm.c.689: cached_user_name: :root
11:46:49.501 [6154] <2> vauth_get_user_name: vauth_comm.c.695: user_name: :root
11:46:49.501 [6154] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
11:46:49.501 [6154] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
11:46:49.501 [6154] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
11:46:49.501 [6154] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
11:46:49.502 [6154] <2> init_cache: vnet_hosts.c.990: host_cache_size: 200 0x000000c8
11:46:49.502 [6154] <2> init_cache: vnet_hosts.c.991: cache_time: 3600 0x00000e10
11:46:49.502 [6154] <2> init_cache: vnet_hosts.c.1003: host_failed_cache_size: 40 0x00000028
11:46:49.502 [6154] <2> init_cache: vnet_hosts.c.1004: cache_time: 3600 0x00000e10
11:46:49.502 [6154] <2> vnet_async_connect: vnet_vnetd.c.4019: connect in progress: 0 0x00000000
11:46:49.509 [6154] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
11:46:49.509 [6154] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: service: bprd
11:46:49.550 [6154] <2> vnet_async_connect: vnet_vnetd.c.4205: in progress connect: 0 0x00000000
11:46:49.550 [6154] <2> vnet_async_connect: vnet_vnetd.c.4208: connect: async CONNECT FROM 192.168.66.183.11256 TO 172.30.240.1.13724 fd = 4
11:46:49.550 [6154] <2> logconnections: BPRD CONNECT FROM 192.168.66.183.11256 TO 172.30.240.1.13724
11:46:49.550 [6154] <2> vauth_authentication_required: vauth_comm.c.749: no methods for address: no authentication required
11:46:49.550 [6154] <2> vauth_connector: vauth_comm.c.182: no methods for address: no authentication required
11:46:49.550 [6154] <2> bprd_connect: no authentication required
11:46:49.558 [6154] <2> vnet_check_vxss_client_magic_with_info: vnet_vxss_helper.c.770: Ignoring VxSS authentication: 2 0x00000002
11:46:49.558 [6154] <2> vnet_check_vxss_client_magic_with_info: vnet_vxss_helper.c.926: Not using VxSS authentication: 2 0x00000002
11:46:49.558 [6154] <2> send_request: Set SO_KEEPALIVE on socket.
11:46:49.558 [6154] <2> bparchive: sending user archive request to bprd
11:46:49.558 [6154] <2> bparchive: buf = root root client-p13x1.backup.local client-p13x1.backup.local client-p13x1.backup.local NONE NONE User_Arch_7W 0 0 0 0 C C C C C 0 0 -1 0 5
11:46:49.558 [6154] <4> bparchive: /tmp/leigh

when i try to telnet  masterserver bpcd, it connects, but drops out immediately, as it does when doing the same to the media server.

-bash-3.00# telnet nbu-server bpcd
Trying 172.30.240.1...
Connected to nbu-server.backup.local ( ip address)
Escape character is '^]'.
Connection closed by foreign host.

all name resolution is fine, and backups initiated from the server work fine

the platform is

Linux client-p13x1 2.6.9-42.0.10.ELsmp #1 SMP Fri Feb 16 17:13:42 EST 2007 x86_64 x86_64 x86_64 GNU/Linux

and the client installed is

file /usr/openv/netbackup/bin/bpcd
/usr/openv/netbackup/bin/bpcd: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), for GNU/Linux 2.2.5, dynamically linked (uses shared libs), not stripped


Has anyone got any ideas that can help please?

cheers

Rich

[quebek]

To be able to run bpbackup/bparchive from client side - You have to create a policy with schedule - USER BACKUP | USER ARCHIVE.
If You have such policy in place try to use with these commands the -L switch.
Ie.
bpbackup -p user_policy -s user_schedule -L /tmp/progress_log.txt /etc/*

Where:
user_policy is an existing policy on NBU server
user_schedule is an existing schedule of type (user backup) in the policy user_policy
/tmp/progress_log.txt is a new file where are logged all information about progress of this backup
/etc/* is the backup selection list


after issuing this command please run this
tail -f /tmp/progress_log.txt
and paste its output here.

[richs24]

the output is as follows
Archive started 05/19/2009 13:08:39


not much to go on, but that is what i was trying to tell you.  there is nothing to point you in the right direction.

The one difference this time though, was that there was an error returned to the command line

EXIT STATUS 40: network connection broken

i've just re-tried a server initiated backup though, and that works fine still

[quebek]

How many network interfaces are confiugre on this box?
what is the output from the bp.conf
is the first entry for SERVER =
for Your backup server?
try to add there line REQUIRED_INTERFACE if this box is multihomed (several NICs)

[richs24]

2 nics are configured, and the bp.conf is set up correctly with the righ server name at the top, and the required interface parameter configured

[quebek]

Hi again
while the server initiated backup is running please run ps -ef|grep bp
on client and the backup server.
Please paste this outputs here
maybe You are missing something - like -S switch in the bparchvie/bpbackup

What is in the bpbkar on the client log?

[richs24]

Hi,

thanks for your persistence with this.

output as requested, as well as the command i'm using

-bash-3.00# /usr/openv/netbackup/bin/bparchive -s User_Arch_7W -L /tmp/test.log -S nbu-server.backup.local -f /tmp/temp_filelist
EXIT STATUS 40: network connection broken
-bash-3.00# ps -ef |grep bp
root 6676 5069 0 13:54 pts/1 00:00:00 grep bp


cheers

[quebek]

Please run this command while is running server initiated backup!
and please run this command on backup server and this client
BTW please provide the bpbkar logs  from this client.

[richs24]

the bpbkar logs are empty, which is what i've been saying.  the command doesn't run on this server, it just fails straight away.
the same command works fine on 20 other servers in our estate, so we know it's not an issue with the command, but there is something more specific about this server that we are struggling with

[quebek]

Please check out the iptables if it is configured properly and its not blocking any input/ouptut traffic.
Later on I would double check all names - server, client.
Compare output from hostname command on this client with entry CLIENT_NAME in bp.conf
the same for server etc.
no more ideas for now - sorry.

[richs24]

everything is as it should be, cheers for your help

[richs24]

by which i mean, that everything is set up as it should be, but still not working!