Netbackup Comms Requirements

[Nerdling]

Hi Guys,

I'm working on a new Netbackup Instlation, version 7.1.  All hosts are Win2K8 r2.

I have comms between hosts and can ping and confirm name resolution between hosts.

Netbackup does not talk.

Using the client list, I right click on the host name and click connect, this fails with a message "can not ping...".

If I try to run a job it fails with error 58.

Here is the out put from the job log:

19/01/2012 3:40:51 PM - Info nbjm(pid=3748) starting backup job (jobid=116) for client dbsrv01, policy MSSQL, schedule Monthly_Full 
19/01/2012 3:40:51 PM - Info nbjm(pid=3748) requesting MEDIA_SERVER_WITH_ATTRIBUTES resources from RB for backup job (jobid=116, request id:{2AF90966-687E-4AF4-B6D5-0E8CC7BA4E72}) 
19/01/2012 3:40:51 PM - requesting resource MasterSrv-hcart2-robot-tld-1
19/01/2012 3:40:51 PM - requesting resource MasterSrv.domain.domain.NBU_CLIENT.MAXJOBS.dbsrv01
19/01/2012 3:40:51 PM - requesting resource MasterSrv.domain.domain.NBU_POLICY.MAXJOBS.MSSQL
19/01/2012 3:40:51 PM - granted resource MasterSrv.domain.domain.NBU_CLIENT.MAXJOBS.dbsrv01
19/01/2012 3:40:51 PM - granted resource MasterSrv.domain.domain.NBU_POLICY.MAXJOBS.MSSQL
19/01/2012 3:40:51 PM - granted resource MasterSrv-hcart2-robot-tld-1
19/01/2012 3:40:51 PM - estimated 0 Kbytes needed
19/01/2012 3:40:51 PM - Info nbjm(pid=3748) started backup job for client dbsrv01, policy MSSQL, schedule Monthly_Full on storage unit MasterSrv-hcart2-robot-tld-1
19/01/2012 3:40:51 PM - started process bpbrm (1788)
19/01/2012 3:44:28 PM - Error bpbrm(pid=1788) Cannot connect to dbsrv01        
19/01/2012 3:44:28 PM - Info bpbrm(pid=1788) dbsrv01 is the host to backup data from    
19/01/2012 3:44:28 PM - end writing
can't connect to client(58)
19/01/2012 3:44:33 PM - Info bpbkar32(pid=0) done. status: 58: can't connect to client    

I created a bprm folder in the logs directory on both the master and client servers.  The client sevrer folder remained empty, however below is what was logged on the master server:

15:54:28.890 [4440.7548] <2> bpbrm main: INITIATING (VERBOSE = 0): version NetBackup 7.1 0
15:54:28.890 [4440.7548] <2> logparams: -backup -S mgt01.nqa.internal -c crmdb01 -ct 15 -ru root -cl MSSQL -sched Monthly_Full -bt 1326948868 -dt 0 -st 0 -b crmdb01_1326948868 -mediasvr mgt01.nqa.internal -jobid 116 -jobgrpid 116 -masterversion 710000 -maxfrag 0 -p 0 -use_ofb -use_otm -jm -secure 1 -kl 28 -rg other -fso -hqdb -connect_options 16974338
15:54:28.890 [4440.7548] <2> read_client: dname=., offline=0, online_at=0
15:54:28.890 [4440.7548] <2> read_client: dname=.., offline=0, online_at=0
15:54:28.890 [4440.7548] <2> read_client: dname=CO_0, offline=0, online_at=0
15:54:28.890 [4440.7548] <2> read_client: dname=host_info, offline=0, online_at=0
15:54:28.890 [4440.7548] <2> read_client: dname=OA_2147483647, offline=0, online_at=2147483647
15:54:28.890 [4440.7548] <2> db_freeEXDB_INFO: ?
15:54:46.346 [6376.1220] <2> bpbrm main: INITIATING (VERBOSE = 0): version NetBackup 7.1 0
15:54:46.346 [6376.1220] <2> logparams: -backup -S mgt01.nqa.internal -c spdb01 -ct 15 -ru root -cl MSSQL -sched Monthly_Full -bt 1326948886 -dt 0 -st 0 -b spdb01_1326948886 -mediasvr mgt01.nqa.internal -jobid 117 -jobgrpid 117 -masterversion 710000 -maxfrag 0 -p 0 -use_ofb -use_otm -jm -secure 1 -kl 28 -rg other -fso -hqdb -connect_options 16974338
15:54:46.346 [6376.1220] <2> read_client: dname=., offline=0, online_at=0
15:54:46.346 [6376.1220] <2> read_client: dname=.., offline=0, online_at=0
15:54:46.346 [6376.1220] <2> read_client: dname=CO_0, offline=0, online_at=0
15:54:46.346 [6376.1220] <2> read_client: dname=host_info, offline=0, online_at=0
15:54:46.346 [6376.1220] <2> read_client: dname=OA_2147483647, offline=0, online_at=2147483647
15:54:46.361 [6376.1220] <2> db_freeEXDB_INFO: ?
15:54:58.950 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:54:59.949 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:16.406 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:17.405 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:29.994 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:31.008 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:41.007 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:47.450 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:48.464 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:55:58.463 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:11.052 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:13.064 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:22.065 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:28.508 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:30.520 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:39.490 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:52.110 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:56:56.119 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:03.093 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:09.535 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:13.544 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:20.533 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:33.138 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:41.140 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:44.151 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:50.578 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:57:58.581 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:58:01.591 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:58:05.164 [4440.7548] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:58:05.164 [4440.7548] <2> connect_to_service: ../../libvlibs/vnet_connect.c.382: 0: vnet_async_connect() failed: 18 0x00000012
15:58:05.164 [4440.7548] <2> vnet_connect_to_bpcd: ../../libvlibs/vnet_connect.c.237: 0: connect_to_service() failed: 18 0x00000012
15:58:05.164 [4440.7548] <2> local_bpcr_connect: Can't connect to client crmdb01
15:58:05.164 [4440.7548] <2> ConnectToBPCD: bpcd_connect_and_verify(crmdb01, crmdb01) failed: 25
15:58:05.164 [4440.7548] <16> bpbrm start_bpcd_stat: Cannot connect to crmdb01
15:58:05.164 [4440.7548] <2> job_connect: SO_KEEPALIVE set on socket 648 for client mgt01.nqa.internal
15:58:05.164 [4440.7548] <2> logconnections: BPJOBD CONNECT FROM 172.19.96.11.53966 TO 172.19.96.11.13723 fd = 648
15:58:05.164 [4440.7548] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:58:05.164 [4440.7548] <2> job_connect: Connected to the host mgt01.nqa.internal contype 10 jobid <116> socket <648>
15:58:05.164 [4440.7548] <2> job_connect: Connected on port 53966
15:58:05.164 [4440.7548] <2> job_monitoring_exex: ACK disconnect
15:58:05.164 [4440.7548] <2> job_disconnect: Disconnected
15:58:05.179 [4440.7548] <2> verify_client: bpbrm.c.34896: start_bpcd_stat failed: 58 58 0x0000003a
15:58:05.179 [4440.7548] <2> job_connect: SO_KEEPALIVE set on socket 624 for client mgt01.nqa.internal
15:58:05.179 [4440.7548] <2> logconnections: BPJOBD CONNECT FROM 172.19.96.11.53967 TO 172.19.96.11.13723 fd = 624
15:58:05.179 [4440.7548] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:58:05.179 [4440.7548] <2> job_connect: Connected to the host mgt01.nqa.internal contype 10 jobid <116> socket <624>
15:58:05.179 [4440.7548] <2> job_connect: Connected on port 53967
15:58:05.179 [4440.7548] <2> bpbrm main: bpbrm.c.2844: verify_client failed: 58 58 0x0000003a
15:58:05.179 [4440.7548] <2> bpbrm kill_child_process_Ex: start
15:58:10.187 [4440.7548] <2> bpbrm Exit: client backup EXIT STATUS 58: can't connect to client
15:58:22.620 [6376.1220] <2> vnet_async_connect: ../../libvlibs/vnet_connect.c.1376: 0: getsockopt SO_ERROR returned: 10060 0x0000274c
15:58:22.620 [6376.1220] <2> connect_to_service: ../../libvlibs/vnet_connect.c.382: 0: vnet_async_connect() failed: 18 0x00000012
15:58:22.620 [6376.1220] <2> vnet_connect_to_bpcd: ../../libvlibs/vnet_connect.c.237: 0: connect_to_service() failed: 18 0x00000012
15:58:22.620 [6376.1220] <2> local_bpcr_connect: Can't connect to client spdb01
15:58:22.620 [6376.1220] <2> ConnectToBPCD: bpcd_connect_and_verify(spdb01, spdb01) failed: 25
15:58:22.620 [6376.1220] <16> bpbrm start_bpcd_stat: Cannot connect to spdb01
15:58:22.620 [6376.1220] <2> job_connect: SO_KEEPALIVE set on socket 648 for client mgt01.nqa.internal
15:58:22.620 [6376.1220] <2> logconnections: BPJOBD CONNECT FROM 172.19.96.11.53973 TO 172.19.96.11.13723 fd = 648
15:58:22.620 [6376.1220] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:58:22.620 [6376.1220] <2> job_connect: Connected to the host mgt01.nqa.internal contype 10 jobid <117> socket <648>
15:58:22.620 [6376.1220] <2> job_connect: Connected on port 53973
15:58:22.635 [6376.1220] <2> job_monitoring_exex: ACK disconnect
15:58:22.635 [6376.1220] <2> job_disconnect: Disconnected
15:58:22.635 [6376.1220] <2> verify_client: bpbrm.c.34896: start_bpcd_stat failed: 58 58 0x0000003a
15:58:22.635 [6376.1220] <2> job_connect: SO_KEEPALIVE set on socket 624 for client mgt01.nqa.internal
15:58:22.635 [6376.1220] <2> logconnections: BPJOBD CONNECT FROM 172.19.96.11.53974 TO 172.19.96.11.13723 fd = 624
15:58:22.635 [6376.1220] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:58:22.635 [6376.1220] <2> job_connect: Connected to the host mgt01.nqa.internal contype 10 jobid <117> socket <624>
15:58:22.635 [6376.1220] <2> job_connect: Connected on port 53974
15:58:22.635 [6376.1220] <2> bpbrm main: bpbrm.c.2844: verify_client failed: 58 58 0x0000003a
15:58:22.635 [6376.1220] <2> bpbrm kill_child_process_Ex: start
15:58:27.659 [6376.1220] <2> bpbrm Exit: client backup EXIT STATUS 58: can't connect to client
 

[Yasuhisa_Ishika]

You have to allow network access between NetBackup hosts on port 1556. Check firewall setting.
Port usage on NetBackup is detailed in this guide.
http://www.symantec.com/docs/DOC3655

[Marianne · Accepted solution]

Requirements:

1. Open ports between media server and client in both directions - pbx (1556) will be attempted first. Failing that, vnetd (13724) will be tried. Windows Firewall will prevent connection.
2. Forward and reverse name lookup. Client needs to resolve incoming IP address from media server to a valid hostname that appears in the client's SERVER list.

Please note that bpbrm on the media server connects to bpcd on the client. Therefore you need bpcd log on the client to troubleshoot.

[Nerdling]

Thanks guys,  You've confirmed what I thought was going on.  I don't have full control of the environment, I've requested that the NBU ports are opened and will report back once I have tested.

thanks

[Nerdling]

Comms ports have been opend.  Thanks for confirming my thoughts.