getting status code 23: socket read failed..

[S__Sankara_Nara]

Client is behind DMZ and all port are enabled between DMZ and NBU server 6.5.....


15:00:45.894 [24993] <2> bpbrm main: INITIATING (VERBOSE = 5): version NetBackup 6.5 2008061904
15:00:45.894 [24993] <2> logparams: -backup -S netbackup -c Tmxweb -ct 13 -ru root -cl Tmxweb_orc1_2_Backup -sched Orc1_Orc2_cold_backup -bt 1239874245 -dt 0 -st 0 -b Tmxweb_1239874245 -mediasvr netbackup -jobid 8533 -jobgrpid 8533 -masterversion 650000 -maxfrag 524288 -reqid -1239874107 -mt 0 -to 0 -stunit Disk_Backup -rl 5 -rp 8035200 -p /skpbackup -mst 1 -flags 0 -use_ofb -use_otm -WOFB_enabled 1 -nbu -jm -secure 1 -kl 1 -rg root -fso -connect_options 16974338
15:00:45.895 [24993] <2> verify_client: bpbrm.c.32222: *connect_opts: 16974338 16974338 0x01030202
15:00:45.895 [24993] <2> read_client: ?
15:00:45.896 [24993] <2> read_client: opendir() failed: Tmxweb: No such file or directory (2)
15:00:45.896 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <Tmxweb>
15:00:45.896 [24993] <2> hosts_equal: names are the same
15:00:45.897 [24993] <2> bpbrm start_bpcd_stat: bpbrm.c.19319: bpcd_client: Tmxweb
15:00:45.897 [24993] <2> bpbrm start_bpcd_stat: bpbrm.c.19322: bpcd_client_hostname: Tmxweb
15:00:45.898 [24993] <2> vauth_get_user_name: vauth_comm.c.687: cached_user_name: root
15:00:45.898 [24993] <2> vauth_get_user_name: vauth_comm.c.689: cached_user_name: :root
15:00:45.898 [24993] <2> vauth_get_user_name: vauth_comm.c.695: user_name: :root
15:00:45.898 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <Tmxweb>
15:00:45.898 [24993] <2> hosts_equal: names are the same
15:00:45.898 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <Tmxweb>
15:00:45.898 [24993] <2> hosts_equal: names are the same
15:00:45.898 [24993] <2> local_bpcr_connect: bpcr.c.276: connect_opts = 0x01000100 connect_opts2 = 0x01000100
15:00:45.898 [24993] <2> local_bpcr_connect: bpcr.c.283: connect_opts = 0x01000100
15:00:45.898 [24993] <2> local_bpcr_connect: bpcr.c.322: daemon_port_type = 0
15:00:45.898 [24993] <2> init_cache: vnet_hosts.c.915: host_cache_size: 200 0x000000c8
15:00:45.898 [24993] <2> init_cache: vnet_hosts.c.916: cache_time: 3600 0x00000e10
15:00:45.899 [24993] <2> init_cache: vnet_hosts.c.928: host_failed_cache_size: 40 0x00000028
15:00:45.899 [24993] <2> init_cache: vnet_hosts.c.929: cache_time: 3600 0x00000e10
15:00:45.899 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.310: host is not found in cache: Tmxweb
15:00:45.899 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.409: Completed : Tmxweb
15:00:45.899 [24993] <2> init_cache: vnet_hosts.c.915: host_cache_size: 200 0x000000c8
15:00:45.899 [24993] <2> init_cache: vnet_hosts.c.916: cache_time: 3600 0x00000e10
15:00:45.899 [24993] <2> init_cache: vnet_hosts.c.928: host_failed_cache_size: 40 0x00000028
15:00:45.899 [24993] <2> init_cache: vnet_hosts.c.929: cache_time: 3600 0x00000e10
15:00:45.899 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.310: host is not found in cache: Tmxweb
15:00:45.899 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.409: Completed : Tmxweb
15:00:45.900 [24993] <2> vnet_async_connect: vnet_vnetd.c.4019: connect in progress: 0 0x00000000
15:00:45.932 [24993] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
15:00:45.933 [24993] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: service: bpcd
15:00:46.129 [24993] <2> vnet_async_connect: vnet_vnetd.c.4205: in progress connect: 0 0x00000000
15:00:46.130 [24993] <2> vnet_async_connect: vnet_vnetd.c.4208: connect: async CONNECT FROM 100.1.1.61.4999 TO 192.168.255.2.13724 fd = 7
15:00:46.130 [24993] <2> logconnections: BPCD CONNECT FROM 100.1.1.61.4999 TO 192.168.255.2.13724
15:00:46.130 [24993] <2> vauth_authentication_required: vauth_comm.c.749: no methods for address: no authentication required
15:00:46.130 [24993] <2> vauth_connector: vauth_comm.c.182: no methods for address: no authentication required
15:00:46.130 [24993] <2> bpcr_authenticate_connection: no authentication required
15:00:46.132 [24993] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.179: msg: VNETD CONNECT FROM 100.1.1.61.4908 TO 192.168.255.2.13724 fd = 8
15:00:46.165 [24993] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.532: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
15:00:46.238 [24993] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.549: ipc_string: 2617
15:00:46.240 [24993] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.560: hash_str1: 6e7f6af4e24bd19108d0565492d9cd38
15:00:50.692 [24993] <2> get_short: (1) cannot read (byte 1) from network: Connection reset by peer (131)
15:00:50.692 [24993] <2> bpcr_put_vnetd_forward_socket: get_short failed: 131
15:00:50.692 [24993] <2> local_bpcr_connect: bpcr_put_vnetd_forward_socket failed: 23
15:00:50.693 [24993] <2> ConnectToBPCD: bpcd_connect_and_verify(Tmxweb, Tmxweb) failed: 23
15:00:50.693 [24993] <16> bpbrm start_bpcd_stat: bpcd on Tmxweb exited with status 23: socket read failed
15:00:50.693 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <netbackup>
15:00:50.694 [24993] <2> hosts_equal: host1 Tmxweb tmxweb addr 192.168.255.2 (0xc0a8ff02)
15:00:50.694 [24993] <2> hosts_equal: host2 netbackup netbackup addr 100.1.1.61 (0x6401013d)
15:00:50.694 [24993] <2> hosts_equal: hostnames DO NOT compare
15:00:50.694 [24993] <2> hosts_equal: name1=Tmxweb name2=netbackup
15:00:50.694 [24993] <2> hosts_equal: hostbuf=tmxweb hostentry->h_name=netbackup
15:00:50.694 [24993] <2> hosts_equal: compare tmxweb with alias netbackup.thermax.com
15:00:50.694 [24993] <2> hosts_equal: compare tmxweb with alias loghost
15:00:50.694 [24993] <2> hosts_equal: there were NO aliases for tmxweb
15:00:50.694 [24993] <2> hosts_equal: addresses DO NOT match
15:00:50.694 [24993] <2> hosts_equal: Tmxweb=0xc0a8ff02 netbackup=0x6401013d
15:00:50.694 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.310: host is not found in cache: netbackup
15:00:50.694 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.409: Completed : netbackup
15:00:50.694 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.307: found host in cache: netbackup
15:00:50.695 [24993] <2> vnet_async_connect: vnet_vnetd.c.3991: connect failed: 125 0x0000007d
15:00:50.695 [24993] <2> vnet_async_connect: vnet_vnetd.c.4007: new max port: 4998 0x00001386
15:00:50.695 [24993] <2> vnet_async_connect: vnet_vnetd.c.3972: immediate connect: 1 0x00000001
15:00:50.695 [24993] <2> vnet_async_connect: vnet_vnetd.c.3975: connect: immediate CONNECT FROM 100.1.1.61.4999 TO 100.1.1.61.13723 fd = 7
15:00:50.695 [24993] <2> logconnections: BPJOBD CONNECT FROM 100.1.1.61.4999 TO 100.1.1.61.13723
15:00:50.695 [24993] <2> vauth_authentication_required: vauth_comm.c.749: no methods for address: no authentication required
15:00:50.695 [24993] <2> vauth_connector: vauth_comm.c.182: no methods for address: no authentication required
15:00:50.695 [24993] <2> job_authenticate_connection: no authentication required
15:00:50.695 [24993] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:00:50.696 [24993] <2> job_connect: Connected to the host netbackup contype 10 jobid <8533> socket <7>
15:00:50.696 [24993] <2> job_connect: Connected on port 4999
15:00:50.696 [24993] <2> set_job_details: Sending Tfile jobid (8533)
15:00:50.696 [24993] <2> set_job_details: LOG 1239874250 16 bpbrm 24993 bpcd on Tmxweb exited with status 23: socket read failed

15:00:50.696 [24993] <2> set_job_details: Done
15:00:50.697 [24993] <2> job_monitoring_exex: ACK disconnect
15:00:50.697 [24993] <2> job_disconnect: Disconnected
15:00:50.697 [24993] <2> db_error_add_to_file: dberrorq.c:midnite = 1239820200
15:00:50.723 [24993] <2> verify_client: bpbrm.c.32405: start_bpcd_stat failed: 23 23 0x00000017
15:00:50.723 [24993] <2> verify_client: bpbrm.c.32409: *client_hostname: Tmxweb
15:00:50.723 [24993] <2> verify_client: bpbrm.c.32411: *connect_opts: 16777472 16777472 0x01000100
15:00:50.723 [24993] <2> bpbrm main: bpbrm.c.2611: verify_client failed: 23 23 0x00000017
15:00:50.724 [24993] <2> bpbrm kill_child_process: start
15:00:50.724 [24993] <2> bpbrm Exit: attempting to send mail to root on Tmxweb
15:00:50.724 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <Tmxweb>
15:00:50.724 [24993] <2> hosts_equal: names are the same
15:00:50.724 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <Tmxweb>
15:00:50.724 [24993] <2> hosts_equal: names are the same
15:00:50.724 [24993] <2> local_bpcr_connect: bpcr.c.276: connect_opts = 0x01000100 connect_opts2 = 0x01000100
15:00:50.724 [24993] <2> local_bpcr_connect: bpcr.c.283: connect_opts = 0x01000100
15:00:50.724 [24993] <2> local_bpcr_connect: bpcr.c.322: daemon_port_type = 0
15:00:50.724 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.307: found host in cache: Tmxweb
15:00:50.724 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.307: found host in cache: Tmxweb
15:00:50.724 [24993] <2> vnet_async_connect: vnet_vnetd.c.4019: connect in progress: 0 0x00000000
15:00:50.756 [24993] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2043: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
15:00:50.756 [24993] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2057: service: bpcd
15:00:50.833 [24993] <2> vnet_async_connect: vnet_vnetd.c.4205: in progress connect: 0 0x00000000
15:00:50.833 [24993] <2> vnet_async_connect: vnet_vnetd.c.4208: connect: async CONNECT FROM 100.1.1.61.4999 TO 192.168.255.2.13724 fd = 7
15:00:50.833 [24993] <2> logconnections: BPCD CONNECT FROM 100.1.1.61.4999 TO 192.168.255.2.13724
15:00:50.833 [24993] <2> vauth_authentication_required: vauth_comm.c.749: no methods for address: no authentication required
15:00:50.833 [24993] <2> vauth_connector: vauth_comm.c.182: no methods for address: no authentication required
15:00:50.833 [24993] <2> bpcr_authenticate_connection: no authentication required
15:00:50.834 [24993] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.179: msg: VNETD CONNECT FROM 100.1.1.61.4956 TO 192.168.255.2.13724 fd = 9
15:00:50.868 [24993] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.532: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
15:00:51.051 [24993] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.549: ipc_string: 2624
15:00:51.052 [24993] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.560: hash_str1: 3b217e28c22c51a99874f508370247b3
15:00:55.395 [24993] <2> get_short: (1) cannot read (byte 1) from network: Connection reset by peer (131)
15:00:55.395 [24993] <2> bpcr_put_vnetd_forward_socket: get_short failed: 131
15:00:55.395 [24993] <2> local_bpcr_connect: bpcr_put_vnetd_forward_socket failed: 23
15:00:55.395 [24993] <2> ConnectToBPCD: bpcd_connect_and_verify(Tmxweb, Tmxweb) failed: 23
15:00:55.395 [24993] <16> bpbrm Exit: cannot send mail because BPCD on Tmxweb exited with status 23: socket read failed
15:00:55.395 [24993] <2> hosts_equal: Comparing hosts <Tmxweb> and <netbackup>
15:00:55.396 [24993] <2> hosts_equal: host1 Tmxweb tmxweb addr 192.168.255.2 (0xc0a8ff02)
15:00:55.396 [24993] <2> hosts_equal: host2 netbackup netbackup addr 100.1.1.61 (0x6401013d)
15:00:55.396 [24993] <2> hosts_equal: hostnames DO NOT compare
15:00:55.396 [24993] <2> hosts_equal: name1=Tmxweb name2=netbackup
15:00:55.396 [24993] <2> hosts_equal: hostbuf=tmxweb hostentry->h_name=netbackup
15:00:55.396 [24993] <2> hosts_equal: compare tmxweb with alias netbackup.thermax.com
15:00:55.396 [24993] <2> hosts_equal: compare tmxweb with alias loghost
15:00:55.396 [24993] <2> hosts_equal: there were NO aliases for tmxweb
15:00:55.396 [24993] <2> hosts_equal: addresses DO NOT match
15:00:55.396 [24993] <2> hosts_equal: Tmxweb=0xc0a8ff02 netbackup=0x6401013d
15:00:55.396 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.307: found host in cache: netbackup
15:00:55.396 [24993] <2> vnet_cached_gethostbyname: vnet_hosts.c.307: found host in cache: netbackup
15:00:55.396 [24993] <2> vnet_async_connect: vnet_vnetd.c.3991: connect failed: 125 0x0000007d
15:00:55.396 [24993] <2> vnet_async_connect: vnet_vnetd.c.4007: new max port: 4998 0x00001386
15:00:55.397 [24993] <2> vnet_async_connect: vnet_vnetd.c.3972: immediate connect: 1 0x00000001
15:00:55.397 [24993] <2> vnet_async_connect: vnet_vnetd.c.3975: connect: immediate CONNECT FROM 100.1.1.61.4999 TO 100.1.1.61.13723 fd = 7
15:00:55.397 [24993] <2> logconnections: BPJOBD CONNECT FROM 100.1.1.61.4999 TO 100.1.1.61.13723
15:00:55.397 [24993] <2> vauth_authentication_required: vauth_comm.c.749: no methods for address: no authentication required
15:00:55.397 [24993] <2> vauth_connector: vauth_comm.c.182: no methods for address: no authentication required
15:00:55.397 [24993] <2> job_authenticate_connection: no authentication required
15:00:55.397 [24993] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:00:55.398 [24993] <2> job_connect: Connected to the host netbackup contype 10 jobid <8533> socket <7>
15:00:55.398 [24993] <2> job_connect: Connected on port 4999
15:00:55.398 [24993] <2> set_job_details: Sending Tfile jobid (8533)
15:00:55.398 [24993] <2> set_job_details: LOG 1239874255 16 bpbrm 24993 cannot send mail because BPCD on Tmxweb exited with status 23: socket read failed

15:00:55.398 [24993] <2> set_job_details: Done
15:00:55.398 [24993] <2> job_monitoring_exex: ACK disconnect
15:00:55.398 [24993] <2> job_disconnect: Disconnected
15:00:55.399 [24993] <2> db_error_add_to_file: dberrorq.c:midnite = 1239820200
15:00:55.416 [24993] <2> OpenMailPipe: /usr/ucb/mail -s "Backup on Tmxweb - 23

[schmaustech]

This looks like the bpbrm log.  Do you have the bpcd log from the client? 

Regards,

Benjamin Schmaus

[Karthikeyan_Sun]

 Is your ping and telnet and bpclntcmd connectivity ok???

[rishi_rich]

Hi,

Are you getting this problem on windows machine...??If yes then add hostname and IP address of master and media server into the file
C:/WINDOWS/system32/drivers/hosts and lmhosts.This will hopefully solve problem.Before doing that make sure that netbackup client has been added on client as well as make sure all network conecction

Thx
rishi nandedkar

[S__Sankara_Nara · Accepted solution]

resolved

firewall blocked few ports & resolved by assigning them correctly

[Click18]

Deare Sankara,

Could you please tell me the port numbers

[Will_Restore]

vnetd (13724) & pbx (1556)

Port Usage Guide for Windows and UNIX Platforms
http://seer.entsupport.symantec.com/docs/281623.htm

[Click18]

Thanks wrobbins