Windows client fails with Status 50 error

[WayneLackey]

I have a Windows client that had been backing up without issue until very recently, when it started getting persistent failures (status 50). Environment is as follows:

Master: NBU 7.5.0.4 on Solaris SunOS 5.10

Media: NBU 7.5.0.4 on Solaris SunOS 5.10

Client: NBU client 7.1 on Windows 2008 Server

---

Job detail from most recent failure:

04/01/2013 22:58:43 - Info nbjm (pid=1602) starting backup job (jobid=4362995) for client bknhicodcdcp01b, policy NHIC-BL8, schedule Diff
04/01/2013 22:58:43 - Info nbjm (pid=1602) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=4362995, request id:{3A918E80-9B41-11E2-A390-1CC1DE1EF662})
04/01/2013 22:58:43 - requesting resource bkbugatti-hcart-robot-tld-0
04/01/2013 22:58:43 - requesting resource bkferrari.NBU_CLIENT.MAXJOBS.bknhicodcdcp01b
04/01/2013 22:58:43 - requesting resource bkferrari.NBU_POLICY.MAXJOBS.NHIC-BL8
04/01/2013 22:58:52 - awaiting resource bkbugatti-hcart-robot-tld-0. No drives are available.
04/01/2013 22:59:17 - awaiting resource bkbugatti-hcart-robot-tld-0. Waiting for resources.
          Reason: Drives are in use, Media server: bkbugatti,
          Robot Type(Number): TLD(0), Media ID: N/A, Drive Name: N/A,
          Volume Pool: NHIC, Storage Unit: bkbugatti-hcart-robot-tld-0, Drive Scan Host: N/A,
          Disk Pool: N/A, Disk Volume: N/A
04/01/2013 23:00:06 - awaiting resource bkbugatti-hcart-robot-tld-0. No drives are available.
04/01/2013 23:05:09 - awaiting resource bkbugatti-hcart-robot-tld-0. Waiting for resources.
          Reason: Drives are in use, Media server: bkbugatti,
          Robot Type(Number): TLD(0), Media ID: N/A, Drive Name: N/A,
          Volume Pool: NHIC, Storage Unit: bkbugatti-hcart-robot-tld-0, Drive Scan Host: N/A,
          Disk Pool: N/A, Disk Volume: N/A
04/01/2013 23:07:02 - awaiting resource bkbugatti-hcart-robot-tld-0. No drives are available.
04/01/2013 23:08:41 - granted resource  bkferrari.NBU_CLIENT.MAXJOBS.bknhicodcdcp01b
04/01/2013 23:08:41 - granted resource  bkferrari.NBU_POLICY.MAXJOBS.NHIC-BL8
04/01/2013 23:08:41 - granted resource  ODC409
04/01/2013 23:08:41 - granted resource  HP.ULTRIUM4-SCSI.032
04/01/2013 23:08:41 - granted resource  bkbugatti-hcart-robot-tld-0
04/01/2013 23:08:41 - estimated 17278404 kbytes needed
04/01/2013 23:08:41 - Info nbjm (pid=1602) started backup (backupid=bknhicodcdcp01b_1364872121) job for client bknhicodcdcp01b, policy NHIC-BL8, schedule Diff on storage unit bkbugatti-hcart-robot-tld-0
04/01/2013 23:08:43 - started process bpbrm (pid=4118)
04/01/2013 23:08:46 - Info bpbrm (pid=4118) bknhicodcdcp01b is the host to backup data from
04/01/2013 23:08:46 - Info bpbrm (pid=4118) reading file list from client
04/01/2013 23:08:46 - connecting
04/01/2013 23:08:47 - Info bpbrm (pid=4118) starting bpbkar on client
04/01/2013 23:08:47 - connected; connect time: 0:00:00
04/01/2013 23:08:48 - Info bpbkar (pid=7836) Backup started
04/01/2013 23:08:48 - Info bpbrm (pid=4118) bptm pid: 4119
04/01/2013 23:08:49 - Info bptm (pid=4119) start
04/01/2013 23:08:50 - Info bptm (pid=4119) using 65536 data buffer size
04/01/2013 23:08:50 - Info bptm (pid=4119) setting receive network buffer to 262144 bytes
04/01/2013 23:08:50 - Info bptm (pid=4119) using 30 data buffers
04/01/2013 23:08:51 - Info bptm (pid=4119) start backup
04/01/2013 23:08:51 - Info bptm (pid=4119) backup child process is pid 4129
04/01/2013 23:08:51 - Info bptm (pid=4119) Waiting for mount of media id ODC409 (copy 1) on server bkbugatti.
04/01/2013 23:08:51 - mounting ODC409
04/01/2013 23:08:54 - Error bpbrm (pid=4118) from client bknhicodcdcp01b: ERR - Unable to backup System State or Shadow Copy. Please check the state of VSS and associated Writers.INF - EXIT STATUS 69: invalid filelist specification
04/01/2013 23:08:54 - Warning bpbrm (pid=4118) from client bknhicodcdcp01b: WRN - archive bits will NOT be cleared
04/01/2013 23:08:54 - Error bptm (pid=4129) system call failed - Connection reset by peer (at child.c.1298)
04/01/2013 23:08:54 - Error bptm (pid=4119) media manager terminated during mount of media id ODC409, possible media mount timeout
04/01/2013 23:08:54 - Critical bpbrm (pid=4118) unexpected termination of client bknhicodcdcp01b
04/01/2013 23:08:54 - Error bptm (pid=4129) unable to perform read from client socket, connection may have been broken
04/01/2013 23:08:54 - Error bptm (pid=4119) media manager terminated by parent process
04/01/2013 23:08:54 - Error bpbrm (pid=4118) could not send server status message
04/01/2013 23:08:55 - Info bpbkar (pid=7836) done. status: 50: client process aborted
04/01/2013 23:08:55 - end writing
client process aborted  (50)

---

Any ideas?

Thanks,

Wayne

[Nicolai]

Try these tech notes - look like a issue with VSS: 

http://www.symantec.com/docs/TECH164829

http://www.symantec.com/docs/TECH178507

Else create the bpfis and bpkar debug log on the client. Set the client "Verbose" to 5 and re-try the operation until it fails. zip logs and attach files to a post. 

Update:

One more for the list : http://www.symantec.com/docs/TECH72663

[abhinav_trivedi · Accepted solution]

This will be VSS issue. Please check below commands on client and if any error you receive please contact your OS admin.

C:\> vssadmin list providers

C:\> vssadmin list writers

[Mark_Solutions]

Looks like the VSS Issues cause a NetBackup process crash I would first upgrade the NetBackup client to 7.5.0.4 and also check for any VSS rollup packages / Service packs for the client As it has had a failure it will need a reboot before it will work again anyway to re-set the VSS writers Hope this helps