Netbackup 7.1 Status Code 156

[RCBrown_DKH]

My Master/Media server is Windows 2008 R2 running Netbackup 7.1.  The client having the problem is a Windows Server 2003 running Netbackup 7.0.  I am getting a a status code 156 error.  Job details are below:

5/31/2012 6:33:35 PM - Info nbjm(pid=33196) starting backup job (jobid=203726) for client janus01.daykimball.org, policy Servers.AllLocal, schedule Incremental 
5/31/2012 6:33:35 PM - estimated 39939338 Kbytes needed
5/31/2012 6:33:35 PM - Info nbjm(pid=33196) started backup job for client janus01.daykimball.org, policy Servers.AllLocal, schedule Incremental on storage unit STG1
5/31/2012 6:33:35 PM - started
5/31/2012 6:33:36 PM - started process bpbrm (6092)
5/31/2012 6:33:41 PM - Info bpbrm(pid=6092) janus01.daykimball.org is the host to backup data from    
5/31/2012 6:33:45 PM - Info bpbrm(pid=6092) reading file list from client       
5/31/2012 6:33:45 PM - connecting
5/31/2012 6:33:48 PM - Info bpbrm(pid=6092) starting bpbkar32 on client        
5/31/2012 6:33:48 PM - connected; connect time: 00:00:03
5/31/2012 6:33:54 PM - Info bpbkar32(pid=0) Backup started          
5/31/2012 6:33:54 PM - Info bptm(pid=7348) start           
5/31/2012 6:33:54 PM - Info bptm(pid=7348) using 262144 data buffer size       
5/31/2012 6:33:54 PM - Info bptm(pid=7348) setting receive network buffer to 1049600 bytes     
5/31/2012 6:33:54 PM - Info bptm(pid=7348) using 50 data buffers        
5/31/2012 6:33:57 PM - Info bptm(pid=7348) start backup          
5/31/2012 6:34:05 PM - Info bptm(pid=7348) backup child process is pid 11288.5820      
5/31/2012 6:34:05 PM - Info bptm(pid=11288) start           
5/31/2012 6:34:05 PM - begin writing
5/31/2012 6:55:43 PM - Error bpbrm(pid=6092) from client janus01.daykimball.org: ERR - failure reading file: D:\Program Files\Siemens\EDI\ENVIRONMENT\I0AR\OlcReports\PROCESSED\EmPKINDONAVAN42268706_20120531220942955.pdf (WIN32 2: The system cannot find the file specified. )
5/31/2012 6:55:44 PM - Error bpbrm(pid=6092) from client janus01.daykimball.org: ERR - Snapshot Error while reading file: GLOBALROOT\Device\HarddiskVolumeShadowCopy1032\Program Files\Siemens\EDI\ENVIRONMENT\I0AR\OlcReports\PROCESSED\EmPKINDONAVAN42268706_20120531220942955.pdf
5/31/2012 6:55:44 PM - Critical bpbrm(pid=6092) from client janus01.daykimball.org: FTL - Backup operation aborted!    
5/31/2012 6:55:56 PM - Info puck2(pid=7348) StorageServer=PureDisk:puck2; Report=PDDO Stats for (puck2): scanned: 17646487 KB, stream rate: 71.98 MB/sec, CR sent: 55670 KB, dedup: 99.7%, cache hits: 4957 (3.5%)
5/31/2012 6:55:58 PM - Error bpbrm(pid=6092) could not send server status message      
5/31/2012 6:56:00 PM - end writing; write time: 00:21:55

I have also noticed on the client a windows system error in the event viewer.  The error is event id 25 and the source is VolSnap.  The drive details are:  53GB with 39GB free.  Shadow copy settings are using a limit of 1000mb.

Details below:
The shadow copies of volume D: were deleted because the shadow copy storage could not grow in time. Consider reducing the IO load on the system or choose a shadow copy storage volume that is not being shadow copied.

[J_H_Is_gone · Accepted solution]

when the backup beings it uses VSS to make the shadow storage.

You even note that your SS is set to 1000 mb.

it is not big enough.

good rule of thumb is 10% of used disk.

increase the size if your SS (if you are not a windows admin - have one of them do it)

then try the backup again.

------

but what I think the issue is you have a file it cannot read - because the file may have been removed between the start of the job and when it went to SS it.

Steps I would take.

1) see if it can be excluded (ask the system admin) at any point in the path higher then the final file ( as that seems to be something that changes

2) you can set the client attributes ( under master server properties) to Disable snapshot and continue with the backup.  - this step is to be considered very carefully.

[Will_Restore]

Looks like a transient file.  Consider adding the directory

D:\Program Files\Siemens\EDI\ENVIRONMENT\I0AR\OlcReports\PROCESSED\

to client backup exclude list

[RCBrown_DKH]

I have made a change to the SS.  It is now 1400mb instead of 1000.  The file in the error log is not there.  I just looked for it.  The folder in question can not be excluded.  What are the ramifications of disabling snapshot and continuing with the backup?

[RCBrown_DKH]

I was thinking along those lines.  I changed SS setting.  I will see if that fixes the issue before trying something else.  I will update this forum on monday.  Thanks for your help.

[J_H_Is_gone]

then it will just skip any files it has any issues with - which means it might skip more open files than you think.

[RCBrown_DKH]

Not such a great idea overall.  Thanks for the assistance.  I will check in on monday with my status.

[RCBrown_DKH]

Thank you J.  Both a Full and Incremental backup have worked.  It looks like it was the SS.  Thanks for your help.