NetBackup restores failing - buffer size/space?

[bertieb77]

Hello.  I'm having a strange problem restoring some files to a Windows 2008 file server from NetBackup 7.1 (on Windows).

I am able to restore files individually, and if I rerun the failed job it appears to be different files that fail.   The file and print server is Windows 2008 and has NTFS compression enabled.  I know the Netbackup Agent is v6.5.4 at the moment.  Backups seem to be fine, it's the restores (and randomness) that I am finding a bit odd.  An example of the failure log from the backup server is as follows.  Any ideas?

17/01/2013 14:15:27 - begin Restore
17/01/2013 14:15:28 - 1 images required
17/01/2013 14:15:28 - media 0110L4 required
17/01/2013 14:15:34 - restoring image fpssrv01_1356920301
17/01/2013 14:15:35 - Info bpbrm(pid=10056) telling media manager to start restore on client     
17/01/2013 14:15:36 - Info bptm(pid=6320) Waiting for mount of media id 0110L4 (copy 2) on server BKPSRV.
17/01/2013 14:15:36 - started process bptm (6320)
17/01/2013 14:15:36 - mounting 0110L4
17/01/2013 14:15:36 - Info bptm(pid=6320) INF - Waiting for mount of media id 0110L4 on server BKPSRV for reading.
17/01/2013 14:15:36 - requesting resource 0110L4
17/01/2013 14:15:36 - granted resource 0110L4
17/01/2013 14:15:36 - granted resource IBM.ULT3580-TD4.000
17/01/2013 14:15:37 - connecting
17/01/2013 14:15:40 - Info bpbrm(pid=10104) start tar32 on client         
17/01/2013 14:15:44 - Info tar32(pid=0) Restore started.           
17/01/2013 14:15:44 - connected; connect time: 00:00:07
17/01/2013 14:16:13 - mounted; mount time: 00:00:37
17/01/2013 14:16:13 - Info bptm(pid=6320) 0110L4            
17/01/2013 14:16:13 - Info bptm(pid=6320) INF - Waiting for positioning of media id 0110L4 on server BKPSRV for reading.
17/01/2013 14:16:13 - positioning 0110L4 to file 1
17/01/2013 14:16:13 - positioned 0110L4; position time: 00:00:00
17/01/2013 14:17:34 - begin reading
17/01/2013 14:17:35 - Info bpbrm(pid=10056) sending media manager msg: CONTINUE RESTORE       
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\FEB 11\Total_AP_Creditors_Extract_230211.xls   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 8083456   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 41320    
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\FEB 11\Total_AP_Creditors_Extract_240211.xls   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 8082432   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 62312    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\D6591200   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 8131584   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 12052    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\D7930200   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 7784960   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 7444    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\AP_Creditors_Extract_060111.txt   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 1038336   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 28934    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\DUS_AP_Creditors_Extract_010211.txt   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 951296   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 4950    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\DUS_AP_Creditors_Extract_040111.txt   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 1237504   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 3085    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\DUS_AP_Creditors_Extract_050111.htm   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 1042432   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 14247    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\DUS_AP_Creditors_Extract_050111.txt   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 1031680   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 23344    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\Dus_AP_Creditors_Extract_100111.txt   
17/01/2013 14:18:26 - Info bpbrm(pid=10104) from client fpssrv01: TRV - last message being suppressed after 10 occurrences
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 825856   
17/01/2013 14:18:26 - Info bpbrm(pid=10104) from client fpssrv01: TRV - last message being suppressed after 10 occurrences
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 3945    
17/01/2013 14:18:26 - Info bpbrm(pid=10104) from client fpssrv01: TRV - last message being suppressed after 10 occurrences
17/01/2013 14:18:32 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JULY 11\HEL_AP_Creditors_Extract_040711.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:32 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:32 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JULY 11\HEL_AP_Creditors_Extract_070711.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:32 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\ (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\Dbe_AP_Invoices_Details_300611.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\Dus_AP_Invoices_Details_300611.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\hel_AP_Creditors_Extract_210611.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\HEL_AP_Creditors_Extract_230611.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\HEL_AP_Creditors_Extract_290611.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\hel_AP_Invoices_Details_300611.txt (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\June 11\JULY 11\ (err=WIN32 112: Unknown error)
17/01/2013 14:18:36 - Info bpbrm(pid=10104) from client fpssrv01: TRV - last message being suppressed after 10 occurrences
17/01/2013 14:18:36 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing byte: 0    
17/01/2013 14:18:36 - Info bpbrm(pid=10104) from client fpssrv01: TRV - last message being suppressed after 10 occurrences
17/01/2013 14:19:05 - end reading; read time: 00:01:31
17/01/2013 14:19:05 - Info bpbrm(pid=10056) media manager for backup id fpssrv01_1356920301 exited with status 0: the requested operation was successfully completed
17/01/2013 14:19:05 - Info tar32(pid=0) done. status: 0          
17/01/2013 14:19:05 - Info tar32(pid=0) done. status: 1 - the requested operation was partially successful   
17/01/2013 14:19:06 - Info bpbrm(pid=10056) child done, status 1         
17/01/2013 14:19:06 - restored image fpssrv01_1356920301 - (the requested operation was partially successful(1)); restore time 00:03:32
17/01/2013 14:19:06 - Warning bprd(pid=8816) Restore must be resumed prior to first image expiration on 30/12/2019 02:18:21
17/01/2013 14:19:06 - Info bpbrm(pid=10056) sending media manager msg: TERMINATE        
17/01/2013 14:19:06 - end Restore; elapsed time: 00:03:39
the requested operation was partially successful(1)
 

[RamNagalla]

17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\FEB 11\Total_AP_Creditors_Extract_230211.xls   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 8083456   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 41320    
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\FEB 11\Total_AP_Creditors_Extract_240211.xls   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 8082432   
17/01/2013 14:18:25 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 62312    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\D6591200   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - disk full at byte: 8131584   
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - wanted buffer size: 12052    
17/01/2013 14:18:26 - Warning bpbrm(pid=10104) from client fpssrv01: WRN - error writing file: D:\Restore\JAN 11\D7930200   

hi,

you need to fix the space issue on the destination before attempting the next restore.

1) remove partial succesfull restore files from the destination

2)Make sure you have enough space on Destination

3)then start the restore job again.

check how it goes.

if it failes, show us the logs again... 

[bertieb77]

Sorry, I should have clarified.  It's a 900GB partition with over 630GB free so there is plenty of space on the disk.

Thanks.

[RamNagalla]

you would need to double check it.

1) space of the destination

2)did you specify the desired path that you what?

3) Destination client ?

then try retoring single small file, and see how it works.

if it still failes, please provide the screenshots of the destination location, and the restore steps.

[watsons]

Give us the filesystem details of your client fpssrv01, such as how much space left in C and D drives - use command line output to show us.

D: drive could have more space, but if D:\restore is a mountpoint from somewhere else and does not have that much of space, restore would fail with above errors.

Try restore onto other drives (C:, E:) and see how it goes. Basically Nagalla has provided most troubleshooting steps.

[sksujeet]

You are restoring to windows 2008, please check if you have rights to restore the file and have enough permission on the folder to restore it. Have you tried creating the folder and file in that folder where you are restoring to make sure permission is not the issue.

 I know the Netbackup Agent is v6.5.4 at the moment.  Backups seem to be fine

It won't harm to upgrade the agent(won't even need a reboot) and check again if it makes a difference. With windows 2008 I have seen intersting things.

[bertieb77]

Thanks for the suggestions - I'm raising this with Symantec support and will let you know how it goes.

I've checked drive space (C: 80GB (45GB free)  D: 900GB (619GB free)) and permissions and its OK - and if I try a re-run its different files that have issues though if we restore them individually they are fine.

[sksujeet]

Can you upgrade the client to the same level, create a tar folder on the client and try the restore again.Post the log file here once done.

Edit* Symantec will ask to upgrade the client as first thing as it is no longer supported. Please upgrade the client and check how it goes.

[Marianne]

Hi Bertie

Welcome here!

I guess Symantec Support has also requested tar log file?

Please post here as well as File attachment and let us know the outcome of the support call?