cancel
Showing results for 
Search instead for 
Did you mean: 

VM backups failing with file read failed (13)

Abhishek_Sharma
Level 3

Hi All,

 

We have mulitpleVM backups failing with error code 13 on Netbackup 7.1.0.4 .And they complete fine on rerun 

Master Server - Suse Linux 11

Media Server - Windows 2008 R2  (Vmware backup host )

 

Please see the output of detailed status .And jobs are also failing after writing some data

 

07/22/2012 23:49:53 - Info bptm (pid=756) using 32 data buffers
07/22/2012 23:49:54 - Info bpbrm (pid=4804) sending bpsched msg: CONNECTING TO CLIENT FOR NIBIDEV1_1342997392
07/22/2012 23:49:54 - Info bpbrm (pid=4804) start bpbkar32 on client
07/22/2012 23:49:54 - connecting
07/22/2012 23:49:54 - connected; connect time: 0:00:00
07/22/2012 23:49:54 - begin writing
07/22/2012 23:49:56 - Info bpbkar32 (pid=10696) Backup started
07/22/2012 23:49:56 - Info bpbkar32 (pid=10696) CONTINUE BACKUP received.
07/22/2012 23:49:56 - Info bpbrm (pid=4804) Sending the file list to the client
07/23/2012 00:24:15 - Error bpbrm (pid=4804) from client NIBIDEV1: ERR - Read of VM file read 0 bytes, should have read 65024 bytes
07/23/2012 00:24:59 - Info bpbkar32 (pid=10696) bpbkar waited 11480 times for empty buffer, delayed 16821 times.
07/23/2012 00:25:01 - Info bpbrm (pid=8032) child done, status 13
07/23/2012 00:25:01 - Info bpbrm (pid=8032) sending message to media manager: STOP BACKUP NIBIDEV1_1342997392
07/23/2012 00:33:20 - Error bptm (pid=756) read of image metadata file failed: the file list is incomplete
07/23/2012 00:41:45 - Error bptm (pid=756) read of image metadata file failed: the file list is incomplete
07/23/2012 00:41:50 - Error bptm (pid=756) socket operation failed - 10038 (at bptm.c.26670)
07/23/2012 00:42:02 - Info bpbrm (pid=8032) media manager for backup id NIBIDEV1_1342997392 exited with status 23: socket read failed
07/23/2012 00:42:02 - end writing; write time: 0:52:08
07/23/2012 00:52:02 - Info nbjm (pid=7906) starting backup job (jobid=585468) for client NIBIDEV1, policy OS-VM-NIBIDEV1, schedule OS-Win-Full-Grp-3
07/23/2012 00:52:03 - Info bpbrm (pid=8032) pnioynbvstg01 is the host to backup data from
07/23/2012 00:52:03 - Info bpbrm (pid=8032) telling media manager to start backup on client
07/23/2012 00:52:03 - Info bptm (pid=756) using 65536 data buffer size
07/23/2012 00:52:03 - Info bptm (pid=756) using 32 data buffers
file read failed  (13)
 
 
Snippets from logs 
 
bptm
 
12:39:39.740 [8612.1076] <16> setup_tir_or_im_read: read of image metadata file failed: the file list is incomplete
12:39:44.748 [8612.1076] <2> write_data_tir: setup_tir_or_im_read() failed: EXIT_Status = 249, retry = 2, Bpbrm pid = 5312
 
 
48:09.872 [8612.1076] <16> write_data_tir: socket operation failed - 10038 (at bptm.c.26670)
12:48:09.872 [8612.1076] <2> write_data_tir: TIR error after writing to tape, backspace and rewrite tapemark
 
 
 
bpbrm 
 
 
12:25:33.929 [2824.9952] <2> bpbrm handle_backup: from client TXTNSTEIN-RT1: INF - VxMS error - severity 99.
12:25:33.929 [2824.9952] <2> bpbrm handle_backup: from client TXTNSTEIN-RT1: INF - VxMS Error message 1 = fiml_read_file vfm_readmessage 2 = stat 11 req.io_error 0
12:25:33.929 [2824.9952] <2> bpbrm handle_backup: from client TXTNSTEIN-RT1: INF - Read of VM file read 0 bytes, should have read 65024 bytes, will be issuing retry 1 of 3
 
12:26:12.679 [2824.9952] <2> set_job_details: Tfile (557042): LOG 1342092372 4 bpbkar32 8868 bpbkar waited 4834 times for empty buffer, delayed 5430 times.
 
12:26:12.679 [2824.9952] <2> bpbrm handle_backup: client TXTNSTEIN-RT1 EXIT STATUS = 11: system call failed
 
2:26:13.319 [5312.3000] <2> bpbrm brm_child_done: child 2824 exited with status 13: file read failed
12:26:13.319 [5312.3000] <2> bpbrm send_status_to_parent: bpbrm child is done, but the media manager child is not.
12:26:13.319 [5312.3000] <2> set_job_details: Tfile (557042): LOG 1342092373 4 bpbrm 5312 sending message to media manager: STOP BACKUP TXTNSTEIN-RT1_1342091402
 
12:26:13.319 [5312.3000] <2> bpbrm tell_mm: sending media manager msg: STOP BACKUP TXTNSTEIN-RT1_1342091402
 

Have not enabled VxMS logs till now as it fills my media server disk in 30 mins on high verbose . 

Have gone through the below technote on this issue but see this error on multiple clients from different datastore . Transfer type we use is all Types in VM policies and we have seen this issue after moving the VM machines from file level backups to VM backups . 

http://www.symantec.com/business/support/index?page=content&pmv=print&impressions=&viewlocale=&id=TE...

Regards,

Abhishek

 

4 REPLIES 4

Will_Restore
Level 6

Article URL http://www.symantec.com/docs/TECH70378

but the bugfix is for older version (6.5.2)

 

As your backup works upon rerun it may just be network congestion.

I would open a support case if trouble continues.

Abhishek_Sharma
Level 3

Thanks for the reply .I have opened a support case for this .....

mohankumar_sa
Not applicable

Abhishek,

Is the issue resolved? what was the cause for this failure?

 

mohankumar

rizwan84tx
Level 6
Certified

In my past experiance, i have came through this. Its always been faulting BPBKAR and VXMS API; and fix was applied by getting EEB from support, or reinstallation of NBU in backup host.