error in duplication
Hi! We've more than 80 virtual servers on VMWare 6.5 platform. Daily backups of VM run fine. We duplicate the data every weekend to a DR site via SLP process. Only 2 windows servers fail to duplicate. the activity log show: 17:37:1908/06/2018-requestingresourceLCM_B2D-DR-stu 17:37:1908/06/2018-grantedresourceLCM_B2D-DR-stu 17:37:2008/06/2018-startedprocessRUNCMD(pid=233188) 17:37:2008/06/2018-endedprocess0(pid=233188) 17:37:2108/06/2018-beginDuplicate 17:37:2208/06/2018-requestingresourceB2D-DR-stu 17:37:2208/06/2018-reservingresource@aaaab 17:37:2308/06/2018-resource@aaaabreserved 17:37:2308/06/2018-grantedresourceMediaID=@aaaaf;DiskVolume=PureDiskVolume;DiskPool=B2D-DR;Path=PureDiskVolume;StorageServer=bkp-dr-media12.aro.local;MediaServer=bkp-dr-media12.aro.local 17:37:2308/06/2018-grantedresourceB2D-DR-stu 17:37:2408/06/2018-InfoDuplicate(pid=233188)Initiatingoptimizedduplicationfrom@aaaabto@aaaaf 17:37:2408/06/2018-requestingresource@aaaab 17:37:2408/06/2018-grantedresourceMediaID=@aaaab;DiskVolume=PureDiskVolume;DiskPool=PureDIsk01;Path=PureDiskVolume;StorageServer=bkp-media12r2.aro.local;MediaServer=bkp-dr-media12.aro.local 17:37:2508/06/2018-Infobpduplicate(pid=233188)Suspendwindowclosebehaviorisnotsupportedforoptimizedduplications 17:37:2508/06/2018-Infobpduplicate(pid=233188)windowclosebehavior:Continueprocessingthecurrentimage 17:37:2508/06/2018-Infobpdm(pid=38504)started 17:37:2508/06/2018-startedprocessbpdm(pid=38504) 17:37:2908/06/2018-Infobpdm(pid=38504)requestingnbjmformedia 17:37:3008/06/2018-Criticalbpdm(pid=38504)imageopenfailed:error2060001:oneormoreinvalidarguments 17:37:3208/06/2018-Errorbpduplicate(pid=233188)hostbkp-media12r2.aro.localbackupidAV_ePO_DB_1525994014optimizedduplicationfailed,mediaopenerror(83). 17:37:3208/06/2018-Errorbpduplicate(pid=233188)DuplicateofbackupidAV_ePO_DB_1525994014failed,mediaopenerror(83). 17:37:3208/06/2018-Errorbpduplicate(pid=233188)Status=noimagesweresuccessfullyprocessed. 17:37:3208/06/2018-endDuplicate;elapsedtime0:00:11 noimagesweresuccessfullyprocessed (191) bpdm.log show: 17:36:34.821 [24692.57960] <2> send_begin_repl_marker: AV_ePO_DB_1525994014_C2_OPT_DUP_BEGIN image created 17:36:34.823 [24692.57960] <2> bp_sts_open_image: STH set to STS_SA_IMAGE 17:36:34.835 [24692.57960] <16> 162589:bptm:24692:bkp-media12r2.aro.local: [ERROR] PDSTS: impl_image_handle: PdvfsOpen(/bkp-media12r2.aro.local#1/2/AV_ePO_DB/VMware-ITVC-Policy/AV_ePO_DB_1525994014_C1_F1.img) failed (9 Bad file descriptor) for image 17:36:34.835 [24692.57960] <16> 162589:bptm:24692:bkp-media12r2.aro.local: [ERROR] PDSTS: impl_open_image: impl_image_handle() failed (2060001:one or more invalid arguments) 17:36:34.835 [24692.57960] <16> 162589:bptm:24692:bkp-media12r2.aro.local: [ERROR] PDSTS: pi_open_image_v10: impl_open_image() failed (2060001:one or more invalid arguments) 17:36:34.835 [24692.57960] <32> bp_sts_open_image: sts_open_image failed: error 2060001 Of course, NBU tries to duplicate the images all the weekend unsuccesfully. I can't explain why this failure occurs only on those servers. I'll appreciate your help. Thanks, Meir
no images were successfully processed(191)
Master/Media: Windows Server 2012 NBU: 7.6.0.4 Job type: Duplication Job policy: SLP_Yearly Job schedule: Default_24x7_Window 4/19/2018 9:33:19 AM - begin Duplicate 4/19/2018 9:33:19 AM - requesting resource LCM_Tandberg 4/19/2018 9:33:19 AM - granted resource LCM_Tandberg 4/19/2018 9:33:19 AM - started process RUNCMD (26176) 4/19/2018 9:33:19 AM - ended process 0 (26176) 4/19/2018 9:33:21 AM - requesting resource Tandberg 4/19/2018 9:33:21 AM - requesting resource @aaaah 4/19/2018 9:33:21 AM - reserving resource @aaaah 4/19/2018 9:33:21 AM - reserved resource @aaaah 4/19/2018 9:33:21 AM - granted resource 006972 4/19/2018 9:33:21 AM - granted resource HP.ULTRIUM5-SCSI.001 4/19/2018 9:33:21 AM - granted resource Tandberg 4/19/2018 9:33:21 AM - granted resource MediaID=@aaaah;DiskVolume=PureDiskVolume;DiskPool=DedupPool;Path=PureDiskVolume;StorageServer=srvbkp1-ap;MediaServer=srvbkp1-ap 4/19/2018 9:33:22 AM - Info bpduplicate(pid=26176) window close behavior: Suspend 4/19/2018 9:33:22 AM - Info bptm(pid=21160) start 4/19/2018 9:33:22 AM - started process bptm (21160) 4/19/2018 9:33:24 AM - Info bptm(pid=21160) start backup 4/19/2018 9:33:24 AM - Info bpdm(pid=24200) started 4/19/2018 9:33:24 AM - started process bpdm (24200) 4/19/2018 9:33:24 AM - Info bpdm(pid=24200) reading backup image 4/19/2018 9:33:24 AM - Info bpdm(pid=24200) using 64 data buffers 4/19/2018 9:33:24 AM - Info bpdm(pid=24200) requesting nbjm for media 4/19/2018 9:33:24 AM - Info bptm(pid=21160) Waiting for mount of media id 006972 (copy 2) on server srvbkp1-ap. 4/19/2018 9:33:24 AM - started process bptm (21160) 4/19/2018 9:33:24 AM - mounting 006972 4/19/2018 9:33:24 AM - Info bptm(pid=21160) INF - Waiting for mount of media id 006972 on server srvbkp1-ap for writing. 4/19/2018 9:33:25 AM - Critical bpdm(pid=24200) image open failed: error 2060018: file not found 4/19/2018 9:33:25 AM - Error bpduplicate(pid=26176) host srvbkp1-ap backup id srvred01-ap_1476140400 read failed, media open error (83). 4/19/2018 9:33:25 AM - Error bpduplicate(pid=26176) host srvbkp1-ap backupid srvred01-ap_1476140400 write failed, termination requested by administrator (150). 4/19/2018 9:33:26 AM - Error bpduplicate(pid=26176) Duplicate of backupid srvred01-ap_1476140400 failed, termination requested by administrator (150). 4/19/2018 9:33:26 AM - requesting resource @aaaah 4/19/2018 9:33:26 AM - granted resource MediaID=@aaaah;DiskVolume=PureDiskVolume;DiskPool=DedupPool;Path=PureDiskVolume;StorageServer=srvbkp1-ap;MediaServer=srvbkp1-ap 4/19/2018 9:33:26 AM - Info bptm(pid=16860) start 4/19/2018 9:33:26 AM - started process bptm (16860) 4/19/2018 9:33:27 AM - requesting resource Tandberg 4/19/2018 9:33:27 AM - awaiting resource Tandberg - No drives are available 4/19/2018 9:37:04 AM - granted resource 006972 4/19/2018 9:37:04 AM - granted resource HP.ULTRIUM5-SCSI.001 4/19/2018 9:37:04 AM - granted resource Tandberg 4/19/2018 9:37:05 AM - Info bptm(pid=16860) start backup 4/19/2018 9:37:05 AM - Info bpdm(pid=388) started 4/19/2018 9:37:05 AM - started process bpdm (388) 4/19/2018 9:37:05 AM - Info bpdm(pid=388) reading backup image 4/19/2018 9:37:05 AM - Info bpdm(pid=388) using 64 data buffers 4/19/2018 9:37:05 AM - Info bpdm(pid=388) requesting nbjm for media 4/19/2018 9:37:05 AM - Info bptm(pid=16860) Waiting for mount of media id 006972 (copy 2) on server srvbkp1-ap. 4/19/2018 9:37:05 AM - started process bptm (16860) 4/19/2018 9:37:05 AM - mounting 006972 4/19/2018 9:37:05 AM - Info bptm(pid=16860) INF - Waiting for mount of media id 006972 on server srvbkp1-ap for writing. 4/19/2018 9:37:06 AM - Critical bpdm(pid=388) image open failed: error 2060018: file not found 4/19/2018 9:37:06 AM - Error bpduplicate(pid=26176) host srvbkp1-ap backup id srvred01-ap_1476226800 read failed, media open error (83). 4/19/2018 9:37:06 AM - Error bpduplicate(pid=26176) host srvbkp1-ap backupid srvred01-ap_1476226800 write failed, termination requested by administrator (150). 4/19/2018 9:37:07 AM - Error bpduplicate(pid=26176) Duplicate of backupid srvred01-ap_1476226800 failed, termination requested by administrator (150). 4/19/2018 9:37:07 AM - Error bpduplicate(pid=26176) Status = no images were successfully processed. 4/19/2018 9:37:07 AM - end Duplicate; elapsed time: 0:03:48 no images were successfully processed(191)