12-15-2017 02:19 AM
Hello everybody,
we have a big environment of hyper-v VMs and we have some issue, in particular we have job error 6 that I cant find any solution. Do you have any experience ??
Our environment is all in 8.1.
Master: win server 2012 R2; Media server: appliance 5240; clients (host hyper-v): win server 2012 R2
Solved! Go to Solution.
01-31-2018 06:31 AM - edited 01-31-2018 06:32 AM
Hello guys,
I solved the issue with a support veritas case. The support guy found these evidence:
I believe the issue seems to originate from this error in VxMS: 16:03:37.0234 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0234 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0234 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0234 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0281 : dumpMftBitmap:NtfsFileSystem.cpp:1277 <INFO> : Dumping $mftbitmap of \\?\GLOBALROOT\Device\CSV{d1ea67bc-c984-4ca8-9f98-3ae8149f718f}\ : mftbitmap_1bc4ec38 16:03:37.0281 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0281 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0328 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0328 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0328 : openFileName:NtfsOpenFile.cpp:480 <WARN> : Returning: 5488 16:03:37.0328 : openFileName:NtfsFileByHandle.cpp:646 <WARN> : Returning: 5488 16:03:37.0328 : openFileName:NtfsFile.cpp:780 <WARN> : Returning: 5488 16:03:37.0328 : ntfsMapOpenFileName:NtfsCoordinator.cpp:1001 <WARN> : Returning: 5488 16:03:37.0328 : pv_ntfs_map_open_file_name:libntfs.cpp:1790 <WARN> : Returning: 5488 16:03:37.0328 : hv_vmware_map_fini:libvix.cpp:539 <TRACE> : Released VixCoordinator 16:03:37.0328 : hv_microsoft_wmi_map_fini:libvhdo.cpp:522 <TRACE> : Released VhdoCoordinator 5488 - 4096 = Win32 API error 1392 C:\ >net helpmsg 1392 The file or directory is corrupted and unreadable. When checking in the hyperv event viewer we see: Event 10172 VSS writers inside virtual machine SVSWAPAP06 failed to perform BackupComplete to its shadow copy (VSS snapshot) set: Catastrophic failure (0x8000FFFF) Event 10172 VSS writers inside virtual machine SVSWAPAP06 failed to perform BackupComplete to its shadow copy (VSS snapshot) set: A function call was made when the object was in an incorrect state for that function (0x80042301) This is coming from microsoft side, I would suggest opening a call with microsoft of notifying your windows team on this error for assistance.
So I asked help to the Microsoft Support Team and after many attempts we solved with these two actions:
on the VM Stop / Restart hyper-v shadaow copy service
on the VM Stop Volume shadow copy
regards
Ste
12-15-2017 02:50 AM
In attachment some logs. thank you !
12-15-2017 03:41 AM
According to your job details, bpbkar reported the error but the log also showed that your have connectivity problems between the media server and the master:
Dec 15, 2017 11:19:38 AM - Warning bptm (pid=278129) db_getCONFIG() failed: cannot connect on socket
To identify by bpbkar failed we will need VxMS logs at verbose 5.
https://www.veritas.com/content/support/en_US/doc/123860515-126796677-0/v23649764-126796677
12-15-2017 05:36 AM
thank you dear,
in attachment you can find the Vxmx log, can you understend someting ?
best regards
12-15-2017 06:05 AM
Per the VxMS it appears you are getting the below error:
ERROR_FILE_CORRUPT
The file or directory is corrupted and unreadable.
13:52:10.0511 : openFileName:NtfsOpenFile.cpp:480 <WARN> : Returning: 5488
13:52:10.0511 : openFileName:NtfsFileByHandle.cpp:646 <WARN> : Returning: 5488
13:52:10.0511 : openFileName:NtfsFile.cpp:780 <WARN> : Returning: 5488
13:52:10.0511 : ntfsMapOpenFileName:NtfsCoordinator.cpp:1001 <WARN> : Returning: 5488
13:52:10.0511 : pv_ntfs_map_open_file_name:libntfs.cpp:1790 <WARN> : Returning: 5488
Do this backup work if you disable File Level Backup?
Is this a Hyper-V cluster?
What filesystem is it on?
Are you using NTFS Deduplication or REFS?
12-29-2017 02:51 AM
Dear Duncan sorry for delay, I am very busy..
Do this backup work if you disable File Level Backup? I never test this before, I will try and update you
Is this a Hyper-V cluster? Yes the host is a cluster
What filesystem is it on? NTFS
Are you using NTFS Deduplication or REFS? I asked to Microsoft Support Team, no we don' use it.
01-31-2018 06:31 AM - edited 01-31-2018 06:32 AM
Hello guys,
I solved the issue with a support veritas case. The support guy found these evidence:
I believe the issue seems to originate from this error in VxMS: 16:03:37.0234 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0234 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0234 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0234 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0281 : dumpMftBitmap:NtfsFileSystem.cpp:1277 <INFO> : Dumping $mftbitmap of \\?\GLOBALROOT\Device\CSV{d1ea67bc-c984-4ca8-9f98-3ae8149f718f}\ : mftbitmap_1bc4ec38 16:03:37.0281 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0281 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0328 : openFrn:NtfsOpenFile.cpp:407 <WARN> : Returning: 4101 16:03:37.0328 : openFileFrn:NtfsOpenFile.cpp:423 <WARN> : Returning: 4101 16:03:37.0328 : openFileName:NtfsOpenFile.cpp:480 <WARN> : Returning: 5488 16:03:37.0328 : openFileName:NtfsFileByHandle.cpp:646 <WARN> : Returning: 5488 16:03:37.0328 : openFileName:NtfsFile.cpp:780 <WARN> : Returning: 5488 16:03:37.0328 : ntfsMapOpenFileName:NtfsCoordinator.cpp:1001 <WARN> : Returning: 5488 16:03:37.0328 : pv_ntfs_map_open_file_name:libntfs.cpp:1790 <WARN> : Returning: 5488 16:03:37.0328 : hv_vmware_map_fini:libvix.cpp:539 <TRACE> : Released VixCoordinator 16:03:37.0328 : hv_microsoft_wmi_map_fini:libvhdo.cpp:522 <TRACE> : Released VhdoCoordinator 5488 - 4096 = Win32 API error 1392 C:\ >net helpmsg 1392 The file or directory is corrupted and unreadable. When checking in the hyperv event viewer we see: Event 10172 VSS writers inside virtual machine SVSWAPAP06 failed to perform BackupComplete to its shadow copy (VSS snapshot) set: Catastrophic failure (0x8000FFFF) Event 10172 VSS writers inside virtual machine SVSWAPAP06 failed to perform BackupComplete to its shadow copy (VSS snapshot) set: A function call was made when the object was in an incorrect state for that function (0x80042301) This is coming from microsoft side, I would suggest opening a call with microsoft of notifying your windows team on this error for assistance.
So I asked help to the Microsoft Support Team and after many attempts we solved with these two actions:
on the VM Stop / Restart hyper-v shadaow copy service
on the VM Stop Volume shadow copy
regards
Ste