Hyper-V, Status 156 "snapshot error encountered"

[Rick_Flair]

Hello,

Hoping someone can help me out.  We have 3x virtual machines (Win2003 and Win2008) on same Hyper-V host (Win2008 R2) failing with a Status 156 "snapshot error encountered", everything running Netbackup 7.0.  The bpfis messages are echoed in this technote: http://support.veritas.com/docs/334235, but we have ample space with "no limit" configured:


Virtual machines: 135 Total GB on drive, 37GB used, 98GB free, checked that Maximum Size for Shadow Copies is configured to "No Limit"
Hyper-V Host: 498 Total GB on drive, 176GB used, 322GB free. checked that Maximum Size for Shadow Copies is configured to "No Limit"



BPFIS OUTPUT:
10:51:45.203 [114348.115752] <4> bpfis: INF - BACKUP START 114348
10:51:45.203 [114348.115752] <2> bpfis main: receive filelist:<NEW_STREAM>
10:51:45.203 [114348.115752] <2> bpfis main: receive filelist:<ALL_LOCAL_DRIVES>
10:51:45.422 [114348.115752] <2> bpfis main: receive filelist:<CONTINUE>
10:51:45.469 [114348.115752] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.2054: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
10:51:45.469 [114348.115752] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.2068: service: bprd
10:51:45.671 [114348.115752] <2> logconnections: BPRD CONNECT FROM 10.32.xxx.xxx.63873 TO 10.32.xxx.xxx.13724
10:51:47.965 [114348.115752] <2> get_long: (2) premature end of file (byte 1)
10:51:47.965 [114348.115752] <2> bprd_read_text_file: get_string() failed, Access is denied.  (5), premature end of file encountered
10:51:47.965 [114348.115752] <8> bpfis: WRN - VfMS error 10; see following messages:
10:51:47.965 [114348.115752] <8> bpfis: WRN - Non-fatal method error was reported
10:51:47.965 [114348.115752] <8> bpfis: WRN - vfm_configure_fi_one: method: FlashSnap, type: FIM, function: FlashSnap_init
10:51:47.965 [114348.115752] <8> bpfis: WRN - VfMS method error 3; see following message:
10:51:47.965 [114348.115752] <8> bpfis: WRN - FlashSnap_init: Veritas Volume Manager not installed.
10:51:47.980 [114348.115752] <8> bpfis: WRN - VfMS error 10; see following messages:
10:51:47.980 [114348.115752] <8> bpfis: WRN - Non-fatal method error was reported
10:51:47.980 [114348.115752] <8> bpfis: WRN - vfm_configure_fi_one: method: vxvm, type: FIM, function: vxvm_init
10:51:47.980 [114348.115752] <8> bpfis: WRN - VfMS method error 3; see following message:
10:51:47.980 [114348.115752] <8> bpfis: WRN - vxvm_init: Veritas Volume Manager not installed.
10:51:47.996 [114348.115752] <4> bpfis: INF - FIS_ID=CLIENT_1278463893
10:51:47.996 [114348.115752] <4> bpfis: INF - Preparing freeze of ALL_LOCAL_DRIVES using snapshot method Hyper-V.
10:51:47.996 [114348.115752] <4> bpfis: INF - Created mount point C:\Program Files\VERITAS\NetBackup\temp\_vrts_frzn_img_ALL_LOCAL_DRIVES_114348
...
...
...
10:51:47.996 [114348.115752] <2> parse_value_specification: Found default 1
10:51:47.996 [114348.115752] <2> parse_ssm_parms: Found prompt Maximum Snapshots (Instant Recovery only)
10:51:47.996 [114348.115752] <2> read_vfm_conf: Found FIM: VSS_Writer
10:51:47.996 [114348.115752] <2> read_vfm_conf: Found library: C:\Program Files\VERITAS\NetBackup\bin\libfi_vss_writer.dll
10:51:52.520 [114348.115752] <32> bpfis: FTL - VfMS error 11; see following messages:
10:51:52.520 [114348.115752] <32> bpfis: FTL - Fatal method error was reported
10:51:52.520 [114348.115752] <32> bpfis: FTL - vfm_freeze_commit: method: Hyper-V, type: FIM, function: Hyper-V_gentree
10:51:52.520 [114348.115752] <32> bpfis: FTL - VfMS method error 6; see following message:
10:51:52.520 [114348.115752] <32> bpfis: FTL - snapshot services: snapshot target analysis failed: provider-private error.
10:51:52.520 [114348.115752] <32> bpfis: FTL - VfMS error 11; see following messages:
10:51:52.520 [114348.115752] <32> bpfis: FTL - Fatal method error was reported
10:51:52.520 [114348.115752] <32> bpfis: FTL - vfm_freeze_commit: method: Hyper-V, type: FIM, function: Hyper-V_gentree
10:51:52.520 [114348.115752] <32> bpfis: FTL - VfMS method error 6; see following message:
10:51:52.520 [114348.115752] <32> bpfis: FTL - snapshot services: snapshot target analysis failed: provider-private error.
10:51:52.520 [114348.115752] <4> bpfis: INF - Thawing ALL_LOCAL_DRIVES using snapshot method Hyper-V.
10:51:54.532 [114348.115752] <4> bpfis: INF - do_thaw return value: 5
10:51:54.532 [114348.115752] <32> bpfis: FTL - VfMS error 5; see following messages:
10:51:54.532 [114348.115752] <32> bpfis: FTL - File open failed
10:51:54.532 [114348.115752] <32> bpfis: FTL - do_reaccess: cannot open reaccess file C:\Program Files\VERITAS\NetBackup\online_util\fi_cntl\bpfis.fim.CLIENT_1278463893.0.fiid
10:51:54.532 [114348.115752] <16> bpfis: FTL - snapshot creation failed, status 156
10:51:54.532 [114348.115752] <4> bpfis: INF - Thawing ALL_LOCAL_DRIVES using snapshot method Hyper-V.
10:51:54.532 [114348.115752] <8> bpfis: WRN - ALL_LOCAL_DRIVES is not frozen
10:51:54.532 [114348.115752] <8> bpfis: WRN - snapshot delete returned status 20
10:51:54.563 [114348.115752] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.2054: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
10:51:54.563 [114348.115752] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.2068: service: bprd
10:51:54.766 [114348.115752] <2> logconnections: BPRD CONNECT FROM 10.32.xxx.xxx.63876 TO 10.32.xxx.xxx.13724
10:51:56.186 [114348.115752] <4> bpfis: INF - EXIT STATUS 156: snapshot error encountered
10:52:09.305 [116360.4756] <2> logparams: C:\Program Files\VERITAS\NetBackup\bin\bpfis.exe delete -nbu -id CLIENT_1278463893 -bpstart_to 300 -bpend_to 300 -clnt hyperv_server.domain.local -pt 29 -st INCR -status 156 -S master_server.domain.local
10:52:09.352 [116360.4756] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.2054: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
10:52:09.352 [116360.4756] <2> vnet_vnetd_service_socket: ../../libvlibs/vnet_vnetd.c.2068: service: bprd
10:52:09.555 [116360.4756] <2> logconnections: BPRD CONNECT FROM 10.32.xxx.xxx.63887 TO 10.32.xxx.xxx.13724
10:52:11.021 [116360.4756] <4> bpfis: INF - BACKUP START 116360
10:52:11.021 [116360.4756] <32> bpfis: FTL - cannot open C:\Program Files\VERITAS\NetBackup\online_util\fi_cntl\bpfis.fim.CLIENT_1278463893.0

[Nefarious]

Which 'Provider Type' are you using under the 'Snapshot Client' options in the policy?

Page 28 of the Hyper-V Admin Guide describes them.  We didn't have much luck with with "Auto" in our environment.
 

[Rick_Flair]

Thanks.  We're using Auto, as well.  What would cause Auto to experience problems?