Pre and Post PowerShell backup Scripts Hang with Event ID 7046 and 7082
Hi All
Hi All,
This issue only popped recently. When I manually set the Vault Store to Backup Mode via the VAC I get the following:
Although the error occurs it still set the vault store in backup mode:
When trying to clear the backup mode via the VAC I get the following:
The same as above, the error pops up but the backup mode is cleared.
When running the Powershell Script, sometimes it hangs and sometime it goes through which quite random, it can take from minutes to hours:
The same as the VAC, although the scripts hang the Backup Mode is set and cleared.
The Powershell dtrace shows:
1 11:25:24.622 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {SetVaultStoreBackUpMode} Begin Processing - enter
2 11:25:24.887 [5664](powershell) <14120> EV:M VaultCoCreateInstanceEx: IsLocalMachineExtendedCheck returned true for server [EVSERVER] as the IP Address matched that of the local machine
3 11:25:24.902 [5664](powershell) <14120> EV:L CDCOMSecurityHelper::SetClientBlanket Authentication Level=6 Impersonation Level=2 Capabilities=32 HRESULT=Success [0]
4 11:25:24.902 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {VaultStoreBackupModeTasks.BeginProcessing} Site ID:1D2ABC39FD37CFE4DA458F1AC44C9F7601d10000
5 11:25:24.902 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {SetVaultStoreBackUpMode} Begin Processing - exit
6 11:25:24.918 [5664](powershell) <14120> EV:M CSecurityWrapper::CSecurityWrapper
7 11:25:24.918 [5664](powershell) <14120> EV:M CSecurityWrapper::HasServerClientGotPermission, Admin Operation: 2005
8 11:25:24.918 [5664](powershell) <14120> EV:M CSecurityWrapper::IsServerClientTheVSA
9 11:25:24.918 [5664](powershell) <14120> EV:M CSecurityWrapper::IsServerClientTheVSA - hr=0 InClientCOMCall:F VSA:T
10 11:25:24.918 [5664](powershell) <14120> EV:M CSecurityWrapper::HasServerClientGotPermission: VSA: Allowed
11 11:25:24.918 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {VaultStoreBackupModeTasks.ProcessRecord} Finding entryid. Object Name: Vault Store 1 ObjectType:VaultStore
18 11:25:24.918 [5664](powershell) <14120> EV:M CBaseDirectoryServiceWrapper::GetInterface - RegKey UseLocalDirectory [False]
20 11:25:24.918 [5664](powershell) <14120> EV:M CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]
21 11:25:24.918 [5664](powershell) <14120> EV:L CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine
22 11:25:24.949 [5664](powershell) <14120> EV:M DirectoryVault: Initialization: DLL_PROCESS_ATTACH received by the DirectoryVault DLL. |
23 11:25:24.949 [5664](powershell) <14120> EV:H DirectoryVault: Initialization: DirectoryVault DLL version is: v1.2.| |
25 11:25:24.965 [5664](powershell) <14120> EV:M CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]
26 11:25:24.965 [5664](powershell) <14120> EV:L CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine
28 11:25:24.980 [5664](powershell) <14120> EV:M CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]
29 11:25:24.980 [5664](powershell) <14120> EV:L CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine
31 11:25:24.980 [5664](powershell) <14120> EV:M CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]
32 11:25:24.980 [5664](powershell) <14120> EV:L CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine
33 11:25:24.996 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {VaultStoreBackupModeTasks.UpdateBackupMode} entred update backup mode
34 11:25:24.996 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {StorageMangementHelperCache.GetStorageManagementHelper} Initializing StorageManagementHelper for storage service [133A4B9CE9925224BA26B534E2C31CF261e10000]
35 11:25:25.012 [5664](powershell) <14120> EV:M VaultCoCreateInstanceEx: IsLocalMachineExtendedCheck returned true for server [EVSERVER] as the IP Address matched that of the local machine
39 11:25:55.915 [7316](StorageManagement) <6112> EV~E Event ID: 7046 Unable to set Vault Store Backup Mode. |Reason:Storage Service is not running Storage Service Id [0xc00419f1] |VaultStoreEntryId: 186635AF957D1274AAEE4FCC6A612387C1210000 |Name: Vault Store 1 |
40 11:25:55.915 [5664](powershell) <14120> EV:M StorageMangementHelperObject::UpdateVaultStoreBackupMode - failed with hr [0xc00419f1]
41 11:25:55.915 [5664](powershell) <Pipeline Execution Thread:14120> EV-H {VaultStoreBackupModeTasks.UpdateBackupMode} Unable to set Vault Store backup mode on Vault Store 'Vault Store 1'
42 11:25:55.978 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {VaultStoreBackupModeTasks.ProcessRecord} Completed
43 11:25:55.978 [5664](powershell) <Pipeline Execution Thread:14120> EV-L {SetVaultStoreBackUpMode} End Processing
44 11:25:55.993 [5664](powershell) <13284> EV:H DirectoryVault: Termination: DLL_PROCESS_DETACH received by the DirectoryVault DLL. |
Event logs:
Log Name: Symantec Enterprise Vault
Source: Enterprise Vault
Date: 20/12/2011 12:07:05
Event ID: 7046
Task Category: Storage Management
Level: Error
Keywords: Classic
User: N/A
Computer: EVSERVER
Description:
Unable to set Vault Store Backup Mode.
Reason:Storage Service is not running Storage Service Id [0xc00419f1]
VaultStoreEntryId: 186635AF957D1274AAEE4FCC6A612387C1210000
Name: Vault Store 1
Log Name: Symantec Enterprise Vault
Source: Enterprise Vault
Date: 20/12/2011 12:07:25
Event ID: 7082
Task Category: Storage Management
Level: Error
Keywords: Classic
User: N/A
Computer: EVSERVER
Description:
Unable to clear Vault Store Backup Mode.
Reason:Storage Service is not running Storage Service Id [0xc00419f1]
VaultStoreEntryId: 186635AF957D1274AAEE4FCC6A612387C1210000
Name: Vault Store 1
The same events occur for Powershell script and manual via the VAC. The dtrace attached tells me pretty much the same errors.
The error seems to suggest that there is a problem with my EV Storage Service but there isn’t. I can assure you that EV Storage Service is fine.
Rebooting Server and restarting EV services does not help.
The only technote that I could find relating to the specific error Reason:Storage Service is not running Storage Service Id [0xc00419f1]
http://www.symantec.com/business/support/index?page=content&id=TECH129424
Although this technote seem to suggest that there is a problem with the account I am running as, I am running as VSA. Nonetheless, I applied the technote but did not help.
When the powershell script hangs this prevent NetBackup completing the BpStart_notify command therefore backup fails.
EV8 SP4 on Windows 2008 R2. Three EV servers, the other two are running fine, just this one. Configs and scripts are identical.
I think I have covered everything, if I missed anything please let me know.
Anyone has the same issue or experienced this at some point?
Thanks in advnace.
Upgrade to SP5, there were known issues with SP4 and before. Release notes attached.