Forum Discussion

LCT's avatar
LCT
Level 6
13 years ago

Pre and Post PowerShell backup Scripts Hang with Event ID 7046 and 7082

Hi All  

Hi All,

This issue only popped recently. When I manually set the Vault Store to Backup Mode via the VAC I get the following:

 

Although the error occurs it still set the vault store in backup mode:

 

 

When trying to clear the backup mode via the VAC I get the following:

 

 

The same as above, the error pops up but the backup mode is cleared.

 

When running the Powershell Script, sometimes it hangs and sometime it goes through which quite random, it can take from minutes to hours:

 

 

 

The same as the VAC, although the scripts hang the Backup Mode is set and cleared.

 

The Powershell dtrace shows:

 

1          11:25:24.622    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {SetVaultStoreBackUpMode} Begin Processing - enter

2          11:25:24.887    [5664](powershell)     <14120>          EV:M   VaultCoCreateInstanceEx: IsLocalMachineExtendedCheck returned true for server [EVSERVER]  as the IP Address matched that of the local machine

3          11:25:24.902    [5664](powershell)     <14120>          EV:L    CDCOMSecurityHelper::SetClientBlanket Authentication Level=6 Impersonation Level=2 Capabilities=32 HRESULT=Success  [0]

4          11:25:24.902    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {VaultStoreBackupModeTasks.BeginProcessing} Site ID:1D2ABC39FD37CFE4DA458F1AC44C9F7601d10000

5          11:25:24.902    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {SetVaultStoreBackUpMode} Begin Processing - exit

6          11:25:24.918    [5664](powershell)     <14120>          EV:M   CSecurityWrapper::CSecurityWrapper

7          11:25:24.918    [5664](powershell)     <14120>          EV:M   CSecurityWrapper::HasServerClientGotPermission, Admin Operation: 2005

8          11:25:24.918    [5664](powershell)     <14120>          EV:M   CSecurityWrapper::IsServerClientTheVSA

9          11:25:24.918    [5664](powershell)     <14120>          EV:M   CSecurityWrapper::IsServerClientTheVSA - hr=0 InClientCOMCall:F VSA:T

10        11:25:24.918    [5664](powershell)     <14120>          EV:M   CSecurityWrapper::HasServerClientGotPermission: VSA: Allowed

11        11:25:24.918    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {VaultStoreBackupModeTasks.ProcessRecord} Finding entryid. Object Name: Vault Store 1 ObjectType:VaultStore

18        11:25:24.918    [5664](powershell)     <14120>          EV:M   CBaseDirectoryServiceWrapper::GetInterface - RegKey UseLocalDirectory [False]

20        11:25:24.918    [5664](powershell)     <14120>          EV:M            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]

21        11:25:24.918    [5664](powershell)     <14120>          EV:L            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine

22        11:25:24.949    [5664](powershell)     <14120>          EV:M   DirectoryVault: Initialization: DLL_PROCESS_ATTACH received by the DirectoryVault DLL. |

23        11:25:24.949    [5664](powershell)     <14120>          EV:H    DirectoryVault: Initialization: DirectoryVault DLL version is: v1.2.| |

25        11:25:24.965    [5664](powershell)     <14120>          EV:M            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]

26        11:25:24.965    [5664](powershell)     <14120>          EV:L            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine

28        11:25:24.980    [5664](powershell)     <14120>          EV:M            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]

29        11:25:24.980    [5664](powershell)     <14120>          EV:L            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine

31        11:25:24.980    [5664](powershell)     <14120>          EV:M            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]

32        11:25:24.980    [5664](powershell)     <14120>          EV:L            CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine

33        11:25:24.996    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {VaultStoreBackupModeTasks.UpdateBackupMode} entred update backup mode

34        11:25:24.996    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {StorageMangementHelperCache.GetStorageManagementHelper} Initializing StorageManagementHelper for storage service [133A4B9CE9925224BA26B534E2C31CF261e10000]

35        11:25:25.012    [5664](powershell)     <14120>          EV:M   VaultCoCreateInstanceEx: IsLocalMachineExtendedCheck returned true for server [EVSERVER]  as the IP Address matched that of the local machine

39        11:25:55.915    [7316](StorageManagement)  <6112>            EV~E   Event ID: 7046 Unable to set Vault Store Backup Mode. |Reason:Storage Service is not running   Storage Service Id       [0xc00419f1] |VaultStoreEntryId: 186635AF957D1274AAEE4FCC6A612387C1210000 |Name: Vault Store 1 |

40        11:25:55.915    [5664](powershell)     <14120>          EV:M            StorageMangementHelperObject::UpdateVaultStoreBackupMode - failed with hr [0xc00419f1]

41        11:25:55.915    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-H            {VaultStoreBackupModeTasks.UpdateBackupMode} Unable to set Vault Store backup mode on Vault Store 'Vault Store 1'

42        11:25:55.978    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {VaultStoreBackupModeTasks.ProcessRecord} Completed

43        11:25:55.978    [5664](powershell)     <Pipeline Execution Thread:14120>      EV-L            {SetVaultStoreBackUpMode} End Processing

44        11:25:55.993    [5664](powershell)     <13284>          EV:H    DirectoryVault: Termination: DLL_PROCESS_DETACH received by the DirectoryVault DLL. |

 

Event logs:

 

Log Name:      Symantec Enterprise Vault

Source:        Enterprise Vault

Date:          20/12/2011 12:07:05

Event ID:      7046

Task Category: Storage Management

Level:         Error

Keywords:      Classic

User:          N/A

Computer:      EVSERVER

Description:

Unable to set Vault Store Backup Mode.

Reason:Storage Service is not running   Storage Service Id       [0xc00419f1]

VaultStoreEntryId: 186635AF957D1274AAEE4FCC6A612387C1210000

Name: Vault Store 1

 

Log Name:      Symantec Enterprise Vault

Source:        Enterprise Vault

Date:          20/12/2011 12:07:25

Event ID:      7082

Task Category: Storage Management

Level:         Error

Keywords:      Classic

User:          N/A

Computer:      EVSERVER

Description:

Unable to clear Vault Store Backup Mode.

Reason:Storage Service is not running   Storage Service Id       [0xc00419f1]

VaultStoreEntryId: 186635AF957D1274AAEE4FCC6A612387C1210000

Name: Vault Store 1

 

The same events occur for Powershell script and manual via the VAC. The dtrace attached tells me pretty much the same errors.

The error seems to suggest that there is a problem with my EV Storage Service but there isn’t. I can assure you that EV Storage Service is fine.

Rebooting Server and restarting EV services does not help.

The only technote that I could find relating to the specific error Reason:Storage Service is not running   Storage Service Id       [0xc00419f1]

http://www.symantec.com/business/support/index?page=content&id=TECH129424

Although this technote seem to suggest that there is a problem with the account I am running as, I am running as VSA. Nonetheless, I applied the technote but did not help.

When the powershell script hangs this prevent NetBackup completing the BpStart_notify command therefore backup fails.

EV8 SP4 on Windows 2008 R2. Three EV servers, the other two are running fine, just this one. Configs and scripts are identical.

I think I have covered everything, if I missed anything please let me know.

Anyone has the same issue or experienced this at some point?

Thanks in advnace.

  

  • Thanks Percy!!! :-)

    It is someting to do with the the VAC being opened. From the EV8 SP5 Release notes:

    *********

    Backup mode could be cleared unexpectedly from vault stores and index locations [Ref 801186, E1451957]

    Under certain circumstances, backup mode could be cleared unexpectedly from vault stores and index locations. This happened because the Administration Console cached certain configuration information including backup mode settings for vault stores and index locations.

    If you used PowerShell cmdlets to set or clear backup mode on vault stores or index locations while the Administration Console was open, the cached backup mode settings could become out of date, and then be wrongly reapplied.

    This has been fixed.

    **********

    I tested by closing the VAC (MMC.exe *32) on all accounts on the server and the scripts get executed within a couple minutes and disappeared. But I still get the event IDs logged in the event logs? Anyway, I know we shouldn't be logging on to the EV server but sometimes there are things we do that we have to logon into the server.

    So for now we are adding the taskkill /f/im mmc.exe*32 onto the script as a workaround until the Change Freeze is over in January 2012 and then we will be upgrading to EV9 SP3.

    Cheers.