Forum Discussion

Francis-T's avatar
Francis-T
Level 4
12 years ago

Intermittent archived item retrieval failure

Hi,

 

Have an intermittent issue that seems to be occuring a few times a week, no services stop, but a  restart of the services or server gets things running.

Seems to be 3 Enterprise Vault events (all with a Task Category of Web Application WP) on the EV server that tie in with when archive items start to fail.

In order they are;

 

AutoStorageOnline error.

Reason: Not enough storage is available to process this command. [0x80070008]

Reference: [CTSOL]

 

AutoStorageOnline error.

Reason: Not enough storage is available to process this command. [0x80070008]

Reference: [CO]

 

Unable to fetch item from "EVSERVER1.domain.wan".

Reason: Not enough storage is available to process this command. [0x80070008]

Saveset Id: 201302090437169~201301101307220000~Z~C123407DDFF16F5881C3C3D29B10AAC1

Archive Name: user.name

Archive Folder Path: ?Inbox

Reference: [GOAFS]

 

We found a couple of KB's that talk about free space, which isn't an issue on this server, and also about the amount of items in %TEMP% locations, but they've been cleared down as well.

Environment is 2 x EV 8.0.5.1048 servers. 1 for the journal and 1 for the user archives, this issue is on the server used for user archives.

OS is 2008 SP2 x64.

There are other issues relating to backups and the time they are taking (2-3 days for a full at present), still an ongoing piece of work to address this.

Exchange is 2007 SP3 RU6 on a 2003 R2 x64 cluster

SQL is 2005 on a 2003 R2 x64 cluster

Beyond the couple of KB's that didn't get us anywhere, now at a bit of a dead end for what to look at next.

Hoping to get a DTrace when trying to retrieve items the next time it happens and look to log a support call as well if I'm no getting anywhere.

 

Anything else I should be looking at, or anything obvious I've missed?

 

Cheers

 

  • Morning Ryan,

     

    Had almost forgotten about this thread, still having intermittent issues with EV though, the previous fixes did nothing.

    Do believe Symantec Support have now given us the root cause of the issue though, and it does tie in with your fix;

    http://www.symantec.com/docs/TECH155407

    Do you have a 64bit SharePoint web front end that is archived by EV?

    I was getting hung up on the EV backup, but now that Symantec highlighted the KB and SharePoint interaction, that would explain our issue.

    We've been monitoring the handles of storageonlineopns.exe proactively and getting alerts when it hits 20,000, that way we can restart the service and keep EV running before users start to have issues.

    In the meantime we're just confirming the trend of it's handles spiking during the SharePoint backup, but ultimately it does look like we'll need to upgrade.