Backup Exec 2010 Beta - Exchange 2010 Single-Item restore fails with error e00002f8

[Mikael_Jonsson]

Hi!
I'm trying to do single item restores using GRT with BAckup Exec 2010 on an Exchange 2010 Server, but it all fails with status code E00002f8.
Both full mailbox and single mail message restores exits with the error code.

       Error: e00002f8 - Cannot open one or more mail messages because of unknown MAPI errors. Review the job log for more information.
 

I'm using the same accounts as I've been doing for the last year on Exchange 2007 without any problems.

Using SGMon on the Exchange 2010 Server, it reveals the following:

BEREMOTE: [11-10-01 08:29:57] [7380]     SendSeedMSG: mail message sent Succesfully.
MONAD:    [01-11-10 08:30:12] [0000]     [1] [01-11-10 08:30:12.1]  BEExch2007Component::ValidCredentials
MONAD:    [01-11-10 08:30:12] [0000]     [1] [01-11-10 08:30:12.1]  BEExch2007Component::GetUserMailbox:get-User -Id 'UserName'
MONAD:    [01-11-10 08:30:12] [0000]     [1] [01-11-10 08:30:12.2]  BEExch2007Component::GetUserMailbox:get-Mailbox -Id 'UserName'
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     Logging on to server -> Servername as user -> UserName

     MessageStoreDN=/O=/OU=/CN=Configuration/CN=Servers/CN=ServerName/CN=Microsoft Private MDB

     MailBoxDN=/
MONAD:    [01-11-10 08:30:12] [0000]     [1] [01-11-10 08:30:12.2]  BEExch2007Component::ValidCredentials
MONAD:    [01-11-10 08:30:12] [0000]     [1] [01-11-10 08:30:12.2]  BEExch2007Component::GetUserMailbox:get-User -Id 'UserName'
MONAD:    [01-11-10 08:30:12] [0000]     [1] [01-11-10 08:30:12.3]  BEExch2007Component::GetUserMailbox:get-Mailbox -Id 'MailboxName'
BEREMOTE: [11-10-01 08:30:12] [7380]     Error: OpenObj returns extended error e00002f8
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MB2 message already exists "<No Subject>"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MBOX:Open() CreateMessage failed for e_id->len = 70, msg with 80004005
BEREMOTE: [11-10-01 08:30:12] [7380]     Error: OpenObj returns extended error e00002f8
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MB2 message already exists "<No Subject>"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MBOX:Open() CreateMessage failed for e_id->len = 70, msg with 80004005
BEREMOTE: [11-10-01 08:30:12] [7380]     Error: OpenObj returns extended error e00002f8
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MB2 message already exists "<No Subject>"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MBOX:Open() CreateMessage failed for e_id->len = 70, msg with 80004005
BEREMOTE: [11-10-01 08:30:12] [7380]     Error: OpenObj returns extended error e00002f8
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MB2 message already exists "<No Subject>"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MapiAdmin::OpenCurMbox() Found matched mailbox by mailboxName - "MailboxName" == "MailboxName"
BEREMOTE: [11-10-01 08:30:12] [7380]     MBOX:Open() CreateMessage failed for e_id->len = 70, msg with 80004005
and so on..

I've set the job options to overwrite existing items, but somehow it won't overwrite the items that's been purged from the dumpster.
Any ideas of what the root causing this problem might be?

Best regards,
Mikael Jonsson

[Mikael_Jonsson]

Both the BE  and Exchange server are running on Windows Server 2008 R2.

[CornishPastie]

Hiya,

I think you may need to add the owner permisson for the account you are using to do the restore.

Regards

[Mikael_Jonsson]

Hi!

What other owner permissions should be set? I can't find anything in the BE Admin guide for BE 2010 about owner permissions..
The account used for the restore is a member of the domain admins group and the owner of the account is set by default to domain admins.
I've checked the full access as well as the send and receive as permissions on both the mailboxes and databases but still no luck with the restores.

The backups are running without any problems and everything is visible in the selection list view.
But it seems that BE just won't overwrite the "existing items" (the retention limit haven't been reached yet, so the mail messages are still in the hidden purged items folder).
I haven't tried to restore single mail messages to another mailbox using redirections yet, but that haven't been an issue before with Exchange 2007 and BE 12.5.
/Mike

[Adam86]

Did you ever manage to fix this? I have exactly the same issue.

[Mikael_Jonsson]

Unfortunatly no. I didn't  have time to troubleshoot any more, so I decided to use DPM 2010 Beta instead (since we've got licenses for DPM too, we might start using it instead of BE).
I haven't tried BE 2010 RTM yet, so I'm not really sure if using it would work. I'm still interested in getting BE 2010 single item recovery to work with Exchange 2010, but since there's no more information about this error, I've decided to wait until somone figures out how to fix it.
/Mike

[Adam86]

I am using RTM in trial mode and it is the same,

I dont know if this is of any use to you :

http://seer.entsupport.symantec.com/docs/337861.htm

I found it this morning, this is the setup I have so I believe it comes down to this, not exactly ideal solution right now either.

[Mikael_Jonsson]

Thanks Adam!
That might very well be the root cause of the problem, even if it seems strange that it doesn't work with certificates installed on the EXCH2010 CAS.
Our Exchange server has every role installed except UM.
Lets hope Symantec comes up with a fix for this sometime soon.
/Mike

[Adam86]

Well I tested restore to a Recovery Database but it also failed with exactly the same error.

Did a little bit of messing about this afternoon, setup a test Server 2008 box with Exchange 2010 CAS role and then tested a restore redirecting it to that CAS server with the default Exchange certficate which is installed on that box, the restore showed as successful and the message appeared in my inbox saying messages were been restored but none showed up! and then tried it again and only 3 appeared! so still doesnt work right.

I dont understand how Symantec can miss this big a bug!

[kbayless]

My office is having this issue.  I've opened a Case with Symantec and will work the issue to completion as we must have granular restore capability - that's the only reason to own the product.  When I get a solution I'll update the forum.

[Adam86]

Cheers that would be great if you could keep us informed, I'm not buying the product until the issue is fixed therefore cannot get any official support currently as the product is still in trial mode.

Cheers

[MosesM]

I have wasted many valuable DAYS trying everything they suggest. Still no luck getting a successful single item restore after a GRT backup. Like many others, it is the only reason why we bought the product.
 

[CraigV]

Seems to be a general problem at the moment. Best thing would be to log a call with Symantec support and see if they can help you fix it.
Have you tried staging to disk first, and then restoring out of that?

[kbayless]

The issue is not solved.  Indications are that it is a SSL certificate issue.  I must say the Symantec technical staff have been most patient and thorough in gathering logging information from the restore jobs.  Initially we created a device on disk as a New Job to Duplicate Backup Sets.  The intent was to get the restore tape on disk to make it faster for it to fail.  The tech staff, mostly in India, use the Webex to review the attempt.  The problem has been bumped to a higher level of tech support but I haven't heard from them.  The error log in the restore job for individual items failure line states:

Exception in sending seedmsg Request failed. The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel.

I believe we will attempt to remove our Certificate used for IIS which has False for self signed and we still have the Microsoft Exchange self signed default certificates installed for IMAP, POP, SMTP.

[MosesM]

I hope the Symantec team eventually get the issue resolved. I will keep checking the post for your progress. Again thanks for keeping us informed

[dirisit]

kbayless, did you remove your false signed certifcate?? and did it make a difference? I'm curious to know, cause I'm logged over 8 hours
on support for this and NEED to restore individual messages asap, thanks

[kbayless]

We have elevated this issue to Citrix technical support, 2nd level engineering.  I spoke with a representative this morning.  He called this a known MAPI issue and is not related to our certificates.  They have a beta fix that will be lumped into a hot fix but not the hot fix to be distributed next week.  He referred to the "work around" addressed in this article:  http://support.veritas.com/docs/337861. but I haven't tried it as I don't have a current requirement to restore.  A support engineer is supposed to contact me today with instructions on the beta fix that hopefully will allow a normal "individual item" restore from tape.  Our exchange consultant reviewed our installation of Exchange 2010 and found no errors so hopefully Symantec can solve the issue.

[kbayless]

There is an orphan fix for the restore individual items failure with BE2010 for Exchange 2010 in Windows 2008 x64.  You copy 7 dll files to program files\symantec\backup exec and three to program files\symantec\backup exec\x86 folders after stopping the services.  I had a restore job from disk and it worked great  after starting the services.  Tech support states this will be released shortly as hot fix.  If you can't wait for hot fix release contact technical support to get access to the zip file.

[jsoupene]

Hello kbayless, thanks for doing all the leg work with Symantec for us that are having the same issue as yourself.  Is there anyway you would want to make available the dll's that we need so we do not have to contact Symantec?  If not, I understand. 

[DFrank]

I would also like to request these files. I just opened a case with Symantec regarding this, but they have yet to call me back.