0xe0008488 - Access is denied / Beremote crashing on Exchange

[Wes_Stewart]

I was asked to create a new thread by Symantec support, so excuse me if the subject has been sort of covered.

Legacy Backup of Mailboxes. Worked fine in 10d, did an in-place upgrade to 11d and I get thousands of the lines below for many mailboxes in the log. The strange thing is that 9 out of the last 30 days the legacy mailbox backup has been successful.


V-79-57344-33928 - Access is denied.
Access denied to file Res Confirmations Top of Information StoreInboxConfirming your reservation.


WARNING: "\\TRINITY\Microsoft Exchange Mailboxes\Res Confirmations Top of Information StoreInboxConfirming your reservation" is a corrupt file.
This file cannot verify.

The access denied seems to start when beremote crashes on the Exchange server:

Event Type: Error
Event Source: Application Error
Event Category: (100)
Event ID: 1000
Date: 2/1/2007
Time: 10:24:58 PM
User: N/A
Computer: TRINITY
Description:
Faulting application beremote.exe, version 11.0.6235.0, faulting module BEDSMBox.dll, version 11.0.6235.1, fault address 0x0001f659.

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
Data:
0000: 41 70 70 6c 69 63 61 74 Applicat
0008: 69 6f 6e 20 46 61 69 6c ion Fail
0010: 75 72 65 20 20 62 65 72 ure ber
0018: 65 6d 6f 74 65 2e 65 78 emote.ex
0020: 65 20 31 31 2e 30 2e 36 e 11.0.6
0028: 32 33 35 2e 30 20 69 6e 235.0 in
0030: 20 42 45 44 53 4d 42 6f BEDSMBo
0038: 78 2e 64 6c 6c 20 31 31 x.dll 11
0040: 2e 30 2e 36 32 33 35 2e .0.6235.
0048: 31 20 61 74 20 6f 66 66 1 at off
0050: 73 65 74 20 30 30 30 31 set 0001
0058: 66 36 35 39 f659

[Joshua_Kane]

Wes,

I believe this issue will be addressed as part of the GRT Hotfix for 11d. The Technote linked below will update when the Hotfix is released. I would try checking it mid-week.

I know the description below has nothing to do with corrupt messages, or a crash in bedsmbox.dll but it will link to the HF when it is released.

Mailboxes or Mail Messages Restored from an Exchange Information Store (IS) backup using the Backup Exec 11d Granular Restore Technology (GRT) feature may not be restored as expected. Items Restored from GRT backup may not contain usable attachments, embedded items, or the text body of the mail message may be missing.

http://support.veritas.com/docs/287227

Joshua Kane
Symantec

Backup Exec for Windows Servers Free E-mail Support
http://seer.entsupport.symantec.com/email_forms/intro_emailsup.asp

[Wes_Stewart]

It is nice to know that we can expect a hot fix soon to fix some of major problems out there.

[Joshua_Kane]

Wes:


This Hotfix may help resolve your issue. It will have to be installed on both the Media server, and any server the remote agent is installed on.

Link to download the 32 bit version of the hotfix: http://support.veritas.com/docs/287233

Link to download the 64 bit version of the hotfix: http://support.veritas.com/docs/287234

What issues does this hotfix resolve?
Exchange IS Backup to Tape with GRT enabled may not display all items for restore
Restore of Exchange IS Mail items using GRT may not correctly restore attachments or embedded items
Restore of Exchange IS Mail items using GRT may result in corrupt or missing mail messages
Restore of a Mailbox from GRT data results in the Remote Agent Stopping on the Media Server

[Philip_Pearson]

Do you have any disabled accounts? They will cause access denied

[Derek_Hill]

As far as I know the BE Remote agent dying is not being addressed by HotFix 11, HF 11 addresses all sort of Exchange related problems such as access denied when trying to restore a mailbox, not being able to backup to disk, etc.

The dying agent is still a problem, I am having this issue on more than just exchange servers, it seems random and I haven't been able to figure out a pattern, I have seen this on Windows 2000 Server, 2003 (standard and enterprise) as well as 2003 R2 standard.

Hope that clarifies things a bit.

Derek

[Derek_Hill]

Removed Double PostMessage was edited by:
Derek Hill

[Philip_Pearson]

I think it only stops the be remote agent dying if you are restoring via grt.

[Wes_Stewart]

No disabled accounts. We only delete them and then remove them from the backup job manually. I wish BackupExec was smart enough to not show a failure when an account was deleted.

[Joshua_Kane]

Wes:

Have you tried purging your AD so the accouts are deleted and not tombstoned. If AD is still reporting the accounts you will get an error message similar to what you are seeing.

Also what happens if you create a new IS Backup and select to use GRT?

Joshua Kane
Symantec

[Wes_Stewart]

I haven't tried a GRT backup yet. That will be tonight.

I can confirm that hotfix 11 does nothing for the remote agent crashing on my Exchange Server. The darn thing had crashed even before I had logged in after hotfix 11 installation/reboot.

[Joshua_Kane]

Wes:

Can you confirm if the crash is createing a User.dmp file on your Exchange Server, if it is I can always analyze it for you.

Joshua Kane
Symantec

[Wes_Stewart]

I think this is what you want:

http://cruiseamerica.com/temp/beremote.txt

[Joshua_Kane]

No, that is the Drwatson log file. I want the actual crash dump. It will be named user.dmp

[Wes_Stewart]

I am not getting a user.dmp. I have set it up in Drwatson to do so, but it will not. I do have new errors in the event log.

Event Type:Error
Event Source:Backup Exec
Event Category:None
Event ID:58117
Date:2/13/2007
Time:5:11:15 PM
User:N/A
Computer:TRINITY
Description:
The Backup Exec Remote Agent for Windows Servers Service did not start. The application failed to listen on the NDMP TCP/IP port. Check the network configuration.

Event Type:Error
Event Source:Application Error
Event Category:(100)
Event ID:1000
Date:2/13/2007
Time:5:06:26 PM
User:N/A
Computer:TRINITY
Description:
Faulting application beremote.exe, version 11.0.6235.0, faulting module BEDSMBox.dll, version 11.0.6235.11, fault address 0x0001f6c9.

Data:
0000: 41 70 70 6c 69 63 61 74 Applicat
0008: 69 6f 6e 20 46 61 69 6c ion Fail
0010: 75 72 65 20 20 62 65 72 ure ber
0018: 65 6d 6f 74 65 2e 65 78 emote.ex
0020: 65 20 31 31 2e 30 2e 36 e 11.0.6
0028: 32 33 35 2e 30 20 69 6e 235.0 in
0030: 20 42 45 44 53 4d 42 6f BEDSMBo
0038: 78 2e 64 6c 6c 20 31 31 x.dll 11
0040: 2e 30 2e 36 32 33 35 2e .0.6235.
0048: 31 31 20 61 74 20 6f 66 11 at of
0050: 66 73 65 74 20 30 30 30 fset 000
0058: 31 66 36 63 39 1f6c9

Event Type:Information
Event Source:DrWatson
Event Category:None
Event ID:4097
Date:2/13/2007
Time:5:06:30 PM
User:N/A
Computer:TRINITY
Description:
The application, C:\Program Files\Symantec\Backup Exec\RAWS\beremote.exe, generated an application error The error occurred on 02/13/2007 @ 17:06:28.124 The exception generated was c0000005 at address 01F1F6C9 (bedsmbox!GetTable)

Data:
00000: 0d 00 0a 00 0d 00 0a 00 ........
00008: 41 00 70 00 70 00 6c 00 A.p.p.l.
00010: 69 00 63 00 61 00 74 00 i.c.a.t.
00018: 69 00 6f 00 6e 00 20 00 i.o.n. .
00020: 65 00 78 00 63 00 65 00 e.x.c.e.
00028: 70 00 74 00 69 00 6f 00 p.t.i.o.
00030: 6e 00 20 00 6f 00 63 00 n. .o.c.
00038: 63 00 75 00 72 00 72 00 c.u.r.r.
and about 18,350 more lines like this

[Wes_Stewart]

Here is the dump file that was requested. Hopefully something will come out of it since I rarely have a complete legacy mailbox backup.

http://cruiseamerica.com/temp/user.zip

With 1,170 views and counting it looks like a few others are having the same problemMessage was edited by:
Wes Stewart

[Joshua_Kane]

Wes:

I am looking into this, I will get back to you in short order.

-- Joshua

[Joshua_Kane]

Wes:

I have examined the crash you sent in, and I can see where it is occuring, but I am still pin-pointing the why. I am going to have to request a few more items, and some additional information.

Can you provide me with the following

1) The beremote debug logs.
2) The bkupexec job log.

Can you answer the following question as well

1) Do all messages show up as corrupt or just some of them?
2) Are you using the administrator�s credentials and if so are they for the correct domain?

-- Joshua

[Wes_Stewart]

Joshua

I would like to give you the link to download the logs you requested privately, How can I do so?

Not all message are showing up as corrupt. We only have one domain here, but it is a NT to AD migration. So in some places it seems that CA1 works, the original NT domain and then in others hq.******.net work, tha AD domain. Yes I am using administrators credentials.

[Joshua_Kane]

Can you link them like you did last time?