Exchange 2010 GRT Backups Failing GRT Recovery

Question

Hi All,I have a strange issue regarding our MS Exchange backups when it comes to the Granular processing on a certain storage type.To start off we are running:NB Master:AIX 6.1 with Netbackup 7.7.2&nbsp;NB Media :3 x AIX 6.1 with Netbackup 7.7.2 (Not used for Exchange backups)3 x MS Windows 2012 R2&nbsp;with&nbsp;Netbackup 7.7.2OST Plugin&nbsp;for all media Servers is 3.1.5&nbsp;Storage Units:1 x MSDP Pure disk Volume (GRT Backups work when going here)1 x HP StoreOnce 6500 running software 3.13 and using Catalyst Stores (GRT Backups fail on this storage unit)&nbsp;To cut a long story short, we want to move the storatge unit our exchange backups go to from the MSDP to the Open Storage platform.The backup seems to fail on the GRT segment of the backup on the Open Storage, the database&nbsp;backs up&nbsp;fine.As far as i can see the compatibility lists state that our StoreOnce should be on software version 3.1 and Netbackup on 7.6 or above which we meet.The detailed Status Log when backup up to MSDB says: (No error just to reiterate)&nbsp;12/15/2016 12:47:02 - Info bpbrm (pid=7944) DB_BACKUP_STATUS is 012/15/2016 12:48:01 - Info bpbrm (pid=7944) from client server-dag-01.domain.com: TRV - Starting granular backup processing for (/Microsoft Exchange Database Availability Groups/server-dag-01\Microsoft Information Store:\server-MBX-DB2\). This may take a while...12/15/2016 12:48:04 - end writing; write time: 0:36:2912/15/2016 12:48:36 - Info bpbrm (pid=7944) from client server-dag-01.domain.com: TRV - Successfully finished granular backup processing for (/Microsoft Exchange Database Availability Groups/server-dag-01\Microsoft Information Store:\server-MBX-DB2\).12/15/2016 12:48:36 - Info bpbrm (pid=7944) from client server-dag-01.domain.com: TRV - Exchange granular database changes were backed up successfully.12/15/2016 12:48:36 - Info bptm (pid=11284) waited for full buffer 88039 times, delayed 139391 times12/15/2016 12:48:39 - Info bptm (pid=11284) EXITING with status 0 &lt;----------12/15/2016 12:48:39 - Info resnetb3 (pid=11284) StorageServer=PureDisk:mediaserver2; Report=PDDO Stats (multi-threaded stream used) for (mediaserver2): scanned: 37852441 KB, CR sent: 88611 KB, CR sent over FC: 0 KB, dedup: 99.8%, cache hits: 2209 (0.7%), rebased: 28 (0.0%)12/15/2016 12:48:40 - Info bpbrm (pid=7944) validating image for client server-dag-01.domain.com12/15/2016 12:48:41 - Info bpbkar32 (pid=45212) done. status: 0: the requested operation was successfully completedthe requested operation was successfully completed&nbsp; (0)&nbsp;But as soon as we switch over to the StoreOnce:&nbsp;12/15/2016 17:11:01 - Info bptm (pid=12956) start12/15/2016 17:47:24 - end writing; write time: 0:37:0012/15/2016 17:47:31 - Info bpbrm (pid=13832) DB_BACKUP_STATUS is 012/15/2016 17:47:50 - Info bpbrm (pid=13832) from client server-dag-01.domain.com: TRV - Starting granular backup processing for (/Microsoft Exchange Database Availability Groups/server-dag-01\Microsoft Information Store:\server-MBX-DB2\). This may take a while...12/15/2016 17:47:54 - Info bpbrm (pid=13832) from client server-dag-01.domain.com: TRV - Granular processing failed!12/15/2016 17:47:54 - Error bpbrm (pid=13832) from client server-dag-01.domain.com: ERR - Error encountered while attempting to get additional files for Microsoft Information Store:\server-MBX-DB2\Logs_1481821614\12/15/2016 17:47:54 - Error bpbrm (pid=13832) from client server-dag-01.domain.com: ERR - Exchange granular restore from this image may not work.12/15/2016 17:47:54 - Info bpbrm (pid=13832) from client server-dag-01.domain.com: TRV - Exchange granular database changes were backed up successfully.12/15/2016 17:47:56 - Info bptm (pid=4620) waited for full buffer 70906 times, delayed 126450 times12/15/2016 17:48:00 - Info bptm (pid=4620) EXITING with status 0 &lt;----------12/15/2016 17:48:00 - Info mediaserver2 (pid=4620) StorageServer=hp-StoreOnceCatalyst:STORAGEBKUPTIER3SS1; Report=scanned: 38748558336 Bytes, CR sent: 337319494 Bytes, dedup: 99.12%12/15/2016 17:48:00 - Info bpbrm (pid=13832) validating image for client server-dag-01.domain.com12/15/2016 17:48:02 - Info bpbkar32 (pid=51732) done. status: 1: the requested operation was partially successfulThe requested operation was partially successful&nbsp; (1)The only difference between these backups is the storage unit. it is the same policy with the same settings. We are just dropping the menu down and selecting a different Storage unit. To help with our investigation we have locked this test down to just 1 of our 6 media servers.Any help on this issue is greatly appreciated.Kind regards,Leth&nbsp;

lowell_palecek · Answer

Given that it works to MSDP but not to your OST plug-in, I need to see a bpbkar log at max logging levels (set both levels), and&nbsp;both nbfsd and bptm logs from the media server, also at maximum level.It's likely that all we'll learn from the bptm log is more evidence&nbsp;that points to the HP plug-in. That would need you to open coordinated support cases with Veritas and HP. Let's start with the logs and see what we find.Please clarify. In the discussion you have indicated that the GRT phase of backup has been failing. Your thread title indicates GRT recovery. Are we focusing on the backup? (Without GRT backup, there is no GRT recovery.)

lowell_palecek · Answer

This is a level 0 log, not very informative:ov_log::OVInit: GENERAL Log Level (Effective): 0ov_log::OVInit: TCP Log Level (Effective): 0OVLog: BPBKAR&nbsp; NetBackup Backup/Archive&nbsp; 7.7GA&nbsp; [Jan 11 2016]OVLog: Copyright © 1993 - 2016 Symantec Corporation, All RightWinMain: BPBKAR_VERBOSE Debug log level: Actual=0, Effective=0Here's the failure. Need&nbsp;max level log to know why:_nbfs_close_link_file(): ERR - Attempt to link files failed, error = 1006In light of this error, please also provide the nbfsd logs from both the client and the media server (especially the media server, and make sure it's at max level).If you are changing media servers, do you have NFS enabled on the new server?

leth · Answer

As it won't let me edit my post, we are running on Exchange 2010 and have a 6 node DAG configuration.

lowell_palecek · Answer

Do you have a verbose bpbkar log?

leth · Answer

Hi Lowell,Thanks for your responce.I have set the verbose level on the client to 5. I will report back with the log files after the backup has completed tomorrow.Kind regards,Leth

Forum Discussion

Exchange 2010 GRT Backups Failing GRT Recovery

9 Replies

Related Content

Backup Exec v22 and Alta Recovery Vault

Exchange 2013 DAG backup

Netbackup Catalog Recovery

where i can get Exchange Mailbox Analyzer

Exchange VM backup

Recent Discussions

command: bperror

MS-SharePoint policy restore error (2804) .

How to restore a backup

How to configure RBAC

10 years old netbackup appliance database service down, ssl certification out date