cancel
Showing results for 
Search instead for 
Did you mean: 

Restore error 2850 and tar status code 5

BharathAchar
Level 4


Aug 20, 2020 11:21:28 AM - begin Restore
Aug 20, 2020 11:21:29 AM - Info bprd (pid=54413) Found (13,176,043) files in (83) images for Restore Job ID 11202933.xxx
Aug 20, 2020 11:21:55 AM - number of images required: 1
Aug 20, 2020 11:21:55 AM - media needed: 6N3681
Aug 20, 2020 11:21:55 AM - media needed: 6NE659
Aug 20, 2020 11:21:55 AM - media needed: 6NC931
Aug 20, 2020 11:22:27 AM - restoring from image ba5lsbk0204.iind.company.com_1579577042
Aug 20, 2020 11:22:27 AM - Info bpbrm (pid=57413) ba5lsbk0202.iind.company.com is the host to restore to
Aug 20, 2020 11:22:27 AM - Info bpbrm (pid=57413) telling media manager to start restore on client
Aug 20, 2020 11:22:27 AM - Info bpbrm (pid=57413) spawning a brm child process
Aug 20, 2020 11:22:27 AM - Info bpbrm (pid=57413) child pid: 57448
Aug 20, 2020 11:22:27 AM - connecting
Aug 20, 2020 11:22:28 AM - Info bpbrm (pid=57448) start tar on client
Aug 20, 2020 11:22:28 AM - Info tar (pid=57453) Restore started.
Aug 20, 2020 11:22:28 AM - connected; connect time: 0:00:00
Aug 20, 2020 11:22:28 AM - requesting resource  6NE659
Aug 20, 2020 11:22:31 AM - Info bptm (pid=57434) Waiting for mount of media id 6NE659 (copy 1) on server ba5lsbk0202.iind.company.com.
Aug 20, 2020 11:22:31 AM - started process bptm (pid=57434)
Aug 20, 2020 11:22:31 AM - mounting 6NE659
Aug 20, 2020 11:22:31 AM - granted resource  6NE659
Aug 20, 2020 11:22:31 AM - granted resource  HP.ULTRIUM6-SCSI.003
Aug 20, 2020 11:22:32 AM - Info bptm (pid=57434) INF - Waiting for mount of media id 6NE659 on server ba5lsbk0202.iind.company.com for reading.
Aug 20, 2020 11:23:39 AM - mounted 6NE659; mount time: 0:01:08
Aug 20, 2020 11:23:39 AM - Info bptm (pid=57434) 6NE659
Aug 20, 2020 11:23:39 AM - Info bptm (pid=57434) INF - Waiting for positioning of media id 6NE659 on server ba5lsbk0202.iind.company.com for reading.
Aug 20, 2020 11:23:39 AM - positioning 6NE659 to file 7
Aug 20, 2020 11:25:32 AM - positioned 6NE659; position time: 0:01:53
Aug 20, 2020 11:25:32 AM - begin reading
Aug 20, 2020 11:27:11 AM - Info tar (pid=57453) done. status: 0
Aug 20, 2020 11:27:11 AM - end reading; read time: 0:01:39
Aug 20, 2020 11:27:11 AM - Info bpbrm (pid=57413) media manager for backup id ba5lsbk0204.iind.company.com_1579577042 exited with status 0: the requested operation was successfully completed
Aug 20, 2020 11:27:11 AM - Info tar (pid=57453) done. status: 5 - the restore failed to recover the requested files
Aug 20, 2020 11:27:12 AM - restored from image ba5lsbk0204.iind.company.com_1579577042; restore time: 0:04:45
Aug 20, 2020 11:27:12 AM - Warning bprd (pid=54413) Restore must be resumed prior to first image expiration on Wed 20 Jan 2021 08:54:02 AM IST
Aug 20, 2020 11:27:12 AM - end Restore; elapsed time 0:05:44
Restore error  (2850)

15 REPLIES 15

lnw
Level 3
Partner Accredited

Hi,

Which restore type that you tried to restore?
- file level, database, VMware or etc

Same location or redirect restore?

Show me the destination location?

Netbackup version master/media and client?

OS and version of NetBackup master/media and client?

Thank you.

 

running with command line option, because I wanted to run it on a specific media server -

its a standard restore and restoring to nfs path, same client client has acccess to destination nfs path.


ba5lsbk0200> cat /tmp/changefile4
change "/nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori" to "/nfs/iind/disks/cmode_restore/TASK9464695_acharbha_restore"

/usr/openv/netbackup/bin/bprestore -B -L /tmp/progress_log4 -C ba5lsbk0204.iind.company.com -D ba5lsbk0204.iind.company.com -S ba5lsbk0200.iind.company.com -disk_media_server ba5lsbk0202.iind.company.com -t 0 -p incfsv07a_aggr1_incfs07n03b_H_iind_disks_sdg74_0523 -s 01/21/20 08:50:00 -e 01/22/20 17:40:00 -R /tmp/changefile4 "/nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori"

/tmp/progress_log4 - shows it is writing but is not writing the data on desination and not even creating the destination path provided in /tmp/changefile4

 

restore.png

lnw
Level 3
Partner Accredited

@BharathAchar 

Not sure you found this KB or not, if not please recheck the -f and listfile options as shown below,

For different client:
bprestore -B -L progress_log -C source_client -D destination_client -R rename_file -f listfile

Option Variables:

progress_log = location of the restore progress log including file name
rename_file = full path of a text file with rename instruction
listfile = list of file to be restore

Note: For the contents of the rename file, there must be one line entry for each file or directory to be renamed, and ensure each line ends with a return, as seen below

Line 1: change original_file to new_file(return)
Line 2: (empty line)

Example:

To restore all files under D:\Projects to the same client at E:\RestoreFiles\.

1 Create the rename_file, named rename.txt, located: C:\temp\rename.txt, put the following entry in the file:

change /D/Projects to /E/RestoreFiles/
 
Note: Ensure there is a 'return' above to start a new empty line.
Create the restore listfile, named filelist.txt, located C:\temp\filelist.txt, put the following entry in the file:
/D/Projects
From the client, run the restore command:
bprestore -L /C/temp/restore.log -R /C/rename.txt-f /C/filelist.txt

https://www.veritas.com/support/en_US/article.100010417

@lnw thanks, I'm aware of the command line option and used the same command earlier for different similar restore.

problem here is Netbakcup job details shows it is writing data to as you see KB written in my attcahment.

however when we look at the destination path, its not writing & the destination path is not even creating.

 

lnw
Level 3
Partner Accredited

@BharathAchar 

One thing how about the (return)?

change original_file to new_file(return)

After the line adds a carriage return. If a carriage return is not added after the change line, the line is ignored.

So not sure we can test restore to the original location or not. just only 1 file for testing.

Thanks.

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
Please create tar log folder on destination client and set logging level to 3.
Retry the restore and upload the tar log as .txt file after failure.

job runs for 22 hours and fails so copying here the logs excerpt that's failing with permission issue.

but the question here is though we have specified a different destination location in changefile however its trying to restore to same path I guess.

ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]

 

Logs:

16:40:28.447 [64737.64737] <4> cRestoreTfi::create: INF - TAR - Restore started at 08/20/20 4:40:28 PM
16:41:28.488 [64737.64738] <2> handle_timeout: DBG - Sending keepalive to master server
16:42:28.548 [64737.64738] <2> handle_timeout: DBG - Sending keepalive to master server
16:43:28.607 [64737.64738] <2> handle_timeout: DBG - Sending keepalive to master server
16:44:28.664 [64737.64738] <2> handle_timeout: DBG - Sending keepalive to master server
16:45:28.682 [64737.64738] <2> handle_timeout: DBG - Sending keepalive to master server
16:46:17.280 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/
16:46:17.280 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori
16:46:17.347 [64737.64737] <2> cGenericUnixFS::getNbuUmask: DBG - NBU umask value: 22
16:46:17.349 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.349 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.349 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/
16:46:17.349 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT
16:46:17.350 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.350 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.350 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fivr_midd
le_right_bot_wrap/
16:46:17.350 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fi
vr_middle_right_bot_wrap
16:46:17.351 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.351 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.351 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fivr_midd
le_right_bot_wrap/cdsLibMgr.il
16:46:17.351 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fi
vr_middle_right_bot_wrap/cdsLibMgr.il
16:46:17.352 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.352 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.352 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fivr_midd
le_right_bot_wrap/xa_default_options.sp
16:46:17.352 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fi
vr_middle_right_bot_wrap/xa_default_options.sp
16:46:17.353 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.353 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.353 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fivr_midd
le_right_bot_wrap/lynx.cdsenv
16:46:17.353 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fi
vr_middle_right_bot_wrap/lynx.cdsenv
16:46:17.353 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.353 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.353 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fivr_midd
le_right_bot_wrap/vcslynx.cdsenv
16:46:17.353 [64737.64737] <2> cGenericUnixFS::prepareForRestore: DBG - Running lstat on /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fi
vr_middle_right_bot_wrap/vcslynx.cdsenv
16:46:17.354 [64737.64737] <16> cGenericUnixFS::createDirTree: ERR - Failed to create parent directory /nfs/iind/disks/sdg74_0523. [Permission denied]
16:46:17.354 [64737.64737] <2> UnpackerTAR::getData(): DBG - Complete data processed. (../UnpackerTAR.cpp:750)
16:46:17.354 [64737.64737] <63> cRestoreTfi::processObjectMetaDataAndOpen: DBG - /nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori/GFX_GT/gt_fivr_midd
--More--

here's the changefile

 

ba5lsbk0200:/tmp# cat changefile6
change "/nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori" to "/nfs/iind/disks/ec_bar_restore/TASK9464695_acharbha_restore"

 

here's the comamnd 

 

/usr/openv/netbackup/bin/bprestore -B -L /tmp/progress_log6 -C ba5lsbk0204.iind.company.com -D ba5lsbk0204.iind.company.com -S ba5lsbk0200.iind.company.com -disk_media_server ba5lsbk0202.iind.company.com -t 0 -p incfsv07a_aggr1_incfs07n03b_H_iind_disks_sdg74_0523 -s 01/21/20 08:50:00 -e 01/22/20 17:40:00 -R /tmp/changefile6 "/nfs/iind/disks/sdg74_0523/.snapshot/snapshot_for_backup_iind_disks_sdg74_0523/anemoori"

 

FYI - source path is more accesible and was deleted couple of months back and we are trying to restore from jan, 2020.

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
Can you please confirm that you have CR at the end of the changefile? My experience with command line bprestore is that restore will go to original path if there is no CR.
Please also confirm write permission of root user on destination client to restore path.

@marriane


Yes. Changefile has CR at the end.
I mean I tried just entering to next line and created the changefile and ran the restore command... But as per the logs . Isn't it trying to restore to source path instead of given destination and so showing no permission error on source path ..

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
Cmd bprestore is difficult to get right and even more difficult to troubleshoot.
All I can suggest is to try the restore from the GUI. It is possible to specify disk media server to be used.
Let us know how it goes.

RamNagalla
Moderator
Moderator
Partner    VIP    Certified

Based on the logs one thing is for sure that the resore job is not chainging the destination path, so i would like to make sure the rename file do not have any black spaces, blank lines in it first.

then see if you can make this restore work with simple path like /etc/hosts to /tmp though command line by creating new change file and not using the existing one.

this will give us the idea if the issue with chage path file or the restore process it self.

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

@BharathAchar 

Last thought:

Try the 'changefile' without using quotes.

I'm having another look at the Command Reference Guide - quotes are nowhere seen, except with keyword option.
So, probably not supported in rename syntax. 

 

Two comments / suggestions. 

  1. As @Marianne there should be no quotes in either the rename file or the restore file (if there are spaces, then use a restore file with the path length listed before the file name - not relevant in your case).
  2. The rename file is probably being ignored as it is not in a "safe" path - you either need to locate this under /usr/openv/netbackup/logs, or update BPCD_WHITELIST_PATH to include /tmp