cancel
Showing results for 
Search instead for 
Did you mean: 

Offline catalog backup fails with error 124

ramkr2020
Level 5

Hi All,

 

Offline catalog backup is continously failing since 31st Jan in our netbackup environment, below is error which we are receiveing at the end of catalog backup. Please advice. 

 

/6/2014 12:17:53 AM - begin Catalog Backup
2/6/2014 1:14:02 AM - end Catalog Backup; elapsed time: 00:56:09
NB database backup failed, a path was not found or is inaccessible(124)
2/6/2014 1:14:02 AM - Error bpbackupdb(pid=9532) Offline catalog backup to path \\server\Apps\veritascatalog FAILED      
21 REPLIES 21

SymTerry
Level 6
Employee Accredited

What version of NetBackup are you running?

TECH49110 talks about this error being caused by a lock file in place. STREAMS.lck files are to do with the NetBackup's stream discovery process - for multiple streams backups (and some other type of backups, too) NetBackup will initiate stream discovery process, and the lock file would be created. While this was for version 5 it might still apply

Do you have a STREAMSpolicy_name.lck in the netbackup/db/images/client/xxxxxxx directory?

 

Mark_Solutions
Level 6
Partner Accredited Certified

offline catalog backup!! That implies you are still on NetBackup 6.x - please upgrade as soon as possible it has been end of life for some time!

As for you error you need to confirm that the path  \\server\Apps\veritascatalog is actually accessible using the account specified in the offline catalog backup settings (right click on the Catalog in th Admin Console and select configure catalog backup - or similar, it has been a while since I did an offline catalog backup!)

Hope this helps

ramkr2020
Level 5

hi Mark,

 

path is accessible from master/media server, i've make sure the nb services are using the domain account which have access to the path. but still this error. it was working fine till 31st Jan. suddenly this problem started. not sure what happened. is there a way to find it out? Configure Netbackup catalog screenshot attached. 

ramkr2020
Level 5

hi

nb version is 6.0, i know it's older we have plan to upgrade it soon...yes i can find the streams.lck file in the path you mentioned, i have went throught the article earlier but i couldn't follow the below step.. i am not sure what 3rd pathy tool they mention here and how to remove the lock on the file. 

Customer might use a third-party utility to find which process/application is holding the file handle, and remove the lock on the file to delete it and run a successful catalog backup.

revarooo
Level 6
Employee

What happens if you goto the path on the master and try and write into it using OS commands?

ramkr2020
Level 5

attached the screenshot, where it write the image on the path and then it fails.. so not sure why it's failing. 

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
Simply delete the .lck file. PLEASE upgrade this environment ASAP. Not only has all versions of 6.x reached EOSL, it is a known fact that 6.0 was the most problematic version of NBU.

Mark_Solutions
Level 6
Partner Accredited Certified

Also check the amount of disk space on that location

I can see files being writtent there so it works to a certain point before failing - perhaps that location is just almost full so the catalog is too big to write it there

ramkr2020
Level 5

Hi Marianne,

 

i agree it's a older version but unfortunately we couldn't upgrade it immediately, but will do it sooner or later. there are .lck file in all servers that are getting backedup. we have master/media server as same, backing up few other servers.. not sure which .lck file i should delete. 

 

 

ramkr2020
Level 5

Mark, i can confirm space is not an issue since server have lot of free space. 

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

Delete all the .lck files in the folder for the master server hostname.

ramkr2020
Level 5

hi Marianne,

Deleted the .lck files in master/media server and triggered the offline catalog backup again. Will let you know whether it completes successfully. Thank you all for helping me out with diff ideas!

Mark_Solutions
Level 6
Partner Accredited Certified

Just noticed that the job fails after about an hour

Is the location you are backing up to behind a firewall?

It could be that the keep alive timeout on the firewall (or you operating system) is hitting its 1 hour limit causing the backup to fail

If it is behind a firewall get your firewall admin to increase the keep alive timeout for you

What O/S is your Master Server?

ramkr2020
Level 5

.lck file deletion didn't fix the issue. is not running behind a firewall.. Master Server OS is windows server 2003 R2. 

ramkr2020
Level 5

Is there any other suggestions on this catalog backup failure. with error: 124. Appreciate your help.

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
  1. Upgrade this environment as a matter of urgency.
  2. Backup to local storage (disk or tape)
  3. Configure Hot Catalog backup

ramkr2020
Level 5

Thanks Marianne, Hot catalog backup is configured, it's getting completed with few errors. but failing the save the fails the Disaster Recovery path /sending emails.... does have access to the path. Is there any settings to check it.

Mark_Solutions
Level 6
Partner Accredited Certified

In relation to the original error it could even be a timeout - check the Client Read timeout on the Master and Media Servers host properties - increase it to 3600

In relation to the DR file not being saved it depends where you are saving it - the path needs to be somewhere that the NetBackup client service account has access to write to - what path have you specified?

If it also has some errors what are they - is it just the path or is it more? - show us the text from the detail tabs of the three catalog backup jobs that run

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

Please ensure that you have logging enabled on the master server.

Important log folders needed to troubleshoot:
bpbkar and bpdbm
(NBU needs to be restarted to enable bpdbm log)

Please copy logs to .txt files to reflect process names (e.g. bpbkar.txt) and upload as File attachments.

MOST IMPORTANT:

UPGRADE your NBU environment to a supported version!