02-05-2014 02:36 PM
Hi All,
Offline catalog backup is continously failing since 31st Jan in our netbackup environment, below is error which we are receiveing at the end of catalog backup. Please advice.
02-05-2014 02:51 PM
What version of NetBackup are you running?
TECH49110 talks about this error being caused by a lock file in place. STREAMS.lck files are to do with the NetBackup's stream discovery process - for multiple streams backups (and some other type of backups, too) NetBackup will initiate stream discovery process, and the lock file would be created. While this was for version 5 it might still apply
02-05-2014 02:51 PM
offline catalog backup!! That implies you are still on NetBackup 6.x - please upgrade as soon as possible it has been end of life for some time!
As for you error you need to confirm that the path \\server\Apps\veritascatalog is actually accessible using the account specified in the offline catalog backup settings (right click on the Catalog in th Admin Console and select configure catalog backup - or similar, it has been a while since I did an offline catalog backup!)
Hope this helps
02-05-2014 03:35 PM
hi Mark,
path is accessible from master/media server, i've make sure the nb services are using the domain account which have access to the path. but still this error. it was working fine till 31st Jan. suddenly this problem started. not sure what happened. is there a way to find it out? Configure Netbackup catalog screenshot attached.
02-05-2014 03:39 PM
hi
nb version is 6.0, i know it's older we have plan to upgrade it soon...yes i can find the streams.lck file in the path you mentioned, i have went throught the article earlier but i couldn't follow the below step.. i am not sure what 3rd pathy tool they mention here and how to remove the lock on the file.
Customer might use a third-party utility to find which process/application is holding the file handle, and remove the lock on the file to delete it and run a successful catalog backup.
02-05-2014 03:40 PM
What happens if you goto the path on the master and try and write into it using OS commands?
02-05-2014 04:36 PM
attached the screenshot, where it write the image on the path and then it fails.. so not sure why it's failing.
02-05-2014 11:22 PM
02-06-2014 01:06 AM
Also check the amount of disk space on that location
I can see files being writtent there so it works to a certain point before failing - perhaps that location is just almost full so the catalog is too big to write it there
02-06-2014 02:55 PM
Hi Marianne,
i agree it's a older version but unfortunately we couldn't upgrade it immediately, but will do it sooner or later. there are .lck file in all servers that are getting backedup. we have master/media server as same, backing up few other servers.. not sure which .lck file i should delete.
02-06-2014 03:24 PM
Mark, i can confirm space is not an issue since server have lot of free space.
02-06-2014 09:08 PM
Delete all the .lck files in the folder for the master server hostname.
02-06-2014 11:15 PM
hi Marianne,
Deleted the .lck files in master/media server and triggered the offline catalog backup again. Will let you know whether it completes successfully. Thank you all for helping me out with diff ideas!
02-07-2014 01:13 AM
Just noticed that the job fails after about an hour
Is the location you are backing up to behind a firewall?
It could be that the keep alive timeout on the firewall (or you operating system) is hitting its 1 hour limit causing the backup to fail
If it is behind a firewall get your firewall admin to increase the keep alive timeout for you
What O/S is your Master Server?
02-08-2014 06:27 PM
.lck file deletion didn't fix the issue. is not running behind a firewall.. Master Server OS is windows server 2003 R2.
02-09-2014 08:57 PM
Is there any other suggestions on this catalog backup failure. with error: 124. Appreciate your help.
02-09-2014 09:17 PM
02-09-2014 10:11 PM
Thanks Marianne, Hot catalog backup is configured, it's getting completed with few errors. but failing the save the fails the Disaster Recovery path /sending emails.... does have access to the path. Is there any settings to check it.
02-10-2014 02:24 AM
In relation to the original error it could even be a timeout - check the Client Read timeout on the Master and Media Servers host properties - increase it to 3600
In relation to the DR file not being saved it depends where you are saving it - the path needs to be somewhere that the NetBackup client service account has access to write to - what path have you specified?
If it also has some errors what are they - is it just the path or is it more? - show us the text from the detail tabs of the three catalog backup jobs that run
02-10-2014 02:56 AM
Please ensure that you have logging enabled on the master server.
Important log folders needed to troubleshoot:
bpbkar and bpdbm
(NBU needs to be restarted to enable bpdbm log)
Please copy logs to .txt files to reflect process names (e.g. bpbkar.txt) and upload as File attachments.
MOST IMPORTANT:
UPGRADE your NBU environment to a supported version!