09-20-2018 01:30 PM - edited 09-20-2018 02:54 PM
We normally see good performance (what I expect from nfs, 10GB connection and 6x LTO7 drives).
But currently I am at 168 hours, 108,989,304 kilobytes backed up.
I've checked network, media server, robot, and nas storage. All are opereating normally and optimally. When I try rsyncing files off I'm seeing speed I would normally expect.
But in terms of netbackup I have no idea where to even start looking to see the issue. I mean backing up at like 185KB/s seems completely ridiculous.
Thoughts?
09-21-2018 05:11 AM
There was another post recently where backup over NFS was very slow.
https://vox.veritas.com/t5/NetBackup/ZFS-BACKUP-SLOW-THROUGHPUT/td-p/854727
You will see that I suggested to use tar as a test to simulate the NBU backup process (without actually using NBU).
The OP solved the problem by changing the mount options on the master/media server.
09-21-2018 07:30 AM
Testing with tar, I get the speed I would expect. Even rsync across the nfs share.
This is def something related to Netbackup :\
09-21-2018 07:35 AM
If you feel that NBU is at fault, you should log a call with Veritas Support.
09-25-2018 12:45 AM
How fast is it if you just copy some files from the NFS share to the local file system o the media server ?
Additionally, make a small backup from the NFS share, just enough to watch it go slowly for say 10 - 15 mins - then when the backup complates, look in the Details Status of the job for the lines that look like:
bptm waited xx times, delayed yy times
09-25-2018 12:49 PM
09-27-2018 12:33 PM
I have had similar issues with backups where the total was not too outrageous, but the details were significant.
180TB is not an issue, 15,825,579 files is not an issue - BUT
If 160TB is one file, and the remaining 20TB was in 15,825,578 files that were all in one directory - you would experience this type performance.
I know my isilon support had some tools to scan directory structures looking for anomalies - it could be a single directory with tonnes of files in it...
09-28-2018 08:31 AM
You did the tar with the same backup selection as you choose in NetBackup?
Makes no sense that you get different results when using Linux's tar and NetBackup's tar.