06-18-2014 10:11 PM
Hello,
My setup as follows:-
Master Server
5220 Appliance / Version 2.5.2 / NetBackup Version 7.5.0.5 / 2 x 10Gb/s Bond
Client Server
Solaris 10 SPARC Server / 7.5.0.5 NetBackup Client / 10GbE network
Data that is being backup up ( Oracle / SAP database files. Typically 10GB is size per file )
The performance that I achieve for my backups is not very good. For one particular backup, I typically kick off 10x backup streams, on average 15000 KB/s per stream. That equates to approx 2.5 hours to backup around 1 TB of data.
On another NetBackup environment, I backup the same data to a SL3000 library in approx 20-30 mins
I have noticed that the 5220 job reports the following:-
06/18/2014 21:00:50 - Info bptm (pid=14000) waited for full buffer 250973 times, delayed 262027 times
Is there any tuning that I can do on the 5220 appliance to get these buffers vaules down ?
Any advice on tuning will be appreciated.
Thanks
Warren
06-18-2014 10:37 PM
Hi Warren,
Hope you're doing well. What are the buffer settings on the appliance? The waits are very high.
Have you copied (ftp not scp as learnt) form the client to the appliance. What speed do you get on a data file.
Please post the result.
06-18-2014 11:46 PM
Hello Riaan,
I am waiting for my security team to open the firewall for FTP test. I will revert with that when I have access. I thought these settings are "tape" related
qgntnbu03.Settings> NetBackup DataBuffers Number show
NUMBER_DATA_BUFFERS : 30 (Default)
NUMBER_DATA_BUFFERS_DISK : 30 (Default)
NUMBER_DATA_BUFFERS_FT : 16 (Default)
NUMBER_DATA_BUFFERS_RESTORE : 30 (Default)
qgntnbu03.Settings> NetBackup DataBuffers Size show
SIZE_DATA_BUFFERS : 262144 (Default)
SIZE_DATA_BUFFERS_DISK : 262144 (Default)
SIZE_DATA_BUFFERS_FT : 262144 (Default)
Thanks
Warren
06-18-2014 11:51 PM
Hi Riaan,
I am waiting for the firewall guys to open FTP for me to run that test.
I will revert back with the results when I have access.
I thought these setting are "tape" related;-
qgntnbu03.Settings> NetBackup DataBuffers Number show
NUMBER_DATA_BUFFERS : 30 (Default)
NUMBER_DATA_BUFFERS_DISK : 30 (Default)
NUMBER_DATA_BUFFERS_FT : 16 (Default)
NUMBER_DATA_BUFFERS_RESTORE : 30 (Default)
qgntnbu03.Settings> NetBackup DataBuffers Size show
SIZE_DATA_BUFFERS : 262144 (Default)
SIZE_DATA_BUFFERS_DISK : 262144 (Default)
SIZE_DATA_BUFFERS_FT : 262144 (Default)
Thanks
Warren
06-19-2014 12:03 AM
You can use GEN_DATA file directive to performance test the Netbackup installation.
GEN_DATA file directive will generate random data streams in memory and is really one of Netbackup hidden gems.
I suggest you take a look at this technote:
http://www.symantec.com/docs/TECH75213
06-19-2014 12:12 AM
Hi Warren,
Those defaults should be sufficient. The fact that the wait was so high would indicate to me that the data is arriving to slowly across the network.
Why are you going through a firewall? What is the speed of the ports on that?
06-19-2014 01:12 AM
Are you doing client-side dedupe or relying on media server dedupe only?
Have you had a look at changes that should be made to backup scripts the moment you backup Oracle to dedupe storage?
Two examples:
compression on Oracle/rman side should not be done.
Filesperset should be changed to 1 with increased amount of channels.
The next change to look at is upgrade to 2.6.0.x.
Major performance enhancements has been made to MSDP in NBU 7.6 and appliance 2.6.
06-19-2014 01:31 AM
For tape backup you should increase NUMBER_DATA_BUFFERS to 256.
As Riiaan has already mentioned I think the problem is at firewall.
What type of firwall is installed - manafacture and model ?
06-19-2014 04:04 AM
See Symantec NetBackup 52xx Appliance Capacity Planning and Performance Tuning Guide:
http://www.symantec.com/docs/DOC6745
See the Oracle section in Chapter 6:
About implementing deduplication solution
07-01-2014 08:27 AM
Hi Warren,
As part of the trroubleshooting you ran test backups of flat files to both the appliance advanced disk, and dedupe disk. Both resulted in a speed of around 20MBps. You then proceeded to check the network by running FTP transfers between the client and the media server.
You discovered some funnies on the network.
Please let us know if the issue is resolved.