Forum Discussion

WarrenZ's avatar
WarrenZ
Level 2
11 years ago

5220 Backup performance

Hello,

 

My setup as follows:-

 

Master Server

5220 Appliance / Version 2.5.2 / NetBackup Version 7.5.0.5 / 2 x 10Gb/s Bond

Client Server

Solaris 10 SPARC Server / 7.5.0.5 NetBackup Client / 10GbE network

Data that is being backup up ( Oracle / SAP database files. Typically 10GB is size per file )

 

The performance that I achieve for my backups is not very good. For one particular backup, I typically kick off 10x backup streams, on average 15000 KB/s per stream. That equates to approx 2.5 hours to backup around 1 TB of data.

On another NetBackup environment, I backup the same data to a SL3000 library in approx 20-30 mins

 

I have noticed that the 5220 job reports the following:-

06/18/2014 21:00:50 - Info bptm (pid=14000) waited for full buffer 250973 times, delayed 262027 times

 

 

Is there any tuning that I can do on the 5220 appliance to get these buffers vaules down ?

 

Any advice on tuning will be appreciated.

 

Thanks

Warren

 

 

 

 

 

 

 

 

 

 

9 Replies

  • Hi Warren,

     

    Hope you're doing well. What are the buffer settings on the appliance? The waits are very high.

     

    Have you copied (ftp not scp as learnt) form the client to the appliance. What speed do you get on a data file.

     

    Please post the result.

  • Hello Riaan,

     

    I am waiting for my security team to open the firewall for FTP test. I will revert with that when I have access. I thought these settings are "tape" related


    qgntnbu03.Settings> NetBackup DataBuffers Number show
    NUMBER_DATA_BUFFERS                               : 30 (Default)
    NUMBER_DATA_BUFFERS_DISK                     : 30 (Default)
    NUMBER_DATA_BUFFERS_FT                         : 16 (Default)
    NUMBER_DATA_BUFFERS_RESTORE            : 30 (Default)

    qgntnbu03.Settings> NetBackup DataBuffers Size show
    SIZE_DATA_BUFFERS                                 : 262144 (Default)
    SIZE_DATA_BUFFERS_DISK                       : 262144 (Default)
    SIZE_DATA_BUFFERS_FT                           : 262144 (Default)
     

    Thanks

    Warren

     

     

  • Hi Riaan,

     

    I am waiting for the firewall guys to open FTP for me to run that test.

    I will revert back with the results when I have access.

    I thought these setting are "tape" related;-


    qgntnbu03.Settings> NetBackup DataBuffers Number show
    NUMBER_DATA_BUFFERS                               : 30 (Default)
    NUMBER_DATA_BUFFERS_DISK                     : 30 (Default)
    NUMBER_DATA_BUFFERS_FT                         : 16 (Default)
    NUMBER_DATA_BUFFERS_RESTORE            : 30 (Default)

    qgntnbu03.Settings> NetBackup DataBuffers Size show
    SIZE_DATA_BUFFERS                                 : 262144 (Default)
    SIZE_DATA_BUFFERS_DISK                       : 262144 (Default)
    SIZE_DATA_BUFFERS_FT                           : 262144 (Default)
     

    Thanks

    Warren

     

  • You can use GEN_DATA file directive to performance test the Netbackup installation.

    GEN_DATA file directive will generate random data streams in memory and is really one of Netbackup hidden gems. 

    I suggest you take a look at this technote:

    http://www.symantec.com/docs/TECH75213

     

  • Hi Warren,

     

    Those defaults should be sufficient. The fact that the wait was so high would indicate to me that the data is arriving to slowly across the network.

     

    Why are you going through a firewall? What is the speed of the ports on that?

     

     

  • Are you doing client-side dedupe or relying on media server dedupe only?

    Have you had a look at changes that should be made to backup scripts the moment you backup Oracle to dedupe storage?

    Two examples:
    compression on Oracle/rman side should not be done.
    Filesperset should be changed to 1 with increased amount of channels.

    The next change to look at is upgrade to 2.6.0.x. 

    Major performance enhancements has been made to MSDP in NBU 7.6 and appliance 2.6.

  • For tape backup you should increase NUMBER_DATA_BUFFERS to 256.

    As Riiaan has already mentioned I think the problem is at firewall.

    What type of firwall is installed - manafacture and model ?

  • Hi Warren,

    As part of the trroubleshooting you ran test backups of flat files to both the appliance advanced disk, and dedupe disk. Both resulted in a speed of around 20MBps. You then proceeded to check the network by running FTP transfers between the client and the media server.

    You discovered some funnies on the network.

    Please let us know if the issue is resolved.