Forum Discussion

CesarJimGon's avatar
CesarJimGon
Level 4
6 years ago

ZFS BACKUP SLOW THROUGHPUT

Hi. I have a Netbackup 7.7.3 environment with a Solaris 11 SPARC Master Server which backups an Oracle ZFS storage, besides another applications. The ZFS shares are mapped to the Master Server by N...
7.7
Solaris
  • CesarJimGon's avatar
    CesarJimGon
    6 years ago

    Thanks Marianne.

    I checked the NFS configuration in the Master Server and compared it to another Master Server with the same ZFS backup solution. I found there were missing options:

    root@uxvtbck1 # more /vfstab
    /vfstab: No such file or directory
    root@uxvtbck1 # more vfstab
    #device         device          mount           FS      fsck    mount   mount
    #to mount       to fsck         point           type    pass    at boot options
    #
    /devices        -               /devices        devfs   -       no      -
    /proc           -               /proc           proc    -       no      -
    ctfs            -               /system/contract ctfs   -       no      -
    objfs           -               /system/object  objfs   -       no      -
    sharefs         -               /etc/dfs/sharetab       sharefs -       no      -
    fd              -               /dev/fd         fd      -       no      -
    swap            -               /tmp            tmpfs   -       yes     -

    /dev/zvol/dsk/rpool/swap        -               -               swap    -       no      -
    192.168.10.50:/export/respaldo1 -       /respaldo1      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.51:/export/respaldo2 -       /respaldo2      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.50:/export/respaldo3 -       /respaldo3      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.51:/export/respaldo4 -       /respaldo4      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.50:/export/respaldo5 -       /respaldo5      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.51:/export/respaldo6 -       /respaldo6      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.50:/export/respaldo7 -       /respaldo7      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio
    192.168.10.51:/export/respaldo8 -       /respaldo8      nfs     -       yes     rw,bg,hard,nointr,rsize=1048576,wsize=1048576,proto=tcp,vers=3,forcedirectio

    The missing options were proto=tcp,vers=3,forcedirectio

    These options were added to the /etc/vfstab file of the Master Server. Before that, the ZFS mount points were unmounted. After the configuration these mount points were mounted again.

    I'm running a full backup right now. The throughput is 138 Mb/sec. The backups run faster.

Marianne's avatar
Marianne
Level 6

CesarJimGon

Have you tried to test read speed outside of NBU?

Something like :

time tar cBf  /dev/null </mountpoint>
Or instead of mountpoint, a subdirectory that is about 5 - 10GB.
Get the size before you start in order to work out read speed. 

CesarJimGon's avatar
CesarJimGon
Level 4
6 years ago

Hi Marianne.

I'm testing your suggestion, but I don't think I'm doing it right.

Checking size of test directory

du -as /usr/openv/netbackup
35739031        /usr/openv/netbackup

Read test

time tar cBf /usr/openv/netbackup
tar: Missing filenames

real    0m0.020s
user    0m0.003s
sys     0m0.008s

  • Marianne's avatar
    Marianne
    Level 6
    6 years ago
    You missed /dev/null.
    You need to specify /dev/null as backup device, meaning you are simply reading the files and not really writing to anything.
    Please choose a folder on the NFS mount.
    • CesarJimGon's avatar
      CesarJimGon
      Level 4
      6 years ago

       Hi Marianne

      I send the output

      cd /zfsbackup6
      zfsbackup6# ls -l
      total 5540
      drwxr-xr-x 7 nobody nobody 13368 Dec 6 2014 BKP_TRC
      drwxr-xr-x 14 1001 1001 14 Feb 16 2016 bkup
      drwxr-xr-x 3 1000 1001 4 May 27 2015 listeners
      -rw------- 1 nobody nobody 53687091200 Nov 19 2014 load
      drwxr-xr-x 3 1001 1001 6 Aug 31 2015 Patches
      drwxr-xr-x 2 1001 1001 2 Sep 29 2015 siebel
      drwxr-xr-x 4 1000 1001 4 May 29 2015 Traces

      /zfsbackup6# time tar cBf /dev/null/zfsbackup6/siebel
      tar: Missing filenames

      real 0m0.011s
      user 0m0.003s
      sys 0m0.008s

      df -k
      Filesystem 1024-blocks Used Available Capacity Mounted on
      rpool/ROOT/solaris 286949376 55595990 29243717 66% /
      /devices 0 0 0 0% /devices
      /dev 0 0 0 0% /dev
      ctfs 0 0 0 0% /system/contract
      proc 0 0 0 0% /proc
      mnttab 0 0 0 0% /etc/mnttab
      swap 32643296 2832 32640464 1% /system/volatile
      objfs 0 0 0 0% /system/object
      sharefs 0 0 0 0% /etc/dfs/sharetab
      fd 0 0 0 0% /dev/fd
      rpool/ROOT/solaris/var
      286949376 592731 29243717 2% /var
      swap 32824512 184048 32640464 1% /tmp
      rpool/VARSHARE 286949376 2263739 29243717 8% /var/share
      rpool/export 286949376 3496 29243717 1% /export
      rpool/export/home 286949376 32 29243717 1% /export/home
      rpool/export/home/admin
      286949376 389 29243717 1% /export/home/admin
      rpool/repo 286949376 11558600 29243717 29% /repo
      rpool 286949376 73 29243717 1% /rpool
      rpool/VARSHARE/zones 286949376 31 29243717 1% /system/zones
      rpool/VARSHARE/pkg 286949376 32 29243717 1% /var/share/pkg
      rpool/VARSHARE/pkg/repositories
      286949376 31 29243717 1% /var/share/pkg/repositories
      192.168.10.99:/export/zfsbackup6
      8933536765 1934208810 6999327955 22% /zfsbackup6

      • Marianne's avatar
        Marianne
        Level 6
        6 years ago
        You missed the space after /dev/null.

        time tar cBf /dev/null /zfsbackup6/siebel