Forum Discussion

Zailar's avatar
Zailar
Level 5
4 years ago

How to optimaly utilize if i have 20 drives in ndmp backup

Hello Expert, Directory backup selection and multistream backup
/level1a/level2a/level3a
/level1a/level2a/level3b
/level1a/level2a/level3c
/level1a/level2a/level3d
/level1a/level2a/level3e
/level1a/level2a/level3f
/level1a/level2a/level3g
/level1a/level2a/level3h

I have tries backup selection with
/level1a/level2a/level3a
/level1a/level2a/level3b
/level1a/level2a/level3c
/level1a/level2a/level3d
/level1a/level2a/level3e
/level1a/level2a/level3f
/level1a/level2a/level3g
/level1a/level2a/level3h/level4a
/level1a/level2a/level3h/level4b
/level1a/level2a/level3h/level4c
/level1a/level2a/level3h/level4d
/level1a/level2a/level3h/level4e
/level1a/level2a/level3h/level4f
/level1a/level2a/level3h/level4g
/level1a/level2a/level3h/level4h
/level1a/level2a/level3h/level4i
/level1a/level2a/level3h/level4j
/level1a/level2a/level3h/level4k
/level1a/level2a/level3h/level4l
/level1a/level2a/level3h/level4m

but sometime error code 23 (random in directory /level1a/level2a/level3h/level4m or /level1a/level2a/level3h/level4a) How to optimaly utilize if i have 20 drives in ndmp backup Or have idea for speed up baackup in ndmp?

Thank You Zainal

*** Inserted line breaks for readability...  M. ***

  • hey

    To leverage multiple drives - add to this selection list directive 

    NEW_STREAM

    as first entry, than after few streams (which should be occupying one tape driver) add yet another NEW_STREAM 

    and so on...

    Hope this help. What is that filer? Some have max of 4 concurrent jobs...

    You can read about this directive here https://www.veritas.com/support/en_US/article.100026337

    and if you will google you will find more.

    • Zailar's avatar
      Zailar
      Level 5

      Hi Quebek,

      Thank You

      For directory backup selection list bellow and attribute multistream , just only use 8 drives

      /level1a/level2a/level3a
      /level1a/level2a/level3b
      /level1a/level2a/level3c
      /level1a/level2a/level3d
      /level1a/level2a/level3e
      /level1a/level2a/level3f
      /level1a/level2a/level3g
      /level1a/level2a/level3h

      For directory backup selection list bellow and attribute multistream, use 20 drives

      but sometime error code 23 (random in directory /level1a/level2a/level3h/level4m or /level1a/level2a/level3h/level4a)

      /level1a/level2a/level3a
      /level1a/level2a/level3b
      /level1a/level2a/level3c
      /level1a/level2a/level3d
      /level1a/level2a/level3e
      /level1a/level2a/level3f
      /level1a/level2a/level3g
      /level1a/level2a/level3h/level4a
      /level1a/level2a/level3h/level4b
      /level1a/level2a/level3h/level4c
      /level1a/level2a/level3h/level4d
      /level1a/level2a/level3h/level4e
      /level1a/level2a/level3h/level4f
      /level1a/level2a/level3h/level4g
      /level1a/level2a/level3h/level4h
      /level1a/level2a/level3h/level4i
      /level1a/level2a/level3h/level4j
      /level1a/level2a/level3h/level4k
      /level1a/level2a/level3h/level4l
      /level1a/level2a/level3h/level4m

      Your suggetion mean like this?  just only use 4 drives

      NEW_STREAM
      /level1a/level2a/level3a
      /level1a/level2a/level3b
      NEW_STREAM
      /level1a/level2a/level3c
      /level1a/level2a/level3d
      NEW_STREAM
      /level1a/level2a/level3e
      /level1a/level2a/level3f
      NEW_STREAM
      /level1a/level2a/level3g
      /level1a/level2a/level3h

      use Isilon filers and 4 A100

      Regards

      Zainal

  • From my experience, that's a couple of years old by now. You should be careful not to start to many NDMP data streams at the same time, as the data movers internally in the filer also has a capacity. The manual for the filer should state how may data stream you can start at the same time.

    • Zailar's avatar
      Zailar
      Level 5

      Hi Nicolai,

      You are right,

      I was tried changes backup selection more than 10, for better backup result time.

      Regards

      Zainal

      • Zailar's avatar
        Zailar
        Level 5

        Hello Marianne,

        About NDMP limitations, just only backup speed.

        To the point question ,

        If backup selection list bellow and attribute multistream :

        /level1a/level2a/level3a
        /level1a/level2a/level3b
        /level1a/level2a/level3c
        /level1a/level2a/level3d
        /level1a/level2a/level3e
        /level1a/level2a/level3f
        /level1a/level2a/level3g
        /level1a/level2a/level3h

        What parameter we can use, for running backup with 20 drives?. 

        Or the backup selection must be list bellow for running backup with 20 drive:

        /level1a/level2a/level3a
        /level1a/level2a/level3b
        /level1a/level2a/level3c
        /level1a/level2a/level3d
        /level1a/level2a/level3e
        /level1a/level2a/level3f
        /level1a/level2a/level3g
        /level1a/level2a/level3h/level4a
        /level1a/level2a/level3h/level4b
        /level1a/level2a/level3h/level4c
        /level1a/level2a/level3h/level4d
        /level1a/level2a/level3h/level4e
        /level1a/level2a/level3h/level4f
        /level1a/level2a/level3h/level4g
        /level1a/level2a/level3h/level4h
        /level1a/level2a/level3h/level4i
        /level1a/level2a/level3h/level4j
        /level1a/level2a/level3h/level4k
        /level1a/level2a/level3h/level4l
        /level1a/level2a/level3h/level4m

        Regards

        Zainal