Forum Discussion

Uniken1's avatar
Uniken1
Level 4
7 years ago

Job stop every 50Gb

Hello We have Media Server Deduplication Pool for backup to disk. Now each job flow is a sequence about 15 min write first 51 200 000 Kb data and then hang for about 1,5-2 hours then write next 50G...
7.7
Windows Server 2008 R2
  • Marianne's avatar
    Marianne
    7 years ago

    Insufficient memory could very well be the cause.

    This TN is actually more accurate: https://www.veritas.com/content/support/en_US/doc/25074086-127355784-0/v25295647-127355784

    - at least 1GB RAM for each TB of dedupe storage. 
    That is over and above 8GB RAM needed for master server processes. 
    Experience has shown that 1.5 GB RAM per TB is advisable.

    The MSDP 'write' process can be followed in bptm log. 
    Level 3 logs should be sufficient.

     

RamNagalla's avatar
RamNagalla
Moderator
7 years ago

11/22/2017 13:57:56 - Info bptm (pid=11776) waited for full buffer 25123 times, delayed 139028 times

Delayed 139028 times, as per default values it is around 34 min,  since bptm is waiting for full buffer, client is not sending the data fast enough to Media server.

it might be because of the buffer settings or network speed issues..

what are the values in 

SIZE_DATA_BUFFERS
NUMBER_DATA_BUFFERS

Have you tested the network speed between the media server and clients?

How many paraller jobs are running same time to disk pool?

Have you checked the performance with less jobs sending the MSDP?

  • Uniken1's avatar
    Uniken1
    Level 4
    7 years ago

    This status log of catalog backup.
    This is same server with local disk drives: master (catalog), media(deduplication pool)

    NUMBER_DATA_BUFFERS 1024
    SIZE_DATA_BUFFERS 131072

    >>How many paraller jobs are running same time to disk pool?
    Different. Sometimes many sometimes not.
    Now it 6 jobs. As you can see on screenshot, jobs are multiple by 50Gb

     

     

     

     

     

     

    • Marianne's avatar
      Marianne
      Level 6
      7 years ago
      Have you checked the NBU Dedupe Guide for server and disk resource requirements?
      • Uniken1's avatar
        Uniken1
        Level 4
        7 years ago

        I read NetBackup™ Deduplication Guide Release 7.7

        RAM requirements
        4 GBs for 4 TBs of storage up to 32 GBs for 64 TBs of storage.

        Now Storage has grown to 64Tb, and RAM is 24Gb.
        I will try increase to 48Gb.

        Is lack of memory can cause such behavior?
        Deduplication pool database placed on SSD storage, and as I see it load very small.