Forum Discussion

panthony's avatar
panthony
Level 4
9 years ago

Status 26 "client/server handshaking failed" during disk staging

Hi !

I have some duplications which fails with status 26. In fact, the DSSU policies fails, but the duplication jobs associated end with status 0. Any idea , Where can I search first ?

My master and media are in Windows 2K8 with 7.6.0.2 version.

 

08/09/2015 04:00:00 - Info nbjm(pid=4640) starting backup job (jobid=981620) for client vsaus113.proton.intra.irsn.fr, policy __DSSU_POLICY_Storage_Unit_Vsaus113_Lun9, schedule Storage_Unit_Vsaus113_Lun9 
08/09/2015 04:00:00 - Info nbjm(pid=4640) requesting NO_STORAGE_UNIT resources from RB for backup job (jobid=981620, request id:{8536E5B8-FC1C-4DC0-B821-760489DD1F40}) 
08/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
08/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
08/09/2015 04:00:01 - granted resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
08/09/2015 04:00:01 - granted resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
08/09/2015 04:00:09 - estimated 0 Kbytes needed
08/09/2015 04:00:09 - begin Parent Job
08/09/2015 04:00:09 - begin Disk Staging, Start Notify Script
08/09/2015 04:00:10 - Info RUNCMD(pid=6136) started           
08/09/2015 04:00:10 - Info RUNCMD(pid=6136) exiting with status: 0        
Status 0
08/09/2015 04:00:10 - end Disk Staging, Start Notify Script; elapsed time: 0:00:01
08/09/2015 04:00:10 - begin Disk Staging, Execute Script
08/09/2015 04:00:11 - started process bpbrm (18656)
Status 26
08/09/2015 06:00:22 - end Disk Staging, Execute Script; elapsed time: 2:00:12
08/09/2015 06:00:22 - begin Disk Staging, Stop On Error
Status 0
08/09/2015 06:00:22 - end Disk Staging, Stop On Error; elapsed time: 0:00:00
08/09/2015 06:00:22 - begin Disk Staging, End Notify Script
08/09/2015 06:00:22 - Info RUNCMD(pid=21240) started           
08/09/2015 06:00:22 - Info RUNCMD(pid=21240) exiting with status: 0        
Status 0
08/09/2015 06:00:22 - end Disk Staging, End Notify Script; elapsed time: 0:00:00
Status 26
08/09/2015 06:00:22 - end Parent Job; elapsed time: 2:00:13
client/server handshaking failed(26)

 

 

Thanks

  • Apologies for the late reply....

    I'm battling to figure out what is happening here (plus battling with level 5 logs... too big... to much info that only Support understands).

    It seems that source is P:\Lun 4 on media server  vsaus113  and that destination STU is  vsaus113_vsaul113_LTO5-DRV1 on same media server. 
    Is that right?

    It seems that the process is started and then simply ends with a socket error 2 hours later:

    06:00:34.514 [18968.13732] <2> get_short_base: (1) cannot read (byte 1) from network: An existing connection was forcibly closed by the remote host. 
    06:00:34.514 [18968.13732] <2> bpduplicate: EXIT status = 23

     

    This looks like internal network connectivity between NBU processes on the media server is failing.

    A fellow Trusted Advisor managed to solve duplication issues with these settings (followed by a reboot):

    1. The paging file was set to automatic. It has been set to a fixed value 64GB (twice the physical memory) and set to use the F drive which has the most free space.
    2. Increased the number of worker threads available to Windows using the following registry keys (note that the RpcXdr\Parameters\DefaultNumberofWorkerThreads needed to be created):

    Parameter

    Value

    HKLM\SYSTEM\CurrentControlSet\Services\RpcXdr\Parameters\
    DefaultNumberofWorkerThreads

    64

    HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\
    Executive\AdditionalDelayedWorkerThreads

    16

    HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\Executive\
    AdditionalCriticalWorkerThreads

    16

    These recommendations (and more) can be found in:

    The NetBackup Backup Planning and Performance Tuning Guide, Release 7.5 and Release 7.6  
     http://www.symantec.com/docs/DOC7449 

    If this does not help, then please log a Support call with Symantec/Veritas.

     

     

10 Replies

  • Tell us more about DSSU config -
    Basic Disk and tape STU attached to same or different media servers?

    This extract from job details seems to indicate incorrect config :

    Info nbjm(pid=4640) requesting NO_STORAGE_UNIT

    I don't see tape or other STU selected for duplication? 

    Please show us STU config:

    bpstulist -L

    and staging config:

    bpschedule -L

  • Hello Marianne,

    Actually, before, the Basic Disk and the library were attached to differents media servers. But I've just heard that now, the two are attached to the same media server. Could it come from this ?

    bpstulist -L :

    Label:                vsaus113_vsaul113_LTO5-DRV2
    Storage Unit Type:    Media Manager
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Number of Drives:     2
    On Demand Only:       no
    Density:              hcart2 (14)
    Robot Type/Number:    TLD (8) / 0
    Max Fragment Size:    1048575
    Max MPX/drive:        1

    Label:                vsaus113_vsaul113_LTO5-DRV1
    Storage Unit Type:    Media Manager
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Number of Drives:     2
    On Demand Only:       no
    Density:              hcart2 (14)
    Robot Type/Number:    TLD (8) / 0
    Max Fragment Size:    1048575
    Max MPX/drive:        1

    Label:                Storage_Unit_Vsaus113_Lun1
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "M:\Lun 1"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun2
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "N:\Lun 2"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun3
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "O:\Lun 3"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun4
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "P:\Lun 4"
    Robot Type:           (not robotic)
    Max Fragment Size:    524288
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun5
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "Q:\Lun 5"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun6
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "R:\Lun 6"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun7
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "S:\Lun 7"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun8
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "T:\Lun 8"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun9
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "U:\Lun 9"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

    Label:                Storage_Unit_Vsaus113_Lun10
    Storage Unit Type:    Disk
    Media Subtype:        Basic (1)
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Concurrent Jobs:      10
    On Demand Only:       yes
    Path:                 "V:\Lun 10"
    Robot Type:           (not robotic)
    Max Fragment Size:    524287
    Max MPX:              1
    Stage data:           yes
    Block Sharing:        no
    File System Export:   no
    High Water Mark:      80
    Low Water Mark:       70
    Ok On Root:           no

     

    bpschedule -L :


    Schedule:              Storage_Unit_Vsaus113_Lun1
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV1
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      006:00:00  042:00:00   006:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     002:00:00  018:00:00   050:00:00  066:00:00 
       Wednesday   002:00:00  018:00:00   074:00:00  090:00:00 
       Thursday    002:00:00  018:00:00   098:00:00  114:00:00 
       Friday      002:00:00  018:00:00   122:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun10
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV2
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      006:00:00  042:00:00   006:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     002:00:00  018:00:00   050:00:00  066:00:00 
       Wednesday   002:00:00  018:00:00   074:00:00  090:00:00 
       Thursday    002:00:00  018:00:00   098:00:00  114:00:00 
       Friday      002:00:00  018:00:00   122:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun2
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV2
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun3
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV1
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun4
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV2
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun5
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV1
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun6
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV2
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun7
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV1
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun8
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV2
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

    Schedule:              Storage_Unit_Vsaus113_Lun9
      Type:                FULL (0)
      Frequency:           0+ day(s) (18000 seconds)
       Excluded Dates----------
          No specific exclude dates entered
          No exclude days of week entered
      Retention Level:     1 (1 month)
      u-wind/o/d:          0 0
      Incr Type:           DELTA (0)
      Alt Read Host:       (none defined)
      Max Frag Size:       0 MB
      Synthetic:           0
      Checksum Change Detection: 0
      PFI Recovery:        0
      Stage Priority:      0
      Maximum MPX:         1
      Number Copies:       1
      Fail on Error:       0
      Residence:           vsaus113_vsaul113_LTO5-DRV1
      Volume Pool:         dupli_vsaus113
      Server Group:        *ANY*
      Residence is Storage Lifecycle Policy:         0
      Schedule indexing:   0
      Daily Windows:
       Day         Open       Close       W-Open     W-Close
       Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
       Monday      000:00:00  000:00:00
       Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
       Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
       Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
       Friday      004:00:00  018:00:00   124:00:00  138:00:00 
       Saturday    000:00:00  000:00:00

     

    Sorry for the long post, but I can't attach the two files, I don't know why...

  • Why do you have 2 Media Manager STUs with exact same parameters?

    Label:                vsaus113_vsaul113_LTO5-DRV2
    Storage Unit Type:    Media Manager
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Number of Drives:     2
    On Demand Only:       no
    Density:              hcart2 (14)
    Robot Type/Number:    TLD (8) / 0
    Max Fragment Size:    1048575
    Max MPX/drive:        1

    Label:                vsaus113_vsaul113_LTO5-DRV1
    Storage Unit Type:    Media Manager
    Host Connection:      vsaus113.proton.intra.irsn.fr
    Number of Drives:     2
    On Demand Only:       no
    Density:              hcart2 (14)
    Robot Type/Number:    TLD (8) / 0
    Max Fragment Size:    1048575
    Max MPX/drive:        1

     

    The DSSU config looks fine - all attached to same media server:

    STU Label:                Storage_Unit_Vsaus113_Lun9
    Host Connection:      vsaus113.proton.intra.irsn.fr


    Label:                vsaus113_vsaul113_LTO5-DRV1
    Host Connection:      vsaus113.proton.intra.irsn.fr

    Staging:

    Storage_Unit_Vsaus113_Lun9

    vsaus113_vsaul113_LTO5-DRV1

     

    If the config looked different previously (before, the Basic Disk and the library were attached to differents media servers) - is it possible that config was changed while staging was already in progress?

    I do not have any other explanation for the error.

    If you are still seeing status 26, please ensure that there is admin log folder on the master and media server under netbackup\logs.

    After next status 26, please copy logs to .txt files (e.g. master-admin.txt and media-admin.txt) and upload as File attachments.

     

  • I don't know why there is two media manager STUs with the same parameters, I already notice this but I have to wait for the confirmation to change that...

    Yes, it is possible that there was staging when the robotic was moving.

    Ok I will see for the logs.

  • Please share Activity Monitor job details for the latest failure so that we can see what/where to look in the logs.

  • 09/09/2015 04:00:00 - Info nbjm(pid=4640) starting backup job (jobid=983106) for client vsaus113.proton.intra.irsn.fr, policy __DSSU_POLICY_Storage_Unit_Vsaus113_Lun9, schedule Storage_Unit_Vsaus113_Lun9 
    09/09/2015 04:00:00 - Info nbjm(pid=4640) requesting NO_STORAGE_UNIT resources from RB for backup job (jobid=983106, request id:{1C2C0A3F-286E-44D7-B1A0-92D9D0C176D5}) 
    09/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
    09/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
    09/09/2015 04:00:00 - granted resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
    09/09/2015 04:00:00 - granted resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
    09/09/2015 04:00:05 - estimated 0 Kbytes needed
    09/09/2015 04:00:05 - begin Parent Job
    09/09/2015 04:00:05 - begin Disk Staging, Start Notify Script
    09/09/2015 04:00:05 - Info RUNCMD(pid=20420) started           
    09/09/2015 04:00:06 - Info RUNCMD(pid=20420) exiting with status: 0        
    Status 0
    09/09/2015 04:00:06 - end Disk Staging, Start Notify Script; elapsed time: 0:00:01
    09/09/2015 04:00:06 - begin Disk Staging, Execute Script
    09/09/2015 04:00:08 - started process bpbrm (16392)
    Status 26
    09/09/2015 06:00:19 - end Disk Staging, Execute Script; elapsed time: 2:00:13
    09/09/2015 06:00:19 - begin Disk Staging, Stop On Error
    Status 0
    09/09/2015 06:00:19 - end Disk Staging, Stop On Error; elapsed time: 0:00:00
    09/09/2015 06:00:19 - begin Disk Staging, End Notify Script
    09/09/2015 06:00:20 - Info RUNCMD(pid=9072) started           
    09/09/2015 06:00:20 - Info RUNCMD(pid=9072) exiting with status: 0        
    Status 0
    09/09/2015 06:00:20 - end Disk Staging, End Notify Script; elapsed time: 0:00:01
    Status 26
    09/09/2015 06:00:20 - end Parent Job; elapsed time: 2:00:15
    client/server handshaking failed(26)

  • Apologies - no time today to look at logs...

    If this is becoming urgent, please log a Support call?

  • Apologies for the late reply....

    I'm battling to figure out what is happening here (plus battling with level 5 logs... too big... to much info that only Support understands).

    It seems that source is P:\Lun 4 on media server  vsaus113  and that destination STU is  vsaus113_vsaul113_LTO5-DRV1 on same media server. 
    Is that right?

    It seems that the process is started and then simply ends with a socket error 2 hours later:

    06:00:34.514 [18968.13732] <2> get_short_base: (1) cannot read (byte 1) from network: An existing connection was forcibly closed by the remote host. 
    06:00:34.514 [18968.13732] <2> bpduplicate: EXIT status = 23

     

    This looks like internal network connectivity between NBU processes on the media server is failing.

    A fellow Trusted Advisor managed to solve duplication issues with these settings (followed by a reboot):

    1. The paging file was set to automatic. It has been set to a fixed value 64GB (twice the physical memory) and set to use the F drive which has the most free space.
    2. Increased the number of worker threads available to Windows using the following registry keys (note that the RpcXdr\Parameters\DefaultNumberofWorkerThreads needed to be created):

    Parameter

    Value

    HKLM\SYSTEM\CurrentControlSet\Services\RpcXdr\Parameters\
    DefaultNumberofWorkerThreads

    64

    HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\
    Executive\AdditionalDelayedWorkerThreads

    16

    HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\Executive\
    AdditionalCriticalWorkerThreads

    16

    These recommendations (and more) can be found in:

    The NetBackup Backup Planning and Performance Tuning Guide, Release 7.5 and Release 7.6  
     http://www.symantec.com/docs/DOC7449 

    If this does not help, then please log a Support call with Symantec/Veritas.