cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Veritas.com
Support

Status 26 "client/server handshaking failed" during disk staging

Go to solution
panthony
Level 4
Partner

‎09-08-2015 05:39 AM

Hi !

I have some duplications which fails with status 26. In fact, the DSSU policies fails, but the duplication jobs associated end with status 0. Any idea , Where can I search first ?

My master and media are in Windows 2K8 with 7.6.0.2 version.

 

08/09/2015 04:00:00 - Info nbjm(pid=4640) starting backup job (jobid=981620) for client vsaus113.proton.intra.irsn.fr, policy __DSSU_POLICY_Storage_Unit_Vsaus113_Lun9, schedule Storage_Unit_Vsaus113_Lun9 
08/09/2015 04:00:00 - Info nbjm(pid=4640) requesting NO_STORAGE_UNIT resources from RB for backup job (jobid=981620, request id:{8536E5B8-FC1C-4DC0-B821-760489DD1F40}) 
08/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
08/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
08/09/2015 04:00:01 - granted resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
08/09/2015 04:00:01 - granted resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
08/09/2015 04:00:09 - estimated 0 Kbytes needed
08/09/2015 04:00:09 - begin Parent Job
08/09/2015 04:00:09 - begin Disk Staging, Start Notify Script
08/09/2015 04:00:10 - Info RUNCMD(pid=6136) started           
08/09/2015 04:00:10 - Info RUNCMD(pid=6136) exiting with status: 0        
Status 0
08/09/2015 04:00:10 - end Disk Staging, Start Notify Script; elapsed time: 0:00:01
08/09/2015 04:00:10 - begin Disk Staging, Execute Script
08/09/2015 04:00:11 - started process bpbrm (18656)
Status 26
08/09/2015 06:00:22 - end Disk Staging, Execute Script; elapsed time: 2:00:12
08/09/2015 06:00:22 - begin Disk Staging, Stop On Error
Status 0
08/09/2015 06:00:22 - end Disk Staging, Stop On Error; elapsed time: 0:00:00
08/09/2015 06:00:22 - begin Disk Staging, End Notify Script
08/09/2015 06:00:22 - Info RUNCMD(pid=21240) started           
08/09/2015 06:00:22 - Info RUNCMD(pid=21240) exiting with status: 0        
Status 0
08/09/2015 06:00:22 - end Disk Staging, End Notify Script; elapsed time: 0:00:00
Status 26
08/09/2015 06:00:22 - end Parent Job; elapsed time: 2:00:13
client/server handshaking failed(26)

 

 

Thanks

0 Kudos
1 ACCEPTED SOLUTION

Accepted Solutions

Go to solution
Marianne
Level 6
Partner    VIP    Accredited Certified

‎09-21-2015 07:21 AM

Apologies for the late reply....

I'm battling to figure out what is happening here (plus battling with level 5 logs... too big... to much info that only Support understands).

It seems that source is P:\Lun 4 on media server  vsaus113  and that destination STU is  vsaus113_vsaul113_LTO5-DRV1 on same media server. 
Is that right?

It seems that the process is started and then simply ends with a socket error 2 hours later:

06:00:34.514 [18968.13732] <2> get_short_base: (1) cannot read (byte 1) from network: An existing connection was forcibly closed by the remote host. 
06:00:34.514 [18968.13732] <2> bpduplicate: EXIT status = 23

 

This looks like internal network connectivity between NBU processes on the media server is failing.

A fellow Trusted Advisor managed to solve duplication issues with these settings (followed by a reboot):

  1. The paging file was set to automatic. It has been set to a fixed value 64GB (twice the physical memory) and set to use the F drive which has the most free space.
  2. Increased the number of worker threads available to Windows using the following registry keys (note that the RpcXdr\Parameters\DefaultNumberofWorkerThreads needed to be created):

Parameter

Value

HKLM\SYSTEM\CurrentControlSet\Services\RpcXdr\Parameters\
DefaultNumberofWorkerThreads

64

HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\
Executive\AdditionalDelayedWorkerThreads

16

HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\Executive\
AdditionalCriticalWorkerThreads

16

These recommendations (and more) can be found in:

The NetBackup Backup Planning and Performance Tuning Guide, Release 7.5 and Release 7.6  
 http://www.symantec.com/docs/DOC7449 

If this does not help, then please log a Support call with Symantec/Veritas.

 

 


Handy NetBackup Links

View solution in original post

0 Kudos
10 REPLIES 10

Go to solution
Marianne
Level 6
Partner    VIP    Accredited Certified

‎09-08-2015 05:56 AM

Tell us more about DSSU config -
Basic Disk and tape STU attached to same or different media servers?

This extract from job details seems to indicate incorrect config :

Info nbjm(pid=4640) requesting NO_STORAGE_UNIT

I don't see tape or other STU selected for duplication? 

Please show us STU config:

bpstulist -L

and staging config:

bpschedule -L


Handy NetBackup Links
0 Kudos

Go to solution
panthony
Level 4
Partner

‎09-08-2015 06:53 AM

Hello Marianne,

Actually, before, the Basic Disk and the library were attached to differents media servers. But I've just heard that now, the two are attached to the same media server. Could it come from this ?

bpstulist -L :

Label:                vsaus113_vsaul113_LTO5-DRV2
Storage Unit Type:    Media Manager
Host Connection:      vsaus113.proton.intra.irsn.fr
Number of Drives:     2
On Demand Only:       no
Density:              hcart2 (14)
Robot Type/Number:    TLD (8) / 0
Max Fragment Size:    1048575
Max MPX/drive:        1

Label:                vsaus113_vsaul113_LTO5-DRV1
Storage Unit Type:    Media Manager
Host Connection:      vsaus113.proton.intra.irsn.fr
Number of Drives:     2
On Demand Only:       no
Density:              hcart2 (14)
Robot Type/Number:    TLD (8) / 0
Max Fragment Size:    1048575
Max MPX/drive:        1

Label:                Storage_Unit_Vsaus113_Lun1
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "M:\Lun 1"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun2
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "N:\Lun 2"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun3
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "O:\Lun 3"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun4
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "P:\Lun 4"
Robot Type:           (not robotic)
Max Fragment Size:    524288
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun5
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "Q:\Lun 5"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun6
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "R:\Lun 6"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun7
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "S:\Lun 7"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun8
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "T:\Lun 8"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun9
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "U:\Lun 9"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

Label:                Storage_Unit_Vsaus113_Lun10
Storage Unit Type:    Disk
Media Subtype:        Basic (1)
Host Connection:      vsaus113.proton.intra.irsn.fr
Concurrent Jobs:      10
On Demand Only:       yes
Path:                 "V:\Lun 10"
Robot Type:           (not robotic)
Max Fragment Size:    524287
Max MPX:              1
Stage data:           yes
Block Sharing:        no
File System Export:   no
High Water Mark:      80
Low Water Mark:       70
Ok On Root:           no

 

bpschedule -L :


Schedule:              Storage_Unit_Vsaus113_Lun1
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV1
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      006:00:00  042:00:00   006:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     002:00:00  018:00:00   050:00:00  066:00:00 
   Wednesday   002:00:00  018:00:00   074:00:00  090:00:00 
   Thursday    002:00:00  018:00:00   098:00:00  114:00:00 
   Friday      002:00:00  018:00:00   122:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun10
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV2
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      006:00:00  042:00:00   006:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     002:00:00  018:00:00   050:00:00  066:00:00 
   Wednesday   002:00:00  018:00:00   074:00:00  090:00:00 
   Thursday    002:00:00  018:00:00   098:00:00  114:00:00 
   Friday      002:00:00  018:00:00   122:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun2
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV2
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun3
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV1
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun4
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV2
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun5
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV1
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun6
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV2
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun7
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV1
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun8
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV2
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

Schedule:              Storage_Unit_Vsaus113_Lun9
  Type:                FULL (0)
  Frequency:           0+ day(s) (18000 seconds)
   Excluded Dates----------
      No specific exclude dates entered
      No exclude days of week entered
  Retention Level:     1 (1 month)
  u-wind/o/d:          0 0
  Incr Type:           DELTA (0)
  Alt Read Host:       (none defined)
  Max Frag Size:       0 MB
  Synthetic:           0
  Checksum Change Detection: 0
  PFI Recovery:        0
  Stage Priority:      0
  Maximum MPX:         1
  Number Copies:       1
  Fail on Error:       0
  Residence:           vsaus113_vsaul113_LTO5-DRV1
  Volume Pool:         dupli_vsaus113
  Server Group:        *ANY*
  Residence is Storage Lifecycle Policy:         0
  Schedule indexing:   0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      008:00:00  042:00:00   008:00:00  042:00:00 
   Monday      000:00:00  000:00:00
   Tuesday     004:00:00  018:00:00   052:00:00  066:00:00 
   Wednesday   004:00:00  018:00:00   076:00:00  090:00:00 
   Thursday    004:00:00  018:00:00   100:00:00  114:00:00 
   Friday      004:00:00  018:00:00   124:00:00  138:00:00 
   Saturday    000:00:00  000:00:00

 

Sorry for the long post, but I can't attach the two files, I don't know why...

0 Kudos

Go to solution
Marianne
Level 6
Partner    VIP    Accredited Certified

‎09-08-2015 07:44 AM

Why do you have 2 Media Manager STUs with exact same parameters?

Label:                vsaus113_vsaul113_LTO5-DRV2
Storage Unit Type:    Media Manager
Host Connection:      vsaus113.proton.intra.irsn.fr
Number of Drives:     2
On Demand Only:       no
Density:              hcart2 (14)
Robot Type/Number:    TLD (8) / 0
Max Fragment Size:    1048575
Max MPX/drive:        1

Label:                vsaus113_vsaul113_LTO5-DRV1
Storage Unit Type:    Media Manager
Host Connection:      vsaus113.proton.intra.irsn.fr
Number of Drives:     2
On Demand Only:       no
Density:              hcart2 (14)
Robot Type/Number:    TLD (8) / 0
Max Fragment Size:    1048575
Max MPX/drive:        1

 

The DSSU config looks fine - all attached to same media server:

STU Label:                Storage_Unit_Vsaus113_Lun9
Host Connection:      vsaus113.proton.intra.irsn.fr


Label:                vsaus113_vsaul113_LTO5-DRV1
Host Connection:      vsaus113.proton.intra.irsn.fr

Staging:

Storage_Unit_Vsaus113_Lun9

vsaus113_vsaul113_LTO5-DRV1

 

If the config looked different previously (before, the Basic Disk and the library were attached to differents media servers) - is it possible that config was changed while staging was already in progress?

I do not have any other explanation for the error.

If you are still seeing status 26, please ensure that there is admin log folder on the master and media server under netbackup\logs.

After next status 26, please copy logs to .txt files (e.g. master-admin.txt and media-admin.txt) and upload as File attachments.

 


Handy NetBackup Links
0 Kudos

Go to solution
panthony
Level 4
Partner

‎09-08-2015 07:52 AM

I don't know why there is two media manager STUs with the same parameters, I already notice this but I have to wait for the confirmation to change that...

Yes, it is possible that there was staging when the robotic was moving.

Ok I will see for the logs.

0 Kudos

Go to solution
panthony
Level 4
Partner

‎09-09-2015 12:34 AM

Here is the logs

0 Kudos

Go to solution
Marianne
Level 6
Partner    VIP    Accredited Certified

‎09-09-2015 12:50 AM

Please share Activity Monitor job details for the latest failure so that we can see what/where to look in the logs.


Handy NetBackup Links
0 Kudos

Go to solution
panthony
Level 4
Partner

‎09-09-2015 01:49 AM

09/09/2015 04:00:00 - Info nbjm(pid=4640) starting backup job (jobid=983106) for client vsaus113.proton.intra.irsn.fr, policy __DSSU_POLICY_Storage_Unit_Vsaus113_Lun9, schedule Storage_Unit_Vsaus113_Lun9 
09/09/2015 04:00:00 - Info nbjm(pid=4640) requesting NO_STORAGE_UNIT resources from RB for backup job (jobid=983106, request id:{1C2C0A3F-286E-44D7-B1A0-92D9D0C176D5}) 
09/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
09/09/2015 04:00:00 - requesting resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
09/09/2015 04:00:00 - granted resource asaus111v.proton.intra.irsn.fr.NBU_CLIENT.MAXJOBS.vsaus113.proton.intra.irsn.fr
09/09/2015 04:00:00 - granted resource asaus111v.proton.intra.irsn.fr.NBU_POLICY.MAXJOBS.__DSSU_POLICY_Storage_Unit_Vsaus113_Lun9
09/09/2015 04:00:05 - estimated 0 Kbytes needed
09/09/2015 04:00:05 - begin Parent Job
09/09/2015 04:00:05 - begin Disk Staging, Start Notify Script
09/09/2015 04:00:05 - Info RUNCMD(pid=20420) started           
09/09/2015 04:00:06 - Info RUNCMD(pid=20420) exiting with status: 0        
Status 0
09/09/2015 04:00:06 - end Disk Staging, Start Notify Script; elapsed time: 0:00:01
09/09/2015 04:00:06 - begin Disk Staging, Execute Script
09/09/2015 04:00:08 - started process bpbrm (16392)
Status 26
09/09/2015 06:00:19 - end Disk Staging, Execute Script; elapsed time: 2:00:13
09/09/2015 06:00:19 - begin Disk Staging, Stop On Error
Status 0
09/09/2015 06:00:19 - end Disk Staging, Stop On Error; elapsed time: 0:00:00
09/09/2015 06:00:19 - begin Disk Staging, End Notify Script
09/09/2015 06:00:20 - Info RUNCMD(pid=9072) started           
09/09/2015 06:00:20 - Info RUNCMD(pid=9072) exiting with status: 0        
Status 0
09/09/2015 06:00:20 - end Disk Staging, End Notify Script; elapsed time: 0:00:01
Status 26
09/09/2015 06:00:20 - end Parent Job; elapsed time: 2:00:15
client/server handshaking failed(26)

0 Kudos

Go to solution
Marianne
Level 6
Partner    VIP    Accredited Certified

‎09-09-2015 06:25 AM

Apologies - no time today to look at logs...

If this is becoming urgent, please log a Support call?


Handy NetBackup Links
0 Kudos

Go to solution
panthony
Level 4
Partner

‎09-09-2015 07:05 AM

Hello Marianne,

No problems, thank you !

0 Kudos

Go to solution
Marianne
Level 6
Partner    VIP    Accredited Certified

‎09-21-2015 07:21 AM

Apologies for the late reply....

I'm battling to figure out what is happening here (plus battling with level 5 logs... too big... to much info that only Support understands).

It seems that source is P:\Lun 4 on media server  vsaus113  and that destination STU is  vsaus113_vsaul113_LTO5-DRV1 on same media server. 
Is that right?

It seems that the process is started and then simply ends with a socket error 2 hours later:

06:00:34.514 [18968.13732] <2> get_short_base: (1) cannot read (byte 1) from network: An existing connection was forcibly closed by the remote host. 
06:00:34.514 [18968.13732] <2> bpduplicate: EXIT status = 23

 

This looks like internal network connectivity between NBU processes on the media server is failing.

A fellow Trusted Advisor managed to solve duplication issues with these settings (followed by a reboot):

  1. The paging file was set to automatic. It has been set to a fixed value 64GB (twice the physical memory) and set to use the F drive which has the most free space.
  2. Increased the number of worker threads available to Windows using the following registry keys (note that the RpcXdr\Parameters\DefaultNumberofWorkerThreads needed to be created):

Parameter

Value

HKLM\SYSTEM\CurrentControlSet\Services\RpcXdr\Parameters\
DefaultNumberofWorkerThreads

64

HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\
Executive\AdditionalDelayedWorkerThreads

16

HKLM\SYSTEM\CurrentControlSet\Control\SessionManager\Executive\
AdditionalCriticalWorkerThreads

16

These recommendations (and more) can be found in:

The NetBackup Backup Planning and Performance Tuning Guide, Release 7.5 and Release 7.6  
 http://www.symantec.com/docs/DOC7449 

If this does not help, then please log a Support call with Symantec/Veritas.

 

 


Handy NetBackup Links
0 Kudos