cancel
Showing results for 
Search instead for 
Did you mean: 

Backup is being submitted for only few streams

somesh_p
Level 4

We have a policy with a client on which we have 21 file systems. It is supposed to submit 21 streams when a scheduled backup kicks in. However, we noticed that only 10 streams are being submitted following a previous failed scheduled backup. What could have gone wrong ??

4 REPLIES 4

Nicolai
Moderator
Moderator
Partner    VIP   

I would suggest you check "max job per client" in the Master Server General Settings

http://www.symantec.com/docs/TECH28070

Marianne
Level 6
Partner    VIP    Accredited Certified

Please show us policy config:
bppllist <policy-name> -U

as well as STU config:
bpstulist -label <stu-name> -U

Check master server Host  Properties -> Global Attributes -> Max jobs per client.
Please tell us what this setting is.

Show us backups done over the last 3 days for this client:
bpimagelist -client <client-name> -hoursago 72 -U

We should be able to pinpoint the problem with all of above info.

 

somesh_p
Level 4

bash-3.2# ./bppllist OSS_i386_DATA_ossbkupIP_syb1bkupIP -L

Policy Name:       OSS_i386_DATA_ossbkupIP_syb1bkupIP
Options:           0x0
template:          FALSE
c_unused1:         ?
Names:             (none)
Policy Type:       Standard (0)
Active:            yes
Effective date:    12/31/1969 19:00:00
Client Compress:   no
Follow NFS Mnts:   yes
Cross Mnt Points:  no
Collect TIR info:      yes, with move detection
Block Incremental: no
Mult. Data Stream: yes
Perform Snapshot Backup:   no
Snapshot Method:           (none)
Snapshot Method Arguments: (none)
Perform Offhost Backup:    no
Backup Copy:               0
Use Data Mover:            no
Data Mover Type:           -1
Use Alternate Client:      no
Alternate Client Name:     (none)
Use Virtual Machine:      0
Hyper-V Server Name:     (none)
Enable Instant Recovery:   no
Policy Priority:   0
Max Jobs/Policy:   Unlimited
Disaster Recovery: 0
Collect BMR Info:  yes
Keyword:           (none specified)
Data Classification:       -
Residence is Storage Lifecycle Policy:    no
Client Encrypt:    no
Checkpoint:        no
Residence:         Backup2disk
Volume Pool:       OSSRC_Pool
Server Group:      *ANY*
Granular Restore Info:  no
Exchange Source attributes:              no
Exchange 2010 Preferred Server: (none defined)
Generation:      121
Ignore Client Direct:  no
Client/HW/OS/Pri:  ossbkupIP Solaris Solaris_x86_10_64 0 0 0 0 ?
Client/HW/OS/Pri:  syb1bkupIP Solaris Solaris_x86_10_64 0 0 0 0 ?
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/pm/pmsybdata
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/fm/fmsybdata
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/pm/pmsyblog
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/oss/sybdata
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/fm/fmsyblog
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/oss/syblog
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/sybdev/sybmaster
Include:           NEW_STREAM
Include:           /Backup/sybasedg/ossrc/dbdumps
Include:           NEW_STREAM
Include:           /Backup/ossdg/var/opt/ericsson
Include:           NEW_STREAM
Include:           /Backup/ossdg/ossrc/versant
Include:           NEW_STREAM
Include:           /Backup/ossdg/ossrc/upgrade
Include:           NEW_STREAM
Include:           /Backup/ombsnap/polled_data
Include:           NEW_STREAM
Include:           /Backup/ombsnap/outputfiles
Include:           NEW_STREAM
Include:           /Backup/ombsnap/pm_storage
Include:           NEW_STREAM
Include:           /Backup/ombsnap/segment1
Include:           NEW_STREAM
Include:           /Backup/ombsnap/ddc_data
Include:           NEW_STREAM
Include:           /Backup/ossdg/ossrc/3pp
Include:           NEW_STREAM
Include:           /Backup/ombsnap/pmData
Include:           NEW_STREAM
Include:           /Backup/ossdg/export
Include:           NEW_STREAM
Include:           /Backup/ombsnap/home
Include:           NEW_STREAM
Include:           /Backup/ombsnap/data
Schedule:          Weekly_Full
  Type:            FULL (0)
  Frequency:       7 day(s) (604800 seconds)
  Maximum MPX:     2
  Synthetic:       0
  PFI Recovery:    0
  Retention Level: 3 (1 month)
  u-wind/o/d:      0 0
  Incr Type:       DELTA (0)
  Alt Read Host:   (none defined)
  Max Frag Size:   0 MB
  Number Copies:   1
  Fail on Error:   0
  Residence:       (specific storage unit not required)
  Volume Pool:     (same as policy volume pool)
  Server Group:    (same as specified for policy)
  Residence is Storage Lifecycle Policy:     0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      000:01:00  000:01:00
   Monday      000:00:00  000:00:00
   Tuesday     000:00:00  000:00:00
   Wednesday   000:00:00  000:00:00
   Thursday    000:00:00  000:00:00
   Friday      000:00:00  000:00:00
   Saturday    000:01:00  023:01:00   144:01:00  167:01:00
Schedule:          Daily_Incr
  Type:            INCR (1)
  Frequency:       1 day(s) (86400 seconds)
  Maximum MPX:     2
  Synthetic:       0
  PFI Recovery:    0
  Retention Level: 3 (1 month)
  u-wind/o/d:      0 0
  Incr Type:       DELTA (0)
  Alt Read Host:   (none defined)
  Max Frag Size:   0 MB
  Number Copies:   1
  Fail on Error:   0
  Residence:       (specific storage unit not required)
  Volume Pool:     (same as policy volume pool)
  Server Group:    (same as specified for policy)
  Residence is Storage Lifecycle Policy:     0
  Daily Windows:
   Day         Open       Close       W-Open     W-Close
   Sunday      000:01:00  023:01:00   000:01:00  023:01:00
   Monday      000:01:00  023:01:00   024:01:00  047:01:00
   Tuesday     000:01:00  023:01:00   048:01:00  071:01:00
   Wednesday   000:01:00  023:01:00   072:01:00  095:01:00
   Thursday    008:21:00  023:01:00   104:21:00  119:01:00
   Friday      000:01:00  023:01:00   120:01:00  143:01:00
   Saturday    000:00:00  000:00:00
bash-3.2#


bash-3.2# /usr/openv/netbackup/bin/admincmd/bpimagelist -client ossbkupIP -hoursago 96 -U
Backed Up         Expires       Files       KB  C  Sched Type   Policy
----------------  ---------- -------- --------  -  ------------ ------------
05/10/2013 01:57  06/10/2013    57328  2344753  N  Differential OSS_i386_ROOT_ossbkupIP_syb1bkupIP
05/10/2013 01:48  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:48  06/10/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:47  06/10/2013    33433    32681  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:46  06/10/2013      157      408  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:37  06/10/2013     8064   130813  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:36  06/10/2013        0       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:36  06/10/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:36  06/10/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:35  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:33  06/10/2013     4091  3005408  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:31  06/10/2013       42  6835464  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03  06/10/2013   194797 30683601  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03  06/10/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:02  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:02  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:01  06/10/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 00:18  06/10/2013   382529 45218558  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 00:09  06/10/2013     7761  7916232  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 00:09  06/10/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:56  06/09/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:55  06/09/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:55  06/09/2013    33678    34569  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:54  06/09/2013      312  1847608  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:59  06/09/2013   641748 164649469  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:59  06/09/2013        0       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:59  06/09/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:29  06/09/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 21:19  06/08/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 18:58  06/08/2013    33634    36338  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 16:37  06/08/2013     1208  4131395  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 09:29  06/08/2013   632517 161194024  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 07:09  06/08/2013        0       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 04:49  06/08/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 02:29  06/08/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 00:09  06/08/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:47  06/07/2013    28233  1885747  N  Differential OSS_i386_ROOT_ossbkupIP_syb1bkupIP
05/07/2013 08:38  06/07/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:36  06/07/2013     4078  1880445  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:36  06/07/2013       28       40  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:09  06/07/2013   167499 25329202  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:08  06/07/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 07:39  06/07/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 22:23  06/06/2013   200249 23411388  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 20:02  06/06/2013       42  6515400  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 17:18  06/06/2013   180399 29247410  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 14:58  06/06/2013        1       32  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 12:38  06/06/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 10:17  06/06/2013    28233  1103889  N  Differential OSS_i386_ROOT_ossbkupIP_syb1bkupIP
05/06/2013 09:39  06/06/2013        1       33  N  Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP


bash-3.2# /usr/openv/netbackup/bin/admincmd/bpstulist -label Backup2disk -U

Label:                Backup2disk
Storage Unit Type:    Disk
Storage Unit Subtype: Basic (1)
Host Connection:      akr1e3ombs-bu
Concurrent Jobs:      3
On Demand Only:       yes
Max MPX:              1
Path:                 "/data2"
Max Fragment Size:    524287 MB
Stage data:           no
Block Sharing:        no
High Water Mark:      98
Low Water Mark:       80
Ok On Root:           no

Check master server Host Properties -> Global Attributes -> Max jobs per client. == 999

Marianne
Level 6
Partner    VIP    Accredited Certified

MPX in schedule:
Maximum MPX:     2

STU: 
Concurrent Jobs:      3

Seems 2 jobs will be activated simultaneously.
The rest will be queued.
Because you have Multiple Data streams enabled and your frequency is every one day (every 24 hours), each new stream will be evaluated separately, based on when last a successful backup for this stream was started. This becomes progressive worse every day - backups are no longer submitted when backup window opens - only 24 hours after the start of previous successful backups. 
We call this 'schedule creeping'.

Why the big difference in daily backup windows?
And exceptionally large open window on most days?

The current backup windows make it difficult to cater for 'schedule creeping' due to small amount of concurrent backups allowed.
You will be better off allowing more simultaneous streams in DSU and higher MPX in schedule with smaller backup window and smaller frequency. e.g. if backup window is 8 hours, make frequency every 9 hours.
This will ensure that next day's backup is attempted as close as possible to backup window start time .

Please see David Chapa's article about Frequency based schedules:
https://www-secure.symantec.com/connect/articles/netbackup-frequency-based-scheduling-1