05-09-2013 07:03 AM
We have a policy with a client on which we have 21 file systems. It is supposed to submit 21 streams when a scheduled backup kicks in. However, we noticed that only 10 streams are being submitted following a previous failed scheduled backup. What could have gone wrong ??
05-09-2013 09:01 AM
I would suggest you check "max job per client" in the Master Server General Settings
http://www.symantec.com/docs/TECH28070
05-09-2013 12:01 PM
Please show us policy config:
bppllist <policy-name> -U
as well as STU config:
bpstulist -label <stu-name> -U
Check master server Host Properties -> Global Attributes -> Max jobs per client.
Please tell us what this setting is.
Show us backups done over the last 3 days for this client:
bpimagelist -client <client-name> -hoursago 72 -U
We should be able to pinpoint the problem with all of above info.
05-10-2013 07:41 AM
bash-3.2# ./bppllist OSS_i386_DATA_ossbkupIP_syb1bkupIP -L
Policy Name: OSS_i386_DATA_ossbkupIP_syb1bkupIP
Options: 0x0
template: FALSE
c_unused1: ?
Names: (none)
Policy Type: Standard (0)
Active: yes
Effective date: 12/31/1969 19:00:00
Client Compress: no
Follow NFS Mnts: yes
Cross Mnt Points: no
Collect TIR info: yes, with move detection
Block Incremental: no
Mult. Data Stream: yes
Perform Snapshot Backup: no
Snapshot Method: (none)
Snapshot Method Arguments: (none)
Perform Offhost Backup: no
Backup Copy: 0
Use Data Mover: no
Data Mover Type: -1
Use Alternate Client: no
Alternate Client Name: (none)
Use Virtual Machine: 0
Hyper-V Server Name: (none)
Enable Instant Recovery: no
Policy Priority: 0
Max Jobs/Policy: Unlimited
Disaster Recovery: 0
Collect BMR Info: yes
Keyword: (none specified)
Data Classification: -
Residence is Storage Lifecycle Policy: no
Client Encrypt: no
Checkpoint: no
Residence: Backup2disk
Volume Pool: OSSRC_Pool
Server Group: *ANY*
Granular Restore Info: no
Exchange Source attributes: no
Exchange 2010 Preferred Server: (none defined)
Generation: 121
Ignore Client Direct: no
Client/HW/OS/Pri: ossbkupIP Solaris Solaris_x86_10_64 0 0 0 0 ?
Client/HW/OS/Pri: syb1bkupIP Solaris Solaris_x86_10_64 0 0 0 0 ?
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/pm/pmsybdata
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/fm/fmsybdata
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/pm/pmsyblog
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/oss/sybdata
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/fm/fmsyblog
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/oss/syblog
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/sybdev/sybmaster
Include: NEW_STREAM
Include: /Backup/sybasedg/ossrc/dbdumps
Include: NEW_STREAM
Include: /Backup/ossdg/var/opt/ericsson
Include: NEW_STREAM
Include: /Backup/ossdg/ossrc/versant
Include: NEW_STREAM
Include: /Backup/ossdg/ossrc/upgrade
Include: NEW_STREAM
Include: /Backup/ombsnap/polled_data
Include: NEW_STREAM
Include: /Backup/ombsnap/outputfiles
Include: NEW_STREAM
Include: /Backup/ombsnap/pm_storage
Include: NEW_STREAM
Include: /Backup/ombsnap/segment1
Include: NEW_STREAM
Include: /Backup/ombsnap/ddc_data
Include: NEW_STREAM
Include: /Backup/ossdg/ossrc/3pp
Include: NEW_STREAM
Include: /Backup/ombsnap/pmData
Include: NEW_STREAM
Include: /Backup/ossdg/export
Include: NEW_STREAM
Include: /Backup/ombsnap/home
Include: NEW_STREAM
Include: /Backup/ombsnap/data
Schedule: Weekly_Full
Type: FULL (0)
Frequency: 7 day(s) (604800 seconds)
Maximum MPX: 2
Synthetic: 0
PFI Recovery: 0
Retention Level: 3 (1 month)
u-wind/o/d: 0 0
Incr Type: DELTA (0)
Alt Read Host: (none defined)
Max Frag Size: 0 MB
Number Copies: 1
Fail on Error: 0
Residence: (specific storage unit not required)
Volume Pool: (same as policy volume pool)
Server Group: (same as specified for policy)
Residence is Storage Lifecycle Policy: 0
Daily Windows:
Day Open Close W-Open W-Close
Sunday 000:01:00 000:01:00
Monday 000:00:00 000:00:00
Tuesday 000:00:00 000:00:00
Wednesday 000:00:00 000:00:00
Thursday 000:00:00 000:00:00
Friday 000:00:00 000:00:00
Saturday 000:01:00 023:01:00 144:01:00 167:01:00
Schedule: Daily_Incr
Type: INCR (1)
Frequency: 1 day(s) (86400 seconds)
Maximum MPX: 2
Synthetic: 0
PFI Recovery: 0
Retention Level: 3 (1 month)
u-wind/o/d: 0 0
Incr Type: DELTA (0)
Alt Read Host: (none defined)
Max Frag Size: 0 MB
Number Copies: 1
Fail on Error: 0
Residence: (specific storage unit not required)
Volume Pool: (same as policy volume pool)
Server Group: (same as specified for policy)
Residence is Storage Lifecycle Policy: 0
Daily Windows:
Day Open Close W-Open W-Close
Sunday 000:01:00 023:01:00 000:01:00 023:01:00
Monday 000:01:00 023:01:00 024:01:00 047:01:00
Tuesday 000:01:00 023:01:00 048:01:00 071:01:00
Wednesday 000:01:00 023:01:00 072:01:00 095:01:00
Thursday 008:21:00 023:01:00 104:21:00 119:01:00
Friday 000:01:00 023:01:00 120:01:00 143:01:00
Saturday 000:00:00 000:00:00
bash-3.2#
bash-3.2# /usr/openv/netbackup/bin/admincmd/bpimagelist -client ossbkupIP -hoursago 96 -U
Backed Up Expires Files KB C Sched Type Policy
---------------- ---------- -------- -------- - ------------ ------------
05/10/2013 01:57 06/10/2013 57328 2344753 N Differential OSS_i386_ROOT_ossbkupIP_syb1bkupIP
05/10/2013 01:48 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:48 06/10/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:47 06/10/2013 33433 32681 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:46 06/10/2013 157 408 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:37 06/10/2013 8064 130813 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:36 06/10/2013 0 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:36 06/10/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:36 06/10/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:35 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:33 06/10/2013 4091 3005408 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:31 06/10/2013 42 6835464 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03 06/10/2013 194797 30683601 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03 06/10/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:03 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:02 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:02 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 01:01 06/10/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 00:18 06/10/2013 382529 45218558 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 00:09 06/10/2013 7761 7916232 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/10/2013 00:09 06/10/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:56 06/09/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:55 06/09/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:55 06/09/2013 33678 34569 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 13:54 06/09/2013 312 1847608 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:59 06/09/2013 641748 164649469 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:59 06/09/2013 0 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:59 06/09/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/09/2013 08:29 06/09/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 21:19 06/08/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 18:58 06/08/2013 33634 36338 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 16:37 06/08/2013 1208 4131395 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 09:29 06/08/2013 632517 161194024 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 07:09 06/08/2013 0 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 04:49 06/08/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 02:29 06/08/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/08/2013 00:09 06/08/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:47 06/07/2013 28233 1885747 N Differential OSS_i386_ROOT_ossbkupIP_syb1bkupIP
05/07/2013 08:38 06/07/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:36 06/07/2013 4078 1880445 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:36 06/07/2013 28 40 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:09 06/07/2013 167499 25329202 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 08:08 06/07/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/07/2013 07:39 06/07/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 22:23 06/06/2013 200249 23411388 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 20:02 06/06/2013 42 6515400 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 17:18 06/06/2013 180399 29247410 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 14:58 06/06/2013 1 32 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 12:38 06/06/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
05/06/2013 10:17 06/06/2013 28233 1103889 N Differential OSS_i386_ROOT_ossbkupIP_syb1bkupIP
05/06/2013 09:39 06/06/2013 1 33 N Differential OSS_i386_DATA_ossbkupIP_syb1bkupIP
bash-3.2# /usr/openv/netbackup/bin/admincmd/bpstulist -label Backup2disk -U
Label: Backup2disk
Storage Unit Type: Disk
Storage Unit Subtype: Basic (1)
Host Connection: akr1e3ombs-bu
Concurrent Jobs: 3
On Demand Only: yes
Max MPX: 1
Path: "/data2"
Max Fragment Size: 524287 MB
Stage data: no
Block Sharing: no
High Water Mark: 98
Low Water Mark: 80
Ok On Root: no
Check master server Host Properties -> Global Attributes -> Max jobs per client. == 999
05-10-2013 11:33 AM
MPX in schedule:
Maximum MPX: 2
STU:
Concurrent Jobs: 3
Seems 2 jobs will be activated simultaneously.
The rest will be queued.
Because you have Multiple Data streams enabled and your frequency is every one day (every 24 hours), each new stream will be evaluated separately, based on when last a successful backup for this stream was started. This becomes progressive worse every day - backups are no longer submitted when backup window opens - only 24 hours after the start of previous successful backups.
We call this 'schedule creeping'.
Why the big difference in daily backup windows?
And exceptionally large open window on most days?
The current backup windows make it difficult to cater for 'schedule creeping' due to small amount of concurrent backups allowed.
You will be better off allowing more simultaneous streams in DSU and higher MPX in schedule with smaller backup window and smaller frequency. e.g. if backup window is 8 hours, make frequency every 9 hours.
This will ensure that next day's backup is attempted as close as possible to backup window start time .
Please see David Chapa's article about Frequency based schedules:
https://www-secure.symantec.com/connect/articles/netbackup-frequency-based-scheduling-1