Netbackup Include Lists - Regular Expressions

Consider following alternatives.

• Just specify daily snapshot path in file selections of your backup policy. Update it everyday using bpplinclude command. It can be done on master server.
• Update include_list everyday on client host.
• Use user backup instead. Run backup using bpbackup on client host specifying backup target in its argument.

I am wondering if bpstart_notify may work to create the include_list. I am not sure in which order notify scripts and exlcude/include lists are processed, but possibly worth a try. Be sure to create bpbkar log with verbose level of 3 or higher to see how the files are evaluated.

/data/export/.zfs/snapshot/$(date +%m-%d-%Y)

That will for sure not work since you got a command as part of the expression. Please take a look in the Netbackup administrator guide volume 1 page 1091 about the regular expressions supported.

http://www.symantec.com/docs/DOC6452

Marianne, that works as I just tried it.

bpstart_notify can create the exclude and include lists and bpbkar will honour those new lists.

 

Morning All,

Thanks for the feedback ... I will try the bpstart_notify option and see if it works for us.

Regards

Morning Again,

Ok, partial success. Via "bpstart_notify" I can update the "include_list" by including a path to a script. However, when starting the backup, it does not backup that path in the "include_list", but, if I put that path in the policy it does.

/usr/openv/netbackup/exclude_list

/data/export

/usr/openv/netbackup/include_list

/data/export/.zfs/snapshot/06-26-2015

Some logs ...

12:02:16.373 [14426] <4> bpbkar main: real locales <LC_CTYPE=en_US.UTF-8;LC_NUMERIC=en_US.UTF-8;LC_TIME=en_US.UTF-8;LC_COLLATE=en_US.UTF-8;LC_MONETARY=C;LC_MESSAGES=en_US.UTF-8;LC_PAPER=C;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=C;LC_IDENTIFICATION=C>
12:02:16.373 [14426] <4> bpbkar main: standardized locales - mnt_lc_messages <en_US.UTF-8> mnt_lc_ctype <en_US.UTF-8> mnt_lc_time <en_US.UTF-8> mnt_lc_collate <en_US.UTF-8> mnt_lc_numeric <en_US.UTF-8>
12:02:16.374 [14426] <2> logparams: bpbkar -r 3024000 -ru root -dt 0 -to 0 -bpstart_time 1435313235 -clnt iamppnfs01.za.omlac.net -class iamppnfs01 -sched Weekly -st FULL -bpstart_to 300 -bpend_to 300 -read_to 7200 -stream_count 1 -stream_number 1 -jobgrpid 5046565 -blks_per_buffer 512 -use_otm -fso -b iamppnfs01.za.omlac.net_1435312935 -kl 4 -use_ofb
12:02:16.374 [14426] <2> bpbkar main: hole_granularity = 256.
12:02:16.376 [14426] <4> bpbkar: INF - setenv KEYWORD=NONE
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_PID=14426
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_NUMBER=1
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_COUNT=1
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAMS=0
12:02:16.376 [14426] <4> bpbkar: INF - setenv BPSTART_TIMEOUT=300
12:02:16.376 [14426] <4> bpbkar: INF - setenv BPEND_TIMEOUT=300
12:02:16.376 [14426] <4> bpbkar: INF - setenv RESTARTED=0
12:02:16.376 [14426] <4> bpbkar: INF - setenv BACKUPID=iamppnfs01.za.omlac.net_1435312935
12:02:16.377 [14426] <4> bpbkar: INF - setenv UNIXBACKUPTIME=1435312935
12:02:16.377 [14426] <4> bpbkar: INF - setenv BACKUPTIME=Fri Jun 26 12:02:15 2015

12:02:16.377 [14426] <4> bpbkar: INF - START bpstart_notify
12:02:16.377 [14426] <4> bpbkar: /usr/openv/netbackup/bin/bpstart_notify iamppnfs01.za.omlac.net iamppnfs01 Weekly FULL
12:02:16.397 [14426] <4> bpbkar: INF - END bpstart_notify
12:02:16.397 [14426] <4> bpbkar: INF - BACKUP START 14426
12:02:16.397 [14426] <4> bpbkar: INF - Estimate:-1 -1
12:02:16.399 [14426] <2> bpbkar add_to_filelist: starting sizeof(filelistrec) <128>
12:02:16.399 [14426] <4> bpbkar: start to backup filelist /data/export ,nb_fscp_enabled is 0
12:02:16.399 [14426] <4> bpbkar: INF - Processing /data/export
12:02:16.412 [14426] <4> is_excluded: Excluded /data/export by exclude_list entry /data/export
12:02:19.373 [14426] <4> bpbkar: end backup for filelist /data/export
12:02:19.373 [14426] <4> bpbkar: INF - Client completed sending data for backup

12:02:19.374 [14426] <4> bpbkar: INF - bpbkar exit normal
12:02:19.375 [14426] <4> bpbkar: INF - EXIT STATUS 0: the requested operation was successfully completed
12:02:19.375 [14426] <4> bpbkar: INF - setenv FINISHED=1

Regards

My understanding is that the 'include_list' is used to 'override' the 'exclude_list' - and is not treated as a list of paths to backup - it is a list of paths to not honour from the 'exclude_list'.  It sounds to me like you maybe (maybe) should also modify the 'selection_list' of a backup policy.

So, maybe what you need is:

1) A policy which has permanently has a 'selection_list' covering every variety of the 'structure name' of the object/path that you want to backup - i.e. a slection list which will always match whatever you use (later) in your 'include_list' on the client.

2) An 'exclude_list' on the client that is the same as the 'selection_list' of the policy - so everything is excluded.

3) An 'include_list' on the client which then re-includes the path that you want to backup.