Highlighted

Netbackup Include Lists - Regular Expressions

Good Day,

We are doing backups of an NFS Servers that uses ZFS as the file system. We are wanting to exclude the active filesystem and just backup the last Snapshot. The Backup kicks off just after the Snapshot is taken. I have as follows :

/usr/openv/netbackup/exclude_list

/data/export

/usr/openv/netbackup/include_list

/data/export/.zfs/snapshot/$(date +%m-%d-%Y)

Thge above does not seem to work, speaking of the Inclusions ...

Note, the snapshot is taken as follows :

zfs snapshot data/export@$(date +%m-%d-%Y)

The contents of the Snapshot location :

dr-xr-xr-x 1 root root 0 Jun 23 12:28 02-10-2015
dr-xr-xr-x 1 root root 0 Jun 23 12:28 04-01-2015
dr-xr-xr-x 1 root root 0 Jun 23 12:28 05-18-2015
dr-xr-xr-x 1 root root 0 Jun 23 12:28 06-01-2015
dr-xr-xr-x 1 root root 0 Jun 25 14:04 06-25-2015

If you could help or provide alternate it would be much appreciated.

Regards

Shaun

 

1 Solution

Accepted Solutions
Highlighted
Accepted Solution!

Nope, but adding it to the

Nope, but adding it to the bpstart_notify script for the shell to create it , as Marianne suggested, DOES work as I just tried it.

View solution in original post

8 Replies
Highlighted

Consider following

Consider following alternatives.

  • Just specify daily snapshot path in file selections of your backup policy. Update it everyday using bpplinclude command. It can be done on master server.
  • Update include_list everyday on client host.
  • Use user backup instead. Run backup using bpbackup on client host specifying backup target in its argument.
Highlighted

I am wondering if

I am wondering if bpstart_notify may work to create the include_list. I am not sure in which order notify scripts and exlcude/include lists are processed, but possibly worth a try. Be sure to create bpbkar log with verbose level of 3 or higher to see how the files are evaluated.
Highlighted

/data/export/.zfs/snapshot/$(

/data/export/.zfs/snapshot/$(date +%m-%d-%Y)

That will for sure not work since you got a command as part of the expression. Please take a look in the Netbackup administrator guide volume 1 page 1091 about the regular expressions supported.

http://www.symantec.com/docs/DOC6452

Highlighted

Marianne, that works as I

Marianne, that works as I just tried it.

bpstart_notify can create the exclude and include lists and bpbkar will honour those new lists.

 

Highlighted
Accepted Solution!

Nope, but adding it to the

Nope, but adding it to the bpstart_notify script for the shell to create it , as Marianne suggested, DOES work as I just tried it.

View solution in original post

Highlighted

Morning All, Thanks for the

Morning All,

Thanks for the feedback ... I will try the bpstart_notify option and see if it works for us.

Regards

Highlighted

Morning Again, Ok, partial

Morning Again,

Ok, partial success. Via "bpstart_notify" I can update the "include_list" by including a path to a script. However, when starting the backup, it does not backup that path in the "include_list", but, if I put that path in the policy it does.

/usr/openv/netbackup/exclude_list

/data/export

/usr/openv/netbackup/include_list

/data/export/.zfs/snapshot/06-26-2015

Some logs ...

12:02:16.373 [14426] <4> bpbkar main: real locales <LC_CTYPE=en_US.UTF-8;LC_NUMERIC=en_US.UTF-8;LC_TIME=en_US.UTF-8;LC_COLLATE=en_US.UTF-8;LC_MONETARY=C;LC_MESSAGES=en_US.UTF-8;LC_PAPER=C;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=C;LC_IDENTIFICATION=C>
12:02:16.373 [14426] <4> bpbkar main: standardized locales - mnt_lc_messages <en_US.UTF-8> mnt_lc_ctype <en_US.UTF-8> mnt_lc_time <en_US.UTF-8> mnt_lc_collate <en_US.UTF-8> mnt_lc_numeric <en_US.UTF-8>
12:02:16.374 [14426] <2> logparams: bpbkar -r 3024000 -ru root -dt 0 -to 0 -bpstart_time 1435313235 -clnt iamppnfs01.za.omlac.net -class iamppnfs01 -sched Weekly -st FULL -bpstart_to 300 -bpend_to 300 -read_to 7200 -stream_count 1 -stream_number 1 -jobgrpid 5046565 -blks_per_buffer 512 -use_otm -fso -b iamppnfs01.za.omlac.net_1435312935 -kl 4 -use_ofb
12:02:16.374 [14426] <2> bpbkar main: hole_granularity = 256.
12:02:16.376 [14426] <4> bpbkar: INF - setenv KEYWORD=NONE
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_PID=14426
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_NUMBER=1
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_COUNT=1
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAMS=0
12:02:16.376 [14426] <4> bpbkar: INF - setenv BPSTART_TIMEOUT=300
12:02:16.376 [14426] <4> bpbkar: INF - setenv BPEND_TIMEOUT=300
12:02:16.376 [14426] <4> bpbkar: INF - setenv RESTARTED=0
12:02:16.376 [14426] <4> bpbkar: INF - setenv BACKUPID=iamppnfs01.za.omlac.net_1435312935
12:02:16.377 [14426] <4> bpbkar: INF - setenv UNIXBACKUPTIME=1435312935
12:02:16.377 [14426] <4> bpbkar: INF - setenv BACKUPTIME=Fri Jun 26 12:02:15 2015

12:02:16.377 [14426] <4> bpbkar: INF - START bpstart_notify
12:02:16.377 [14426] <4> bpbkar: /usr/openv/netbackup/bin/bpstart_notify iamppnfs01.za.omlac.net iamppnfs01 Weekly FULL
12:02:16.397 [14426] <4> bpbkar: INF - END bpstart_notify
12:02:16.397 [14426] <4> bpbkar: INF - BACKUP START 14426
12:02:16.397 [14426] <4> bpbkar: INF - Estimate:-1 -1
12:02:16.399 [14426] <2> bpbkar add_to_filelist: starting sizeof(filelistrec) <128>
12:02:16.399 [14426] <4> bpbkar: start to backup filelist /data/export ,nb_fscp_enabled is 0
12:02:16.399 [14426] <4> bpbkar: INF - Processing /data/export
12:02:16.412 [14426] <4> is_excluded: Excluded /data/export by exclude_list entry /data/export
12:02:19.373 [14426] <4> bpbkar: end backup for filelist /data/export
12:02:19.373 [14426] <4> bpbkar: INF - Client completed sending data for backup

12:02:19.374 [14426] <4> bpbkar: INF - bpbkar exit normal
12:02:19.375 [14426] <4> bpbkar: INF - EXIT STATUS 0: the requested operation was successfully completed
12:02:19.375 [14426] <4> bpbkar: INF - setenv FINISHED=1

Regards

Highlighted

My understanding is that the

My understanding is that the 'include_list' is used to 'override' the 'exclude_list' - and is not treated as a list of paths to backup - it is a list of paths to not honour from the 'exclude_list'.  It sounds to me like you maybe (maybe) should also modify the 'selection_list' of a backup policy.

So, maybe what you need is:

1) A policy which has permanently has a 'selection_list' covering every variety of the 'structure name' of the object/path that you want to backup - i.e. a slection list which will always match whatever you use (later) in your 'include_list' on the client.

2) An 'exclude_list' on the client that is the same as the 'selection_list' of the policy - so everything is excluded.

3) An 'include_list' on the client which then re-includes the path that you want to backup.