cancel
Showing results for 
Search instead for 
Did you mean: 

Netbackup Include Lists - Regular Expressions

Shaun_Glass
Level 2

Good Day,

We are doing backups of an NFS Servers that uses ZFS as the file system. We are wanting to exclude the active filesystem and just backup the last Snapshot. The Backup kicks off just after the Snapshot is taken. I have as follows :

/usr/openv/netbackup/exclude_list

/data/export

/usr/openv/netbackup/include_list

/data/export/.zfs/snapshot/$(date +%m-%d-%Y)

Thge above does not seem to work, speaking of the Inclusions ...

Note, the snapshot is taken as follows :

zfs snapshot data/export@$(date +%m-%d-%Y)

The contents of the Snapshot location :

dr-xr-xr-x 1 root root 0 Jun 23 12:28 02-10-2015
dr-xr-xr-x 1 root root 0 Jun 23 12:28 04-01-2015
dr-xr-xr-x 1 root root 0 Jun 23 12:28 05-18-2015
dr-xr-xr-x 1 root root 0 Jun 23 12:28 06-01-2015
dr-xr-xr-x 1 root root 0 Jun 25 14:04 06-25-2015

If you could help or provide alternate it would be much appreciated.

Regards

Shaun

 

1 ACCEPTED SOLUTION

Accepted Solutions

revarooo
Level 6
Employee

Nope, but adding it to the bpstart_notify script for the shell to create it , as Marianne suggested, DOES work as I just tried it.

View solution in original post

8 REPLIES 8

Yasuhisa_Ishika
Level 6
Partner Accredited Certified

Consider following alternatives.

  • Just specify daily snapshot path in file selections of your backup policy. Update it everyday using bpplinclude command. It can be done on master server.
  • Update include_list everyday on client host.
  • Use user backup instead. Run backup using bpbackup on client host specifying backup target in its argument.

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
I am wondering if bpstart_notify may work to create the include_list. I am not sure in which order notify scripts and exlcude/include lists are processed, but possibly worth a try. Be sure to create bpbkar log with verbose level of 3 or higher to see how the files are evaluated.

Nicolai
Moderator
Moderator
Partner    VIP   

/data/export/.zfs/snapshot/$(date +%m-%d-%Y)

That will for sure not work since you got a command as part of the expression. Please take a look in the Netbackup administrator guide volume 1 page 1091 about the regular expressions supported.

http://www.symantec.com/docs/DOC6452

revarooo
Level 6
Employee

Marianne, that works as I just tried it.

bpstart_notify can create the exclude and include lists and bpbkar will honour those new lists.

 

revarooo
Level 6
Employee

Nope, but adding it to the bpstart_notify script for the shell to create it , as Marianne suggested, DOES work as I just tried it.

Shaun_Glass
Level 2

Morning All,

Thanks for the feedback ... I will try the bpstart_notify option and see if it works for us.

Regards

Shaun_Glass
Level 2

Morning Again,

Ok, partial success. Via "bpstart_notify" I can update the "include_list" by including a path to a script. However, when starting the backup, it does not backup that path in the "include_list", but, if I put that path in the policy it does.

/usr/openv/netbackup/exclude_list

/data/export

/usr/openv/netbackup/include_list

/data/export/.zfs/snapshot/06-26-2015

Some logs ...

12:02:16.373 [14426] <4> bpbkar main: real locales <LC_CTYPE=en_US.UTF-8;LC_NUMERIC=en_US.UTF-8;LC_TIME=en_US.UTF-8;LC_COLLATE=en_US.UTF-8;LC_MONETARY=C;LC_MESSAGES=en_US.UTF-8;LC_PAPER=C;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=C;LC_IDENTIFICATION=C>
12:02:16.373 [14426] <4> bpbkar main: standardized locales - mnt_lc_messages <en_US.UTF-8> mnt_lc_ctype <en_US.UTF-8> mnt_lc_time <en_US.UTF-8> mnt_lc_collate <en_US.UTF-8> mnt_lc_numeric <en_US.UTF-8>
12:02:16.374 [14426] <2> logparams: bpbkar -r 3024000 -ru root -dt 0 -to 0 -bpstart_time 1435313235 -clnt iamppnfs01.za.omlac.net -class iamppnfs01 -sched Weekly -st FULL -bpstart_to 300 -bpend_to 300 -read_to 7200 -stream_count 1 -stream_number 1 -jobgrpid 5046565 -blks_per_buffer 512 -use_otm -fso -b iamppnfs01.za.omlac.net_1435312935 -kl 4 -use_ofb
12:02:16.374 [14426] <2> bpbkar main: hole_granularity = 256.
12:02:16.376 [14426] <4> bpbkar: INF - setenv KEYWORD=NONE
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_PID=14426
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_NUMBER=1
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAM_COUNT=1
12:02:16.376 [14426] <4> bpbkar: INF - setenv STREAMS=0
12:02:16.376 [14426] <4> bpbkar: INF - setenv BPSTART_TIMEOUT=300
12:02:16.376 [14426] <4> bpbkar: INF - setenv BPEND_TIMEOUT=300
12:02:16.376 [14426] <4> bpbkar: INF - setenv RESTARTED=0
12:02:16.376 [14426] <4> bpbkar: INF - setenv BACKUPID=iamppnfs01.za.omlac.net_1435312935
12:02:16.377 [14426] <4> bpbkar: INF - setenv UNIXBACKUPTIME=1435312935
12:02:16.377 [14426] <4> bpbkar: INF - setenv BACKUPTIME=Fri Jun 26 12:02:15 2015

12:02:16.377 [14426] <4> bpbkar: INF - START bpstart_notify
12:02:16.377 [14426] <4> bpbkar: /usr/openv/netbackup/bin/bpstart_notify iamppnfs01.za.omlac.net iamppnfs01 Weekly FULL
12:02:16.397 [14426] <4> bpbkar: INF - END bpstart_notify
12:02:16.397 [14426] <4> bpbkar: INF - BACKUP START 14426
12:02:16.397 [14426] <4> bpbkar: INF - Estimate:-1 -1
12:02:16.399 [14426] <2> bpbkar add_to_filelist: starting sizeof(filelistrec) <128>
12:02:16.399 [14426] <4> bpbkar: start to backup filelist /data/export ,nb_fscp_enabled is 0
12:02:16.399 [14426] <4> bpbkar: INF - Processing /data/export
12:02:16.412 [14426] <4> is_excluded: Excluded /data/export by exclude_list entry /data/export
12:02:19.373 [14426] <4> bpbkar: end backup for filelist /data/export
12:02:19.373 [14426] <4> bpbkar: INF - Client completed sending data for backup

12:02:19.374 [14426] <4> bpbkar: INF - bpbkar exit normal
12:02:19.375 [14426] <4> bpbkar: INF - EXIT STATUS 0: the requested operation was successfully completed
12:02:19.375 [14426] <4> bpbkar: INF - setenv FINISHED=1

Regards

sdo
Moderator
Moderator
Partner    VIP    Certified

My understanding is that the 'include_list' is used to 'override' the 'exclude_list' - and is not treated as a list of paths to backup - it is a list of paths to not honour from the 'exclude_list'.  It sounds to me like you maybe (maybe) should also modify the 'selection_list' of a backup policy.

So, maybe what you need is:

1) A policy which has permanently has a 'selection_list' covering every variety of the 'structure name' of the object/path that you want to backup - i.e. a slection list which will always match whatever you use (later) in your 'include_list' on the client.

2) An 'exclude_list' on the client that is the same as the 'selection_list' of the policy - so everything is excluded.

3) An 'include_list' on the client which then re-includes the path that you want to backup.