Forum Discussion

Level 5

11 years ago

customizing notification script

Dear All

Here i am creating notification script in NBU 7.5.0.4 & clients ( 7.5 .0.X -- 6.5.0.4 )

As per user requirement he need some more detailed information like start / end time file list etc. (which i can retrieve by parsing bpimagelist -l) on backup completion or abort

but i am not sure were i can i marge this logic since not aware which notification script is generating below mail

below is the notification mail

Backup on client enetdbbcp for user root by server SF440 succeeded.

Policy = BCP_D_W_M_enetdbbcp

Schedule = BCP_D_enetdbbcp

File list

---------

G:/dbbackup

How i configure

Host Properties > client > Properties > Universal setting > administrator > server send mail & i started receiving notification mail.

if any one help me out to find which notification script generate this mail so i can customized this script & append my required logic on successful exit

for more information

For eg.

bpimagelist -client enetdbbcp -hoursago 24 | grep -i Image | awk '{print $2,"\t\t",$7,"\t\t",$20}' etc ...

Thanks .

Raaavan
11 years ago
Dear m.karampasis,

1) Below script run on master server

This script is called by the NetBackup scheduler, after an individual client backup has completed

Path - /usr/openv/netbackup/bin/backup_exit_notify

My script (mail_notification.sh ) internally called in backup_exit_notify.sh & sends notification mail with some extra details

call mail_notification.sh on 71st line of backup_exit_notify.sh like given below

---------------------------------------------------------------

echo ${dateStr} "-----------------------------" >> $OUTF
echo ${dateStr} "       CLIENT: $1" >> $OUTF
echo ${dateStr} "       POLICY: $2" >> $OUTF
echo ${dateStr} "     SCHEDULE: $3" >> $OUTF
echo ${dateStr} "SCHEDULE TYPE: $4" >> $OUTF
echo ${dateStr} "       STATUS: $5" >> $OUTF
echo ${dateStr} "       STREAM: $6" >> $OUTF
echo ${dateStr} " DONE_TRYING: $7" >> $OUTF
echo ${dateStr} "PRIMARY JOBID: $8" >> $OUTF
echo ${dateStr} "-----------------------------" >> $OUTF

sh /usr/local/BKP/mail_notification.sh

# might want to mail this info to someone
#
# cat $OUTF | mail -s "NetBackup backup exit" someone_who_cares

--------------------------------------------------------------------

2) We have multiple master server & on one of the master I found different output for "/usr/openv/netbackup/bin/BACKUP_EXIT_CALLED" which I used to manipulate data
so check /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED output in your environment & use script accordingly with minor changes.below is the list i came across

Use mail_notification.sh-1.txt for output like below

# cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED
Wed Jan 29 00:08:32 IST 2014 -----------------------------
Wed Jan 29 00:08:32 IST 2014        CLIENT: FLXMIDDRMQ1
Wed Jan 29 00:08:32 IST 2014        POLICY: BCP_D_W_M_FLXMIDDRMQ1
Wed Jan 29 00:08:32 IST 2014      SCHEDULE: D_FLXMIDDRMQ1
Wed Jan 29 00:08:32 IST 2014 SCHEDULE TYPE: FULL
Wed Jan 29 00:08:32 IST 2014        STATUS: 0
Wed Jan 29 00:08:32 IST 2014        STREAM: 0
Wed Jan 29 00:08:32 IST 2014   DONE_TRYING: 1
Wed Jan 29 00:08:32 IST 2014 PRIMARY JOBID: 57382
Wed Jan 29 00:08:32 IST 2014 -----------------------------

Use mail_notification.sh-2.txt for output like below

# cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED
Wednesday 29 January 2014 12:25:54 AM IST -----------------------------
Wednesday 29 January 2014 12:25:54 AM IST        CLIENT: HBPRDMAIL3
Wednesday 29 January 2014 12:25:54 AM IST        POLICY: DAKC_Lotus_D_M_HBPRDMAIL3
Wednesday 29 January 2014 12:25:54 AM IST      SCHEDULE: D_HBPRDMAIL3
Wednesday 29 January 2014 12:25:54 AM IST SCHEDULE TYPE: FULL
Wednesday 29 January 2014 12:25:54 AM IST        STATUS: 1
Wednesday 29 January 2014 12:25:54 AM IST        STREAM: -1
Wednesday 29 January 2014 12:25:54 AM IST   DONE_TRYING: 1
Wednesday 29 January 2014 12:25:54 AM IST PRIMARY JOBID: 347855
Wednesday 29 January 2014 12:25:54 AM IST -----------------------------

[ Note - in case you found different date string as per the OS make minor changes accordingly ]

Find attached script - backup_exit_notify.sh ( eg edit existing NBU script )
            mail_notification.sh-1.txt
            mail_notification.sh-2.txt
SCRIPT.7z2 KB

15 Replies

Raaavan
Level 5
11 years ago
is the below script

#! /bin/sh
# $Header: backup_exit_notify.sh,v 1.6 2011/10/19 14:07:15 $

#bcpyrght
#***************************************************************************
#* $VRTScprght: Copyright 2013 Symantec Corporation, All Rights Reserved $ *
#***************************************************************************
#ecpyrght

#
# backup_exit_notify.sh
#
# This script is called by the NetBackup scheduler, after an individual
# client backup has completed (including media closure and image db validation.
#
# NOTE: this script will always be run in "background" mode, meaning that
#        the NetBackup scheduler will NOT wait for it's completion.
#
# This script:
#       receives 8 parameters:
#         CLIENT           - the client hostname
#         POLICY           - the policy label
#         SCHEDULE         - the schedule label
#         SCHEDULE_TYPE    - the type of schedule: FULL INCR UBAK UARC
#         STATUS           - the backup status for this job
#         STREAM           - the backup stream number for this job
#         DONE_TRYING      - 0=will retry, 1=done, will not retry.
#         PRIMARY_JOBID    - the jobid for this job
#       must be executable by the root user
#       should exit with 0 upon successful completion

OUTF=/usr/openv/netbackup/bin/BACKUP_EXIT_CALLED

# --------------------------------------------------------------------
# main script starts here
# --------------------------------------------------------------------

umask 022

dateStr=`date`
if [ "$#" -lt 8 ]
then
        echo ${dateStr} "backup_exit_notify expects at least 8 parameters: $*" >> $OUTF
        exit 1
fi

# You may want to delete the output file elsewhere in order to
# accumulate successful backup information.
# If so, comment out the following 4 lines.
if [ -s $OUTF ]
then
        /bin/rm -rf $OUTF
fi

if [ ! -f $OUTF ]
then
        touch $OUTF
fi

echo ${dateStr} "-----------------------------" >> $OUTF
echo ${dateStr} "       CLIENT: $1" >> $OUTF
echo ${dateStr} "       POLICY: $2" >> $OUTF
echo ${dateStr} "     SCHEDULE: $3" >> $OUTF
echo ${dateStr} "SCHEDULE TYPE: $4" >> $OUTF
echo ${dateStr} "       STATUS: $5" >> $OUTF
echo ${dateStr} "       STREAM: $6" >> $OUTF
echo ${dateStr} " DONE_TRYING: $7" >> $OUTF
echo ${dateStr} "PRIMARY JOBID: $8" >> $OUTF
echo ${dateStr} "-----------------------------" >> $OUTF

#
# might want to mail this info to someone
#
# cat $OUTF | mail -s "NetBackup backup exit" someone_who_cares

exit 0
Raaavan
Level 5
11 years ago
Is no one have idea about this .......??
mph999
Level 6
11 years ago
The mail sent from host properties cannot be modified. It is only menat as a very basic notification, worked/ not worked. OpsCenter is meant as the solution for more involved/ detailed scripts. It should be installed on a separate server, and the free version offers quite a range of reports. The paid version allows scripts to be written, via SQL commands, and can produce very complex eports - please note that Symantec support do not write custom scripts for OpsCenter. If you are not familiar with writing SQL commands it is quite a steep learning curve, if you have no experience in this area. You have listed above the backup_exit_notify script - this is not what is run in host proprtis > send mail etc ... This script is not supported (Symantec support don't write them for you) but can be customized by yourself to do whatever you want. For example. If you delete everything in it and add just : echo hello Copy the script to /usr/openv/netbackup/bin on the client, then when ever any backup finishes, it will run the script and 'hello' should appear on the screen, or more accurately be sent to 'standard out' on the client, which would be the clients console. In reality you would probably send the output to a file, and from there use sendmail/ mailx to email it elsewhere. This TN: http://www.symantec.com/docs/TECH73967 explains how you can modify the name of the bpend notify script so it only runs for certan policies or schedules. I think for you, just leave it with its default name so it runs each time. A number of parameters are passed to the script - eg. $1 = client $2 = policy $3 = schedule $5 = status Therefore if at the bottom of the script (or just delete everything and start blank) you did something like this (My preference is ksh shell, but you could use #!/bin/sh - should still work (bash shell) #!/usr/bin/ksh echo "Client $1 Policy $2 Schedule $3 exited with status $5" Then when the script runs (end of backup) then the line above would be printed, but the $1 / $2 etc would be substituted for the client name. You should use send mail / mailx to email out the results. Problem with this is the script is required on each client. The other option you have is to look in the GUI reports, anything is there any good for you (try running a few). If so, these can be run from the command line if you wish, or, just run them from the GUI once a day / whenever you like. or .... Write a custom script on the master that uses the info in bpimagelist to make your report. A few commands that would give outputs that might be useful bpdbjobs bpimagelist /usr/openv/netbackup/db/jobs/trylogs/.t (trylogs probaby give all the info you require, this is the same info that is in the job activity details screen for a job) To get the files backed up in a backup - bplist commmand, use the -X option for Unix time and specify the ctime of the backup id as the start and end time in the commmand - this then gives the files only made in that onee backup. This TN http://www.symantec.com/docs/TECH145113 shows how to use the bplist command (forget about bpflist) - similar to bplist but not supported. From the TN bplist -R 99 -C womble -l -k womble_disk -X -s 1291023000 -e 1291025000 -I "/" You probably want a slight mod on this. bplist -R 99 -C -l -X -s -e -I "/" -k restricts to the policy name, so you might not want this, as you specify only one backup by giving the start/ end times the same, so it is unique, as NBU can only every run one backup a second. -R tells the commnd to do down 99 levels from in this case / , providing you don't have more than this t will be fine (eg. //dir1/dir2/dir3/dir4/dir5 .... /dir99 - output would only list files to the depth of 99 directories down). M
Raaavan
Level 5
11 years ago
Really Gr8 information ..

with my moderate knowledge on shell scripting i have written below script which is giving exactly i want except file path

I call this script internally in backup_exit_notify & receiving mail as below

#########################################################################

Tue Jan 21 15:03:08 IST 2014 -----------------------------
Tue Jan 21 15:03:08 IST 2014 CLIENT: bcpnetback1
Tue Jan 21 15:03:08 IST 2014 POLICY: bcpnetback1-test
Tue Jan 21 15:03:08 IST 2014 SCHEDULE: bcpnetback1
Tue Jan 21 15:03:08 IST 2014 SCHEDULE TYPE: FULL
Tue Jan 21 15:03:08 IST 2014 STATUS: 0
Tue Jan 21 15:03:08 IST 2014 STREAM: 0
Tue Jan 21 15:03:08 IST 2014 DONE_TRYING: 1
Tue Jan 21 15:03:08 IST 2014 PRIMARY JOBID: 56378
Tue Jan 21 15:03:08 IST 2014 -----------------------------

==========================================================================
CLIENT NAME = bcpnetback1
NO OF FILES = 580
BACKUP SIZE IN KB = 761888
START TIME = Tue Jan 21 15:00:22 2014
END TIME = Tue Jan 21 15:03:08 2014
MEDIA ID = 300334

#############################################################################

I have idea how to get list form bplist command , but i dont want granular list kind of out put I need output like below script which is generated by setting "Universal Setting" in host property

( Dont want to retrive file path from bppllist since it may change for user backup )

eg

#################################################################################

Backup on client bcpnetback1 for user root by server SF440 succeeded.

Policy = bcpnetback1-test
Schedule = bcpnetback1

File list
---------
/usr/openv/netbackup/bin/

################################################################################

My idea was like if i know which script genrate this mail from the binrary i can append the logic & again i dont have to do hard coding for file list

My script --

v=`cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED | grep -i STATUS | awk '{print $8}'`

TEMOUT=/tmp/test-out
OUTF=/usr/openv/netbackup/bin/BACKUP_EXIT_CALLED

if [ -s $TEMOUT ]
then

/bin/rm -rf $TEMOUT

fi

if [ "$v" -eq 0 ] || [ "$v" -eq 1 ]
then
CLIENT=`cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED | grep -i CLIENT: | awk '{print $8}'`

NOFILES=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $20}'`

#START_TIME="$(`bpdbm -ctime `bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $14}'` | cut -d'=' -f2`)"

START_TIME_1=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $14}'`

START_TIME_2="`bpdbm -ctime $START_TIME_1 | cut -d'=' -f2`"

END_TIME="`cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED | tail -1 | awk '{print $1,$2,$3,$4,$6}'`"

#UNIXTIME=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $14}'`

SIZE=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $19}'`

BACKUP_ID=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $6}'`

MEDIA_ID="`bpimagelist -backupid $BACKUP_ID | awk '{print $9}' | sort -nr | uniq |sed 'N;$!P;$!D;$d'`"

touch /tmp/test-out

cat $OUTF >> /tmp/test-out
echo "          " >> /tmp/test-out
echo " ========================================================================== " >> /tmp/test-out

echo CLIENT NAME        = $CLIENT >> /tmp/test-out
echo NO OF FILES        = $NOFILES >> /tmp/test-out
echo BACKUP SIZE IN KB = $SIZE   >> /tmp/test-out
#echo START TIME      = `bpdbm -ctime $UNIXTIME` >> /tmp/test-out
echo START TIME         = $START_TIME_2 >> /tmp/test-out
echo END   TIME         = $END_TIME   >> /tmp/test-out
echo MEDIA ID           = $MEDIA_ID >> /tmp/test-out

mailx -s "Backup Notification Mail $CLIENT" backup-admin@hdfcbank.com < $TEMOUT

else

echo "Dont sent mail" > /dev/null

fi

Thanks for the responce ...
Raaavan
Level 5
11 years ago
my post is pending with moderator for verification
Raaavan
Level 5
11 years ago
This what i have wriiten

v=`cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED | grep -i STATUS | awk '{print $8}'`

TEMOUT=/tmp/test-out
OUTF=/usr/openv/netbackup/bin/BACKUP_EXIT_CALLED

if [ -s $TEMOUT ]
then

/bin/rm -rf $TEMOUT

fi

if [ "$v" -eq 0 ] || [ "$v" -eq 1 ]
then
CLIENT=`cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED | grep -i CLIENT: | awk '{print $8}'`

NOFILES=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $20}'`

#START_TIME="$(`bpdbm -ctime `bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $14}'` | cut -d'=' -f2`)"

START_TIME_1=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $14}'`

START_TIME_2="`bpdbm -ctime $START_TIME_1 | cut -d'=' -f2`"

END_TIME="`cat /usr/openv/netbackup/bin/BACKUP_EXIT_CALLED | tail -1 | awk '{print $1,$2,$3,$4,$6}'`"

#UNIXTIME=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $14}'`

SIZE=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $19}'`

BACKUP_ID=`bpimagelist -client $CLIENT -hoursago 24 | grep -i Image | head -1 | awk '{print $6}'`

MEDIA_ID="`bpimagelist -backupid $BACKUP_ID | awk '{print $9}' | sort -nr | uniq |sed 'N;$!P;$!D;$d'`"

touch /tmp/test-out

cat $OUTF >> /tmp/test-out
echo "          " >> /tmp/test-out
echo " ========================================================================== " >> /tmp/test-out

echo CLIENT NAME        = $CLIENT >> /tmp/test-out
echo NO OF FILES        = $NOFILES >> /tmp/test-out
echo BACKUP SIZE IN KB = $SIZE   >> /tmp/test-out
#echo START TIME      = `bpdbm -ctime $UNIXTIME` >> /tmp/test-out
echo START TIME         = $START_TIME_2 >> /tmp/test-out
echo END   TIME         = $END_TIME   >> /tmp/test-out
echo MEDIA ID           = $MEDIA_ID >> /tmp/test-out

mailx -s "Backup Notification Mail $CLIENT" backup-admin@hdfcbank.com < $TEMOUT

else

echo "Nothing" > /dev/null

fi

giving me desired output except file list

That's why i wanted to know the script which is generating below mail

Backup on client netback1 for user root by server mstnetbkp succeeded.

Policy = test
Schedule = test

File list
---------
/usr/openv/netbackup/

so i can append to my script ...

bplist not giving desired output ..

Thanks
Mark_Solutions
Level 6
11 years ago
Neither NetBackup nor OpsCenter produce reports that have the file path listed in them

To obtain the file list you need to extract it from bpdbjobs - but even then every job can have the file path in a different column in that output

The reports that i have create are done by outputing bpdbjobs - analyse that using a vbs script to produce a csv file which is then further analysed by an excel macro to remove the "rubbish" and tidy it up

I think to produce an automated alert that included the backup path would be very difficult to be honest.
Marianne
Level 6
11 years ago
We cannot expect bplist to give same output as policy Backup Selection.

You can add parameter to bplist to limit directory depth. The default is 99.

So, you can add -R 3 for 3 levels (-R 4 for 4 levels...)

Hope this helps.
Raaavan
Level 5
11 years ago
I do understand customization is not supported in symantec support

This one is strange requirement from the client so need to full fill this

Script name would have make this lot easy
Mark_Solutions
Level 6
11 years ago
The easiest way for this sort of report is using OpsCenter - you just wont get the backup path included.

Otherwise you could work on adding the information for the job to your script

You would need to identify the job id and then pass it to:

bpdbjobs -all_columns -jobid 123456

after which you need to grab the field from that output that contains the path - the output is comma seperated and by defualt the path is the 32nd field - but if snapshots are involved it could get pushed along so could be a later field