cancel
Showing results for 
Search instead for 
Did you mean: 

RMAN backup failed with status code 6

Aravind_M
Level 3
Hi everyone, Please provide your valuable input to resolve this issue.. RMAN-00571: =========================================================== RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS =============== RMAN-00571: =========================================================== RMAN-03002: failure of send command at 04/21/2010 18:01:22 ORA-19559: error sending device command: NB_ORA_POLICY=UNIX-Ora-Corp-CTRLM,NB_ORA_SCHED= ORA-19557: device error, device type: SBT_TAPE, device name: ORA-27194: skgfdvcmd: sbtcommand returned error ORA-19511: Error received from media manager layer, error text: NBBSA_SCHEDULE not found in environment block what is the cause of the failure.. Regards, Aravind.M
10 REPLIES 10

Andy_Welburn
Level 6
Oracle application backup jobs do not queue and dbclient reports; ERR - No value specified for key <NB_ORA_SERV>
http://seer.entsupport.symantec.com/docs/301920.htm

from which it may be worth looking at the parameters you have set within your RMAN script? e.g. "NB_ORA_SCHED=" ?

Aravind_M
Level 3
                NB_ORA_SCHED="Default-Application-Backup-Daily-Oracle"
                NB_ORA_SCHED="Default-Application-Backup-Weekly-Oracle"
                NB_ORA_SCHED="Default-Application-Backup-Monthly-Oracle"
                NB_ORA_SCHED="Default-Application-Backup-Yearly-Oracle"
send 'NB_ORA_POLICY=$NB_ORA_POLICY,NB_ORA_SCHED=$NB_ORA_SCHED';
send 'NB_ORA_POLICY=$NB_ORA_POLICY,NB_ORA_SCHED=$NB_ORA_SCHED';
send 'NB_ORA_POLICY=$NB_ORA_POLICY,NB_ORA_SCHED=$NB_ORA_SCHED';

Andy_Welburn
Level 6
from your RMAN script?

A bit hard to see what's going on without seeing the whole thing!

I would imagine there are a few conditional statements in there? Strange that it is setting the variable 4 times but only 3 sends, or are we just missing a line?

Any other errors in the logs that may also point to a variable not being set (as per the T/N)?

Aravind_M
Level 3
Please check the below script

# ---------------------------------------------------------------------------
# Determine the user which is executing this script.
# ---------------------------------------------------------------------------
CUSER=`id |cut -d"(" -f2 | cut -d ")" -f1`
# ---------------------------------------------------------------------------
# Put output in <this file name>.out. Change as desired.
# Note: output directory requires write permission.
# ---------------------------------------------------------------------------
RMAN_LOG_FILE=/usr/openv/netbackup/backup_ora_logs/orabackup_CTRLM_`date '+%m%d%
y%H%M%S'`.log
# ---------------------------------------------------------------------------
# You may want to delete the output file so that backup information does
# not accumulate.  If not, delete the following lines.
# ---------------------------------------------------------------------------
if [ -f "$RMAN_LOG_FILE" ]
then
        rm -f "$RMAN_LOG_FILE"
fi
# -----------------------------------------------------------------
# Initialize the log file.
# -----------------------------------------------------------------
echo >> $RMAN_LOG_FILE
chmod 666 $RMAN_LOG_FILE
# ---------------------------------------------------------------------------
# Log the start of this script.
# ---------------------------------------------------------------------------
echo Script $0 >> $RMAN_LOG_FILE
echo ==== started on `date` ==== >> $RMAN_LOG_FILE
echo >> $RMAN_LOG_FILE
# ---------------------------------------------------------------------------
# Replace /db/oracle/product/ora81, below, with the Oracle home path.
# ---------------------------------------------------------------------------
ORACLE_HOME=/ctrlm/oractm/app/product/10.2.0
export ORACLE_HOME
# ---------------------------------------------------------------------------
# Replace ora81, below, with the Oracle SID of the target database.
# ---------------------------------------------------------------------------
ORACLE_SID=CTRLM
export ORACLE_SID
# ---------------------------------------------------------------------------
# Replace ora81, below, with the Oracle DBA user id (account).
# ---------------------------------------------------------------------------
ORACLE_USER=oractm
# ---------------------------------------------------------------------------
# Set the target connect string.
# Replace "sys/manager", below, with the target connect string.
# ---------------------------------------------------------------------------
TARGET_CONNECT_STR=/
TARGET_CONNECT_STR=/
# ---------------------------------------------------------------------------
# Set the Oracle Recovery Manager name.
# ---------------------------------------------------------------------------
RMAN=$ORACLE_HOME/bin/rman
# ---------------------------------------------------------------------------
# Print out the value of the variables set by this script.
# ---------------------------------------------------------------------------
echo >> $RMAN_LOG_FILE
echo   "RMAN: $RMAN" >> $RMAN_LOG_FILE
echo   "ORACLE_SID: $ORACLE_SID" >> $RMAN_LOG_FILE
echo   "ORACLE_USER: $ORACLE_USER" >> $RMAN_LOG_FILE
echo   "ORACLE_HOME: $ORACLE_HOME" >> $RMAN_LOG_FILE
# ---------------------------------------------------------------------------
# Print out the value of the variables set by bphdb.
# ---------------------------------------------------------------------------
echo  >> $RMAN_LOG_FILE
echo  >> $RMAN_LOG_FILE
echo   "NB_ORA_FULL: $NB_ORA_FULL" >> $RMAN_LOG_FILE
echo   "NB_ORA_INCR: $NB_ORA_INCR" >> $RMAN_LOG_FILE
echo   "NB_ORA_CINC: $NB_ORA_CINC" >> $RMAN_LOG_FILE
echo   "NB_ORA_SERV: $NB_ORA_SERV" >> $RMAN_LOG_FILE
echo   "NB_ORA_POLICY: $NB_ORA_POLICY" >> $RMAN_LOG_FILE
# ---------------------------------------------------------------------------
# NOTE: This script assumes that the database is properly opened. If desired,
# this would be the place to verify that.
# ---------------------------------------------------------------------------
echo >> $RMAN_LOG_FILE
# ---------------------------------------------------------------------------
# If this script is executed from a NetBackup schedule, NetBackup
# sets an NB_ORA environment variable based on the schedule type.
# The NB_ORA variable is then used to dynamically set BACKUP_TYPE
# For example, when:
#     schedule type is                BACKUP_TYPE is
#     ----------------                --------------
# Automatic Full                     INCREMENTAL LEVEL=0
# Automatic Differential Incremental INCREMENTAL LEVEL=1
# Automatic Cumulative Incremental   INCREMENTAL LEVEL=1 CUMULATIVE
# Automatic Cumulative Incremental   INCREMENTAL LEVEL=1 CUMULATIVE
#
# For user initiated backups, BACKUP_TYPE defaults to incremental
# level 0 (full).  To change the default for a user initiated
# backup to incremental or incremental cumulative, uncomment
# one of the following two lines.
# BACKUP_TYPE="INCREMENTAL LEVEL=1"
# BACKUP_TYPE="INCREMENTAL LEVEL=1 CUMULATIVE"
#
# Note that we use incremental level 0 to specify full backups.
# That is because, although they are identical in content, only
# the incremental level 0 backup can have incremental backups of
# level > 0 applied to it.
# ---------------------------------------------------------------------------
if [ "$NB_ORA_FULL" = "1" ]
then
        echo "Full backup requested" >> $RMAN_LOG_FILE
        BACKUP_TYPE="INCREMENTAL LEVEL=0"
elif [ "$NB_ORA_INCR" = "1" ]
then
        echo "Differential incremental backup requested" >> $RMAN_LOG_FILE
 BACKUP_TYPE="INCREMENTAL LEVEL=1"
elif [ "$NB_ORA_CINC" = "1" ]
then
        echo "Cumulative incremental backup requested" >> $RMAN_LOG_FILE
        BACKUP_TYPE="INCREMENTAL LEVEL=1 CUMULATIVE"
elif [ "$BACKUP_TYPE" = "" ]
then
        echo "Default - Full backup requested" >> $RMAN_LOG_FILE
        BACKUP_TYPE="INCREMENTAL LEVEL=0"
fi
if [ "$NB_ORA_POLICY" = "UNIX-Ora-Corp-CTRLM" ]
then
        if [ $NB_ORA_PC_SCHED = "Oracle-Inc-Daily" ]
        then
                NB_ORA_SCHED="Default-Application-Backup-Daily-Oracle"
        elif [ $NB_ORA_PC_SCHED = "Oracle-Full-Weekly" ]
        then
                NB_ORA_SCHED="Default-Application-Backup-Weekly-Oracle"
        elif [ $NB_ORA_PC_SCHED = "Oracle-Full-Monthly" ]
 then
                NB_ORA_SCHED="Default-Application-Backup-Monthly-Oracle"
        elif [ $NB_ORA_PC_SCHED = "Oracle-Full-Yearly" ]
        then
                NB_ORA_SCHED="Default-Application-Backup-Yearly-Oracle"
        fi
fi

# ---------------------------------------------------------------------------
# Call Recovery Manager to initiate the backup. This example does not use a
# Recovery Catalog. If you choose to use one, replace the option 'nocatalog'
# from the rman command line below with the
# 'rcvcat <userid>/<passwd>@<tns alias>' statement.
#
# Note: Any environment variables needed at run time by RMAN
#       must be set and exported within the switch user (su) command.
# ---------------------------------------------------------------------------
#  Backs up the whole database.  This backup is part of the incremental
#  strategy (this means it can have incremental backups of levels > 0
#  applied to it).
#
#  We do not need to explicitly request the control file to be included
#  in this backup, as it is automatically included each time file 1 of
#  the system tablespace is backed up (the inference: as it is a whole
#  database backup, file 1 of the system tablespace will be backed up,
#  hence the controlfile will also be included automatically).
#
#  Typically, a level 0 backup would be done at least once a week.
#
#  The scenario assumes:
#     o you are backing your database up to two tape drives
#     o you want each backup set to include a maximum of 5 files
#     o you wish to include offline datafiles, and read-only tablespaces,
#       in the backup
#     o you want the backup to continue if any files are inaccessible.
#     o you are not using a Recovery Catalog
#     o you are explicitly backing up the control file.  Since you are
#       specifying nocatalog, the controlfile backup that occurs
#       automatically as the result of backing up the system file is
#       not sufficient; it will not contain records for the backup that
#       is currently in progress.
#     o you want to archive the current log, back up all the
#       archive logs using two channels, putting a maximum of 20 logs
#       in a backup set, and deleting them once the backup is complete.
#
#  Note that the format string is constructed to guarantee uniqueness and
#  to enhance NetBackup for Oracle backup and restore performance.
#
#
#  NOTE WHEN USING TNS ALIAS: When connecting to a database
#  using a TNS alias, you must use a send command or a parms operand to
#  specify environment variables.  In other words, when accessing a database
#  through a listener, the environment variables set at the system level are not
#  visible when RMAN is running.  For more information on the environment
#  variables, please refer to the NetBackup for Oracle Admin. Guide.
#
# ---------------------------------------------------------------------------
CMD_STR="
ORACLE_HOME=$ORACLE_HOME
export ORACLE_HOME
ORACLE_SID=$ORACLE_SID
export ORACLE_SID
$RMAN target $TARGET_CONNECT_STR 'rcvcat catctlrm/catctlrm@RMANCAT' msglog $RMAN
_LOG_FILE append << EOF
RUN {
ALLOCATE CHANNEL ch00 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';
send 'NB_ORA_POLICY=$NB_ORA_POLICY,NB_ORA_SCHED=$NB_ORA_SCHED';
BACKUP
    $BACKUP_TYPE
    SKIP INACCESSIBLE
    TAG hot_db_bk_level0
    FILESPERSET 50
    # recommended format
    FORMAT 'bk_%s_%p_%t'
    DATABASE;
    sql 'alter system archive log current';
RELEASE CHANNEL ch00;
RELEASE CHANNEL ch01;
RELEASE CHANNEL ch02;
# backup all archive logs
ALLOCATE CHANNEL ch00 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';
send 'NB_ORA_POLICY=$NB_ORA_POLICY,NB_ORA_SCHED=$NB_ORA_SCHED';
BACKUP
   filesperset 100
   FORMAT 'al_%s_%p_%t'
   ARCHIVELOG ALL DELETE INPUT;
RELEASE CHANNEL ch00;
RELEASE CHANNEL ch01;
RELEASE CHANNEL ch02;
#
# Note: During the process of backing up the database, RMAN also backs up the
# control file.  This version of the control file does not contain the
# information about the current backup because "nocatalog" has been specified.
# To include the information about the current backup, the control file should
# be backed up as the last step of the RMAN section.  This step would not be
# necessary if we were using a recovery catalog.
#
ALLOCATE CHANNEL ch00 TYPE 'SBT_TAPE';
send 'NB_ORA_POLICY=$NB_ORA_POLICY,NB_ORA_SCHED=$NB_ORA_SCHED';
BACKUP
    # recommended format
    FORMAT 'cntrl_%s_%p_%t'
    CURRENT CONTROLFILE;
RELEASE CHANNEL ch00;
}
EOF
"
# Initiate the command string
if [ "$CUSER" = "root" ]
then
    su - $ORACLE_USER -c "$CMD_STR" >> $RMAN_LOG_FILE
    RSTAT=$?
else
    /usr/bin/sh -c "$CMD_STR" >> $RMAN_LOG_FILE
    RSTAT=$?
fi
# ---------------------------------------------------------------------------
# Log the completion of this script.
# ---------------------------------------------------------------------------
if [ "$RSTAT" = "0" ]
then
    LOGMSG="ended successfully"
else
    LOGMSG="ended in error"
fi
echo >> $RMAN_LOG_FILE
echo Script $0 >> $RMAN_LOG_FILE
echo ==== $LOGMSG on `date` ==== >> $RMAN_LOG_FILE
echo >> $RMAN_LOG_FILE
STATUS=`cat $RMAN_LOG_FILE|grep RMAN-00569 | wc -l`
echo "-------------------------------------------------" >> $RMAN_LOG_FILE
if [ $STATUS -ne 0 ]
then
mailx -s "FAILED: RMAN ${BACKUP_TYPE} Backup of $ORACLE_SID on `uname -n` on `da
te `" rman_notify < ${RMAN_LOG_FILE}
echo "There were errors in the backup, exiting with exit code 5."
exit 5
else
mailx -s "SUCCESS: RMAN ${BACKUP_TYPE} Backup of $ORACLE_SID on `uname -n` on `d
ate `" rman_notify < $RMAN_LOG_FILE
fi
exit $RSTAT#!/bin/sh
# $Header: hot_database_backup.sh,v 1.2 2002/08/06 23:51:42 $
#
#bcpyrght
#***************************************************************************
#* $VRTScprght: Copyright 1993 - 2006 Symantec Corporation, All Rights Reserved
$ *
#***************************************************************************
#ecpyrght
#
# ---------------------------------------------------------------------------
#                       hot_database_backup.sh
# ---------------------------------------------------------------------------
#  This script uses Recovery Manager to take a hot (inconsistent) database
#  backup. A hot backup is inconsistent because portions of the database are
#  being modified and written to the disk while the backup is progressing.
#  You must run your database in ARCHIVELOG mode to make hot backups. It is
#  assumed that this script will be executed by user root. In order for RMAN
#  to work properly we switch user (su -) to the oracle dba account before
#  execution. If this script runs under a user account that has Oracle dba
#  privilege, it will be executed using this user's account.
# ---------------------------------------------------------------------------
# ---------------------------------------------------------------------------

Andy_Welburn
Level 6
Where is NB_ORA_PC_SCHED actually set?

I can see an "if" statement in the script that uses the value of this to set the value of NB_ORA_SCHED.

As I read it, if there is no value for NB_ORA_PC_SCHED then NB_ORA_SCHED won't be set to any value either, hence the error sending an 'empty' variable.

Aravind_M
Level 3

yes, there is no value set for NB_ORA_PC_SCHED & NB_ORA_SCHED . But this backup was sucessfull past 1 week, now it is failing..


 

Andy_Welburn
Level 6
The script?
The policy?
The schedule?

Does the logfile shed any more light on it?

Aravind_M
Level 3
Nothing changed ....
         I will escalate this issue to my higher team..

Thanks for your support...:)

Regars,
Aravind

Aravind_M
Level 3

Thanks

Andy_Welburn
Level 6
what was the solution?

***EDIT***
We'll wait & see! wink