Code = 6: the backup failed to back up the requested files

[NBU_BEX_Support]

Hello Folks! I need some help!

I have a problem in my Netbackup environment. The error that occurs is to an SAP server. Below details LOG with the error:

15/01/2014 15:48:58 - Info nbjm(pid=3920) requesting MEDIA_SERVER_WITH_ATTRIBUTES resources from RB for backup job (jobid=116403, request id:{CE49D22F-DCFB-4E18-A09D-7A6711DC75A8})  
15/01/2014 15:48:58 - requesting resource srv03-hcart-robot-tld-1
15/01/2014 15:48:58 - requesting resource srv03.grupomaggi.corp.NBU_CLIENT.MAXJOBS.sapxip
15/01/2014 15:48:58 - requesting resource srv03.grupomaggi.corp.NBU_POLICY.MAXJOBS.sapxip-db2-xip_database
15/01/2014 15:48:58 - granted resource srv03.grupomaggi.corp.NBU_CLIENT.MAXJOBS.sapxip
15/01/2014 15:48:58 - granted resource srv03.grupomaggi.corp.NBU_POLICY.MAXJOBS.sapxip-db2-xip_database
15/01/2014 15:48:58 - granted resource srv03-hcart-robot-tld-1
15/01/2014 15:48:58 - estimated 0 Kbytes needed
15/01/2014 15:48:58 - Info nbjm(pid=3920) started backup job for client sapxip, policy sapxip-db2-xip_database, schedule Diario-Schedule on storage unit srv03-hcart-robot-tld-1
15/01/2014 15:48:58 - started process bpbrm (3836)
15/01/2014 15:49:02 - Info bpbrm(pid=3836) sapxip is the host to backup data from     
15/01/2014 15:49:02 - Info bpbrm(pid=3836) reading file list from client        
15/01/2014 15:49:02 - connecting
15/01/2014 15:49:03 - Info bpbrm(pid=3836) starting bphdb on client         
15/01/2014 15:49:03 - Info bphdb(pid=17712) Backup started           
15/01/2014 15:49:03 - connected; connect time: 00:00:01
15/01/2014 15:49:04 - Info bphdb(pid=17712) Processing /usr/openv/netbackup/scripts/db2_backup_online.sh           
15/01/2014 15:49:04 - Info bphdb(pid=17712) Waiting for the child status        
15/01/2014 15:49:21 - Error bpbrm(pid=3836) from client sapxip: ERR - Script exited with status = 4 <archive file removal failed>
15/01/2014 15:49:21 - Error bpbrm(pid=3836) from client sapxip: ERR - bphdb exit status = 6: the backup failed to back up the requested files
15/01/2014 15:49:23 - end writing
15/01/2014 15:49:28 - Info bphdb(pid=17712) done. status: 6: the backup failed to back up the requested files
the backup failed to back up the requested files(6)

[Yasuhisa_Ishika]

Any relevant failed at that time? Any clue in dubug logs like bphdb, dbclient or so?

15/01/2014 15:49:21 - Error bpbrm(pid=3836) from client sapxip: ERR - Script exited with status = 4 <archive file removal failed>

This indicate that your backup script(/usr/openv/netbackup/scripts/db2_backup_online.sh) exited with return code 4. Please review your script and its log.

[Marianne]

I agree - check script and its output.
Were NBU sample scripts used? Or own script?

Logs to enable in NBU:

bphdb
backint

Change folder permissions to 777.

**** EDIT ****

Wait!

Let us get back to basics with information about this environment:
SAP with which database?
OS version?
SAP version?
DB type and version?
NBU version on client?
Which agent are you using to backup this database?

The policy name seems to indicate that this is SAP for DB2? 
sapxip-db2-xip_database
If this is the case - the SAP agent cannot be used.

SAP agent is only supported with Oracle and MaxDB.
See NetBackup 7 Application/Database Agent (CL):    http://www.symantec.com/docs/TECH126904

If DB2, the DB2 agent should be used.

[Zailar]

Was you copy db2.conf ?

Its location in the sample directory is as follows:

/usr/openv/netbackup/ext/db_ext/db2/scripts

The active location for the db2.conf file is as follows:

$DB2_Instance_Home/db2.conf

Ref : Admin Guide DB2

[NBU_BEX_Support]

Hello! Tks for help me!

I´ll enable the log on the NBU. I´m just waiting to finish a job that is "running". I just enable "ENABLE ROBUST LOGGING" on client.

About your doubt: The policy name seems to indicate that this is SAP for DB2? 
sapxip-db2-xip_database
If this is the case - the SAP agent cannot be used.

NO. In Policy Type is DB2. This means is there a db2 agent installed? Because if it doesn't  means, I'll talk to the client about this information.

Other doubt like sap version, client, etc. I've asked the client about these information.

OS version?
R=RedHat Enterprise Linux n- release 5.9
SAP version?
R=7.1
DB type and version?
R=DB2
NBU version on client?
R= 7.1
Which agent are you using to backup this database?
R=DB2

 

Tks.

[Marianne]

NBU 7.x installs all agents and options along with Client binaries.

Logs for DB2 policy is different.

See Troubleshooting chapter of NBU for DB2 Admin Guide for UNIX and Linux  http://http://www.symantec.com/docs/DOC3665 for a list of log folders that you need to create on DB2 client.

Please create ALL of them. Take note that some log folders need 777 permissions.

Check which logs folders are populated after next failure, then vopy the log files to reflect process name (e.g. bpcd.txt) and upload as File attachments.

[NBU_BEX_Support]

I understood.

I'm reading Admin Guide for DB2. These list of log folders, should I create, I must go from page 126 from admin guide? The pages 126 and 127.

Marianne van den Berg

Can I use this How to: http://www.symantec.com/business/support/index?page=content&id=HOWTO68946

Tks!

[Marianne]

Yes, you can use the HOWTO.
(Hpefully you have done that by now?)

Another important log that is needed is bprd on the master server.
Create the folder under <install-path>\veritas\netbackup\logs and then restart NetBackup Request Service to enable this log.

PS - we have not seen reply to the following:

... check script and its output.

Were NBU sample scripts used? Or own script?

As well as advice to check $DB2_Instance_Home/db2.conf.

[NBU_BEX_Support]

@marianne-van-den-berg

the client created all the folders and permission, I will be doing the
backup and see the logs.

About the Sample scripts or own script ... how can I see it?

Tks!

[NBU_BEX_Support]

Hi!

I started the backup and the job has already given error. Need I to go on the client and
check if the folders were populated with the logs?

I wait!

Tks!

[Marianne]

About the Sample scripts or own script ... how can I see it?

Easiest is to ask the dba. 

Sample db.conf and sample scripts are installed along with NBU client software in /usr/openv/netbackup/ext/db_ext/db2/scripts.

You need to work with the dba to resolve backup issues.

It is up to the dba to decide how to take care of archive logs. 
This seems to be the problem with current backup procedure.
 

[NBU_BEX_Support]

I'll talk to the DBA to check these errors.
Other questions, I'll be posting!

Tks!

[NBU_BEX_Support]

@marianne-van-den-berg


I'll talk to DBA in loco and can you see about these questions, please?

- I need you see errors "$DB2_Instance_Home/db2.conf."
- I need you check the exit to this file: "/usr/openv/netbackup/scripts/db2_backup_online.sh"

Are there other questions Can I do to DBA?

TKS!

[NBU_BEX_Support]

@marianne-van-den-berg

I talked to the DBA and he informed me that the environment is inconsistent "SAPXIP" for lack of the log file. Follow the below error:

2014-01-21-12.56.53.865742-180 I180720E388         LEVEL: Error
PID     : 20391                TID  : 46913164405056PROC : db2sysc 0
INSTANCE: db2xip               NODE : 000          DB   : XIP
EDUID   : 83                   EDUNAME: db2loggr (XIP) 0
FUNCTION: DB2 UDB, data protection services, sqlpgInitRecoverable, probe:1370
DATA #1 : <preformatted>
Log file S0010354.LOG not found.

2014-01-21-12.56.53.865964-180 I181109E437         LEVEL: Error
PID     : 20391                TID  : 46913164405056PROC : db2sysc 0
INSTANCE: db2xip               NODE : 000          DB   : XIP
EDUID   : 83                   EDUNAME: db2loggr (XIP) 0
FUNCTION: DB2 UDB, data protection services, sqlpgLoggrInit, probe:430
RETCODE : ZRC=0x860F000A=-2045837302=SQLO_FNEX "File not found."
          DIA8411C A file "" could not be found.

2014-01-21-12.56.53.866177-180 I181547E167        LEVEL: Error
PID:20391 TID:46913164405056 NODE:000 Title: SQLP_DBCB
Dump File:/db2/XIP/db2dump/20391.83.000.dump.bin

2014-01-21-12.56.53.867018-180 I181715E371         LEVEL: Severe
PID     : 20391                TID  : 46913164405056PROC : db2sysc 0
INSTANCE: db2xip               NODE : 000          DB   : XIP
EDUID   : 83                   EDUNAME: db2loggr (XIP) 0
FUNCTION: DB2 UDB, data protection services, sqlpgasn, probe:4000
MESSAGE : Logging can not continue due to an error.

2014-01-21-12.56.53.867179-180 I182087E517         LEVEL: Severe
PID     : 20391                TID  : 46913181182272PROC : db2sysc 0
INSTANCE: db2xip               NODE : 000          DB   : XIP
APPHDL  : 0-1484               APPID: *LOCAL.db2xip.140121155653
AUTHID  : DB2XIP
EDUID   : 23                   EDUNAME: db2agent (XIP) 0
FUNCTION: DB2 UDB, data protection services, sqlpgint, probe:9030
RETCODE : ZRC=0x860F000A=-2045837302=SQLO_FNEX "File not found."
          DIA8411C A file "" could not be found.

Therefore, he also sent me "db2.conf" file and file "db2_backup_online.sh.out". Follow:

DB2.CONF:

# $Header: db2.conf,v 1.6 2009/08/26 15:58:31 $
#
# ***************************************************************************
# * $Copyright: Copyright 1993 - 2011 Symantec Corporation, All Rights Reserved $ *
# ***************************************************************************
#
# The following settings are used by NetBackup to backup/restore a DB2 database.
#
# Reminders:
# 1) The specified policy must have a type of "DB2".
# 2) The specified schedule must be defined for this policy.
# 3) The DB2 database host must be entered as a client for this policy.
#

DATABASE XIP
OBJECTTYPE DATABASE
POLICY sapxip-db2-xip_database
SCHEDULE Default-Application-Backup
ENDOPER

#
# The following settings are used by NetBackup to backup/restore DB2 log files.
#
 Reminders:
# 1) DB2 transcation logs can be backed up/restored using  either
#  (a) DB2 User Exit Program
#       The specified policy must have a type of "Standard" (for UNIX DB2
#       host) or "MS-Windows" (for Windows DB2 host).
#
#  (b) LOGARCHMETH1 can be configured to use NetBackup.
#      (When LOGARCHMETH1 = "VENDOR:NetBackup for DB2 agent")
#       This option is possible only for versions 8.2 and above.
#       The specified policy must have a type of DB2.
#
# 2) The specified schedule must be defined for this policy.
# 3) The DB2 database host must be entered as a client for this policy.
#

# ---------------------
# DB2 User Exit Program
# ---------------------
# If DB2 log file archiving is enabled (DB2 USEREXIT ON), DB2 will invoke
# the NetBackup user-exit program to backup & restore DB2 archive log files.
# Using ARCFUNC SAVE causes log files to be archived to NetBackup storage,
# as specified by the policy storage-unit setting.
# Using ARCFUNC COPY causes log files to be archived to a disk directory.
# Use ARCDIR to specify the destination directory for log file backup.
# Use RETDIR to specify the source directory for log file restore.
#
#DATABASE SAMPLE
#OBJECTTYPE ARCHIVE
#POLICY DB2_Log_Policy
#SCHEDULE User
#ARCFUNC SAVE
#ARCFUNC COPY
#ARCDIR /home/db2inst1/arcdir
#RETDIR /home/db2inst1/arcdir
#ENDOPER


# --------------------------------------------------------------
# LOGARCHMETH1 = "VENDOR.." parameter for versions 8.2 and above
# Policy is of type DB2.
# --------------------------------------------------------------
#
# Comment the above DB2 User Exit section when using LOGARCHMETH1 = "VENDOR.."
#
DATABASE XIP
OBJECTTYPE ARCHIVE
POLICY sapxip-db2-xip_database
SCHEDULE Archives
ENDOPER




"b2_backup_online.sh.out" is attached.

Wha do you think, now just DBA Analyts can fix this?

Best Regards,

Tks!

[Marianne]

I am not a DB2 expert/dba... 

What is your dba saying about the missing logs?

Log file S0010354.LOG not found. 

This seems to indicate that DB2 is looking for particular transaction/archive log that cannot be found. 
Your dba should know how to deal with this.

Do not try another backup unless dba tells you that problem is fixed.

*** EDIT *** 

About 'Reason code: "514" ' in the output file:

Check permissions on NBU log folders on db2 client. Permissions need to be 777.

See ttp://www.symantec.com/docs/TECH144232 
 

[Zailar]

Hi ,

Would you try edit db2.conf like this :

#DATABASE SAMPLE
#OBJECTTYPE ARCHIVE
#POLICY DB2_Log_Policy
#SCHEDULE User
#ARCFUNC SAVE

Replace with

DATABASE SAMPLE
OBJECTTYPE ARCHIVE
POLICY DB2_Log_Policy
SCHEDULE User
ARCFUNC SAVE

And

DATABASE XIP
OBJECTTYPE ARCHIVE
POLICY sapxip-db2-xip_database
SCHEDULE Archives
ENDOPER

Replace With

DATABASE XIP
OBJECTTYPE ARCHIVE
POLICY sapxip-db2-xip_database
SCHEDULE Default-Application-Backup
ENDOPER