Backup Archivelogs Oracle EXIT STATUS 6: the backup failed to back up the requested files

[Stivet]

Hi All,

Backup archive logs to server Linux Redhat with Oracle, get error:

EXIT STATUS 6: the backup failed to back up the requested files.

Attached dbclient log of the client of NBU (tascobk).

Any Idea??.

[Will_Restore]

16:57:58.424 [12492] <4> serverResponse: read comm file:<16:57:57 Initiating backup>
17:12:56.915 [12488] <16> readCommFile: ERR - timed out after 900 seconds while reading from /usr/openv/netbackup/logs/user_ops/dbext/logs/12488.0.1421963877

Please check hostname resolution client to/from media server

[Michael_G_Ander]

Could be that the Oracle database is not in archivelog mode

Check the stdout and stderr files under the bphdb folder on the client

https://www-secure.symantec.com/connect/forums/general-database-backup-error-troubleshooting has some more tips

[jim_dalton]

Theres a lot that doesnt make much sense in that log...so whats the history to this job...when did it last work?

You mention Oracle backup yet it seems to be SAP from the log, so maybe confirm the data and the policy type you are using. For SAP theres a different agent, I would be wary of backing up SAPs underlying DB with the Ora agent : suppose you find you cant restore...Symantec may not support you as you arent within the support matrix. Jim 

[Stivet]

HI,

The hostname resolution is OK, master <-> client, the oracle database is in archivelog mode..

This is out of dbclient log:

06:25:29.621 [31670] <4> sendRequest: request = orasbx dba doradobk tascobk doradobk /usr/openv/netbackup/logs/user_ops/dbext/logs/31670.0.1422444329 SAP_BD_Archivelogs_QA SAP_BD_Archivelogs_QA_AM 3 SBX 0 4 0 C C C C C 0 0 0 0 4

06:25:29.621 [31670] <2> conf_update_time: ../../libvlibs/nbconf_glue.cpp.436: errno: 2 2 0x00000002

06:25:29.621 [31670] <2> conf_update_time: ../../libvlibs/nbconf_glue.cpp.437: path: /oracle/SBX/bp.conf

06:25:29.621 [31670] <2> vnet_get_pref_netconnection: [vnet_addrinfo.c:4809] using interface ANY

06:25:29.621 [31670] <2> vnet_get_pref_netconnection: [vnet_addrinfo.c:4809] using interface ANY

06:25:29.622 [31670] <2> vnet_get_pref_netconnection: [vnet_addrinfo.c:4809] using interface ANY

06:25:29.625 [31670] <2> vnet_pbxConnect: pbxConnectEx Succeeded

06:25:29.626 [31670] <2> connect_to_service: connect succeeded STATUS (0) SUCCESS FROM 0.0.0.0 TO scooby 172.17.46.11 bprd VIA pbx

06:25:29.626 [31670] <2> logconnections: BPRD CONNECT FROM 172.17.45.70.19810 TO 172.17.46.11.1556 fd = 11

06:25:29.626 [31670] <2> vnet_check_vxss_client_magic_with_info: [vnet_vxss_helper.c:833] VxSS not supported 0 0x0

06:25:29.626 [31670] <2> conf_update_time: ../../libvlibs/nbconf_glue.cpp.436: errno: 2 2 0x00000002

06:25:29.627 [31670] <2> conf_update_time: ../../libvlibs/nbconf_glue.cpp.437: path: /oracle/SBX/bp.conf

06:25:29.627 [31670] <4> serverResponse: initial client_read_timeout = <900>

06:25:30.248 [31662] <4> serverResponse: read comm file:<06:25:29 Initiating backup>

06:25:30.357 [31664] <4> serverResponse: read comm file:<06:25:29 Initiating backup>

06:25:30.497 [31666] <4> serverResponse: read comm file:<06:25:30 Initiating backup>

06:25:30.627 [31670] <4> serverResponse: read comm file:<06:25:30 Initiating backup>

06:40:28.758 [31664] <16> readCommFile: ERR - timed out after 900 seconds while reading from /usr/openv/netbackup/logs/user_ops/dbext/logs/31664.0.1422444329

06:40:28.758 [31664] <32> serverResponse: ERR - could not read from comm file </usr/openv/netbackup/logs/user_ops/dbext/logs/31664.0.1422444329>

06:40:28.758 [31664] <16> CreateNewImage: ERR - serverResponse() failed

06:40:28.758 [31664] <4> closeApi: INF - EXIT STATUS 6: the backup failed to back up the requested files

This is out of rman log:

------------------------------

input archived log thread=1 sequence=104 RECID=105 STAMP=869835292
input archived log thread=1 sequence=105 RECID=106 STAMP=869835424
channel ch04: starting piece 1 at 28-JAN-2015 06:25
RMAN-03009: failure of backup command on ch01 channel at 01/28/2015 06:40:34
ORA-19506: failed to create sequential file, name="al_SBX_185_1_870157528.bkp", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch01 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch02 channel at 01/28/2015 06:40:34
ORA-19506: failed to create sequential file, name="al_SBX_186_1_870157529.bkp", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch02 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch03 channel at 01/28/2015 06:40:34
ORA-19506: failed to create sequential file, name="al_SBX_187_1_870157529.bkp", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch03 disabled, job failed on it will be run on another channel
released channel: ch01
released channel: ch02
released channel: ch03
released channel: ch04
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of backup command on ch04 channel at 01/28/2015 06:40:34
ORA-19506: failed to create sequential file, name="al_SBX_188_1_870157529.bkp", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
   VxBSACreateObject: Failed with error:
   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve

[Marianne · Accepted solution]

All we can see here is that NOTHING happened inbetween these 2 entries:

06:25:30.627 [31670] <4> serverResponse: read comm file:<06:25:30 Initiating backup>

06:40:28.758 [31664] <16> readCommFile: ERR - timed out after 900 seconds while reading from /usr/openv/netbackup/logs/user_ops/dbext/logs/31664.0.1422444329 

Resulting in timeout on NBU side.

Are normal db backups working? 
Only archive log backups failing? 

Have you tried to increase Client Connect and Client Read timeout to 1800?

If increasing timeouts does not help, you will to increase logging levels.
On client, enable level 5 logging.

Ensure that bprd log on master is enabled. Level 0 should be fine as a start.
If log folder does not exist, restart NBU after creating the folder.

Please post logs as Fle attachments.

[Will_Restore]

Solution was marked after two weeks with no further comment.  So what was the root cause?