09-08-2015 08:22 AM
Hi,
I'm taking backup Oracle Linux client - RMAN Backup on netbackup 7.6.0.4 on Master Server Windows 2008 R2.
I run two scrips, one Full (level 0) Weekly and other Incremental Cumulative (level 1) daily.
Only the Full backup works everytime I run, but the Incremental Cumulative Backup Failed.
The scripts are:
INCREMENTAL:
backup incremental level 1 cumulative device type sbt tag '%TAG' database;
backup device type sbt tag '%TAG' archivelog all not backed up delete all input;
Destino Fita
Modo de Backup Backup On-line
Parâmetros da Biblioteca MMV (Media Management Vendor) SBT_LIBRARY=/u01/app/oracle/product/11g/dbr2/lib/libobk.so,ENV=(NB_ORA_POLICY=
ORACLE_Igua_TOP,NB_ORA_SERV=zzzz.yyy.gov.br, NB_ORA_PC_STREAMS=4)
Unidades de Fita 4
FULL:
backup incremental level 0 cumulative device type sbt tag '%TAG' database;
backup device type sbt tag '%TAG' archivelog all not backed up delete all input;
Destino Fita
Modo de Backup Backup On-line
Parâmetros da Biblioteca MMV (Media Management Vendor) SBT_LIBRARY=/u01/app/oracle/product/11g/dbr2/lib/libobk.so,ENV=(NB_ORA_POLICY=
ORACLE_Igua_TOP,NB_ORA_SERV=zzzz.yyy.gov.br, NB_ORA_PC_STREAMS=4)
Unidades de Fita 4
The Incremental Job fail with error code 6 and 13, as follow:
06/09/2015 20:00:27 - Info nbjm(pid=10004) starting backup job (jobid=451019) for client "X", policy ORACLE, schedule Default-Application-Backup
06/09/2015 20:00:27 - Info nbjm(pid=10004) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=451019, request id:{7278D040-8359-4A5D-B8AE-8F80A14EC909})
06/09/2015 20:00:27 - requesting resource stu.dedup.ar07
06/09/2015 20:00:27 - requesting resource ar.NBU_CLIENT.MAXJOBS."X"
06/09/2015 20:00:27 - requesting resource ar.NBU_POLICY.MAXJOBS.ORACLE
06/09/2015 20:00:27 - granted resource ar.NBU_CLIENT.MAXJOBS."X"
06/09/2015 20:00:27 - granted resource ar.NBU_POLICY.MAXJOBS.ORACLE
06/09/2015 20:00:27 - granted resource MediaID=@aaaaU;DiskVolume=PureDiskVolume;DiskPool=DiskPool07;Path=PureDiskVolume;StorageServer=ar07;MediaServer=ar07
06/09/2015 20:00:27 - granted resource stu.dedup.ar07
06/09/2015 20:00:28 - estimated 0 Kbytes needed
06/09/2015 20:00:28 - Info nbjm(pid=10004) started backup (backupid="X"_1441580427) job for client "X", policy ORACLE, schedule Default-Application-Backup on storage unit stu.dedup.ar07
06/09/2015 20:00:30 - started process bpbrm (24666)
06/09/2015 20:00:32 - connecting
06/09/2015 20:00:33 - connected; connect time: 0:00:01
06/09/2015 20:00:38 - begin writing
06/09/2015 20:06:25 - Info bpbrm(pid=24666) "X" is the host to backup data from
06/09/2015 20:06:25 - Info bpbrm(pid=24666) reading file list for client
06/09/2015 20:06:25 - Info bpbrm(pid=24666) listening for client connection
06/09/2015 20:06:26 - Info bpbrm(pid=24666) INF - Client read timeout = 32767
06/09/2015 20:06:26 - Info bpbrm(pid=24666) accepted connection from client
06/09/2015 20:06:26 - Info dbclient(pid=34863) Backup started
06/09/2015 20:06:26 - Info bpbrm(pid=24666) bptm pid: 24680
06/09/2015 20:06:27 - Info bptm(pid=24680) start
06/09/2015 20:06:27 - Info bptm(pid=24680) using 262144 data buffer size
06/09/2015 20:06:27 - Info bptm(pid=24680) using 30 data buffers
06/09/2015 20:06:29 - Info bptm(pid=24680) start backup
06/09/2015 20:06:32 - Info bptm(pid=24680) backup child process is pid 24723
06/09/2015 20:06:32 - Info dbclient(pid=34863) dbclient(pid=34863) wrote first buffer(size=262144)
06/09/2015 22:11:17 - end writing; write time: 2:10:39
06/09/2015 22:17:02 - Info dbclient(pid=34863) done. status: 6
06/09/2015 22:17:04 - Error bptm(pid=24680) media manager terminated by parent process
06/09/2015 22:17:10 - Info ar07(pid=24680) StorageServer=PureDisk:ar07; Report=PDDO Stats (multi-threaded stream used) for (ar07): scanned: 1837570 KB, CR sent: 591740 KB, CR sent over FC: 0 KB, dedup: 67.8%, cache hits: 0 (0.0%)
06/09/2015 22:17:11 - Info dbclient(pid=34863) done. status: 6: the backup failed to back up the requested files
the backup failed to back up the requested files(6)
06/09/2015 20:00:26 - Info nbjm(pid=10004) starting backup job (jobid=451018) for client "X", policy ORACLE, schedule Default-Application-Backup
06/09/2015 20:00:26 - Info nbjm(pid=10004) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=451018, request id:{3F551A19-CC2F-44C2-8DC6-A80C5A2D1F57})
06/09/2015 20:00:26 - requesting resource stu.dedup.ar07
06/09/2015 20:00:26 - requesting resource araguaia.NBU_CLIENT.MAXJOBS."X"
06/09/2015 20:00:26 - requesting resource araguaia.NBU_POLICY.MAXJOBS.ORACLE
06/09/2015 20:00:26 - granted resource araguaia.NBU_CLIENT.MAXJOBS."X"
06/09/2015 20:00:26 - granted resource araguaia.NBU_POLICY.MAXJOBS.ORACLE
06/09/2015 20:00:26 - granted resource MediaID=@aaaaU;DiskVolume=PureDiskVolume;DiskPool=DiskPool07;Path=PureDiskVolume;StorageServer=ar07;MediaServer=ar07
06/09/2015 20:00:26 - granted resource stu.dedup.ar07
06/09/2015 20:00:27 - estimated 0 Kbytes needed
06/09/2015 20:00:27 - Info nbjm(pid=10004) started backup (backupid="X"_1441580426) job for client "X", policy ORACLE, schedule Default-Application-Backup on storage unit stu.dedup.ar07
06/09/2015 20:00:30 - started process bpbrm (24663)
06/09/2015 20:00:31 - connecting
06/09/2015 20:00:32 - connected; connect time: 0:00:01
06/09/2015 20:00:38 - begin writing
06/09/2015 20:06:24 - Info bpbrm(pid=24663) "X" is the host to backup data from
06/09/2015 20:06:24 - Info bpbrm(pid=24663) reading file list for client
06/09/2015 20:06:25 - Info bpbrm(pid=24663) listening for client connection
06/09/2015 20:06:25 - Info bpbrm(pid=24663) INF - Client read timeout = 32767
06/09/2015 20:06:25 - Info bpbrm(pid=24663) accepted connection from client
06/09/2015 20:06:26 - Info dbclient(pid=34862) Backup started
06/09/2015 20:06:26 - Info bpbrm(pid=24663) bptm pid: 24671
06/09/2015 20:06:26 - Info bptm(pid=24671) start
06/09/2015 20:06:26 - Info bptm(pid=24671) using 262144 data buffer size
06/09/2015 20:06:26 - Info bptm(pid=24671) using 30 data buffers
06/09/2015 20:06:29 - Info bptm(pid=24671) start backup
06/09/2015 20:06:32 - Info bptm(pid=24671) backup child process is pid 24726
06/09/2015 20:06:37 - Info dbclient(pid=34862) dbclient(pid=34862) wrote first buffer(size=262144)
07/09/2015 00:16:07 - end writing; write time: 4:15:29
07/09/2015 00:21:51 - Error bpbrm(pid=24663) socket read failed: errno = 104 - Connection reset by peer
07/09/2015 00:21:54 - Error bptm(pid=24671) media manager terminated by parent process
07/09/2015 00:22:00 - Info ar07(pid=24671) StorageServer=PureDisk:ar07; Report=PDDO Stats (multi-threaded stream used) for (ar07): scanned: 222466 KB, CR sent: 55891 KB, CR sent over FC: 0 KB, dedup: 74.9%, cache hits: 0 (0.0%)
07/09/2015 00:22:00 - Info dbclient(pid=34862) done. status: 13: file read failed
file read failed(13)
ORACLE LOG
RMAN-03009: failure of backup command on ORA_SBT_TAPE_2 channel at 09/01/2015 22:14:57
ORA-27192: skgfcls: sbtclose2 retornou erro - falha ao fechar arquivo
ORA-19511: Erro recebido da camada do gerenciador de midia, texto do erro:
Failed to process backup file <7lqg39qu_1_1>
ORA-19502: erro de gravac?o no arquivo "7lqg39qu_1_1", numero do bloco 241825 (tamanho do bloco=8192)
ORA-27030: skgfwrt: sbtwrite2 retornou erro
ORA-19511: Erro recebido da camada do gerenciador de midia, texto do erro:
VxBSASendData: Failed with error:
LOGS ARE ATTACHED
Can anyone help, please?
09-08-2015 09:45 AM
what are the results of 'netstat -na'
check the following KM for possible reasons and solutions for a time out issue regarding a TCP related issue: http://www.symantec.com/docs/TECH71821
09-09-2015 05:17 AM
I would create the bphdb folder under netbackup logs as that often show indications of what problem is with database backups. Especially the stdout and the stderr files.
Are there data transfered in the time between the wrote first buffer and the end write entries a couple of hours later ?
If not the problem can be that rman are doing a full scan of the database files to find the changed blocks in that time. A solution for that can be enable Block Change Tracking in the Oracle database.
BTW. your CLIENT_TIME_OUT value looks very large, have never gone above 7200 (2 hours) for backups.
09-10-2015 07:12 AM
Ok. Tks for the first feedback.
I'll collect and send more data about the issue.
Tks...