05-05-2013 10:20 AM
Dear All,
need urgunt assistance below is the output of RMAN backup intigrted with netbackup 7.5
Enviroment info --master solaris 7.5.0.4 /solaris
Media server (Which is backed up ) 7.5.0.4 / AIX
Below is the error in RMAN output script
RMAN-03009: failure of backup command on ch01 channel at 05/05/2013 21:45:56
ORA-19506: failed to create sequential file, name="bk_97917_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
VxBSACreateObject: Failed with error:
Server Status: Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch01 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch10 channel at 05/05/2013 21:45:57
ORA-19506: failed to create sequential file, name="bk_97926_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
VxBSACreateObject: Failed with error:
Server Status: Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch10 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch03 channel at 05/05/2013 21:45:58
ORA-19506: failed to create sequential file, name="bk_97919_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
VxBSACreateObject: Failed with error:
Server Status: Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch03 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch05 channel at 05/05/2013 21:45:58
ORA-19506: failed to create sequential file, name="bk_97921_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
VxBSACreateObject: Failed with error:
Server Status: Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch05 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch08 channel at 05/05/2013 21:45:58
ORA-19506: failed to create sequential file, name="bk_97924_1_814653708", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: Error received from media manager layer, error text:
VxBSACreateObject: Failed with error:
Server Status: Communication with the server has not been initiated or the server status has not been retrieved from the serve
channel ch08 disabled, job failed on it will be run on another channel
######################################3
Policy details are attached in txt pad
FYI ..daily policy happened yesterday properly.
Expecting prompt assistance .
Thanks
05-05-2013 10:22 AM
Below is the job details form activity monitor
05/05/2013 20:37:56 - Info nbjm (pid=27784) starting backup job (jobid=105868) for client HBCampDBnew, policy DAKC_W_HBCampDBnew, schedule Default-Application-Backup
05/05/2013 20:37:56 - Info nbjm (pid=27784) requesting STANDARD_RESOURCE resources from RB for backup job (jobid=105868, request id:{90E23C26-B595-11E2-8EF7-002128FA3172})
05/05/2013 20:37:56 - requesting resource HBCampDBnew-hcart2-robot-tld-2
05/05/2013 20:37:56 - requesting resource dakcmstnetbkp.NBU_CLIENT.MAXJOBS.HBCampDBnew
05/05/2013 20:37:56 - requesting resource dakcmstnetbkp.NBU_POLICY.MAXJOBS.DAKC_W_HBCampDBnew
05/05/2013 20:39:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:41:31 - awaiting resource HBCampDBnew-hcart2-robot-tld-2. Waiting for resources.
Reason: Drives are in use, Media server: HBCampDBnew,
Robot Type(Number): TLD(2), Media ID: N/A, Drive Name: N/A,
Volume Pool: DAKC_weekly_pool, Storage Unit: HBCampDBnew-hcart2-robot-tld-2, Drive Scan Host: N/A,
Disk Pool: N/A, Disk Volume: N/A
05/05/2013 20:41:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:43:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:45:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:47:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:49:56 - Info nbjm (pid=27784) Waiting in NetBackup scheduler work queue on server dakcmstnetbkp
05/05/2013 20:51:35 - Waiting for scan drive stop Drive009, Media server: HBCampDBnew
05/05/2013 20:51:35 - granted resource dakcmstnetbkp.NBU_CLIENT.MAXJOBS.HBCampDBnew
05/05/2013 20:51:35 - granted resource dakcmstnetbkp.NBU_POLICY.MAXJOBS.DAKC_W_HBCampDBnew
05/05/2013 20:51:35 - granted resource DD0009
05/05/2013 20:51:35 - granted resource Drive009
05/05/2013 20:51:35 - granted resource HBCampDBnew-hcart2-robot-tld-2
05/05/2013 20:51:39 - estimated 0 kbytes needed
05/05/2013 20:51:39 - Info nbjm (pid=27784) started backup (backupid=HBCampDBnew_1367767299) job for client HBCampDBnew, policy DAKC_W_HBCampDBnew, schedule Default-Application-Backup on storage unit HBCampDBnew-hcart2-robot-tld-2
05/05/2013 20:51:42 - connecting
05/05/2013 20:51:47 - connected; connect time: 0:00:00
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) HBCampDBnew is the host to backup data from
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) telling media manager to start backup on client
05/05/2013 20:55:51 - Info bptm (pid=55574798) using 262144 data buffer size
05/05/2013 20:55:51 - Info bptm (pid=55574798) using 64 data buffers
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) spawning a brm child process
05/05/2013 20:55:51 - Info bpbrm (pid=47383014) child pid: 17432974
05/05/2013 20:55:52 - Info bpbrm (pid=47383014) sending bpsched msg: CONNECTING TO CLIENT FOR HBCampDBnew_1367767299
05/05/2013 20:55:52 - Info bpbrm (pid=47383014) listening for client connection
05/05/2013 20:55:56 - Info bpbrm (pid=47383014) INF - Client read timeout = 3000
05/05/2013 20:55:57 - Info bpbrm (pid=47383014) accepted connection from client
05/05/2013 21:41:49 - end writing
05/05/2013 21:45:58 - Error bpbrm (pid=17432974) client HBCampDBnew EXIT STATUS = 6: the backup failed to back up the requested files
05/05/2013 21:45:58 - Info bpbkar (pid=0) done. status: 6
05/05/2013 21:45:58 - Info bpbrm (pid=47383014) sending message to media manager: STOP BACKUP HBCampDBnew_1367767299
05/05/2013 21:45:58 - Info bpbrm (pid=47383014) media manager for backup id HBCampDBnew_1367767299 exited with status 150: termination requested by administrator
the backup failed to back up the requested files (6)
05-05-2013 10:54 AM
VxBSACreateObject: Failed with error:
Server Status: Communication with the server has not been initiated or the server status has not been retrieved from the server
it looks like communication broken between the client to Master server.
though you might see the good FS backups , you will see the communcation issue in DB backups as DB backups requred the commnication back to master.
what is the output of
bpcltncmd -pn
bpcltncmd -self command from client
and also check the logs of bpclent and bphdb
05-05-2013 09:13 PM
I think Nagalla meant dbclient log.
If this folder does not exist on the client, please create it under /usr/openv/netbackup/logs followed by 'chmod 777 dbclient'.
The log that we need on the master is bprd. If this log folder does not exist, please create it and restart NBU.
Please check on the client that the master server is listed as first SERVER entry in bp.conf.
Check that /etc/hosts entry for the master is correct.
One of the above two entries may have been changed or removed.
bpclntcmd -pn will tell us if client can connect to bprd on the master.
bprd log on the master should contain record of this connection attempt.
bpclntcmd -self will tell us if client name corresponds with client name in the policy.
05-05-2013 09:14 PM
./bpclntcmd -pn
./bptestbpcd -client hostname
were responding properly
“avrd” process was in hang status & become defunct which was not allowing net backup services to start & stop gracefully
So killed that & bounce back NBU services which solved the issue
I suspect “Error received from media manager layer, error text:” may be stands for that
Thanks
05-05-2013 09:18 PM
Thanks bot of you for the prompt responce
Do we have any tech note which will brief me about errors occurred in RMAN backup integrated with netbackup
Because first time I came across such error & want to investigate more about such issue
05-07-2013 02:13 PM
Dear all,
again RMAN backup aborted with below error . & stause code 6
ORA-27028: skgfqcre: sbtbackup returned error ORA-19511: Error received from media manager layer, error text: Server
08-29-2013 10:44 PM
Please, check the output of commands
cd /usr/openv/netbackup/bin