Rman backup fails, its client jobs failing with 239

[Chan_backup]

hi,

This a RMAN backup failed with below error

RMAN-00571: ===========================================================

RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============

RMAN-00571: ===========================================================

RMAN-03009: failure of backup command on ch01 channel at 01/18/2014 01:34:01

ORA-19506: failed to create sequential file, name="bk_10723_1_837134336", parms=""

ORA-27028: skgfqcre: sbtbackup returned error

ORA-19511: Error received from media manager layer, error text:

   VxBSACreateObject: Failed with error:

   Server Status:  Communication with the server has not been initiated or the server status has not been retrieved from the serve

Note : in the activity monitor it parent fails with 6 and child stream fails with 6

Master is linux 7.5.0.6

client is solaris 7.1

Acctual client = saenold24-b

when i logged in with this host name it logged in as saecopt51-b

from client :

bp.conf

-------

saecopt51# cat bp.conf

SERVER = sabumaq

SERVER = samaq01

SERVER = sameq10

SERVER = sameq11

CLIENT_NAME = saecopt51-b

CONNECT_OPTIONS = localhost 1 0 2

./bpclntcmd -hn samaq01

host samaq01: samaq01..com at 10.40.14.72

aliases:     samaq01..com     samaq01     10.40.14.72

saecopt51 ()# ./bpclntcmd -ip 10.40.14.72

host 10.40.14.72: samaq01..com at 10.40.14.72

aliases:     samaq01..com     10.40.14.72

saecopt51 ()# ./bpclntcmd -self

current domain = salo

NIS does not seem to be running: (10) can't communicate with ypbind

gethostname() returned: saecopt51-b..com

host saecopt51-b..com: saecopt51-b..com at 10.40.153.98

aliases:     saecopt51-b..com     10.40.153.98

saecopt51 ()# ./bpclntcmd -pn

expecting response from server sabumaq

saecopt51-b..com saecopt51-b..com 10.40.153.98 54800

from master

$./bpclntcmd -hn saenold24-b..com

host saenold24-b..com: saenold24-b..com at 10.40.153.110

aliases:     saenold24-b..com     10.40.153.110

root@samaq01 /usr/openv/netbackup/bin

$./bpclntcmd -ip 10.40.153.110

host 10.40.153.110: saenold24-b..com at 10.40.153.110

aliases:     saenold24-b..com     10.40.153.110

$nslookup saenold24-b..com

Server:         147.243.4.70

Address:        147.243.4.70#53

Non-authoritative answer:

Name:   saenold24-b..com

Address: 10.40.153.110

root@samaq01 /usr/openv/netbackup/bin

$nslookup 10.40.153.110

Server:         147.243.4.70

Address:        147.243.4.70#53

Non-authoritative answer:

110.153.40.10.in-addr.arpa      name = saenold24-b..com.

Note :

In policy client seletion was made as saenold24-b..com

I have tried the backup changing the client from saenold24-b..com. to saecopt51-b..com, still it fails with same error.

-Chan

[RamNagalla]

Note : in the activity monitor it parent fails with 6 and child stream fails with 6

so where you are seeing the job failure with 239  ?

show us the output of failed job detail status and also the policy output

bppllist <policyname> -L

[Marianne · Accepted solution]

I don't understand - why is CLIENT_NAME in bp.conf on the client set as saecopt51-b when the actual name is saenold24-b?
Is this maybe a cluster with the one name physical hostname and the other the virtual name for the cluster?
Is there a NB_ORA_CLIENT variable in the rman script? If so, what is it set to?

The thing is - you can see from bpclntcmd -pn that the master is also resolving Client IP address as hostname saecopt51-b.

Which one is correct?

What does 'hostname' on the client show? 

nslookup does not seem to know about these names.
Double-check DNS config and ensure that reverse lookup works, or else use hosts entries on master, media server(s) and client.

Your first step will be to ensure correct name lookup.

All of the following should show the SAME client hostname:

On client:
CLIENT_NAME in client's bp.conf
bpclntcmd -self and bpclntcmd -pn on the client
NB_ORA_CLIENT in rman script
 

On master:
bpclntcmd -ip 10.40.153.98 
Client name in policy

If you have to chance hosts entries, remember to refresh NBU host cache where you made changes: bpclntcmd -clear_host_cache

Only when all above entries are the same can the backup be retried.

Create the following log folders for further throubleshooting:

On master: bprd (restart NBU to enable log)
On client: bpcd and dbclient (dbclient needs 777 permissions).

If all hostname entries match and backup is still failing. please post logs.
Copy log file to reflect process name (e.g. bprd.txt) and upload as File attachment.
 

[Chan_backup]

hi,

issue got fixed, in the script, client name was incorrect.

Thanks Marianne for the tip to check NB_ORA_CLIENT in rman script

-Chan