Ralus Agent- Oracle backup fails with ORA-29701: unable to connect to Cluster Synchronization

AGAINST A BRICKWALL – PLEASE HELP

BES 2010 R3, with RALLUS agent on SLES 11.  Oracle 11g.  Two databses on the server, one ASM one NON ASM.  I can backup the NON ASM DB no problem, but the ASM DB throws ORA-29701: unable to connect to Cluster Synchronization.  I am sysdba and asmadmin with my sysbackup account.  I can connect to the server using my logon account, open the DB with sysbackup and kick off a copy of the rman script and it starts, but running through the gui/media manager I get the above error. 

 

27fd710 Tue Nov  8 13:27:30 2011 : CDbsb::dump: m_dbDeviceName (Oracle-Linux::\\myserver.mysite.com\MYASMDB)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsb::dump: m_hLogOnToken (1)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsb::dump: m_dbScriptOutputQ (8473904)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsb::dump: m_threadMutex (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_sqlplusTimeout (600)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_jobType (1)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_bec (0x818490)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_oraVersion (110)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_operationType (Backup)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_backupType (2)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_dbStatus (3)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_dbHome (/orasoft/product/11gR2)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_SID (MYASMDB)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_oraPfile (NULL)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_description (NULL)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_logFileKeyword (RMAN_LOG_FILE)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: m_logFileName (rman)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: DB credentials osAuthenticated (0) tnsname (NULL) login (sysbackup) password (****)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: Recovery catalog credentials osAuthenticated (0) tnsname (NULL) login (NULL) password (NULL)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: database state (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: Use rman defaults (1)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN max read rate (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN max bfs size (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN max open files (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN max files per set (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN max bkset size (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN max arch bkset size (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN auto archive log file delete (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN backup archive log files (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN backup type (NULL)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN bfs format (BE_%U)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN bk set id (NULL)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN bk method (0)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN plus archivelog (1)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: RMAN control file auto backup (1)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::dump: Selection list - objtype (1101) objname ()

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runDBJob: utilCommandFile = /var/VRTSralus/runrman.1320780450-1963D2AD-B21F-4D47-903B-CE0B78403D4D.tmp

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runDBJob: SqlplusCmdFile = /var/VRTSralus/runSqlplus.1320780450-1963D2AD-B21F-4D47-903B-CE0B78403D4D.tmp

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runDBJob: SqlplusCmdFile = /var/VRTSralus/runSrvctl.1320780450-1963D2AD-B21F-4D47-903B-CE0B78403D4D.tmp

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsb::createSecureFile: Obtained user id (1004) for user (beOracle)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::createRmanCmd: Success in opening rman file (/var/VRTSralus/runrman.1320780450-1963D2AD-B21F-4D47-903B-CE0B78403D4D.tmp)

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runRmanCmd: Starting Oracle Recovery Manager using (/orasoft/product/11gR2/bin/rman )

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runCmd: Function called

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runCmd: pipe descriptors. fd[0]=14 fd[1]=15

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runCmd: Parent Process - Closed fd[1]=-1

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runCmd: Waiting until child finishes...

f27fd710 Tue Nov  8 13:27:30 2011 : CDbsbOra::runCmd: ***************** BEGIN LOGGING RMAN OUTPUT *****************

f27fd710 Tue Nov  8 13:27:30 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:30 2011 : procMsg: Recovery Manager: Release 11.2.0.2.0 - Production on Tue Nov 8 13:27:30 2011

f27fd710 Tue Nov  8 13:27:30 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:30 2011 : procMsg: Copyright (c) 1982, 2009, Oracle and/or its affiliates.  All rights reserved.

f27fd710 Tue Nov  8 13:27:30 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:30 2011 : procMsg: 4>

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 5> # -----------------------------------------------------------------

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 6> # RMAN command section

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 7> # -----------------------------------------------------------------

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 8>

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 9> RUN {

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 10> ALLOCATE CHANNEL ch0

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 11>     TYPE 'SBT_TAPE';

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 12> SEND 'BSA_SERVICE_HOST=10.122.156.10,NBBSA_TOTAL_STREAMS=1,NBBSA_JOB_COOKIE={1963D2AD-B21F-4D47-903B-CE0B78403D4D},NBBSA_DB_DEVICE_NAME=Oracle-Linux::\\myserver.mysite.com\MYASMDB';

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 13> BACKUP

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 14>     INCREMENTAL LEVEL=0

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 15>     FORMAT 'BE_%U'

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 16>     DATABASE FORCE PLUS ARCHIVELOG FORCE NOT BACKED UP;

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 17>

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 18> RELEASE CHANNEL ch0;

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 19> }

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: 20>

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: RMAN-06900: WARNING: unable to generate V$RMAN_STATUS or V$RMAN_OUTPUT row

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: RMAN-06901: WARNING: disabling update of the V$RMAN_STATUS and V$RMAN_OUTPUT rows

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: ORACLE error from target database:

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: ORA-29701: unable to connect to Cluster Synchronization Service

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: connected to target database: MYASMDB (DBID=231004848)

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:31 2011 : procMsg: using target database control file instead of recovery catalog

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: allocated channel: ch0

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: channel ch0: SID=1575 device type=SBT_TAPE

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: channel ch0: Symantec/BackupExec/1.1.0

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: sent command to channel: ch0

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: Starting backup at 08-NOV-11

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: ORACLE error from target database:

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: ORA-29701: unable to connect to Cluster Synchronization Service

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: released channel: ch0

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: RMAN-00571: ===========================================================

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: RMAN-00571: ===========================================================

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: RMAN-03002: failure of backup plus archivelog command at 11/08/2011 13:27:32

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: ORA-29701: unable to connect to Cluster Synchronization Service

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg:

f27fd710 Tue Nov  8 13:27:32 2011 : procMsg: Recovery Manager complete.