Forum Discussion

jawad_butt1's avatar
12 years ago

Catalog Backup - unsuccessful

Hey all, I need help with doing a backup of the catalog and not sure where the problem is. There is no where that I can look at (or know) that would tell me what to do to fix it.

I have NBU 7.5 on Windows 2008 R2. Running a Master and a separate Media server. I can run full successful backups of file system jobs without problems but when i try to run the backup job for Catalog, it fails with error: none of the requested files were backed up(2). I have rebooted the server and created the policy a few times. I am trying to backup the catalog to C:\BackupDirectory (Disaster Recovery) with domain credentials but it doesnt seem to work.

 

I am also attaching the dpdbm log that (i dont think) really gives much info that i can go off of. This is all that i can see that says error.
 

excerpt:
15:43:04.391 [3524.3380] <4> bsa_comm_w_bkar: Wait for bkar END file / BEGIN file message.
15:43:07.495 [3524.2880] <16> serverResponse: ERR - server exited with status 25: cannot connect on socket
15:43:07.495 [3524.2880] <16> CreateNewImage: ERR - serverResponse() failed
15:43:08.447 [3524.3380] <16> bsa_a_backup_completed: ERR - thread <2880> backup failed: 25 <cannot connect on socket>
15:43:09.461 [3524.3380] <4> ASA_XBSA_file_backup: All backup jobs have failed.
15:43:09.461 [3524.3380] <16> do_online_nbdb_backup: Error backing up files in C:\Program Files\Veritas\NetBackupDB\staging
15:43:09.461 [3524.3380] <4> do_online_nbdb_backup: Setting NB-Full keyword in vxdbms.conf
15:43:09.461 [3524.3380] <4> do_online_nbdb_backup: Setting empty backup policy and schedule in vxdbms.conf
 

 

Full Error Log:
Lines 96 - 99
15:41:29.012 [3524.3380] <2> logconnections: BPDBM ACCEPT FROM 192.168.231.70.50251 TO 192.168.231.70.13721 fd = 568
15:41:29.012 [3524.3380] <2> bpdbm: VERBOSE = 0
15:41:29.012 [3524.3380] <8> vnet_check_vxss_server_magic: [vnet_vxss_helper.c:495] VxSS magic 1041669 0xfe505
15:41:29.028 [3524.3380] <8> vnet_check_vxss_server_magic: [vnet_vxss_helper.c:496] remote_vxss 160 0xa0
15:41:29.028 [3524.3380] <8> vnet_check_vxss_server_magic: [vnet_vxss_helper.c:538] Ignoring VxSS authentication 2 0x2
15:41:29.028 [3524.3380] <2> image_db: Q_IMAGE_CATALOG_BACKUP
15:41:29.028 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:41:29.028 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.028 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (464)
15:41:29.028 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (464) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.028 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:41:29.231 [3524.3380] <4> do_online_nbdb_backup: VXDBMS_NBDB_BACKUP_OWNER = YES - ASA online backup is included
15:41:29.231 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (568)
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (568) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (568)
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (568) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (568)
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (568) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (568)
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (568) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.246 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:41:29.262 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:41:29.262 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.262 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (568)
15:41:29.262 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (568) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:41:29.262 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:41:29.262 [3524.3380] <4> empty_staging_dir: Emptying staging directory:  C:\Program Files\Veritas\NetBackupDB\staging
15:41:29.293 [3524.3380] <4> open_terminate_event: Created terminate event:"Global\NetBackup Terminate Event, pid: 3524"
15:41:29.309 [3524.3380] <2> job_connect: SO_KEEPALIVE set on socket 588 for client nbmaster.contoso.com
15:41:29.309 [3524.3380] <2> logconnections: BPJOBD CONNECT FROM 192.168.231.70.50252 TO 192.168.231.70.13723 fd = 588
15:41:29.309 [3524.3380] <2> job_authenticate_connection: ignoring VxSS authentication check for now...
15:41:29.324 [3524.3380] <2> job_connect: Connected to the host nbmaster.contoso.com contype 53 jobid <0> socket <588>
15:41:29.324 [3524.3380] <2> job_connect: Connected on port 50252
15:41:29.340 [3524.3380] <4> startStagingJob: staging relational database files for catalog backup
15:41:29.340 [3524.3380] <4> do_online_nbdb_backup: staging NBAZDB backup to C:\Program Files\Veritas\NetBackupDB\staging
15:41:29.434 [3524.3380] <4> backup_dbspaces: Executing:  backup database directory 'C:\Program Files\Veritas\NetBackupDB\staging' wait before start with checkpoint log no copy transaction log truncate;
15:41:30.682 [3524.3380] <4> do_online_nbdb_backup: done staging NBAZDB backup to C:\Program Files\Veritas\NetBackupDB\staging
15:41:30.682 [3524.3380] <4> do_online_nbdb_backup: Online backup of NBAZDB successful
15:41:30.682 [3524.3380] <4> do_online_nbdb_backup: Server nbmaster.contoso.com, Policy HotBackup, Schedule Full, parentJobID 140
15:41:30.682 [3524.3380] <4> do_online_nbdb_backup: staging NBDB backup to C:\Program Files\Veritas\NetBackupDB\staging
15:41:30.728 [3524.3380] <4> backup_dbspaces: Executing:  backup database directory 'C:\Program Files\Veritas\NetBackupDB\staging' wait before start with checkpoint log no copy transaction log truncate;
15:42:03.754 [3524.3380] <4> do_online_nbdb_backup: done staging NBDB backup to C:\Program Files\Veritas\NetBackupDB\staging
15:42:03.754 [3524.3380] <4> do_online_nbdb_backup: Backup checkpoint at Wed Dec 19 15:42:03 2012
15:42:03.754 [3524.3380] <4> do_online_nbdb_backup: Online backup of NBDB successful at Wed Dec 19 15:42:03 2012
15:42:03.754 [3524.3380] <4> do_online_nbdb_backup: Server nbmaster.contoso.com, Policy HotBackup, Schedule Full, parentJobID 140
15:42:03.754 [3524.3380] <4> do_online_nbdb_backup: Setting backup policy:HotBackup and schedule type:0, in vxdbms.conf file.
15:42:03.754 [3524.3380] <4> SaveVxDBMS_Conf: Entering
15:42:03.754 [3524.3380] <2> SaveVxDBMS_Conf: Acquiring mutex
15:42:03.754 [3524.3380] <2> SaveVxDBMS_Conf: Acquiring write lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:42:03.754 [3524.3380] <2> SaveVxDBMS_Conf: Acquired write lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (616)
15:42:03.754 [3524.3380] <2> SaveVxDBMS_Conf: unlocking on fd (616) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:42:03.754 [3524.3380] <2> SaveVxDBMS_Conf: Releasing mutex
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: Backing up 16 database files
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 0:  C:\Program Files\Veritas\NetBackupDB\staging\DARS_DATA.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 1:  C:\Program Files\Veritas\NetBackupDB\staging\DARS_INDEX.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 2:  C:\Program Files\Veritas\NetBackupDB\staging\DBM_DATA.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 3:  C:\Program Files\Veritas\NetBackupDB\staging\DBM_INDEX.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 4:  C:\Program Files\Veritas\NetBackupDB\staging\EMM_DATA.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 5:  C:\Program Files\Veritas\NetBackupDB\staging\EMM_INDEX.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 6:  C:\Program Files\Veritas\NetBackupDB\staging\JOBD_DATA.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 7:  C:\Program Files\Veritas\NetBackupDB\staging\NBAZDB.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 8:  C:\Program Files\Veritas\NetBackupDB\staging\NBAZDB.log.1
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 9:  C:\Program Files\Veritas\NetBackupDB\staging\NBDB.db
15:42:03.769 [3524.3380] <4> do_online_nbdb_backup: File 10:  C:\Program Files\Veritas\NetBackupDB\staging\NBDB.log.1
15:42:03.785 [3524.3380] <4> do_online_nbdb_backup: File 11:  C:\Program Files\Veritas\NetBackupDB\staging\SEARCH_DATA.db
15:42:03.785 [3524.3380] <4> do_online_nbdb_backup: File 12:  C:\Program Files\Veritas\NetBackupDB\staging\SEARCH_INDEX.db
15:42:03.785 [3524.3380] <4> do_online_nbdb_backup: File 13:  C:\Program Files\Veritas\NetBackupDB\staging\databases.conf
15:42:03.785 [3524.3380] <4> do_online_nbdb_backup: File 14:  C:\Program Files\Veritas\NetBackupDB\staging\server.conf
15:42:03.785 [3524.3380] <4> do_online_nbdb_backup: File 15:  C:\Program Files\Veritas\NetBackupDB\staging\vxdbms.conf
15:42:03.785 [3524.3380] <4> do_online_nbdb_backup: DOING_HOT_CATALOG_BACKUP is: YES
15:42:03.800 [3524.3380] <2> logconnections: BPRD CONNECT FROM 192.168.231.70.50253 TO 192.168.231.70.13720 fd = 624
15:42:03.800 [3524.3380] <8> vnet_check_vxss_client_magic_with_info: [vnet_vxss_helper.c:871] Ignoring VxSS authentication 2 0x2
15:42:04.112 [3524.3380] <2> logconnections: BPRD CONNECT FROM 192.168.231.70.50254 TO 192.168.231.70.13720 fd = 624
15:42:04.112 [3524.3380] <8> vnet_check_vxss_client_magic_with_info: [vnet_vxss_helper.c:871] Ignoring VxSS authentication 2 0x2
15:42:04.612 [3524.2880] <2> logconnections: BPRD CONNECT FROM 192.168.231.70.50255 TO 192.168.231.70.13720 fd = 632
15:42:04.612 [3524.2880] <8> vnet_check_vxss_client_magic_with_info: [vnet_vxss_helper.c:871] Ignoring VxSS authentication 2 0x2
15:42:05.314 [3484.3832] <2> logconnections: BPDBM ACCEPT FROM 192.168.231.70.50256 TO 192.168.231.70.13721 fd = 476
15:42:05.329 [3484.3832] <2> bpdbm: VERBOSE = 0
15:42:05.329 [3484.3832] <8> vnet_check_vxss_server_magic: [vnet_vxss_helper.c:495] VxSS magic 1041669 0xfe505
15:42:05.329 [3484.3832] <8> vnet_check_vxss_server_magic: [vnet_vxss_helper.c:496] remote_vxss 84 0x54
15:42:05.329 [3484.3832] <8> vnet_check_vxss_server_magic: [vnet_vxss_helper.c:538] Ignoring VxSS authentication 2 0x2
15:42:05.329 [3484.3832] <2> image_db: Q_IMAGE_GET_CCNAME
15:42:05.360 [3484.3832] <2> LOCAL CLASS_ATT_DEFS: Product ID = 6
15:43:04.391 [3524.3380] <4> bsa_comm_w_bkar: Wait for bkar END file / BEGIN file message.
15:43:07.495 [3524.2880] <16> serverResponse: ERR - server exited with status 25: cannot connect on socket
15:43:07.495 [3524.2880] <16> CreateNewImage: ERR - serverResponse() failed
15:43:08.447 [3524.3380] <16> bsa_a_backup_completed: ERR - thread <2880> backup failed: 25 <cannot connect on socket>
15:43:09.461 [3524.3380] <4> ASA_XBSA_file_backup: All backup jobs have failed.
15:43:09.461 [3524.3380] <16> do_online_nbdb_backup: Error backing up files in C:\Program Files\Veritas\NetBackupDB\staging
15:43:09.461 [3524.3380] <4> do_online_nbdb_backup: Setting NB-Full keyword in vxdbms.conf
15:43:09.461 [3524.3380] <4> do_online_nbdb_backup: Setting empty backup policy and schedule in vxdbms.conf
15:43:09.461 [3524.3380] <4> SaveVxDBMS_Conf: Entering
15:43:09.461 [3524.3380] <2> SaveVxDBMS_Conf: Acquiring mutex
15:43:09.461 [3524.3380] <2> SaveVxDBMS_Conf: Acquiring write lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:43:09.461 [3524.3380] <2> SaveVxDBMS_Conf: Acquired write lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (616)
15:43:09.461 [3524.3380] <2> SaveVxDBMS_Conf: unlocking on fd (616) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:43:09.461 [3524.3380] <2> SaveVxDBMS_Conf: Releasing mutex
15:43:09.492 [3524.3380] <2> job_monitoring_exex: ACK disconnect
15:43:09.492 [3524.3380] <2> job_disconnect: Disconnected
15:43:09.492 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:43:09.492 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:43:09.492 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (588)
15:43:09.492 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (588) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:43:09.492 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:43:09.492 [3524.3380] <4> GetServerCacheSettings: Entering.
15:43:09.492 [3524.3380] <4> GetServerCacheSettings: Exiting with rc = 0
15:43:09.492 [3524.3380] <4> apply_tlog: Executing C:\Program Files\Veritas\NetBackupDB\Win64\dbsrv11 -qs -qw  "C:\Program Files\Veritas\NetBackupDB\staging\NBAZDB.db" -ds "C:\Program Files\Veritas\NetBackupDB\staging" -a "C:\Program Files\Veritas\NetBackupDB\staging\NBAZDB.log.1" -c 100M -ch 1024M -cl 100M
15:43:11.192 [3524.3380] <4> NBDBsystem: Command exited with status: 0
15:43:11.192 [3524.3380] <4> apply_tlog: Deleted log C:\Program Files\Veritas\NetBackupDB\staging\NBAZDB.log.1
15:43:11.192 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring mutex
15:43:11.192 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquiring read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:43:11.192 [3524.3380] <2> ReadVxDBMS_ConfFile: Acquired read lock on C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock successfully with fd (568)
15:43:11.192 [3524.3380] <2> ReadVxDBMS_ConfFile: unlocking on fd (568) for C:\Program Files\Veritas\NetBackupDB\data\vxdbms_conf.lock
15:43:11.192 [3524.3380] <2> ReadVxDBMS_ConfFile: Releasing mutex
15:43:11.192 [3524.3380] <4> GetServerCacheSettings: Entering.
15:43:11.208 [3524.3380] <4> GetServerCacheSettings: Exiting with rc = 0
15:43:11.208 [3524.3380] <4> apply_tlog: Executing C:\Program Files\Veritas\NetBackupDB\Win64\dbsrv11 -qs -qw  "C:\Program Files\Veritas\NetBackupDB\staging\NBDB.db" -ds "C:\Program Files\Veritas\NetBackupDB\staging" -a "C:\Program Files\Veritas\NetBackupDB\staging\NBDB.log.1" -c 100M -ch 1024M -cl 100M
15:43:13.127 [3524.3380] <4> NBDBsystem: Command exited with status: 0
15:43:13.142 [3524.3380] <4> apply_tlog: Deleted log C:\Program Files\Veritas\NetBackupDB\staging\NBDB.log.1
15:43:13.142 [3524.3380] <16> ImageCatalogBackup::executeQuery: exec_asa_database_backup() failed (2)
15:43:13.158 [3524.3380] <4> jmcomm_UpdateActionStatus: Sending status: 2 back to parent JobID: 140
15:43:13.189 [3524.3380] <2> Orb::init: Enabling ORBNativeCharCodeSet UTF-8(Orb.cpp:594)
15:43:13.189 [3524.3380] <2> Orb::init: Created anon service name: NB_3524_1337705567(Orb.cpp:697)
15:43:13.189 [3524.3380] <2> Orb::init: endpointvalue is : pbxiop://1556:NB_3524_1337705567(Orb.cpp:714)
15:43:13.189 [3524.3380] <2> Orb::init: initializing ORB Default_DAEMON_Orb with: Unknown -ORBSvcConfDirective "-ORBDottedDecimalAddresses 0" -ORBSvcConfDirective "static Resource_Factory '-ORBNativeCharCodeSet UTF-8'" -ORBSvcConfDirective "static PBXIOP_Factory '-enable_keepalive'" -ORBSvcConfDirective "static EndpointSelectorFactory ''" -ORBSvcConfDirective "static Resource_Factory '-ORBProtocolFactory PBXIOP_Factory'" -ORBSvcConfDirective "static Resource_Factory '-ORBProtocolFactory IIOP_Factory'" -ORBDefaultInitRef '' -ORBSvcConfDirective "static PBXIOP_Evaluator_Factory '-orb Default_DAEMON_Orb'" -ORBSvcConfDirective "static Resource_Factory '-ORBConnectionCacheMax 1024 '" -ORBEndpoint pbxiop://1556:NB_3524_1337705567 -ORBSvcConf nul -ORBSvcConfDirective "static Server_Strategy_Factory '-ORBMaxRecvGIOPPayloadSize 268435456'"(Orb.cpp:825)
15:43:13.205 [3524.3380] <2> Orb::init: caching EndpointSelectorFactory(Orb.cpp:840)
15:43:13.298 [3524.3380] <2> jmcomm_UpdateActionStatus: returning

 

If you need any other information that would be helpful in getting this issue resolved, i'll be happy to provide. please let me know what you think i can do to get the catalog backups going.

  • Hmm, NAT is not supported with NBU, it can work, but can be very very troublesome.

    CORBA issues are network related, we had 25s and as Marianne pointed out, the master is having trouble talking to itself, which is pointing more and more to something outside NBU casung this, or at least contributing to it, which was my first thought, although I didn't say so ... )

    Proving EMM is correct (the bits we looked at of yours looked fine) and there are no incorrect entries (unlikely on a new system) I'm struggling to think of a reason where NBU could cause this, after all, we only use the network provided to us, we don't control it.

    As you will understand, when looking at an issue you have to consider the most likely cause, there's no point spending hours looking where the issue is least likely to be and I do think that it this case, starting again is the correct way forward.

    I suggest that you progress without NAT, if nothing else to confirm NBU works, keep it simple and all that.  then if you must, see what happens with NAT (which I don't recommend as it's not supported).

    Regards,

    Martin

22 Replies