catalog backup fails ,error code 1

[rookie11]

Hi All

catalog backup fails with error code 1

GUI error , file list : CATALOG_DRIVEN_BACKUP

05/28/2013 16:00:00 - Info bpdbm (pid=23510) staging relational database files for catalog backup

05/28/2013 16:00:00 - Info bpdbm (pid=23510) staging NBAZDB backup to /usr/openv/db/staging

05/28/2013 16:00:00 - Error bpdbm (pid=23510) error staging NBAZDB backup to /usr/openv/db/staging

05/28/2013 16:00:00 - Info bpdbm (pid=23510) staging NBDB backup to /usr/openv/db/staging

05/28/2013 16:00:05 - Info bpdbm (pid=23510) done staging NBDB backup to /usr/openv/db/staging

the requested operation was partially successful  (1)

rest of 2 streams --completes successfully.

 ls -lthr

total 186M

-rw------- 1 root root    26M May 24  2011 DARS_INDEX.db

-rw------- 1 root root    26M May 24  2011 DARS_DATA.db

-rw------- 1 root daemon 2.4M Aug 25  2011 NBAZDB.db.template

-r-------- 1 root root   320K May 25 17:40 NBAZDB.log  ---> date havent changed

-r-------- 1 root root   2.4M May 25 17:40 NBAZDB.db   ---> date havent changed

-rw------ 1 root root    485 May 28 05:03 vxdbms.conf

-rw------- 1 root root    26M May 28 12:14 DBM_INDEX.db

-rw------- 1 root root    26M May 28 12:34 DBM_DATA.db

-rw------- 1 root root    26M May 28 13:54 EMM_INDEX.db

-rw------- 1 root root    26M May 28 15:14 EMM_DATA.db

-rw------- 1 root root   5.8M May 28 15:14 NBDB.db

-rw-rw-rw- 1 root root   4.1M May 28 15:22 NBDB.log 

but for rest of them date changed till latest one.  since 25th may catalog backup fail.

 more vxdbms.conf

VXDBMS_NB_SERVER = NB_MASTER

VXDBMS_NB_PORT = 13785

VXDBMS_NB_DATABASE = NBDB

VXDBMS_AZ_DATABASE = NBAZDB

VXDBMS_NB_DATA = /usr/openv/db/data

VXDBMS_NB_INDEX = /usr/openv/db/data

VXDBMS_NB_TLOG = /usr/openv/db/data

VXDBMS_NB_STAGING = /usr/openv/db/staging

VXDBMS_NB_PASSWORD = 04a6ad0837f4092f666053af12473ff150b5f4e8aff24682

AZ_DB_PASSWORD = Jj8mkP3sKTo=

VXDBMS_NB_FULL_KEYWORD = NBDB:172440:1369735200:F

VXDBMS_NB_INCREMENTAL = NBDB.log.1

VXDBMS_AZ_INCREMENTAL = NBAZDB.log.1 

disk space 25 GB free

/usr/openv/var/global

 more databases.conf

"/usr/openv/db/data/NBDB.db" -n NBDB

"/usr/openv/db/data/NBAZDB.db" -n NBAZDB 

sudo ./nbdb_admin -validate NBAZDB

SQL error (-83) -- Specified database not found

SQL error (-83) -- Specified database not found

SQL Anywhere Validation Utility Version 11.0.1.2475

Database [NBAZDB] validation failed.

error logs nbdb:

16:02:19.352 [317] <16> validate_database: Database validation failed for database NBAZDB

16:02:19.360 [317] <16> nbdb_admin: Database [NBAZDB] validation failed.

16:02:53.492 [406] <16> secure_db: ODBC connection failed.

16:02:53.492 [406] <16> secure_db: ErrMsg [Sybase][ODBC Driver][SQL Anywhere]Specified database not found, ErrCode -1, Sqlstate 08001

16:02:53.492 [406] <16> nbdb_admin: Change of dba password for NBAZDB failed.

[Marianne]

Have a look at this TN: http://www.symantec.com/docs/TECH166041

The TN is for Windows, but you should be able to apply to your environment:

Cause

The can be caused if the AZ_DB_PASSWORD information is missing or corrupt in the<install_path>\Veritas\NetBackupdb\data\vxdbms.conf file.

Solution

From Install_path\Veritas\Netbackup\bin

1)  Run:
nbdb_admin -dba nbusql
***This should create the missing AZ_DB_PASSWORD password line in vxdbms.conf

2) Run:
nbdb_admin -validate BMRDB; nbdb_admin -validate NBAZDB; nbdb_admin -validate

***This will manually validate all databases.

3)  If the validation in #2 succeeds run a hot catalog backup. It should complete successfully for all databases available.

[Ankit_Maheshwar]

As per Marianne suggestion this looks AZ_DB_PASSWORD information is missing...

create the missing AZ_DB_PASSWORD information in vxdbms.conf file...

Do data validiation as per Marianne suggestion if you seee any error in this then follow this procedure.

Down Netbackup services.

installpath/openv/netbackup/bin/goodies/netbackup stop 

Start database service

installpath/openv/netbackup/bin/nbdbms_start_stop start

do full data validation---

cd /usr/openv/db/bin

nbdb_admin <databasename> -validate -full