The last 3 weeks I have had the Netbackup 7.5.0.6 database just stop working. Today This is the error I had when trying to log into see what was going on. "Unable to obtail the server list from the Enterprise Meida Manager server database server is down (93)" The Master/Medai server are the same server.I have 9GB of space which is low for this server I am guessing it is everything waiting to be backup and log files. I have no idea where to start looking into this issue. Like I said this has been happening for about the last 3 weeks and nothing has really changed.

I suspect that the disk is filling up enough to cause NBU to shut down the DB to protect it from getting corrupted. I think it does this somewhere arounf 90% full M

Resolution: If it is determined that nbpem is not running, it should be restarted. This can be accomplished from the Services interface on the Windows server. After nbpem has restarted, start the EMM database from a command prompt, using the command nbdb_admin -start NBDB. (This command can be found in <install_path>\VERITAS\NetBackup\bin.) Article URL http://www.symantec.com/docs/TECH61664

Ah that could be the issue then. I will clear more space.

please see if you find any related info inthe server.log file /usr/openv/db/log/server.log please post the log if possible

Ok got up to 53GB free we will see what that does. Thank you. I will also try the restart command.

Sorry forgot to say this is a windows 2008 server R2. I don't see a server.log any where.

Database keeps going down

14 Replies

Will_Restore
Level 6
11 years ago

Resolution:
If it is determined that nbpem is not running, it should be restarted. This can be accomplished from the Services interface on the Windows server.

After nbpem has restarted, start the EMM database from a command prompt, using the command nbdb_admin -start NBDB. (This command can be found in <install_path>\VERITAS\NetBackup\bin.)

Article URL http://www.symantec.com/docs/TECH61664
mph999
Level 6
11 years ago
I suspect that the disk is filling up enough to cause NBU to shut down the DB to protect it from getting corrupted.

I think it does this somewhere arounf 90% full

M
NathanNieman
Level 6
11 years ago
Ah that could be the issue then. I will clear more space.
RamNagalla
Moderator
11 years ago
please see if you find any related info inthe server.log file

/usr/openv/db/log/server.log

please post the log if possible
NathanNieman
Level 6
11 years ago
Ok got up to 53GB free we will see what that does. Thank you. I will also try the restart command.
NathanNieman
Level 6
11 years ago
Sorry forgot to say this is a windows 2008 server R2.

I don't see a server.log any where.
RamNagalla
Moderator
11 years ago
it should be Installpath\Veritas\NetBackupDB\log\server.log if it is winddows.
NathanNieman
Level 6
11 years ago
Ah found it. Didn't look there. I will post if I find anything in the log.
NathanNieman
Level 6
11 years ago
Ok here is what I am seeing that looks Odd to me

I. 01/02 19:14:56. Finished checkpoint of "NBAZDB" (NBAZDB.db) at Thu Jan 02 2014 19:14

I. 01/02 19:27:42. Starting database "utility_db" (utility_db) at Thu Jan 02 2014 19:27

I. 01/02 19:27:42. Database "utility_db" (utility_db) started at Thu Jan 02 2014 19:27

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbstserv.exe';PID=0xf10;THREAD=0xf14;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbstserv.exe';PID=0xf10;THREAD=0xf14;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbstserv.exe';PID=0xf10;THREAD=0xf14;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbstserv.exe';PID=0xf10;THREAD=0xf14;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbpem.exe';PID=0x14d0;THREAD=0x157c;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x1a00;THREAD=0xc;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x1e50;THREAD=0x2884;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x2eac;THREAD=0x2b84;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x1590;THREAD=0x1ce8;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x165c;THREAD=0xa6c;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x1e24;THREAD=0x1ac8;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x23b8;THREAD=0xdf4;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0xa64;THREAD=0x894;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x29b4;THREAD=0x2bb0;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\bpdbm.exe';PID=0x2220;THREAD=0x2aec;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbim.exe';PID=0xae4;THREAD=0x758;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbim.exe';PID=0xae4;THREAD=0x758;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbim.exe';PID=0xae4;THREAD=0xca0;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Connection terminated abnormally

I. 01/02 19:30:52. Disconnected SharedMemory client's AppInfo: IP=131.40.10.88;HOST=UNS40-88;OSUSER=SYSTEM;OS='Windows 2008R2 Build 7601 Service Pack 1';EXE='C:\Program Files\Veritas\NetBackup\bin\nbim.exe';PID=0xae4;THREAD=0xca0;VERSION=11.0.1.2960;API=ODBC;TIMEZONEADJUSTMENT=-300

I. 01/02 19:30:52. Starting checkpoint of "NBDB" (NBDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:53. Finished checkpoint of "NBDB" (NBDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Database "NBDB" (NBDB.db) stopped at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Starting checkpoint of "NBAZDB" (NBAZDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Finished checkpoint of "NBAZDB" (NBAZDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Database "NBAZDB" (NBAZDB.db) stopped at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Database "utility_db" (utility_db) stopped at Thu Jan 02 2014 19:30

I. 01/03 08:25:06. Starting database "utility_db" (utility_db) at Fri Jan 03 2014 08:25

I. 01/03 08:25:06. Database "utility_db" (utility_db) started at Fri Jan 03 2014 08:25

I. 01/03 08:25:06. Cache size adjusted to 197812K

I. 01/03 08:25:06. Starting database "NBDB" (C:\Progra

I am guessing it was the 90% of the space used that was causing this issue.
NathanNieman
Level 6
11 years ago
Also seeing this from today

. 01/02 19:30:52. Starting checkpoint of "NBDB" (NBDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:53. Finished checkpoint of "NBDB" (NBDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Database "NBDB" (NBDB.db) stopped at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Starting checkpoint of "NBAZDB" (NBAZDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Finished checkpoint of "NBAZDB" (NBAZDB.db) at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Database "NBAZDB" (NBAZDB.db) stopped at Thu Jan 02 2014 19:30

I. 01/02 19:30:54. Database "utility_db" (utility_db) stopped at Thu Jan 02 2014 19:30

I. 01/03 08:25:06. Starting database "utility_db" (utility_db) at Fri Jan 03 2014 08:25

I. 01/03 08:25:06. Database "utility_db" (utility_db) started at Fri Jan 03 2014 08:25

I. 01/03 08:25:06. Cache size adjusted to 197812K

I. 01/03 08:25:06. Starting database "NBDB" (C:\Program Files\Veritas\NetBackupDB\data\NBDB.db) at Fri Jan 03 2014 08:25

I. 01/03 08:25:06. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\NBDB.db" consists of 42 disk fragments

I. 01/03 08:25:07. Opening dbspace 'EMM_DATA' in file 'C:\Program Files\Veritas\NetBackupDB\data\EMM_DATA.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\EMM_DATA.db" consists of 29 disk fragments

I. 01/03 08:25:07. Opening dbspace 'EMM_INDEX' in file 'C:\Program Files\Veritas\NetBackupDB\data\EMM_INDEX.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\EMM_INDEX.db" consists of 3 disk fragments

I. 01/03 08:25:07. Opening dbspace 'DBM_DATA' in file 'C:\Program Files\Veritas\NetBackupDB\data\DBM_DATA.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\DBM_DATA.db" consists of 106 disk fragments

I. 01/03 08:25:07. Opening dbspace 'DBM_INDEX' in file 'C:\Program Files\Veritas\NetBackupDB\data\DBM_INDEX.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\DBM_INDEX.db" consists of 8 disk fragments

I. 01/03 08:25:07. Opening dbspace 'DARS_DATA' in file 'C:\Program Files\Veritas\NetBackupDB\data\DARS_DATA.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\DARS_DATA.db" consists of 2 disk fragments

I. 01/03 08:25:07. Opening dbspace 'DARS_INDEX' in file 'C:\Program Files\Veritas\NetBackupDB\data\DARS_INDEX.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\DARS_INDEX.db" consists of 2 disk fragments

I. 01/03 08:25:07. Opening dbspace 'SEARCH_DATA' in file 'C:\Program Files\Veritas\NetBackupDB\data\SEARCH_DATA.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\SEARCH_DATA.db" consists of 2 disk fragments

I. 01/03 08:25:07. Opening dbspace 'SEARCH_INDEX' in file 'C:\Program Files\Veritas\NetBackupDB\data\SEARCH_INDEX.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\SEARCH_INDEX.db" consists of 2 disk fragments

I. 01/03 08:25:07. Opening dbspace 'JOBD_DATA' in file 'C:\Program Files\Veritas\NetBackupDB\data\JOBD_DATA.db' for database 'NBDB'

I. 01/03 08:25:07. Performance warning: Database file "C:\Program Files\Veritas\NetBackupDB\data\JOBD_DATA.db" consists of 2 disk fragments

I. 01/03 08:25:07. Transaction log: NBDB.log

I. 01/03 08:25:07. Starting checkpoint of "NBDB" (NBDB.db) at Fri Jan 03 2014 08:25

I. 01/03 08:25:07. Finished checkpoint of "NBDB" (NBDB.db) at Fri Jan 03 2014 08:25

I. 01/03 08:25:07. Database "NBDB" (NBDB.db) started at Fri Jan 03 2014 08:25

I. 01/03 08:25:07. This database is licensed for use with:

I. 01/03 08:25:07. Application: CommonRepository

I. 01/03 08:25:07. Company: VERITAS

I. 01/03 08:25:12. Cache size adjusted to 320200K

I. 01/03 08:25:15. Cache size adjusted to 351700K

I. 01/03 08:25:17. Cache size adjusted to 360788K

Forum Discussion

Database keeps going down

14 Replies

Related Content

Tape drive keeps going offline

tape drive path keeps going down

Journal Database keeps growing

Index services keep stopping

Oracle database restore from vmware type backup

Recent Discussions

command: bperror

MS-SharePoint policy restore error (2804) .

How to restore a backup

How to configure RBAC

10 years old netbackup appliance database service down, ssl certification out date