Forum Discussion

turguns's avatar
turguns
Level 5
11 years ago

150: termination requested by administrator client process aborted (50)

Hello All,

Netbackup 7.1 Enterprise. Pool is VTL media.

Yesterday at 21:00 started backup policy with big size. Type of backup type is  oracle with  8 streams (rman)...  But  morning  at 6:10   the netbackup policy was terminated with error  150: termination requested by administrator client process aborted  (50). Nobody stopped it. Stopped itself. Our DBA admin also checked from Oracle side and saying everything is normal from dba side. Any idea? did you have like this experience before?

  • Hi all, This problem was solved. At this time on this machine  have a job to label the media and restart the netbackup to clean logs..I forgot.. Now I moved it another time.. It is okay..

    Thank you all for replies.

     

  • I have seen it before - status code 50 is client process aborted. So something went wrong during the backup process. Check for possible core dump or low memory, swap space, kernel settings etc etc. Status 150 is a side effect of the status 50 - the status code is absolute misleading.

  • Hi Nicolai. I should check master server or client server ??

  • Hi Nicolai. I checked client side..seems everythink is okay. enough memory,enough swap space, no problems from log.

     

    From Master server I found the following log from /var/log/messages. telling at 

    Jan 15 06:00:03 nbumedia nbvault: Shutting down nbvault daemon

    Maybe reason is this ??  Because  time is matching . 01/15/2014 06:10:24 - Info bphdb (pid=20039) done. status: 150: termination requested by administrator
    client process aborted  (50)

    At 06:10 backup process was stopped.

    What do you think?

     

    an 15 04:05:03 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 04:05
    Jan 15 04:05:04 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 04:05
    Jan 15 04:30:50 nbumedia kernel: st 2:0:1:10: reservation conflict
    Jan 15 04:30:50 nbumedia kernel: st50: Error 110018 (driver bt 0x0, host bt 0x11).
    Jan 15 04:33:18 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 04:33
    Jan 15 04:33:20 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 04:33
    Jan 15 05:00:03 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 05:00
    Jan 15 05:00:05 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 05:00
    Jan 15 05:23:40 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 05:23
    Jan 15 05:23:43 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 05:23
    Jan 15 05:52:18 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 05:52
    Jan 15 05:52:20 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 05:52
    Jan 15 06:00:03 nbumedia nbvault: Shutting down nbvault daemon
    Jan 15 06:00:43 nbumedia tldcd[3409]: starting tldcd
    Jan 15 06:00:43 nbumedia tldcd[5108]: TERMINATION requested from nbumedia
    Jan 15 06:00:46 nbumedia ltid[4082]: Sending shutdown to tldcd daemon...
    Jan 15 06:00:46 nbumedia tldcd[5108]: Daemon has terminated on request
    Jan 15 06:00:50 nbumedia vmd[4096]: terminating - successful (0)
    Jan 15 06:00:50 nbumedia vmd[4096]: volume daemon terminating because it received a signal (15)
    Jan 15 06:00:50 nbumedia vmd[4096]: terminating - daemon terminated (7)
    Jan 15 06:01:27 nbumedia SQLAnywhere(nb_nbumedia): Starting database "utility_db" (utility_db) at Wed Jan 15 2014 06:01
    Jan 15 06:01:27 nbumedia SQLAnywhere(nb_nbumedia): Database "utility_db" (utility_db) started at Wed Jan 15 2014 06:01
    Jan 15 06:01:27 nbumedia SQLAnywhere(nb_nbumedia): Database server shutdown requested by DBSTOP
    Jan 15 06:01:27 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:01
    Jan 15 06:01:27 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:01
    Jan 15 06:01:28 nbumedia SQLAnywhere(nb_nbumedia): Database server stopped at Wed Jan 15 2014 06:01
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): SQL Anywhere Network Server Version 11.0.1.2475
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): OEM Authenticated Edition, licensed only for use with authenticated OEM applications.
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Copyright (c) 2001-2009, iAnywhere Solutions, Inc.
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Portions copyright (c) 1988-2009, Sybase, Inc. All rights reserved.
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Use of this software is governed by the Sybase License Agreement. Refer to http://www.sybase.com/softwarelicenses
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): 16 logical processor(s) on 2 physical processor(s) detected.
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Processor limit (licensed processors): 128
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Maximum number of physical processors the server will use: 2
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): This server is licensed to:
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):     NetBackup
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):     Symantec Corporation
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Running Linux 2.6.32-131.0.15.el6.x86_64 #1 SMP Tue May 10 15:42:40 EDT 2011 on X86_64
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Server built for X86_64 processor architecture
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): 25600K of memory used for caching
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Minimum cache size: 25600K, maximum cache size: 512000K
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Using a maximum page size of 4096 bytes
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Starting database "NBDB" (/usr/openv/db/data/NBDB.db) at Wed Jan 15 2014 06:06
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'EMM_DATA' in file '/usr/openv/db/data/EMM_DATA.db' for database 'NBDB'
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'EMM_INDEX' in file '/usr/openv/db/data/EMM_INDEX.db' for database 'NBDB'
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DBM_DATA' in file '/usr/openv/db/data/DBM_DATA.db' for database 'NBDB'
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DBM_INDEX' in file '/usr/openv/db/data/DBM_INDEX.db' for database 'NBDB'
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DARS_DATA' in file '/usr/openv/db/data/DARS_DATA.db' for database 'NBDB'
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DARS_INDEX' in file '/usr/openv/db/data/DARS_INDEX.db' for database 'NBDB'
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Transaction log: /usr/openv/db/data/NBDB.log
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:06
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:06
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Database "NBDB" (NBDB.db) started at Wed Jan 15 2014 06:06
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): This database is licensed for use with:
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):     Application: CommonRepository
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):     Company: VERITAS
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Database server started at Wed Jan 15 2014 06:06
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Trying to start SharedMemory link ...
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):     SharedMemory link started successfully
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Trying to start TCPIP link ...
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Starting on port 13785
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia):     TCPIP link started successfully
    Jan 15 06:06:04 nbumedia SQLAnywhere(nb_nbumedia): Now accepting requests
    Jan 15 06:06:13 nbumedia vmd[5032]: ready for connections
    Jan 15 06:06:15 nbumedia nbvault: Starting nbvault daemon
    Jan 15 06:06:41 nbumedia ltid[5026]: ltid can not be started while resources are assigned to the host.
    Jan 15 06:07:16 nbumedia tldcd[5620]: starting tldcd
    Jan 15 06:07:21 nbumedia tldd[5615]: TLD(0) going to UP state
    Jan 15 06:07:21 nbumedia avrd[5616]: Reservation Conflict status from hcart2013 (device 14)
    Jan 15 06:07:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:07:22 nbumedia tldd[5615]: TLD(1) going to UP state
    Jan 15 06:07:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:07:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:08:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:08:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:08:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:08:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:09:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:09:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:09:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:09:51 nbumedia kernel: st71: Block limits 1 - 2097152 bytes.
    Jan 15 06:09:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:10:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:10:16 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:10
    Jan 15 06:10:21 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:10
    Jan 15 06:10:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:10:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:10:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:10:57 nbumedia SQLAnywhere(nb_nbumedia): Cache size adjusted to 159724K
    Jan 15 06:11:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:11:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:11:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:11:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:11:57 nbumedia SQLAnywhere(nb_nbumedia): Cache size adjusted to 193148K
    Jan 15 06:12:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:12:16 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:12
    Jan 15 06:12:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:12:21 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:12
    Jan 15 06:12:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:12:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:13:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:13:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:13:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:13:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:14:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:14:16 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:14
    Jan 15 06:14:20 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:14
    Jan 15 06:14:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:14:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:14:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:15:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:15:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:15:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:15:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:16:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:16:18 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:16
    Jan 15 06:16:19 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 15 2014 06:16
    Jan 15 06:16:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:16:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:16:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:17:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:17:36 nbumedia avrd[5616]: Reservation Conflict status from hcart2013 (device 14)
    Jan 15 06:17:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:18:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:18:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:18:36 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:18:51 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:19:06 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:19:21 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan 15 06:19:36 nbumedia kernel: st 2:0:1:17: reservation conflict

     

  • Seems 'someone' has stopped NBU on nbumedia:

    TERMINATION requested from nbumedia

    This did not happen by itself. 
    Maybe 'someone' saw the st device errors and hoped that restart of NBU would fix the issue?

    It clearly did not as the issue is at OS st-driver level.

    A reboot of the server may fix the problem.

    bpps -x output will show start time of NBU processes/daemons.

  • I think that is not a reason of problem(from above log.)..Because it is happening every Wednesday morning. At january 8  also was same process.

    Jan  8 06:00:04 nbumedia nbvault: Shutting down nbvault daemon

     

    I couldnt find yet the reason((((...

     

     

     

    Jan  8 06:00:04 nbumedia nbvault: Shutting down nbvault daemon
    Jan  8 06:00:05 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan  8 06:00:20 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan  8 06:00:35 nbumedia kernel: st 2:0:1:17: reservation conflict
    Jan  8 06:00:50 nbumedia ltid[15742]: Sending shutdown to tldcd daemon...
    Jan  8 06:00:50 nbumedia tldcd[16319]: TERMINATION requested from nbumedia
    Jan  8 06:00:50 nbumedia vmd[15748]: terminating - successful (0)
    Jan  8 06:00:50 nbumedia vmd[15748]: volume daemon terminating because it received a signal (15)
    Jan  8 06:00:50 nbumedia vmd[15748]: terminating - daemon terminated (7)
    Jan  8 06:00:51 nbumedia tldcd[2058]: starting tldcd
    Jan  8 06:00:53 nbumedia tldcd[16319]: Daemon has terminated on request
    Jan  8 06:01:28 nbumedia SQLAnywhere(nb_nbumedia): Starting database "utility_db" (utility_db) at Wed Jan 08 2014 06:01
    Jan  8 06:01:28 nbumedia SQLAnywhere(nb_nbumedia): Database "utility_db" (utility_db) started at Wed Jan 08 2014 06:01
    Jan  8 06:01:28 nbumedia SQLAnywhere(nb_nbumedia): Database server shutdown requested by DBSTOP
    Jan  8 06:01:28 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:01
    Jan  8 06:01:29 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:01
    Jan  8 06:01:30 nbumedia SQLAnywhere(nb_nbumedia): Database server stopped at Wed Jan 08 2014 06:01
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): SQL Anywhere Network Server Version 11.0.1.2475
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): OEM Authenticated Edition, licensed only for use with authenticated OEM applications.
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Copyright (c) 2001-2009, iAnywhere Solutions, Inc.
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Portions copyright (c) 1988-2009, Sybase, Inc. All rights reserved.
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Use of this software is governed by the Sybase License Agreement. Refer to http://www.sybase.com/softwarelicenses
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): 16 logical processor(s) on 2 physical processor(s) detected.
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Processor limit (licensed processors): 128
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Maximum number of physical processors the server will use: 2
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): This server is licensed to:
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):     NetBackup
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):     Symantec Corporation
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Running Linux 2.6.32-131.0.15.el6.x86_64 #1 SMP Tue May 10 15:42:40 EDT 2011 on X86_64
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Server built for X86_64 processor architecture
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): 25600K of memory used for caching
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Minimum cache size: 25600K, maximum cache size: 512000K
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Using a maximum page size of 4096 bytes
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Starting database "NBDB" (/usr/openv/db/data/NBDB.db) at Wed Jan 08 2014 06:05
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'EMM_DATA' in file '/usr/openv/db/data/EMM_DATA.db' for database 'NBDB'
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'EMM_INDEX' in file '/usr/openv/db/data/EMM_INDEX.db' for database 'NBDB'
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DBM_DATA' in file '/usr/openv/db/data/DBM_DATA.db' for database 'NBDB'
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DBM_INDEX' in file '/usr/openv/db/data/DBM_INDEX.db' for database 'NBDB'
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DARS_DATA' in file '/usr/openv/db/data/DARS_DATA.db' for database 'NBDB'
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Opening dbspace 'DARS_INDEX' in file '/usr/openv/db/data/DARS_INDEX.db' for database 'NBDB'
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Transaction log: /usr/openv/db/data/NBDB.log
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:05
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:05
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Database "NBDB" (NBDB.db) started at Wed Jan 08 2014 06:05
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): This database is licensed for use with:
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):     Application: CommonRepository
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):     Company: VERITAS
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Database server started at Wed Jan 08 2014 06:05
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Trying to start SharedMemory link ...
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):     SharedMemory link started successfully
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Trying to start TCPIP link ...
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Starting on port 13785
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia):     TCPIP link started successfully
    Jan  8 06:05:50 nbumedia SQLAnywhere(nb_nbumedia): Now accepting requests
    Jan  8 06:05:58 nbumedia vmd[3249]: ready for connections
    Jan  8 06:06:01 nbumedia nbvault: Starting nbvault daemon
    Jan  8 06:06:33 nbumedia tldcd[3814]: starting tldcd
    Jan  8 06:06:38 nbumedia tldd[3806]: TLD(0) going to UP state
    Jan  8 06:06:39 nbumedia tldd[3806]: TLD(1) going to UP state
    Jan  8 06:09:41 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:09
    Jan  8 06:09:43 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:09
    Jan  8 06:10:43 nbumedia SQLAnywhere(nb_nbumedia): Cache size adjusted to 160012K
    Jan  8 06:11:41 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:11
    Jan  8 06:11:44 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:11
    Jan  8 06:29:29 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:29
    Jan  8 06:29:36 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:29
    Jan  8 06:31:28 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:31
    Jan  8 06:31:31 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 06:31
    Jan  8 07:31:29 nbumedia SQLAnywhere(nb_nbumedia): Starting checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 07:31
    Jan  8 07:31:32 nbumedia SQLAnywhere(nb_nbumedia): Finished checkpoint of "NBDB" (NBDB.db) at Wed Jan 08 2014 07:31
  • the output of bpps -x is as follow..

     

    [root@nbumedia /]# bpps -x
    NB Processes
    ------------
    root      4269     1  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/vnetd -standalone
    root      4272     1  0 06:06 ?        00:00:01 /usr/openv/netbackup/bin/bpcd -standalone
    root      4338     1  3 06:06 ?        00:19:41 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/global/databases.conf -hn 7
    root      4384     1  0 06:06 ?        00:00:17 /usr/openv/netbackup/bin/nbevtmgr
    root      4425     1  0 06:06 ?        00:00:03 /usr/openv/netbackup/bin/nbaudit
    root      4521     1  0 06:06 ?        00:00:24 /usr/openv/pdde/pdcr/bin/spad
    pddb      4718     1  0 06:06 ?        00:00:00 /usr/openv/pdde/pddb/bin/postmaster -D /Q/shares/nfsshare/databases/pddb/data -N 512 -B 1024 -i -p10085
    root      4892     1  0 06:06 ?        00:00:27 /usr/openv/pdde/pdcr/bin/spoold
    root      4985     1  0 06:06 ?        00:05:29 /usr/openv/netbackup/bin/nbemm
    root      5001     1  0 06:06 ?        00:01:25 /usr/openv/netbackup/bin/nbrb
    root      5034     1  0 06:06 ?        00:00:02 /usr/openv/netbackup/bin/bprd
    root      5038     1  0 06:06 ?        00:00:01 /usr/openv/netbackup/bin/bpcompatd
    root      5042     1  0 06:06 ?        00:00:45 /usr/openv/netbackup/bin/nbjm
    root      5067     1  0 06:06 ?        00:00:01 /usr/openv/netbackup/bin/bpdbm
    root      5072  5067  0 06:06 ?        00:00:10 /usr/openv/netbackup/bin/bpjobd
    root      5074     1  0 06:06 ?        00:00:04 /usr/openv/netbackup/bin/nbpem
    root      5115  5074  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbpem
    root      5150     1  0 06:06 ?        00:00:06 /usr/openv/netbackup/bin/nbstserv
    root      5156  5074  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbpem_cleanup
    root      5231     1  0 06:06 ?        00:00:26 /usr/openv/netbackup/bin/nbrmms
    root      5376     1  0 06:06 ?        00:00:07 /usr/openv/netbackup/bin/nbsl
    root      5412     1  0 06:06 ?        00:00:02 /usr/openv/netbackup/bin/nbars
    root      5452     1  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbvault
    root      5476     1  0 06:06 ?        00:00:03 /usr/openv/netbackup/bin/nbsvcmon
    root      5587  5042  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbjm
    root      5663  5074  0 06:07 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbpem_email
    root     11025 10984  0 11:28 ?        00:00:57 /usr/openv/java/jre/bin/java -Dvrts.NBJAVA_CONF=/usr/openv/java/nbj.conf -showversion -Dvrts.common.server.LCCTYPE="en_US.UTF-8" -Dvrts.common.server.LOG_CMDLINES=false -Djava.library.path=/usr/openv/lib -Dvrtsat.datadir=/usr/openv/var/vxss/at -Dvrtsat.home=/usr/openv/netbackup/sec/at -Dvrts.common.utilities.DEBUG_PROPERTIES=/usr/openv/java/Debug.properties -Dvrts.nbe.HOSTNAME= -Dvrts.nbe.INST_REL=710000 -Dvrts.nbe.BUILDNO=20110203 -Djava.util.prefs.PreferencesFactory=vrts.common.launch.PropertiesPreferencesFactory -Xms128M -Xmx512M vrts.nbe.AdminConsole
    root     11066     1  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     11068 11066  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     11073 11066  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     11111 11066  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     12032 11991  0 11:42 pts/0    00:00:22 /usr/openv/java/jre/bin/java -Dvrts.NBJAVA_CONF=/usr/openv/java/nbj.conf -showversion -Dvrts.common.server.LCCTYPE="en_US.UTF-8" -Dvrts.common.server.LOG_CMDLINES=false -Djava.library.path=/usr/openv/lib -Dvrtsat.datadir=/usr/openv/var/vxss/at -Dvrtsat.home=/usr/openv/netbackup/sec/at -Dvrts.common.utilities.DEBUG_PROPERTIES=/usr/openv/java/Debug.properties -Dvrts.nbe.HOSTNAME= -Dvrts.nbe.INST_REL=710000 -Dvrts.nbe.BUILDNO=20110203 -Djava.util.prefs.PreferencesFactory=vrts.common.launch.PropertiesPreferencesFactory -Xms128M -Xmx512M vrts.nbe.AdminConsole
    root     12074     1  0 11:42 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12076 12074  0 11:42 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12081 12074  0 11:42 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12116 12074  0 11:43 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12285  5376  0 11:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -PolicyManager-4.ior.mgr
    root     12312  5376  0 11:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -StorageService-4.ior.mgr
    root     19460  5376  0 13:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -PolicyManager-3.ior.mgr
    root     19485  5376  0 13:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -StorageService-3.ior.mgr
    root     26067  5231  0 15:20 ?        00:00:00 /usr/openv/netbackup/bin/admincmd/bpstsinfo -DPSPROXY


    MM Processes
    ------------
    root      5026     1  0 06:06 ?        00:00:02 /usr/openv/volmgr/bin/ltid
    root      5032     1  0 06:06 ?        00:00:01 vmd
    root      5614  5032  0 06:07 ?        00:00:00 rdevmi -sockfd 13 -p 50 -r
    root      5615  5026  0 06:07 ?        00:00:00 tldd
    root      5616  5026  0 06:07 ?        00:00:00 avrd
    root      5622     1  0 06:07 ?        00:00:02 tldcd


    Shared Symantec Processes
    -------------------------
    root      3108     1  0 Jan10 ?        00:00:59 /opt/VRTSpbx/bin/pbx_exchange
    [root@nbumedia /]#

  • output of bpps -x is :

    [root@nbumedia /]# bpps -x
    NB Processes
    ------------
    root      4269     1  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/vnetd -standalone
    root      4272     1  0 06:06 ?        00:00:01 /usr/openv/netbackup/bin/bpcd -standalone
    root      4338     1  3 06:06 ?        00:19:41 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/global/databases.conf -hn 7
    root      4384     1  0 06:06 ?        00:00:17 /usr/openv/netbackup/bin/nbevtmgr
    root      4425     1  0 06:06 ?        00:00:03 /usr/openv/netbackup/bin/nbaudit
    root      4521     1  0 06:06 ?        00:00:24 /usr/openv/pdde/pdcr/bin/spad
    pddb      4718     1  0 06:06 ?        00:00:00 /usr/openv/pdde/pddb/bin/postmaster -D /Q/shares/nfsshare/databases/pddb/data -N 512 -B 1024 -i -p10085
    root      4892     1  0 06:06 ?        00:00:27 /usr/openv/pdde/pdcr/bin/spoold
    root      4985     1  0 06:06 ?        00:05:29 /usr/openv/netbackup/bin/nbemm
    root      5001     1  0 06:06 ?        00:01:25 /usr/openv/netbackup/bin/nbrb
    root      5034     1  0 06:06 ?        00:00:02 /usr/openv/netbackup/bin/bprd
    root      5038     1  0 06:06 ?        00:00:01 /usr/openv/netbackup/bin/bpcompatd
    root      5042     1  0 06:06 ?        00:00:45 /usr/openv/netbackup/bin/nbjm
    root      5067     1  0 06:06 ?        00:00:01 /usr/openv/netbackup/bin/bpdbm
    root      5072  5067  0 06:06 ?        00:00:10 /usr/openv/netbackup/bin/bpjobd
    root      5074     1  0 06:06 ?        00:00:04 /usr/openv/netbackup/bin/nbpem
    root      5115  5074  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbpem
    root      5150     1  0 06:06 ?        00:00:06 /usr/openv/netbackup/bin/nbstserv
    root      5156  5074  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbpem_cleanup
    root      5231     1  0 06:06 ?        00:00:26 /usr/openv/netbackup/bin/nbrmms
    root      5376     1  0 06:06 ?        00:00:07 /usr/openv/netbackup/bin/nbsl
    root      5412     1  0 06:06 ?        00:00:02 /usr/openv/netbackup/bin/nbars
    root      5452     1  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbvault
    root      5476     1  0 06:06 ?        00:00:03 /usr/openv/netbackup/bin/nbsvcmon
    root      5587  5042  0 06:06 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbjm
    root      5663  5074  0 06:07 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib nbpem_email
    root     11025 10984  0 11:28 ?        00:00:57 /usr/openv/java/jre/bin/java -Dvrts.NBJAVA_CONF=/usr/openv/java/nbj.conf -showversion -Dvrts.common.server.LCCTYPE="en_US.UTF-8" -Dvrts.common.server.LOG_CMDLINES=false -Djava.library.path=/usr/openv/lib -Dvrtsat.datadir=/usr/openv/var/vxss/at -Dvrtsat.home=/usr/openv/netbackup/sec/at -Dvrts.common.utilities.DEBUG_PROPERTIES=/usr/openv/java/Debug.properties -Dvrts.nbe.HOSTNAME= -Dvrts.nbe.INST_REL=710000 -Dvrts.nbe.BUILDNO=20110203 -Djava.util.prefs.PreferencesFactory=vrts.common.launch.PropertiesPreferencesFactory -Xms128M -Xmx512M vrts.nbe.AdminConsole
    root     11066     1  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     11068 11066  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     11073 11066  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     11111 11066  0 11:28 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 11063 noUserCredentialsFile
    root     12032 11991  0 11:42 pts/0    00:00:22 /usr/openv/java/jre/bin/java -Dvrts.NBJAVA_CONF=/usr/openv/java/nbj.conf -showversion -Dvrts.common.server.LCCTYPE="en_US.UTF-8" -Dvrts.common.server.LOG_CMDLINES=false -Djava.library.path=/usr/openv/lib -Dvrtsat.datadir=/usr/openv/var/vxss/at -Dvrtsat.home=/usr/openv/netbackup/sec/at -Dvrts.common.utilities.DEBUG_PROPERTIES=/usr/openv/java/Debug.properties -Dvrts.nbe.HOSTNAME= -Dvrts.nbe.INST_REL=710000 -Dvrts.nbe.BUILDNO=20110203 -Djava.util.prefs.PreferencesFactory=vrts.common.launch.PropertiesPreferencesFactory -Xms128M -Xmx512M vrts.nbe.AdminConsole
    root     12074     1  0 11:42 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12076 12074  0 11:42 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12081 12074  0 11:42 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12116 12074  0 11:43 ?        00:00:00 /usr/openv/netbackup/bin/bpjava-susvc root -1 -1 en_US.UTF-8 /usr/openv/java/auth.conf 1 -1 12071 noUserCredentialsFile
    root     12285  5376  0 11:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -PolicyManager-4.ior.mgr
    root     12312  5376  0 11:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -StorageService-4.ior.mgr
    root     19460  5376  0 13:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -PolicyManager-3.ior.mgr
    root     19485  5376  0 13:45 ?        00:00:00 /usr/openv/netbackup/bin/nbproxy dblib -mgrIORFile -StorageService-3.ior.mgr
    root     26067  5231  0 15:20 ?        00:00:00 /usr/openv/netbackup/bin/admincmd/bpstsinfo -DPSPROXY


    MM Processes
    ------------
    root      5026     1  0 06:06 ?        00:00:02 /usr/openv/volmgr/bin/ltid
    root      5032     1  0 06:06 ?        00:00:01 vmd
    root      5614  5032  0 06:07 ?        00:00:00 rdevmi -sockfd 13 -p 50 -r
    root      5615  5026  0 06:07 ?        00:00:00 tldd
    root      5616  5026  0 06:07 ?        00:00:00 avrd
    root      5622     1  0 06:07 ?        00:00:02 tldcd


    Shared Symantec Processes
    -------------------------
    root      3108     1  0 Jan10 ?        00:00:59 /opt/VRTSpbx/bin/pbx_exchange
    [root@nbumedia /]#

  • We are not going to find the answer from within NBU or in messages file.
    There is nothing in NBU that will automatically stop NBU.

    The only automatic built-in shutdown in NBU is to stop the EMM relational database if the disk on which NBU is installed fills up. This is to prevent corruption to the database.
    But this is not what we are seeing here - all of NBU is going down and then restarted.

    You will have to ask everyone with access to the server.
    Maybe check crontab as well.

  • Hi all, This problem was solved. At this time on this machine  have a job to label the media and restart the netbackup to clean logs..I forgot.. Now I moved it another time.. It is okay..

    Thank you all for replies.