Tapedrive not available forbackup

[sujit_kadam]

Netbackup Enterprise version 7.5 on RHEL 5.2

Hi,
I am not able to backup using NB 7.5 I am getting this error.

Error nbjm (pid=29078) NBU status: 2009, EMM status: All compatible drive paths are down, but media is available
All compatible drive paths are down but media is available (2009)

When I stoped and started the netback S77netbackup script, i get the following messages in /var/log messages........

Mar 14 16:00:59 geoser ltid[14128]: Sending shutdown to tldcd daemon...
Mar 14 16:00:59 geoser vmd[14142]: terminating - successful (0)
Mar 14 16:00:59 geoser vmd[14142]: volume daemon terminating because it received a signal (15)
Mar 14 16:00:59 geoser vmd[14142]: terminating - daemon terminated (7)
Mar 14 16:01:00 geoser tldcd[5377]: starting tldcd
Mar 14 16:01:01 geoser tldcd[14549]: TERMINATION requested from geoser
Mar 14 16:01:04 geoser tldcd[14549]: Daemon has terminated on request
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Starting database "utility_db" (utility_db) at Thu Mar 14 2013 16:01
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Database "utility_db" (utility_db) started at Thu Mar 14 2013 16:01
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Database server shutdown requested by DBSTOP
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Starting checkpoint of "NBDB" (NBDB.db) at Thu Mar 14 2013 16:01
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Finished checkpoint of "NBDB" (NBDB.db) at Thu Mar 14 2013 16:01
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Starting checkpoint of "NBAZDB" (NBAZDB.db) at Thu Mar 14 2013 16:01
Mar 14 16:01:25 geoser SQLAnywhere(nb_geoser): Finished checkpoint of "NBAZDB" (NBAZDB.db) at Thu Mar 14 2013 16:01
Mar 14 16:01:27 geoser SQLAnywhere(nb_geoser): Database server stopped at Thu Mar 14 2013 16:01
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): SQL Anywhere Network Server Version 11.0.1.2645
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): OEM Authenticated Edition, licensed only for use with authenticated OEM applications.
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser):
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Copyright (c) 2011, iAnywhere Solutions, Inc.
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Portions copyright (c) 2011, Sybase, Inc. All rights reserved.
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Use of this software is governed by the Sybase License Agreement. Refer to http://www.sybase.com/softwarelicenses
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser):
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): 24 logical processor(s) on 2 physical processor(s) detected.
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Processor limit (licensed processors): 128
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Maximum number of physical processors the server will use: 2
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): This server is licensed to:
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): NetBackup
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Symantec Corporation
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Running Linux 2.6.18-128.el5 #1 SMP Wed Dec 17 11:41:38 EST 2008 on X86_64
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Server built for X86_64 processor architecture
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): 102400K of memory used for caching
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Minimum cache size: 102400K, maximum cache size: 1048576K
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Using a maximum page size of 4096 bytes
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Starting database "NBDB" (/usr/openv/db/data/NBDB.db) at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Starting database "NBAZDB" (/usr/openv/db/data/NBAZDB.db) at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Transaction log: /usr/openv/db/data/NBAZDB.log
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'EMM_DATA' in file '/usr/openv/db/data/EMM_DATA.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'EMM_INDEX' in file '/usr/openv/db/data/EMM_INDEX.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'DBM_DATA' in file '/usr/openv/db/data/DBM_DATA.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'DBM_INDEX' in file '/usr/openv/db/data/DBM_INDEX.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'DARS_DATA' in file '/usr/openv/db/data/DARS_DATA.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'DARS_INDEX' in file '/usr/openv/db/data/DARS_INDEX.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'SEARCH_DATA' in file '/usr/openv/db/data/SEARCH_DATA.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'SEARCH_INDEX' in file '/usr/openv/db/data/SEARCH_INDEX.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Opening dbspace 'JOBD_DATA' in file '/usr/openv/db/data/JOBD_DATA.db' for database 'NBDB'
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Transaction log: /usr/openv/db/data/NBDB.log
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Starting checkpoint of "NBAZDB" (NBAZDB.db) at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Starting checkpoint of "NBDB" (NBDB.db) at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Finished checkpoint of "NBDB" (NBDB.db) at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Finished checkpoint of "NBAZDB" (NBAZDB.db) at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Database "NBDB" (NBDB.db) started at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): This database is licensed for use with:
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Application: CommonRepository
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Company: VERITAS
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Database "NBAZDB" (NBAZDB.db) started at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): This database is licensed for use with:
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Application: CommonRepository
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Company: VERITAS
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Database server started at Thu Mar 14 2013 16:02
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Trying to start SharedMemory link ...
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): SharedMemory link started successfully
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Trying to start TCPIP link ...
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Starting on port 13785
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): TCPIP link started successfully
Mar 14 16:02:04 geoser SQLAnywhere(nb_geoser): Now accepting requests
Mar 14 16:02:11 geoser nbvault: Starting nbvault daemon
Mar 14 16:02:11 geoser nbvault: Vault License validation FAILED. Error=159
Mar 14 16:02:11 geoser vmd[6011]: ready for connections
Mar 14 16:02:12 geoser nbvault: Shutting down nbvault daemon
Mar 14 16:02:17 geoser tldcd[6440]: starting tldcd
Mar 14 16:02:28 geoser tldd[6370]: TLD(0) going to UP state
Mar 14 16:02:33 geoser tldd[6370]: TLD(1) going to UP state


Vault license validation FAILED, Error=159 is beyond my understanding.

In Device Monitor of jnbSA, all the drives have Ready, Write Enabled and shared set to NO.
 

[Andy_Welburn]

Do you actually use "NetBackup Vault"?

Seems like vault is trying to start - something configured somewhere - but you are not licensed for it

Altho' I presume your initial tape drive issue was resolved by the restart?

[Marianne]

All agents and options are installed by default, but the processes will only start if they are licensed.

I don't think this message is related to your problem.

Please show us output of the following commands:

/usr/openv/netbackup/bin/admincmd/nbrbutil -dump

/usr/openv/netbackup/bin/admincmd/bpstulist -U

/usr/openv/volmgr/bin/tpconfig -l

/usr/openv/volmgr/bin/vmoprcmd -d

[sujit_kadam]

Hi Marianne,

Please fidn the below output as required

### BEGIN LOG - DATE: 130315, TIME: 175010 ###

/usr/openv/netbackup/bin/admincmd/nbrbutil -dump

Allocation Requests
(AllocationRequestSeq )


Allocations
(AllocationSeq )

MDS allocations in EMM:
[root@geoser ~]# /usr/openv/netbackup/bin/admincmd/bpstulist -U

Label:                geoser-lto4-robot-tld-0
Storage Unit Type:    Media Manager
Host Connection:      geoser
Number of Drives:     1
On Demand Only:       no
Max MPX/drive:        1
Density:              hcart - 1/2 Inch Cartridge
Robot Type/Number:    TLD / 0
Max Fragment Size:    1048576 MB

Label:                geoser-lto3-robot-tld-1
Storage Unit Type:    Media Manager
Host Connection:      geoser
Number of Drives:     1
On Demand Only:       no
Max MPX/drive:        1
Density:              hcart3 - 1/2 Inch Cartridge 3
Robot Type/Number:    TLD / 1
Max Fragment Size:    1048576 MB

Label:                geoser-hcart2
Storage Unit Type:    Media Manager
Host Connection:      geoser
Number of Drives:     1
On Demand Only:       no
Max MPX/drive:        1
Density:              hcart2 - 1/2 Inch Cartridge 2
Robot Type:           (not robotic)
Max Fragment Size:    1048576 MB

Label:                geoser_local_disk
Storage Unit Type:    Disk
Storage Unit Subtype: Basic (1)
Host Connection:      geoser
Concurrent Jobs:      2
On Demand Only:       yes
Max MPX:              1
Path:                 "/data_geoser/NB_BACKUP"
Max Fragment Size:    524287 MB
Stage data:           no
Block Sharing:        no
High Water Mark:      98
Low Water Mark:       80
Ok On Root:           no
[root@geoser ~]#
[root@geoser ~]# /usr/openv/volmgr/bin/tpconfig -l
Device Robot Drive       Robot                    Drive                Device     Second
Type     Num Index  Type DrNum Status  Comment    Name                 Path       Device Path
robot      0    -    TLD    -       -  -          -                    /dev/sg3
  drive    -    1  hcart    1      UP  -          IBM.ULTRIUM-TD4.000  /dev/nst0
robot      1    -    TLD    -       -  -          -                    /dev/sg5
  drive    -    0 hcart3    1      UP  -          IBM.ULTRIUM-TD3.000  /dev/nst1
drive      -    2 hcart2    -      UP  -          IBM.03592E05.000     /dev/nst2
[root@geoser ~]# /usr/openv/volmgr/bin/vmoprcmd -d

                                PENDING REQUESTS

                                     <NONE>

                                  DRIVE STATUS

Drv Type   Control  User      Label  RecMID  ExtMID  Ready   Wr.Enbl.  ReqId
  0 hcart3   TLD                -                     No       -         0  
  1 hcart    TLD                -                     No       -         0  
  2 hcart2   AVR                -                     No       -         0  

                             ADDITIONAL DRIVE STATUS

Drv DriveName            Shared    Assigned        Comment                   
  0 IBM.ULTRIUM-TD3.000   No       -                                         
  1 IBM.ULTRIUM-TD4.000   No       -                                         
  2 IBM.03592E05.000      No       -                                         
[root@geoser ~]#

### END LOG - DATE: 130315, TIME: 175131 ###

[Marianne · Accepted solution]

OK - so you have 2 robots with one drive each, a standalone drive and a DSU.

Which STU is specified in the policy that failed with the error in your opening post?
Has this installation ever worked?
Is error seen with one or all STU's?

Please enable logging as follows:

Create bptm folder under /usr/openv/netbackup/logs
Add VERBOSE entry to /usr/openv/volmgr/vm.conf and restart NBU.

Post bptm log and /var/log/messages after next failure.
Please rename logs to .txt files (e.g. bptm.txt) and post as File attachments.