02-07-2014 07:48 AM
Hello,
last week i added 2 drives to SL8500 library. I reconfigured sg drivers on all media servers and all works properly, only one of the media servers is unable to use drives in another library SL500. The error message is:
Error nbjm (pid=1054) NBU status: 2001, EMM status: No drives are available
No drives are available for this job (2001)
Netbackup is version 7.5.0.6 on SPARC Solaris 10.
I checked some recommended things:
- daemons running
- nbrbutil -dump
- devices
- sgscan
- once more reconfigure drivers
- restart of NetBackup on master server and on media server
All seems to be good. Drives are up and they are working on other media servers.
Could you help me please what other things should I check?
Thank you.
Solved! Go to Solution.
03-04-2014 04:48 AM
The problem is solved with help of Symantec Support. The drives were not available because there were DOWN. I did not know it, because NB console showed them as UP, as well as vmoprcmd -d or tpconfig -l.
Only command vmoprcmd without parameters tells the true. Any attempt of bringing of downed drives up with vmoprcmd ended with message: The drive is not ready or inoperable.
The solution was deleting of downed drives with tpconfig, then tpautoconf -a and restarting of NetBackup.
02-07-2014 07:56 AM
issue with just one one job or all the jobs?
02-07-2014 07:58 AM
It is issue on all jobs and also on duplications with lifecycle.
02-07-2014 09:23 AM
02-07-2014 10:14 AM
We need to see config for this media server and SLP config using this STU.
Please show us output of the following:
On media server: 'tpconfig -l'
On media server: 'vmoprcmd -d'
On master: bpstulist -label <media-server-STU-name> -U
On master: nbstl <storage_lifecycle_name> -L
02-07-2014 10:45 AM
Also please check that your media and drive types are the same, IE. HCART3.
NetBackup looks for a drive that is compatable with the media supplied, but doesn't see any drives that can use the media. Its actually a pretty common call with support. Refer to HOWTO35763
02-08-2014 12:04 AM
Here are the outputs from commands:
root@master:/root # bpstulist -label mediaserver -hcart3-robot-acs-2 -U
Label: mediaserver-hcart3-robot-acs-2
Storage Unit Type: Media Manager
Host Connection: mediaserver
Number of Drives: 4
On Demand Only: yes
Max MPX/drive: 20
Density: hcart3 - 1/2 Inch Cartridge 3
Robot Type/Number: ACS / 2
Max Fragment Size: 1048575 MB
root@master:/root # nbstl SL8500_2C1D_2w_7w_mediaserver -L
Name: SL8500_2C1D_2w_7w_mediaserver
Data Classification: (none specified)
Duplication job priority: 0
State: active
Version: 6
Operation 1 Use for: 0 (backup)
Storage: mediaserver-hcart3-robot-acs-1
Volume Pool: SL8500_BKP
Server Group: Any
Retention Type: 0 (Fixed)
Retention Level: 1 (2 weeks)
Alternate Read Server: (none specified)
Preserve Multiplexing: false
Enable Automatic Remote Import: false
State: active
Source: 0 (client)
Operation ID: 0
Operation Index: 1
Operation 2 Use for: 0 (backup)
Storage: mediaserver-hcart3-robot-acs-1
Volume Pool: SL8500_EXP
Server Group: Any
Retention Type: 2 (Expire After Copy)
Retention Level: 0 (1 week)
Alternate Read Server: (none specified)
Preserve Multiplexing: false
Enable Automatic Remote Import: false
State: active
Source: 0 (client)
Operation ID: 0
Operation Index: 2
Operation 3 Use for: 1 (duplication)
Storage: mediaserver-hcart3-robot-acs-2
Volume Pool: L500_DUPL
Server Group: Any
Retention Type: 0 (Fixed)
Retention Level: 18 (32 days)
Alternate Read Server: (none specified)
Preserve Multiplexing: true
Enable Automatic Remote Import: false
State: active
Source: Operation 2 (backup:mediaserver-hcart3-robot-acs-1)
Operation ID: 0
Operation Index: 3
root@mediaserver:/root [global] # tpconfig -l
Device Robot Drive Robot Drive Device Second
Type Num Index Type DrNum Status Comment Name Path Device Path
robot 1 - ACS - - - - acsserver
drive - 1 hcart3 - UP SL8500_LTO3 Drive001 /dev/rmt/19cbn ACS=0, LSM=1, PANEL=1, DRIVE=14
drive - 2 hcart3 - UP SL8500_LTO3 Drive002 /dev/rmt/18cbn ACS=0, LSM=1, PANEL=1, DRIVE=4
drive - 3 hcart3 - UP SL8500_LTO3 Drive013 /dev/rmt/21cbn ACS=0, LSM=2, PANEL=1, DRIVE=14
drive - 4 hcart3 - UP SL8500_LTO3 Drive012 /dev/rmt/3cbn ACS=0, LSM=3, PANEL=1, DRIVE=9
drive - 5 hcart3 - UP SL8500_LTO3 Drive010 /dev/rmt/2cbn ACS=0, LSM=3, PANEL=1, DRIVE=3
drive - 7 hcart3 - UP SL8500_LTO3 Drive014 /dev/rmt/20cbn ACS=0, LSM=0, PANEL=1, DRIVE=3
drive - 8 hcart2 - UP SL8500_LTO5 Drive004 /dev/rmt/0cbn ACS=0, LSM=1, PANEL=1, DRIVE=12
drive - 9 hcart2 - UP SL8500_LTO5 Drive005 /dev/rmt/1cbn ACS=0, LSM=3, PANEL=1, DRIVE=12
drive - 14 hcart2 - UP SL8500_LTO5 Drive003 /dev/rmt/17cbn ACS=0, LSM=2, PANEL=1, DRIVE=12
drive - 15 hcart3 - UP SL8500_LTO3 Drive016 /dev/rmt/10cbn ACS=0, LSM=1, PANEL=1, DRIVE=9
drive - 16 hcart3 - UP SL8500_LTO3 Drive017 /dev/rmt/8cbn ACS=0, LSM=0, PANEL=1, DRIVE=9
drive - 17 hcart3 - UP SL8500_LTO3 Drive018 /dev/rmt/9cbn ACS=0, LSM=0, PANEL=1, DRIVE=14
drive - 18 hcart3 - UP SL8500_LTO3 Drive015 /dev/rmt/11cbn ACS=0, LSM=0, PANEL=1, DRIVE=2
drive - 19 hcart3 - DOWN SL8500_LTO3 Drive021 /dev/rmt/29cbn ACS=0, LSM=3, PANEL=1, DRIVE=14
drive - 21 hcart3 - UP SL8500_LTO3 Drive023 /dev/rmt/28cbn ACS=0, LSM=3, PANEL=1, DRIVE=4
drive - 22 hcart3 - UP SL8500_LTO3 Drive024 /dev/rmt/27cbn ACS=0, LSM=0, PANEL=1, DRIVE=4
drive - 23 hcart3 - UP SL8500_LTO3 Drive019 /dev/rmt/25cbn ACS=0, LSM=2, PANEL=1, DRIVE=4
drive - 24 hcart3 - UP SL8500_LTO3 Drive020 /dev/rmt/26cbn ACS=0, LSM=0, PANEL=1, DRIVE=15
drive - 27 hcart3 - UP SL8500_LTO3 Drive027 /dev/rmt/14cbn ACS=0, LSM=1, PANEL=1, DRIVE=3
drive - 29 hcart3 - UP SL8500_LTO3 Drive030 /dev/rmt/15cbn ACS=0, LSM=2, PANEL=1, DRIVE=9
drive - 30 hcart3 - UP SL8500_LTO3 Drive029 /dev/rmt/16cbn ACS=0, LSM=2, PANEL=1, DRIVE=2
robot 2 - ACS - - - - acsserver
drive - 11 hcart3 - UP SL500_LTO3 Drive000 /dev/rmt/23cbn ACS=1, LSM=0, PANEL=1, DRIVE=2
drive - 12 hcart3 - UP SL500_LTO3 Drive011 /dev/rmt/22cbn ACS=1, LSM=0, PANEL=2, DRIVE=2
drive - 20 hcart3 - UP SL500_LTO3 Drive022 /dev/rmt/24cbn ACS=1, LSM=0, PANEL=2, DRIVE=1
drive - 28 hcart3 - UP SL500_LTO3 Drive028 /dev/rmt/30cbn ACS=1, LSM=0, PANEL=1, DRIVE=1
robot 3 - TLD - - - - masterserver
drive - 0 hcart3 2 UP DD670 Drive008 /dev/rmt/6cbn
drive - 6 hcart3 1 UP DD670 Drive009 /dev/rmt/7cbn
drive - 10 hcart3 4 DOWN DD670 Drive006 /dev/rmt/4cbn
drive - 13 hcart3 3 UP DD670 Drive007 /dev/rmt/5cbn
drive - 25 hcart3 5 UP DD670 Drive025 /dev/rmt/13cbn
drive - 26 hcart3 6 UP DD670 Drive026 /dev/rmt/12cbn
root@mediaserver:/root [global] # vmoprcmd -d
PENDING REQUESTS
<NONE>
DRIVE STATUS
Drv Type Control User Label RecMID ExtMID Ready Wr.Enbl. ReqId
0 hcart3 TLD Yes U20060 U20060 Yes Yes 0
1 hcart3 ACS Yes HU1351 HU1351 Yes Yes 0
2 hcart3 ACS Yes HU1337 HU1337 Yes Yes 0
3 hcart3 ACS Yes ZH3338 ZH3338 Yes Yes 0
4 hcart3 ACS Yes ZH3224 ZH3224 Yes Yes 0
5 hcart3 ACS Yes VJ0289 VJ0289 Yes Yes 0
6 hcart3 TLD Yes U20041 U20041 Yes Yes 0
7 hcart3 ACS Yes HU1368 HU1368 Yes Yes 0
8 hcart2 ACS Yes LP0030 LP0030 Yes Yes 0
9 hcart2 ACS - No - 0
10 hcart3 DOWN-TLD Yes U20038 U20038 Yes Yes 0
11 hcart3 ACS Yes HU1240 HU1240 Yes Yes 0
12 hcart3 ACS - No - 0
13 hcart3 TLD Yes U20056 U20056 Yes Yes 0
14 hcart2 ACS - No - 0
15 hcart3 ACS Yes ZH3290 ZH3290 Yes Yes 0
16 hcart3 ACS Yes HU1387 HU1387 Yes Yes 0
17 hcart3 ACS Yes VJ0370 VJ0370 Yes Yes 0
18 hcart3 ACS - No - 0
19 hcart3 DOWN-ACS - No - 0
20 hcart3 ACS - No - 0
21 hcart3 ACS Yes ZH3377 ZH3377 Yes Yes 0
22 hcart3 ACS Yes ZH3182 ZH3182 Yes Yes 0
23 hcart3 ACS Yes KP7237 KP7237 Yes Yes 0
24 hcart3 ACS Yes VJ0343 VJ0343 Yes Yes 0
25 hcart3 TLD Yes U20042 U20042 Yes Yes 0
26 hcart3 TLD Yes U20015 U20015 Yes Yes 0
27 hcart3 ACS Yes KP7229 KP7229 Yes Yes 0
28 hcart3 ACS - No - 0
29 hcart3 ACS Yes HU1393 HU1393 Yes Yes 0
30 hcart3 ACS Yes HU1372 HU1372 Yes Yes 0
ADDITIONAL DRIVE STATUS
Drv DriveName Shared Assigned Comment
0 Drive008 Yes mediaserv1 DD670
1 Drive001 Yes mediaserv1 SL8500_LTO3
2 Drive002 Yes mediaserv1 SL8500_LTO3
3 Drive013 Yes mediaserv1 SL8500_LTO3
4 Drive012 Yes mediaserv1 SL8500_LTO3
5 Drive010 Yes mediaserver SL8500_LTO3
6 Drive009 Yes mediaserv1 DD670
7 Drive014 Yes mediaserv2 SL8500_LTO3
8 Drive004 Yes mediaserv3 SL8500_LTO5
9 Drive005 Yes - SL8500_LTO5
10 Drive006 Yes mediaserv1 DD670
11 Drive000 Yes mediaserv3 SL500_LTO3
12 Drive011 Yes - SL500_LTO3
13 Drive007 Yes mediaserv1 DD670
14 Drive003 Yes - SL8500_LTO5
15 Drive016 Yes mediaserv1 SL8500_LTO3
16 Drive017 Yes mediaserver SL8500_LTO3
17 Drive018 Yes mediaserv1 SL8500_LTO3
18 Drive015 Yes - SL8500_LTO3
19 Drive021 Yes - SL8500_LTO3
20 Drive022 Yes - SL500_LTO3
21 Drive023 Yes mediaserv1 SL8500_LTO3
22 Drive024 Yes mediaserv4 SL8500_LTO3
23 Drive019 Yes mediaserv5 SL8500_LTO3
24 Drive020 Yes mediaserv5 SL8500_LTO3
25 Drive025 Yes mediaserv6 DD670
26 Drive026 Yes mediaserv5 DD670
27 Drive027 Yes mediaserv6 SL8500_LTO3
28 Drive028 Yes - SL500_LTO3
29 Drive030 Yes mediaserv4 SL8500_LTO3
30 Drive029 Yes mediaserv4 SL8500_LTO3
02-15-2014 09:26 AM
Apologies for only responding now...
Hopefully this has been sorted out by now?
If not - check for orphaned device allocations with 'nbrbutil -dump' on the master server.
Post the 'MDS allocations' section at the bottom of the output.
02-15-2014 10:43 AM
Persoanlly I would first run nbrbutil -resetall
Even if the drivs don't show as reserver in nbrbutil -dump, this can get things working agan.
Beware it will kill all running jobs, so do at a time the system is not busy.
02-17-2014 12:55 AM
I checked nbrbutil -dump before. Now I tried nbrbutil -resetall, but the problem persist.
02-17-2014 01:48 AM
One more command... Please run this command on the master server:
vmdareq
Copy output for drives Drive000 Drive011 Drive022 Drive028
Have you tried to add a test policy with something small in backup selection and STU mediaserver-hcart3-robot-acs-2 selected?
02-17-2014 02:39 AM
I tried such policy with the same error. Here is output of vmdareq:
Drive000 - AVAILABLE
master SCAN_HOST UP
mediaserv1 UP
mediaserv2 UP
mediaserv3 UP
mediaserver UP
mediaserv4 UP
mediaserv5 UP
mediaserv6 UP
mediaserv7 UP
Drive011 - RESERVED on Mon Feb 17 11:03:19 2014
master RESERVED SCAN_HOST UP
mediaserv1 UP
mediaserv2 UP
mediaserv3 UP
mediaserver UP
mediaserv4 UP
mediaserv5 UP
mediaserv6 UP
mediaserv7 UP
Drive022 - RESERVED on Mon Feb 17 10:57:08 2014
master SCAN_HOST UP
mediaserv1 UP
mediaserv2 UP
mediaserv3 RESERVED UP
mediaserver UP
mediaserv4 UP
mediaserv5 UP
mediaserv6 UP
mediaserv7 UP
Drive028 - AVAILABLE
master SCAN_HOST UP
mediaserv1 UP
mediaserv2 UP
mediaserv3 UP
mediaserver UP
mediaserv4 UP
mediaserv5 UP
mediaserv6 UP
mediaserv7 UP
02-17-2014 02:49 AM
All I can suggest is that you log a support call with Symantec where you will be able to submit output without the need to change actual output and hostnames.
I perfectly understand the need to mask actual hostnames, but it seems we are missing something small somewhere because we cannot see the real picture...
02-17-2014 05:13 AM
Thank you, I will try to log a call.
03-04-2014 04:48 AM
The problem is solved with help of Symantec Support. The drives were not available because there were DOWN. I did not know it, because NB console showed them as UP, as well as vmoprcmd -d or tpconfig -l.
Only command vmoprcmd without parameters tells the true. Any attempt of bringing of downed drives up with vmoprcmd ended with message: The drive is not ready or inoperable.
The solution was deleting of downed drives with tpconfig, then tpautoconf -a and restarting of NetBackup.