11-08-2019 06:21 PM
Hello all,
We are currently having issues with one of our tape library, which have 6 tape drives in this library where 5 of them are currently down. Got this error as per mentioned in the subject, where eventually the said drive will downed by Veritas.
We able to perform inventory from NBU console also moving medias with robtest but still the issue persist. No error on the physical tape library. We tried to bring up one drive, let the duplication run on this drive, wait until media loaded into the drive and then run robtest. Everything look okay at first but eventually like an hour later there will be this error and the drive down again. This happen on 5 out of 6 drives.
11/09/2019 08:15:46 - requesting resource LCM_mssba572-hcart-robot-tld-1 11/09/2019 08:15:48 - Info nbrb (pid=7708) Limit has been reached for the logical resource LCM_mssba572-hcart-robot-tld-1 11/09/2019 08:17:57 - granted resource LCM_mssba572-hcart-robot-tld-1 11/09/2019 08:18:01 - started process RUNCMD (pid=159288) 11/09/2019 08:18:01 - ended process 0 (pid=159288) 11/09/2019 08:18:03 - begin Duplicate 11/09/2019 08:18:17 - requesting resource mssba572-hcart-robot-tld-1 11/09/2019 08:18:17 - requesting resource @aaaak 11/09/2019 08:18:17 - reserving resource @aaaak 11/09/2019 08:18:19 - awaiting resource mssba572-hcart-robot-tld-1. Waiting for resources. Reason: Tape media server is not active, Media server: mssba572, Robot Type(Number): TLD(1), Media ID: N/A, Drive Name: N/A, Volume Pool: FS_DAILY_POOL, Storage Unit: mssba572-hcart-robot-tld-1, Drive Scan Host: N/A, Disk Pool: N/A, Disk Volume: N/A 11/09/2019 08:20:34 - awaiting resource mssba572-hcart-robot-tld-1. Waiting for resources. Reason: Robotic library is down on server, Media server: mssba572, Robot Type(Number): TLD(1), Media ID: N/A, Drive Name: N/A, Volume Pool: FS_DAILY_POOL, Storage Unit: mssba572-hcart-robot-tld-1, Drive Scan Host: N/A, Disk Pool: N/A, Disk Volume: N/A 11/09/2019 08:20:45 - resource @aaaak reserved 11/09/2019 08:20:45 - granted resource 0938L4 11/09/2019 08:20:45 - granted resource Drive002 11/09/2019 08:20:45 - granted resource mssba572-hcart-robot-tld-1 11/09/2019 08:20:45 - granted resource MediaID=@aaaak;DiskVolume=PureDiskVolume;DiskPool=dp_disk_mssba572;Path=PureDiskVolume;StorageServer=mssba572;MediaServer=mssba572 11/09/2019 08:20:47 - Info bpduplicate (pid=159288) window close behavior: Suspend 11/09/2019 08:29:41 - current media 0938L4 complete, requesting next media Any 11/09/2019 08:30:02 - current media -- complete, awaiting next media Any. Waiting for resources. Reason: Drives are in use, Media server: mssba572, Robot Type(Number): TLD(1), Media ID: N/A, Drive Name: N/A, Volume Pool: FS_DAILY_POOL, Storage Unit: mssba572-hcart-robot-tld-1, Drive Scan Host: N/A, Disk Pool: N/A, Disk Volume: N/A 11/09/2019 08:47:57 - granted resource 0938L4 11/09/2019 08:47:57 - granted resource Drive002 11/09/2019 08:47:57 - granted resource mssba572-hcart-robot-tld-1 11/09/2019 08:55:35 - current media 0938L4 complete, requesting next media Any 11/09/2019 08:55:51 - current media -- complete, awaiting next media Any. Waiting for resources. Reason: Drives are in use, Media server: mssba572, Robot Type(Number): TLD(1), Media ID: N/A, Drive Name: N/A, Volume Pool: FS_DAILY_POOL, Storage Unit: mssba572-hcart-robot-tld-1, Drive Scan Host: N/A, Disk Pool: N/A, Disk Volume: N/A 11/09/2019 09:17:55 - Error bpduplicate (pid=159288) Duplicate of backupid MSGSA578_1573214406 failed, termination requested by administrator (150). 11/09/2019 09:17:55 - Error bpduplicate (pid=159288) Status = no images were successfully processed. 11/09/2019 09:17:55 - end Duplicate; elapsed time 0:59:52 11/09/2019 15:41:35 - Info bptm (pid=166565) start 11/09/2019 15:41:35 - started process bptm (pid=166565) 11/09/2019 15:41:41 - Info bptm (pid=166565) start backup 11/09/2019 15:41:41 - Info bpdm (pid=166601) started 11/09/2019 15:41:41 - started process bpdm (pid=166601) 11/09/2019 15:41:42 - Info bpdm (pid=166601) reading backup image 11/09/2019 15:41:44 - Info bpdm (pid=166601) using 128 data buffers 11/09/2019 15:41:44 - Info bptm (pid=166565) Waiting for mount of media id 0938L4 (copy 2) on server mssba572. 11/09/2019 15:41:44 - Info bpdm (pid=166601) requesting nbjm for media 11/09/2019 15:41:44 - started process bptm (pid=166565) 11/09/2019 15:41:44 - mounting 0938L4 11/09/2019 15:41:44 - Info bptm (pid=166565) INF - Waiting for mount of media id 0938L4 on server mssba572 for writing. 11/09/2019 15:41:50 - begin reading 11/09/2019 15:50:28 - Error bptm (pid=166565) error requesting media, TpErrno = Robot operation failed 11/09/2019 15:50:28 - Warning bptm (pid=166565) media id 0938L4 load operation reported an error 11/09/2019 16:08:44 - Info bptm (pid=166565) Waiting for mount of media id 0938L4 (copy 2) on server mssba572. 11/09/2019 16:08:44 - started process bptm (pid=166565) 11/09/2019 16:08:44 - mounting 0938L4 11/09/2019 16:08:44 - Info bptm (pid=166565) INF - Waiting for mount of media id 0938L4 on server mssba572 for writing. 11/09/2019 16:16:21 - Error bptm (pid=166565) error requesting media, TpErrno = Robot operation failed 11/09/2019 16:16:22 - Warning bptm (pid=166565) media id 0938L4 load operation reported an error 11/09/2019 16:38:37 - Error bpdm (pid=166601) media manager terminated by parent process 11/09/2019 16:38:39 - Error bptm (pid=166565) media manager terminated by parent process 11/09/2019 16:38:48 - Info mssba572 (pid=166601) StorageServer=PureDisk:mssba572; Report=PDDO Stats for (mssba572): read: 65576 KB, CR received: 15633 KB, CR received over FC: 0 KB, dedup: 0.0% termination requested by administrator (150)
We also tried delete all 6 drives then reconfigure storage device but when the duplication job run, the same thing happened again.
We are using
Veritas Netbackup Appliance 5230
Version 2.7.3 (in the midst of upgrade)
IBM TS3310 with LTO4 drives
Thank you
mizi
11-09-2019 10:40 PM
Hi
Did you verified that the Tape Library zoning with Appliance is still intact ? Please reachout to your SAN admin to verify tape drive zoning.
Meanwhile, you can run command on appliance elevated prompt
scan -tape
scan -changer
both commands should scan and show the drives zoned to the appliance.
11-09-2019 11:12 PM
Hello Pats_729,
Well, our SAN switch admin confirm everything is okay, we even change the the FC port on Appliance to another port but issue still persist. The LTO4 library still down 5 out of 6 drives.
Below are the scan command output. You guys may see a lot of drive but this is due to robot control path were selected on all of the drive on LTO4 library.
MSSBA572:/ # scan -changer ************************************************************ *********************** SDT_CHANGER ************************ ************************************************************ ------------------------------------------------------------ Device Name : "/dev/sg41" Passthru Name: "/dev/sg41" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 636G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "636G" Serial Number: "000001311856_LLA" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001311856_LLA" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 6 Number of Slots : 120 Number of Media Access Ports: 6 Drive 1 Serial Number : "1320002221" Drive 2 Serial Number : "9310804050" Drive 3 Serial Number : "1310159213" Drive 4 Serial Number : "9310129495" Drive 5 Serial Number : "1310035164" Drive 6 Serial Number : "9310292343" Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/sg37" Passthru Name: "/dev/sg37" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 636G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "636G" Serial Number: "000001311856_LLA" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001311856_LLA" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 6 Number of Slots : 120 Number of Media Access Ports: 6 Drive 1 Serial Number : "1320002221" Drive 2 Serial Number : "9310804050" Drive 3 Serial Number : "1310159213" Drive 4 Serial Number : "9310129495" Drive 5 Serial Number : "1310035164" Drive 6 Serial Number : "9310292343" Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/sg35" Passthru Name: "/dev/sg35" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 636G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "636G" Serial Number: "000001311856_LLA" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001311856_LLA" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 6 Number of Slots : 120 Number of Media Access Ports: 6 Drive 1 Serial Number : "1320002221" Drive 2 Serial Number : "9310804050" Drive 3 Serial Number : "1310159213" Drive 4 Serial Number : "9310129495" Drive 5 Serial Number : "1310035164" Drive 6 Serial Number : "9310292343" Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/sg33" Passthru Name: "/dev/sg33" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 636G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "636G" Serial Number: "000001311856_LLA" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001311856_LLA" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 6 Number of Slots : 120 Number of Media Access Ports: 6 Drive 1 Serial Number : "1320002221" Drive 2 Serial Number : "9310804050" Drive 3 Serial Number : "1310159213" Drive 4 Serial Number : "9310129495" Drive 5 Serial Number : "1310035164" Drive 6 Serial Number : "9310292343" Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/sg31" Passthru Name: "/dev/sg31" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 636G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "636G" Serial Number: "000001311856_LLA" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001311856_LLA" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 6 Number of Slots : 120 Number of Media Access Ports: 6 Drive 1 Serial Number : "1320002221" Drive 2 Serial Number : "9310804050" Drive 3 Serial Number : "1310159213" Drive 4 Serial Number : "9310129495" Drive 5 Serial Number : "1310035164" Drive 6 Serial Number : "9310292343" Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/sg39" Passthru Name: "/dev/sg39" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 710G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "710G" Serial Number: "000001324868_LLB" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001324868_LLB" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 7 Number of Slots : 155 Number of Media Access Ports: 30 Drive 1 Serial Number : "10WT069341" Drive 2 Serial Number : "10WT072106" Drive 3 Serial Number : "10WT069323" Drive 4 Serial Number : "10WT087042" Drive 5 Serial Number : "10WT069302" Drive 6 Serial Number : "10WT069301" Drive 7 Serial Number : "10WT069326" Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/sg29" Passthru Name: "/dev/sg29" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM 3576-MTL 636G" Vendor ID : "IBM " Product ID : "3576-MTL " Product Rev: "636G" Serial Number: "000001311856_LLA" WWN : "" WWN Id Type : 0 Device Identifier: "IBM 3576-MTL 000001311856_LLA" Device Type : SDT_CHANGER NetBackup Robot Type: 8 Removable : Yes Device Supports: SCSI-3 Number of Drives : 6 Number of Slots : 120 Number of Media Access Ports: 6 Drive 1 Serial Number : "1320002221" Drive 2 Serial Number : "9310804050" Drive 3 Serial Number : "1310159213" Drive 4 Serial Number : "9310129495" Drive 5 Serial Number : "1310035164" Drive 6 Serial Number : "9310292343" Flags : 0x0 Reason: 0x0
MSSBA572:/ # scan -tape ************************************************************ *********************** SDT_TAPE ************************ ************************************************************ ------------------------------------------------------------ Device Name : "/dev/nst23" Passthru Name: "/dev/sg40" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD4 C7QH" Vendor ID : "IBM " Product ID : "ULT3580-TD4 " Product Rev: "C7QH" Serial Number: "9310292343" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD4 9310292343" Device Type : SDT_TAPE NetBackup Drive Type: 3 Removable : Yes Device Supports: SCSI-3 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst21" Passthru Name: "/dev/sg36" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD4 C7QH" Vendor ID : "IBM " Product ID : "ULT3580-TD4 " Product Rev: "C7QH" Serial Number: "9310804050" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD4 9310804050" Device Type : SDT_TAPE NetBackup Drive Type: 3 Removable : Yes Device Supports: SCSI-3 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst20" Passthru Name: "/dev/sg34" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD4 C7QH" Vendor ID : "IBM " Product ID : "ULT3580-TD4 " Product Rev: "C7QH" Serial Number: "1320002221" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD4 1320002221" Device Type : SDT_TAPE NetBackup Drive Type: 3 Removable : Yes Device Supports: SCSI-3 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst19" Passthru Name: "/dev/sg32" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD4 C7QH" Vendor ID : "IBM " Product ID : "ULT3580-TD4 " Product Rev: "C7QH" Serial Number: "1310159213" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD4 1310159213" Device Type : SDT_TAPE NetBackup Drive Type: 3 Removable : Yes Device Supports: SCSI-3 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst18" Passthru Name: "/dev/sg30" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD4 C7QB" Vendor ID : "IBM " Product ID : "ULT3580-TD4 " Product Rev: "C7QB" Serial Number: "9310129495" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD4 9310129495" Device Type : SDT_TAPE NetBackup Drive Type: 3 Removable : Yes Device Supports: SCSI-3 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst22" Passthru Name: "/dev/sg38" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD6 G350" Vendor ID : "IBM " Product ID : "ULT3580-TD6 " Product Rev: "G350" Serial Number: "10WT069341" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD6 10WT069341" Device Type : SDT_TAPE NetBackup Drive Type: 16 Removable : Yes Device Supports: SCSI-6 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst17" Passthru Name: "/dev/sg28" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD4 C7QB" Vendor ID : "IBM " Product ID : "ULT3580-TD4 " Product Rev: "C7QB" Serial Number: "1310035164" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD4 1310035164" Device Type : SDT_TAPE NetBackup Drive Type: 3 Removable : Yes Device Supports: SCSI-3 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst16" Passthru Name: "/dev/sg27" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD6 G350" Vendor ID : "IBM " Product ID : "ULT3580-TD6 " Product Rev: "G350" Serial Number: "10WT087042" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD6 10WT087042" Device Type : SDT_TAPE NetBackup Drive Type: 16 Removable : Yes Device Supports: SCSI-6 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst15" Passthru Name: "/dev/sg26" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD6 G350" Vendor ID : "IBM " Product ID : "ULT3580-TD6 " Product Rev: "G350" Serial Number: "10WT069302" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD6 10WT069302" Device Type : SDT_TAPE NetBackup Drive Type: 16 Removable : Yes Device Supports: SCSI-6 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst14" Passthru Name: "/dev/sg25" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD6 G350" Vendor ID : "IBM " Product ID : "ULT3580-TD6 " Product Rev: "G350" Serial Number: "10WT069301" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD6 10WT069301" Device Type : SDT_TAPE NetBackup Drive Type: 16 Removable : Yes Device Supports: SCSI-6 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst13" Passthru Name: "/dev/sg24" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD6 G350" Vendor ID : "IBM " Product ID : "ULT3580-TD6 " Product Rev: "G350" Serial Number: "10WT069326" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD6 10WT069326" Device Type : SDT_TAPE NetBackup Drive Type: 16 Removable : Yes Device Supports: SCSI-6 Flags : 0x0 Reason: 0x0 ------------------------------------------------------------ Device Name : "/dev/nst12" Passthru Name: "/dev/sg23" Volume Header: "" Port: -1; Bus: -1; Target: -1; LUN: -1 Inquiry : "IBM ULT3580-TD6 G350" Vendor ID : "IBM " Product ID : "ULT3580-TD6 " Product Rev: "G350" Serial Number: "10WT072106" WWN : "" WWN Id Type : 0 Device Identifier: "IBM ULT3580-TD6 10WT072106" Device Type : SDT_TAPE NetBackup Drive Type: 16 Removable : Yes Device Supports: SCSI-6 Flags : 0x0 Reason: 0x0
We plan on rebooting the netbackup master just in case.
will update here soon after.
Thank you
11-10-2019 08:15 AM
Hi
Thanks for output. it confirms zoning is good and Netbackup can see the devices.
Now it will be very necessary to findout if Tape Drives have a tape stuck inside. If you are familier with robtest utility, please run it from the robot control host server (probably "MSSBA572" is the robot host for you).
/usr/openv/volmgr/bin/robtest
Refer to article
11-10-2019 08:58 AM - edited 11-10-2019 09:00 AM
Make sure that robot drive number is not mistaken in NBU configuration - you can verify this by comparing serial numbers with the robot numbers...
Also make sure that tapes are not broken - visit the library web site and see its inventory some vendors provide BAD word in slot where is sitting suspected bad media.
11-11-2019 01:15 AM - edited 11-11-2019 11:02 PM
Can you please copy /var/log/messages on the Appliance for 9 Nov to messages.txt and upload here?
There are a bunch of errors throughout the day on Saturday - none of them about DOWN drives:
11/09/2019 08:18:19 - awaiting resource mssba572-hcart-robot-tld-1. Waiting for resources. Reason: Tape media server is not active, Media server: mssba572,
Was there a comms problem between the master and media server at this time?
11/09/2019 08:20:34 - awaiting resource mssba572-hcart-robot-tld-1. Waiting for resources. Reason: Robotic library is down on server, Media server: mssba572,
Did you check processes running on the media server?
Any chance that someone ran robtest at this time?
Bear in mind that you should not run robtest while backups are running and tape mounts are due - robtest will override NBU robot control.
11/09/2019 15:50:28 - Error bptm (pid=166565) error requesting media, TpErrno = Robot operation failed 11/09/2019 15:50:28 - Warning bptm (pid=166565) media id 0938L4 load operation reported an error 11/09/2019 16:08:44 - Info bptm (pid=166565) Waiting for mount of media id 0938L4 (copy 2) on server mssba572. 11/09/2019 16:08:44 - started process bptm (pid=166565) 11/09/2019 16:08:44 - mounting 0938L4 11/09/2019 16:08:44 - Info bptm (pid=166565) INF - Waiting for mount of media id 0938L4 on server mssba572 for writing. 11/09/2019 16:16:21 - Error bptm (pid=166565) error requesting media, TpErrno = Robot operation failed
Hopefully there will be some info in messages file about the 'Robot / load operation'.
11-11-2019 04:40 PM
Hi Marianne,
It could be me that running the robtest during the duplication job. Now the all drives reside in the LTO4 library running as usual after we reboot the master server.
Thank you
11-11-2019 11:03 PM
Always remember that robtest takes full control of the robot.
The tape drives will all go into AVR status while robtest is running.
11-12-2019 06:20 AM
Your SAN device zoning, and your tape changer LUN presentation, and your tape drive LUN presentation, are all definitely messed up... because you can see one robot (with six LTO4 drives) six times and you see another robot (with seven LTO6 drives) once.