Crazy at Errors in Netbackup 3.4 on Solaris 7

[NMT_screen]

Hi Gents,

Need your kind help/advise/instructions to cure my big problems in netbackup server3.4 running on solaris7 and overland tape library . I have one netbackup 3.4 server and a few media servers running under it. I used to received status code 83 from the backup of media tapes under one of the media servers . I suspect it is due to media tape errors and I changed the tapes under this media server group. But other media tapes under another media server also came out status code 83 and a lot of errors as per follows. PLS PLS HELP ME OUT FROM THIS TROUBLE SINCE I M GOING TO CRAZY.

/var/adm/messages

Feb 26 09:55:52 netbkpserver002 tldcd[22074]: TLD(2) key = 0x0, asc = 0x0, ascq = 0x0, NO ADDITIONAL SENSE INFORMATION

( It is due to backup tape library ? Pls.advise )
Feb 26 09:55:52 netbkpserver002 tldcd[22074]: TLD(2) Move_medium error: CHECK CONDITION

(  Really due to media error ? )
Feb 26 10:02:25 netbkpserver002 tldcd[22386]: TLD(2) cannot dismount drive 2, slot 91 already is full
Feb 26 10:02:25 netbkpserver002 tldcd[22386]: TLD(2) key = 0x0, asc = 0x0, ascq = 0x0, NO ADDITIONAL SENSE INFORMATION
Feb 26 10:02:25 netbkpserver002 tldcd[22386]: TLD(2) Move_medium error: CHECK CONDITION

-Feb 26 10:19:55 netbkpserver002 tldcd[22962]: TLD(2) expected barcode (media03  ) in slot 85, found barcode (--------)
Feb 26 10:23:42 netbkpserver002 tldcd[23000]: TLD(2) expected barcode (media03  ) in slot 85, found barcode (media01  )
Feb 26 10:27:28 netbkpserver002 tldcd[23034]: TLD(2) expected barcode (media03  ) in slot 85, found barcode (media01  )
Feb 26 10:28:13 netbkpserver002 tldcd[23055]: TLD(2) expected barcode (media03  ) in slot 85, found barcode (media01  )

( Volume database is not update with physical media location , Pls. advise , it happen automatically )

Feb 26 10:30:19 netbkpserver002 tldcd[23222]: TLD(2) cannot dismount drive 2, slot 91 already is full

Feb 26 10:31:48 netbkpserver002 ID[RICHPse.monlog.2000]: Disk state amber entered, Action: Move load from busy disks to idle disks
Feb 26 10:33:48 netbkpserver002 ID[RICHPse.monlog.2000]: Disk state white entered, Action: No activity

( I have no idea about the disk state amber and white , what does it mean ? )

Feb 26 20:14:50 netbkpserver002 tldd[2402]: TLD(2) drive 1 (device 0) is being DOWNED, status: Robotic mount failure

( The tape LTOD drives are keeping on down evey 5 to 10 minutes eventhough I changed the tape library drives , why ?)

/usr/openv/netbackup/db/error

1235615750 1 4 16 production 26131 0 0 bkpwindowsATC001 bpsched backup of client bkpwindowsATC001 exited with status 83 (media open error)
1235615750 1 4 16 netbkpserver002 0 0 0 *NULL* bpsched scheduler exiting - media open error (83)

Robot inventory/ media database is not sync with the  physical slots in the tape library.

1235651678 1 4 4 netbkpserver002 0 0 0 netbkpserver002 bpsched skipping backup of client netbkpserver002, class bkp_web2, schedule incrbkps because it has exceeded the configured number of tries
1235651678 1 4 4 netbkpserver002 0 0 0 bkpunix006 bpsched skipping backup of client bkpunix006, class bkp_web3, schedule incrbkps because it has exceeded the configured number of tries

( Why so many tapes are not able to mount ?  Drive error or media error ? )

1235650486 1 132 16 netbkpserver002 26153 0 0 bkpClass bptm FREEZING media id bkp02, it is unmountable and cannot be used for backups
1235650488 1 132 16 netbkpserver002 26153 0 0 bkpClass bptm FREEZING media id bkp07, it is unmountable and cannot be used for backups

( the tapes are usually freeze every now and then , due to media tape error ? )

************************************************************************************************

bpmedialist

Feb 26 20:14:52 netbkpserver002 vmd[2385]: media ID bkp04 has expired
Feb 26 20:14:52 netbkpserver002 vmd[2385]: media ID bkp05 has expired
Feb 26 20:14:58 netbkpserver002 vmd[2385]: media ID bkp04 has expired
Feb 26 20:14:58 netbkpserver002 vmd[2385]: media ID bkp05 has expired

( How can I use back those media to normal backup ? ) 

 I really really really need your gentlemen help since I am getting a lot of problems with this old backup 3.4 server . Pls. help me out.

Thanks  

[J_H_Is_gone]

Yes!  Please do what every body as suggeted you do above.

[Andy_Welburn]

The result from the status command is normal.

e.g. from one of our Solaris servers (not NetBackup) where I know a tape to be loaded but 'idle' :
# mt status
Sun DLT7000 tape drive:
sense key(0x6)= Unit Attention residual= 0 retries= 0
file no= 0 block no= 0

& another from one where the tape drive is physically being used (this one IS NetBackup):
# mt -f /dev/rmt/1 status
/dev/rmt/1: Device busy

& where a tape is NOT loaded:
# mt -f /dev/rmt/0 status
/dev/rmt/0: no tape loaded or drive offline

[NMT_screen]

My aplogies for late resply since I got to communicate with others to get result. I did check with the master server as well as 3 other media server. The result is as follow.

on the master netbackup server. I don't know why I got this unfamiliar message as follow.

While Tape inside Drive 1

mt -f /dev/rmt/0cbn status
Invalid move type, must be i, t, d or s      ( I don't know why show like that instead of status , )

NetbackupMaster# tpconfig -d
Index DriveName DrivePath Type Multihost Status
***** ********* ********** **** ********* ******
0 LTODrv1 /dev/rmt/0cbn hcart Yes UP
TLD(2) Definition DRIVE=1
1 LTODrv2 /dev/rmt/1cbn hcart Yes UP
TLD(2) Definition DRIVE=2
2 LTODrv3 /dev/rmt/2cbn hcart Yes UP
TLD(2) Definition DRIVE=3
3 LTODrv4 /dev/rmt/3cbn hcart Yes UP
TLD(2) Definition DRIVE=4

Currently defined robotics are:
TLD(2) robotic path = /dev/sg/c2t10l0, volume database host = NetbackupMaster

MediaServer1:/usr/openv/volmgr/bin> tpconfig -d
Index DriveName DrivePath Type Multihost Status
***** ********* ********** **** ********* ******
0 LTODrv1 /dev/rmt/0cbn hcart Yes UP
TLD(2) Definition DRIVE=1
1 LTODrv2 /dev/rmt/1cbn hcart Yes UP
TLD(2) Definition DRIVE=2
2 LTODrv3 /dev/rmt/2cbn hcart Yes UP
TLD(2) Definition DRIVE=3
3 LTODrv4 /dev/rmt/3cbn hcart Yes UP
TLD(2) Definition DRIVE=4

Currently defined robotics are:
TLD(2) robot host = SGCCUSASP002, volume database host = NetbackupMaster
DEVATK-iASPire:/usr/openv/volmgr/bin>


MediaServer2:/usr/openv/volmgr/bin> tpconfig -d
Index DriveName DrivePath Type Multihost Status
***** ********* ********** **** ********* ******
0 LTODrv1 /dev/rmt/0cbn hcart Yes UP
TLD(2) Definition DRIVE=1
1 LTODrv2 /dev/rmt/1cbn hcart Yes UP
TLD(2) Definition DRIVE=2
2 LTODrv3 /dev/rmt/2cbn hcart Yes UP
TLD(2) Definition DRIVE=3
3 LTODrv4 /dev/rmt/3cbn hcart Yes UP
TLD(2) Definition DRIVE=4

Currently defined robotics are:
TLD(2) robot host = SGCCUSASP002, volume database host = NetbackupMaster

MediaServer3# tpconfig -d
Index DriveName DrivePath Type Multihost Status
***** ********* ********** **** ********* ******
0 LTODrv1 /dev/rmt/0cbn hcart Yes UP
TLD(2) Definition DRIVE=1
1 LTODrv2 /dev/rmt/1cbn hcart Yes UP
TLD(2) Definition DRIVE=2
2 LTODrv3 /dev/rmt/2cbn hcart Yes UP
TLD(2) Definition DRIVE=3
3 LTODrv4 /dev/rmt/3cbn hcart Yes UP
TLD(2) Definition DRIVE=4

Currently defined robotics are:
TLD(2) robot host = SGCCUSASP002, volume database host = NetbackupMaster

Mediaserver2# mt -f /dev/rmt/0cbn status
/dev/rmt/0cbn: Device busy
Mediaserver2# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: no tape loaded or drive offline
Mediaserver2# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
Mediaserver2# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

Mediaserver3# mt -f /dev/rmt/0cbn status
HP Ultrium tape drive:
sense key(0x6)= Unit Attention residual= 0 retries= 0
file no= 0 block no= 0
# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: write protected or reserved.
# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: write protected or reserved.

# mt -f /dev/rmt/3cbn status

/dev/rmt/3cbn: write protected or reserved.

Mediaserver1# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: write protected or reserved.
Mediaserver1# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
Mediaserver1# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

While Tape inside Drive 2

Mediaserver2# mt -f /dev/rmt/1cbn status
Vendor 'HP ' Product 'Ultrium 2-SCSI ' tape drive:
sense key(0x6)= Unit Attention residual= 0 retries= 0
file no= 0 block no= 0
Mediaserver2# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
Mediaserver2# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

Mediaserver3#
# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: write protected or reserved.
# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: write protected or reserved.
# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: write protected or reserved.


Mediaserver1# mt -f /dev/rmt/1cbn status
HP Ultrium tape drive:
sense key(0x0)= No Additional Sense residual= 0 retries= 0
file no= 0 block no= 0
# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address
# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

While Tape inside Drive 3

Mediaserver3
# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: no tape loaded or drive offline
#
# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: write protected or reserved.
#
# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: write protected or reserved.
#

MediaServer2
Mediaserver2# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: no tape loaded or drive offline
Mediaserver2# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
Mediaserver2# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

MediaServer1
Mediaserver1# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: write protected or reserved.
Mediaserver1# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
Mediaserver1# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

While Tape inside Drive 4

Mediaserver2
Mediaserver2# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: no tape loaded or drive offline
Mediaserver2# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
Mediaserver2# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address

Mediaserver3

# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: write protected or reserved.
#
# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: write protected or reserved.
#
# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: write protected or reserved.

Mediaserver1
# mt -f /dev/rmt/1cbn status
/dev/rmt/1cbn: write protected or reserved.
# mt -f /dev/rmt/2cbn status
/dev/rmt/2cbn: No such device or address
# mt -f /dev/rmt/3cbn status
/dev/rmt/3cbn: No such device or address