cancel
Showing results forΒ 
Search instead forΒ 
Did you mean:Β 

NDMP Drives disabled when a cleaning operation is attempted

thezapman
Level 3

Hi all,

I'm seeing what I assume to be a unique issue. I'm using Backup Exec 2012, which is connected to an Scalar i6k Tape Library and 2 Netapp filers via fiber channel SAN. I backup to the drives using NDMP (which works very well and very fast, currently very happy with this setup). The issue I've been seeing is that while my weekend backup jobs are running the NDMP drives will become disabled. Re-enabling the drives makes them work properly again but unless I'm constantly monitoring the drives it's very easy to miss this and have my NDMP backups fail over the weekend and I have to restart them come Monday.

Looking at the error logs, I believe I have it narrowed down to an issue with cleaning. During the weekend the drives will flag that they need a cleaning. It will attempt to load the cleaning media, fail, and then disable the tape drives. I have so far been unable to find a way to disable the automatic cleaning, and a manual cleaning presents this in the error log:

 PVLSVR:   [11/30/12 13:32:52] [2436]     AdammSession::Execute( ADAMM_SESSION_EXECUTE_SESSION_SET_JOB_INFO )

            Session = {0BA58F7C-1DBD-452C-BBAD-80C21E2A05EF}
 
            Job = {29735FDA-741B-4FA7-B00D-685276B54242}, "Clean Drive 00175"
PVLSVR:   [11/30/12 13:32:52] [2436]     AdammSession::Execute( ADAMM_SESSION_EXECUTE_SESSION_SET_TARGET_DEVICE_HOST )
 
            Session = {0BA58F7C-1DBD-452C-BBAD-80C21E2A05EF}
 
            Device Host = ""
PVLSVR:   [11/30/12 13:32:52] [2436]     AdammSession::Execute( ADAMM_SESSION_EXECUTE_DRIVE_CLEAN )
 
            Session = {0BA58F7C-1DBD-452C-BBAD-80C21E2A05EF}
PVLSVR:   [11/30/12 13:32:55] [9876]     AdammSession::MediaUtilityThreadProc( ADAMM_SESSION_EXECUTE_DRIVE_CLEAN )
 
            Session = {CD4D48BA-5815-4A0D-87F8-92F6501F4690}
 
            Job = {29735FDA-741B-4FA7-B00D-685276B54242}, "Clean Drive 00175"
 
            Drive = {3A13A481-81B0-4207-8A0E-2B45F7D806FA}, "NDMP2"
 
            Slot = 0012
 
            Count = 0001
 
            Side = 0000
PVLSVR:   [11/30/12 13:32:55] [9876]     DeviceIo: ndmpConnect: connection=0x0000000005D600E8 host=LA-FS04.CORP.VALUECLICK.COM port=10000
PVLSVR:   [11/30/12 13:32:55] [9876]     DeviceIo: ndmpConnect: socket=0x2d4, local=192.168.250.53:62408, family=2 <-> peer=192.168.250.53:10000, family=2
PVLSVR:   [11/30/12 13:32:55] [9876]     DeviceIo: 01:00:04:00 - NDMP device not connected or reservation conflict, SCSI cmd 00
PVLSVR:   [11/30/12 13:32:56] [9876]     DeviceIo: ndmpConnect: connection=0x0000000005D600E8 host=LA-FS04.CORP.VALUECLICK.COM port=10000
PVLSVR:   [11/30/12 13:32:56] [9876]     DeviceIo: ndmpConnect: socket=0x4e0, local=192.168.250.53:62414, family=2 <-> peer=192.168.250.53:10000, family=2
PVLSVR:   [11/30/12 13:32:56] [9876]     DeviceIo: 01:00:04:00 - NDMP device not connected or reservation conflict, SCSI cmd 00
PVLSVR:   [11/30/12 13:32:57] [9876]     DeviceIo: ndmpConnect: connection=0x0000000005D600E8 host=LA-FS04.CORP.VALUECLICK.COM port=10000
PVLSVR:   [11/30/12 13:32:57] [9876]     DeviceIo: ndmpConnect: socket=0x2d4, local=192.168.250.53:62450, family=2 <-> peer=192.168.250.53:10000, family=2
PVLSVR:   [11/30/12 13:32:57] [9876]     DeviceIo: 01:00:04:00 - NDMP device not connected or reservation conflict, SCSI cmd 00
PVLSVR:   [11/30/12 13:32:58] [9876]     DeviceIo: ndmpConnect: connection=0x0000000005D600E8 host=LA-FS04.CORP.VALUECLICK.COM port=10000
PVLSVR:   [11/30/12 13:32:58] [9876]     DeviceIo: ndmpConnect: socket=0x4e0, local=192.168.250.53:62453, family=2 <-> peer=192.168.250.53:10000, family=2
PVLSVR:   [11/30/12 13:32:58] [9876]     DeviceIo: 01:00:04:00 - NDMP device not connected or reservation conflict, SCSI cmd 00
PVLSVR:   [11/30/12 13:32:59] [9876]     DeviceIo: ndmpConnect: connection=0x0000000005D600E8 host=LA-FS04.CORP.VALUECLICK.COM port=10000
PVLSVR:   [11/30/12 13:32:59] [9876]     DeviceIo: ndmpConnect: socket=0x2d4, local=192.168.250.53:62465, family=2 <-> peer=192.168.250.53:10000, family=2
PVLSVR:   [11/30/12 13:33:00] [9876]     DeviceIo: 01:00:04:00 - NDMP device not connected or reservation conflict, SCSI cmd 00
PVLSVR:   [11/30/12 13:33:00] [0000]     CWin32SharedMemoryPool::Open:     base=0x0000000000000000, mutex=0xffffffff, name=CdbsSMem.2
PVLSVR:   [11/30/12 13:33:00] [0000]     CWin32SharedMemoryPool::Close:    base=0x0000000000000000, mutex=0xffffffff
PVLSVR:   [11/30/12 13:33:00] [0000]     CWin32SharedMemoryPool::Open:     base=0x000000002A230000, mutex=0x24c, name=CdbsSMem.2
PVLSVR:   [11/30/12 13:33:00] [0000]     CWin32SharedMemoryPool::Close:    base=0x000000002A230000, mutex=0x24c
PVLSVR:   [11/30/12 13:33:00] [0000]     CWin32SharedMemoryPool::Close:    base=0x000000002A230000, mutex=0xffffffff
PVLSVR:   [11/30/12 13:33:00] [9876]     PvlDevice::SendAlert()
 
            Session = {00000000-0000-0000-0000-000000000000}
 
            Device = {3A13A481-81B0-4207-8A0E-2B45F7D806FA}, "NDMP2"
 
            Media = ""
PVLSVR:   [11/30/12 13:33:00] [9876]     "Cluster" key is not present in the registry
PVLSVR:   [11/30/12 13:33:00] [9876]     Did not detect Microsoft cluster ()
PVLSVR:   [11/30/12 13:33:00] [9876]     VCS cluster keys do not appear to be present in the registry
PVLSVR:   [11/30/12 13:33:00] [9876]     Did not detect VCS cluster ()
BESERVER: [11/30/12 13:33:01] [0000]     In Function MN: SendNotification added from  backupadmins@corp.valueclick.com to backupadmin@valueclick.com subject Backup Exec Alert: Storage Error (Server: "LA-DFSBK101")  messsage (Server: "LA-DFSBK101") The drive hardware is offline.
 
    Please confirm that the drive hardware is powered on and properly cabled.
BESERVER: [11/30/12 13:33:01] [0000]     In Function MN: SendNotification Before notify.Send(msg);
BESERVER: [11/30/12 13:33:01] [0000]     In Function MN: SendNotification Send mail success
PVLSVR:   [11/30/12 13:33:00] [9876]     DeviceIo: 01:00:04:00 - NDMP device not connected or reservation conflict, SCSI cmd 00
MANAGEME: [11/30/12 13:33:10] [0000]     Task ProcessNrdsAdvertising_Asynch completed
 
3 REPLIES 3

Backup_Exec1
Level 6
Employee Accredited Certified

Hi

See if you have check this link below 

http://www.symantec.com/docs/TECH69446

 

Thanks

thezapman
Level 3

Unfortunately I don't believe this applies to my current situation (although they are eerily similar). All the fixes described though would do nothing to correct the issue that this only seems to occur when a cleaning is attempted, which the fixes would not apply to. 

 

For now I have ejected all cleaning tapes, and will reimport as needed for cleaning jobs to help prevent automatic cleaning of the drives to see if the drives still encounter the same issue over the weekend. This is quite an annoying bug (if it is indeed a bug with backup exec)!

Backup_Exec1
Level 6
Employee Accredited Certified

Hi

I guess you should open a formal case for Symantec to investigate and help with solution on same

 

Thanks