Forum Discussion

GulzarShaikhAUS's avatar
GulzarShaikhAUS
Level 6
11 years ago

A pending request has been generated for this resource request

Hi All,

A duplication job gets hung with folowing message in the job details "A pending request has been generated for this resource request"

I am pasting all possible information you might need. Its single master media 7507 on windows 2008, single tape library with 2 drives. All backups are multiplexed. Duplication worked for all other images. Some images recides on single media and some of two. The one in question resides on two. Other images with multiple medias goes fine. The backup-id of failed job is asnetapp03_1406917805 and the medias it belong to are HO0002 and HO0023.

There is another image on same media HO0002 and HO0023 but it duplicates without an issue. The diference is it mounts HO0023 and then HO0002 where as the other images which fails tries to mount HO0002 and goes into pending. Ran mcontent on HO0002 and it works well.

Here are some of the outputs -

Job detailed status -

8/6/2014 6:19:19 PM - begin Duplicate
8/6/2014 6:19:20 PM - requesting resource asbackup-hcart2-robot-tld-1
8/6/2014 6:19:20 PM - requesting resource HO0023
8/6/2014 6:19:20 PM - reserving resource HO0023
8/6/2014 6:19:20 PM - reserving resource HO0002
8/6/2014 6:19:20 PM - reserved resource HO0023
8/6/2014 6:19:20 PM - reserved resource HO0002
8/6/2014 6:19:20 PM - granted resource 000008
8/6/2014 6:19:20 PM - granted resource HP.ULTRIUM5-SCSI.001
8/6/2014 6:19:20 PM - granted resource asbackup-hcart2-robot-tld-1
8/6/2014 6:19:20 PM - granted resource HO0023
8/6/2014 6:19:20 PM - granted resource HP.ULTRIUM5-SCSI.000
8/6/2014 6:19:21 PM - Info bptm(pid=4356) start           
8/6/2014 6:19:21 PM - started process bptm (4356)
8/6/2014 6:19:21 PM - Info bptm(pid=4356) using 65536 data buffer size       
8/6/2014 6:19:21 PM - Info bptm(pid=4356) setting receive network buffer to 263168 bytes     
8/6/2014 6:19:21 PM - Info bptm(pid=4356) using 30 data buffers        
8/6/2014 6:19:22 PM - Info bptm(pid=4356) start backup          
8/6/2014 6:19:22 PM - Info bptm(pid=1412) start           
8/6/2014 6:19:22 PM - started process bptm (1412)
8/6/2014 6:19:22 PM - Info bptm(pid=4356) setting receive network buffer to 263168 bytes     
8/6/2014 6:19:22 PM - Info bpdm(pid=1412) reading backup image         
8/6/2014 6:19:22 PM - Info bptm(pid=4356) backup child process is pid 3324.1928      
8/6/2014 6:19:22 PM - Info bptm(pid=4356) Waiting for mount of media id 000008 (copy 2) on server asbackup.asic-hq.com.
8/6/2014 6:19:22 PM - Info bptm(pid=3324) start           
8/6/2014 6:19:22 PM - started process bptm (4356)
8/6/2014 6:19:22 PM - started process bptm (3324)
8/6/2014 6:19:22 PM - mounting 000008
8/6/2014 6:19:22 PM - Info bptm(pid=1412) using 30 data buffers        
8/6/2014 6:19:22 PM - Info bptm(pid=4356) INF - Waiting for mount of media id 000008 on server asbackup.asic-hq.com for writing.
8/6/2014 6:19:22 PM - Info bptm(pid=1412) spawning a child process        
8/6/2014 6:19:22 PM - Info bptm(pid=5732) start           
8/6/2014 6:19:22 PM - Info bptm(pid=1412) child pid: 5732         
8/6/2014 6:19:22 PM - started process bptm (5732)
8/6/2014 6:19:22 PM - requesting resource HO0002
8/6/2014 6:19:22 PM - awaiting resource HO0002 A pending request has been generated for this resource request.
  Operator action may be required. Pending Action: No action.,
  Media ID: HO0002, Barcode: HO0002, Density: hcart2, Access Mode: Read,
  Action Drive Name: N/A, Action Media Server: asbackup.asic-hq.com, Robot Number: N/A, Robot Type: NONE,
  Volume Group: 000_00001_TLD, Action Acs: N/A, Action Lsm: N/A
 
8/6/2014 6:20:13 PM - Info bptm(pid=4356) media id 000008 mounted on drive index 2, drivepath {5,0,1,0}, drivename HP.ULTRIUM5-SCSI.001, copy 2
8/6/2014 6:20:21 PM - Info bptm(pid=4356) INF - Waiting for positioning of media id 000008 on server asbackup.asic-hq.com for writing.

nbrbutil -dump

C:\Program Files\Veritas\NetBackup\bin\admincmd>nbrbutil -dump

Allocation Requests
(AllocationRequestSeq
         index=0 (AllocationRequest: id={0D708F2D-87D1-4F0F-8272-BB6646FABE3D} p
riority=50000 secondPriority=0 userid=jobid=23396 description=FOREIGN_JOB_23396
(RequestSeq
         index=0 (Request provider=ReservationGroupProvider resourcename=Reserva
tionGroupProvider  userSequence=-1 (ReservationGroupRequest: groupid={6775CE61-2
6BC-4079-804A-BAA5B55EEB1F} requested=(RequestSeq
         index=0 (Request provider=DriveOperationProvider resourcename=MEDIA RES
OURCE  userSequence=0 (MediaRequest: mediaId=HO0002 mediaServer=asbackup.asic-hq
.com mediaKey=0 userReservationId= assignedTime=1406914111 client=asnetapp03 usa
geType=10 mustBeNdmp=yes driveName= drivePath= mediaPool= robotNumber=-1 slotNum
ber=-1 density=-1 ndmpControlHost= failIfNoMedia=yes externalFile= mediaType=2 m
ediaSubType=0 isNdmp=true isTirRestore=false isFlashbackupRestore=false isBlockM
apRead=false isCatalogBackup=false isGcsCatalogBackup=false isVMWare=false isLif
eCycle=false preferVtlToDirectAttachedTape=false useFt=false failIfNoFt=false is
GranularExchange=false REQ_IS_HYPER_V=false REQ_IS_EXCHANGE14=false REQ_IS_MPX_N
DMP=true REQ_IS_VXVI=false REQ_IS_EARI=false REQ_IS_SNAPDUPE=false REQ_IS_SNAPRE
PLICATE=false REQ_IS_ALLOW_NDMP_STUS_FOR_NON_NDMP_POLICIES=false NDMPHostName=))
)
)))
))


Allocations
(AllocationSeq
         index=0 (Allocation: id={7CDB4B47-6E83-4A2B-99D4-FF62315260D3} provider
=ReservationGroupProvider resourcename=aResourceGroup masterserver=asbackup.asic
-hq.com groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=-1 userid="j
obid=23396"  firstuserid="jobid=23396" (ReservationGroupAllocation: groupId={677
5CE61-26BC-4079-804A-BAA5B55EEB1F}))
         index=1 (Allocation: id={F28AD460-F6DA-4F88-9453-522F43B4E518} provider
=ReservationGroupProvider resourcename=HO0023 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=2 userid="jobid=2339
6"  firstuserid="jobid=23396" (MediaReservation: mountCount=1 reservationKey=217
191 request=(MediaRequest: mediaId=HO0023 mediaServer=asbackup.asic-hq.com media
Key=4000056 userReservationId= assignedTime=0 client= usageType=0 mustBeNdmp=no
driveName= drivePath= mediaPool= robotNumber=-1 slotNumber=-1 density=-1 ndmpCon
trolHost= failIfNoMedia=no externalFile= mediaType=2 mediaSubType=0 isNdmp=true
isTirRestore=false isFlashbackupRestore=true isBlockMapRead=false isCatalogBacku
p=true isGcsCatalogBackup=false isVMWare=false isLifeCycle=true preferVtlToDirec
tAttachedTape=true)))
         index=2 (Allocation: id={230ED960-5F87-4CF9-B140-B66D98816DB3} provider
=ReservationGroupProvider resourcename=HO0002 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=3 userid="jobid=2339
6"  firstuserid="jobid=23396" (MediaReservation: mountCount=1 reservationKey=217
192 request=(MediaRequest: mediaId=HO0002 mediaServer=asbackup.asic-hq.com media
Key=4000023 userReservationId= assignedTime=0 client= usageType=0 mustBeNdmp=no
driveName= drivePath= mediaPool= robotNumber=-1 slotNumber=-1 density=-1 ndmpCon
trolHost= failIfNoMedia=yes externalFile= mediaType=2 mediaSubType=0 isNdmp=true
 isTirRestore=true isFlashbackupRestore=true isBlockMapRead=true isCatalogBackup
=true isGcsCatalogBackup=true isVMWare=true isLifeCycle=true preferVtlToDirectAt
tachedTape=true)))
         index=3 (Allocation: id={EBB7DA81-B679-4913-B9DC-B214A0FB710B} provider
=ReservationGroupProvider resourcename=asbackup-hcart2-robot-tld-1 masterserver=
asbackup.asic-hq.com groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence
=0 userid="jobid=23396"  firstuserid="jobid=23396" (Media_Drive_Allocation_Recor
d: allocationKey=217194 (Media_Drive_Record: MediaKey=4000066 MediaId=000008 Med
iaServer=asbackup.asic-hq.com DriveKey=2000010 DriveName=HP.ULTRIUM5-SCSI.001 Pr
imaryPath={5,0,1,0} PoolName=Duplication_Pool RobotNum=1 RobotType=8 MediaTypeNa
me=NetBackup HCART2 DriveTypeName=NetBackup HCART2 NdmpControlHost= RetentionLev
el=3 PolicyType=1 JobType=9 MasterServer=asbackup.asic-hq.com) (Storage_Unit_Rec
ord: STU=asbackup-hcart2-robot-tld-1 STUType=2 MasterServer=asbackup.asic-hq.com
 MediaServer=asbackup.asic-hq.com RobotType=8 RobotNumber=1 Density=14 OnDemandO
nly=0 ConcurrentJobs=2 ActiveJobs=0 MaxMultiplexing=8 NdmpAttachHost= AbsolutePa
th=) (Bptm_Strings_Record: 0="MEDIADB 1 217194 000008 4000066 ------ 14 14073333
92 1407338114 1409600894 0 113424454 2 2 3 12 0 0 1024 0 1772264 0" 1="VOLUME 1
000008 4000066 000008 Duplication_Pool HP G130603306 14 8 1 18 0 {00000000-0000-
0000-0000-000000000000} 0" 2="DRIVE 3 HP.ULTRIUM5-SCSI.001 2000010 C38D390004 {5
,0,1,0} -1 -1 -1 -1 -1 -1 -1 -1 *NULL* *NULL* *NULL* *NULL* 1 0 0 1 0 0" 3="STOR
AGE 1 asbackup-hcart2-robot-tld-1 14 1048576 2 1 0 0 asbackup.asic-hq.com asback
up.asic-hq.com *NULL*" 4="DISKGROUP 0 6 *NULL* 6 *NULL* 6 *NULL*" 5="DISKVOLUME
0 6 *NULL* 6 *NULL* 0" 6="DISKMOUNTPOINT 0 6 *NULL*" ) TpReqFileName=))
         index=4 (Allocation: id={71323FB1-6330-4B84-8F8F-05E7B7F4EEBF} provider
=ReservationGroupProvider resourcename=HO0023 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=1 userid="jobid=2339
6"  firstuserid="jobid=23396" (Media_Drive_Allocation_Record: allocationKey=2171
93 (Media_Drive_Record: MediaKey=4000056 MediaId=HO0023 MediaServer=asbackup.asi
c-hq.com DriveKey=2000009 DriveName=HP.ULTRIUM5-SCSI.000 PrimaryPath={4,0,1,0} P
oolName=Daily RobotNum=1 RobotType=8 MediaTypeName=NetBackup HCART2 DriveTypeNam
e=NetBackup HCART2 NdmpControlHost= RetentionLevel=0 PolicyType=2 JobType=10 Mas
terServer=asbackup.asic-hq.com) (Storage_Unit_Record: STU= STUType=0 MasterServe
r= MediaServer= RobotType=0 RobotNumber=0 Density=0 OnDemandOnly=0 ConcurrentJob
s=0 ActiveJobs=0 MaxMultiplexing=0 NdmpAttachHost= AbsolutePath=) (Bptm_Strings_
Record: 0="MEDIADB 1 217193 HO0023 4000056 ------ 14 1406744263 1406917809 14075
22609 1407336502 2131813218 32 32 0 8 0 552 1024 0 29425378 0" 1="VOLUME 1 HO002
3 4000056 HO0023 Daily FUJIFILM ENAVEEM7M7 14 8 1 19 0 {00000000-0000-0000-0000-
000000000000} 0" 2="DRIVE 3 HP.ULTRIUM5-SCSI.000 2000009 C38D390000 {4,0,1,0} -1
 -1 -1 -1 -1 -1 -1 -1 *NULL* *NULL* *NULL* *NULL* 1 16 0 1 0 0" 3="STORAGE 1 *NU
LL* 0 0 0 0 0 0 asbackup.asic-hq.com asbackup.asic-hq.com *NULL*" 4="DISKGROUP 0
 6 *NULL* 6 *NULL* 6 *NULL*" 5="DISKVOLUME 0 6 *NULL* 6 *NULL* 0" 6="DISKMOUNTPO
INT 0 6 *NULL*" ) TpReqFileName=))
         index=5 (Allocation: id={C6F32E27-876D-4740-B91D-651A9FA2D430} provider
=ReservationGroupProvider resourcename=HO0002 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=0 userid="jobid=2339
6"  firstuserid="jobid=23396" (Media_Drive_Allocation_Record: allocationKey=2171
95 (Media_Drive_Record: MediaKey=4000023 MediaId=HO0002 MediaServer=asbackup.asi
c-hq.com DriveKey=0 DriveName= PrimaryPath= PoolName=Daily RobotNum=0 RobotType=
0 MediaTypeName=NetBackup HCART2 DriveTypeName= NdmpControlHost= RetentionLevel=
0 PolicyType=1 JobType=10 MasterServer=asbackup.asic-hq.com) (Storage_Unit_Recor
d: STU= STUType=0 MasterServer= MediaServer= RobotType=0 RobotNumber=0 Density=0
 OnDemandOnly=0 ConcurrentJobs=0 ActiveJobs=0 MaxMultiplexing=0 NdmpAttachHost=
AbsolutePath=) (Bptm_Strings_Record: 0="MEDIADB 1 217195 HO0002 4000023 ------ 1
4 1406914111 1407173505 1407778305 1407336755 2156184778 18 18 0 8 0 512 1024 0
33690450 0" 1="VOLUME 1 HO0002 4000023 HO0002 Daily FUJIFILM EP9LRG84KA 14 8 1 2
3 0 {00000000-0000-0000-0000-000000000000} 0" 2="DRIVE 3 *NULL* 0 *NULL* *NULL*
0 0 0 0 0 0 0 0 *NULL* *NULL* *NULL* *NULL* 0 16 0 1 0 0" 3="STORAGE 1 *NULL* 0
0 0 0 0 0 asbackup.asic-hq.com asbackup.asic-hq.com *NULL*" 4="DISKGROUP 0 6 *NU
LL* 6 *NULL* 6 *NULL*" 5="DISKVOLUME 0 6 *NULL* 6 *NULL* 0" 6="DISKMOUNTPOINT 0
6 *NULL*" ) TpReqFileName=)))

MDS allocations in EMM:

        MdsAllocation: allocationKey=217191 jobType=27 mediaKey=4000056 mediaId=
HO0023 driveKey=0 driveName= drivePath= stuName= masterServerName=asbackup.asic-
hq.com mediaServerName= ndmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=0
 fatPipeKey=0 scsiResType=0 serverStateFlags=0
        MdsAllocation: allocationKey=217192 jobType=27 mediaKey=4000023 mediaId=
HO0002 driveKey=0 driveName= drivePath= stuName= masterServerName=asbackup.asic-
hq.com mediaServerName= ndmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=0
 fatPipeKey=0 scsiResType=0 serverStateFlags=0
        MdsAllocation: allocationKey=217193 jobType=10 mediaKey=4000056 mediaId=
HO0023 driveKey=2000009 driveName=HP.ULTRIUM5-SCSI.000 drivePath={4,0,1,0} stuNa
me= masterServerName=asbackup.asic-hq.com mediaServerName=asbackup.asic-hq.com n
dmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=0 fatPipeKey=0 scsiResType
=1 serverStateFlags=1
        MdsAllocation: allocationKey=217194 jobType=9 mediaKey=4000066 mediaId=0
00008 driveKey=2000010 driveName=HP.ULTRIUM5-SCSI.001 drivePath={5,0,1,0} stuNam
e=asbackup-hcart2-robot-tld-1 masterServerName=asbackup.asic-hq.com mediaServerN
ame=asbackup.asic-hq.com ndmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=
0 fatPipeKey=0 scsiResType=1 serverStateFlags=1
        MdsAllocation: allocationKey=217195 jobType=10 mediaKey=4000023 mediaId=
HO0002 driveKey=0 driveName= drivePath= stuName= masterServerName=asbackup.asic-
hq.com mediaServerName=asbackup.asic-hq.com ndmpTapeServerName= diskVolumeKey=0
mountKey=0 linkKey=0 fatPipeKey=0 scsiResType=0 serverStateFlags=0

vxlogview for nbrb -

C:\Program Files\Veritas\NetBackup\bin>vxlogview -p nb -i nbrb -S
8/6/2014 18:28:24.255 V-118-105 [ResBroker_i::doEvaluation] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=105; DefaultMsg=]
8/6/2014 18:28:24.255 V-118-226 [ResBroker_i::evaluateOne] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=226; DefaultMsg=]
8/6/2014 18:28:24.318 V-118-211 [EMMAccess::reallocate] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=211; DefaultMsg=]
8/6/2014 18:28:24.318 [EMMAccess::reallocate] reallocated: mediaId=HO0002, driveName=, allocationKey=217195
8/6/2014 18:28:24.349 [RbActionHandler::evaluate] PEND is set, MDS defined pend: (PendingRequest_Record: mediaId=HO0002 barcode=HO0002 density=14 accessMode=R
actionCode=1 ()  actionDriveName= actionMediaServerName=asbackup.asic-hq.com robotNum=-1 robotType=0 volumeGroupName=000_00001_TLD actionAcs=-1 actionLsm=-1 pen
dingRequestString=MDS_PEND_ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0 000_00001_TLD -1 -1 0)
8/6/2014 18:28:24.380 V-118-139 [ResBroker_i::evaluateOne] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=139; DefaultMsg=]
8/6/2014 18:28:24.380 [ResBroker_i::evaluateOne] request has pending allocations, requestId={0D708F2D-87D1-4F0F-8272-BB6646FABE3D}, userId=jobid=23396, errorSta
tus=(RBErrorInfo: errorStatus=2005035 retryClass="MDS Defined Pend" retryReason=1 retryText="MDS_PEND_ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0
 000_00001_TLD -1 -1 0" retryResource=asbackup.asic-hq.com)
8/6/2014 18:28:24.380 [ResBroker_i::holdOne] new error status (RBErrorInfo: errorStatus=2005035 retryClass="MDS Defined Pend" retryReason=1 retryText="MDS_PEND_
ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0 000_00001_TLD -1 -1 0" retryResource=asbackup.asic-hq.com)
8/6/2014 18:28:24.380 V-118-106 [ResBroker_i::doEvaluation] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=106; DefaultMsg=]
8/6/2014 18:28:24.380 [ResBroker_i::doEvaluation] <EVALPERF> Evaluated 1 requests, evalTime=124 msec, numSucceeded=0, numQueued=1, numPended=1, numFailed=0, num
MultipleCopyJobs=0, numMdsCacheMisses=0, restartedEvalCycle=0, numDriveReleasesBeforeEval=0, numDrivesAvailStart=1, numDrivesAvailEnd=1, requestQueueSize=0
 

Attaching the bptm

7.5
Backup and Recovery
Error messages
NetBackup
  • GulzarShaikhAUS's avatar
    GulzarShaikhAUS
    Level 6
    11 years ago

    More info  - I tried nbrbutil -resetall. It does not work either.

    Some more info -

    C:\Program Files\Veritas\NetBackup\bin\admincmd>bpimagelist -backupid asnetapp03
    _1406917805 -L

    Client:            asnetapp03
    Backup ID:         asnetapp03_1406917805
    Policy:            FileServer_SLP
    Policy Type:       NDMP (19)
    Proxy Client:      (none specified)
    Creator:           root
    Name1:             (none specified)
    Sched Label:       Daily_Full
    Schedule Type:     FULL (0)
    Retention Level:   1 week (0)
    Backup Time:            8/1/2014 9:30:05 PM (1406917805)
    Elapsed Time:      17043 second(s)
    Expiration Time:        8/8/2014 9:30:05 PM (1407522605)
    Compressed:        no
    Client Encrypted:  no
    Kilobytes:         560585356
    Number of Files:   1071266
    Number of Copies:  1
    Number of Fragments:   9
    Histogram:         0 0 0 0 0 0 0 0 0 0
    DB Compressed:     no
    Files File Name:   FileServer_SLP_1406917805_FULL.f
    Previous Backup Files File Name:   (none specified)
    Parent Backup Image File Name:   (none specified)
    SW Version:        (none specified)
    Options:           0x0
    MPX:               1
    TIR Info:          0
    TIR Expiration:         1/1/1970 3:00:00 AM (0)
    Keyword:           (none specified)
    Ext Security Info: no
    File Restore Raw:  no
    Image Dump Level:  0
    File System Only:  no
    Object Descriptor: (none specified)
    Previous BI Time:       1/1/1970 3:00:00 AM (0)
    BI Full Time:           1/1/1970 3:00:00 AM (0)
    Request Pid:       0
    Backup Status:     0
    Stream Number:     2
    Backup Copy:       Standard (0)
    Files File size:     152471140
    PFI type:     0
    IMAGE_ATTRIBUTE:     32
    Primary Copy:      1
    Image Type:        0  (Regular)
    Job ID:            23173
    Num Resumes:       16
    Resume Expiration:      1/1/1970 3:00:00 AM (0)
    Data Classification:    (none specified)
    Data_Classification_ID: (none specified)
    Storage Lifecycle Policy:    Daily_Full
    Storage Lifecycle Policy Version:    3
    STL_Completed:      3
    Remote Expiration Time:      1/1/1970 3:00:00 AM (0)
    Origin Master Server:  (none specified)
    Origin Master GUID:    (none specified)
    Snap Time:           1/1/1970 3:00:00 AM (0)
    IR Enabled:      no
    Client Character Set:     0
    Image On Hold:     0
    Indexing Status:   0
    Copy number:       1
     Fragment:         TIR (-1)
     Kilobytes:        148898
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         11
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           24068454
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Key tag:          *NULL*
     STL tag:          *NULL*
     Copy on hold:     0
    Copy number:       1
     Fragment:         1
     Kilobytes:        0
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         31
     ID:               HO0023
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           33278310
     Media Date:           7/30/2014 9:17:43 PM (1406744263)
     Dev Written On:   1
     Flags:            0x0
     Media Descriptor:        ?
     Expiration Time:       8/8/2014 9:30:05 PM (1407522605)
     MPX:              1
     retention_lvl:    1 week (0)
     Try to Keep Time:       8/8/2014 9:30:05 PM (1407522605)
     Copy Creation Time:       8/2/2014 2:14:08 AM (1406934848)
     Data Format:      NDMP
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         2
     Kilobytes:        0
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         32
     ID:               HO0023
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           33278855
     Media Date:           7/30/2014 9:17:43 PM (1406744263)
     Dev Written On:   1
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         3
     Kilobytes:        133058752
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         1
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           2
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         4
     Kilobytes:        92864
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         3
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           7337756
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         5
     Kilobytes:        11304576
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         4
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           7341897
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         6
     Kilobytes:        87268608
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         6
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           7947167
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         7
     Kilobytes:        18176576
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         8
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           13093994
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0
    Copy number:       1
     Fragment:         8
     Kilobytes:        310535082
     Remainder:        0
     Media Type:       Media Manager (2)
     Density:          hcart2 (14)
     File Num:         10
     ID:               HO0002
     Host:             asbackup.asic-hq.com
     Block Size:       65536
     Offset:           13987501
     Media Date:            8/1/2014 8:28:31 PM (1406914111)
     Dev Written On:   2
     Flags:            0x0
     Media Descriptor:        ?
     checkpoint:       0
     resume num:       0
     Copy on hold:     0

    C:\Program Files\Veritas\NetBackup\bin\admincmd>nbemmcmd -listmedia -mediaid  HO
    0002
    NBEMMCMD, Version: 7.5.0.7
    ====================================================================
    Media GUID:                     4873178e-9293-4c62-b6f3-d8dd5108eded
    Media ID:                       HO0002
    Partner:                        -
    Media Type:                     HCART2
    Volume Group:                   000_00001_TLD
    Application:                    Netbackup
    Media Flags:                    1
    Description:                    Added by Media Manager
    Barcode:                        HO0002
    Partner Barcode:                --------
    Last Write Host:                asbackup.asic-hq.com
    Created:                        03/25/2013 08:47
    Time Assigned:                  08/01/2014 20:28
    First Mount:                    03/31/2013 15:18
    Last Mount:                     08/06/2014 18:56
    Volume Expiration:              -
    Data Expiration:                08/11/2014 20:31
    Last Written:                   08/04/2014 20:31
    Last Read:                      08/06/2014 18:56
    Robot Type:                     TLD
    Robot Control Host:             asbackup.asic-hq.com
    Robot Number:                   1
    Slot:                           23
    Side/Face:                      -
    Cleanings Remaining:            -
    Number of Mounts:               260
    Maximum Mounts Allowed:         0
    Media Status:                   MPX
    Kilobytes:                      2156184778
    Images:                         18
    Valid Images:                   18
    Retention Period:               0
    Number of Restores:             0
    Optical Header Size Bytes:      1024
    Optical Sector Size Bytes:      0
    Optical Partition Size Bytes:   0
    Last Header Offset:             33690448
    Adamm Guid:                     00000000-0000-0000-0000-000000000000
    Rsm Guid:                       00000000-0000-0000-0000-000000000000
    Origin Host:                    NONE
    Master Host:                    asbackup.asic-hq.com
    Server Group:                   NO_SHARING_GROUP
    Upgrade Conflicts Flag:
    Pool Number:                    8
    Volume Pool:                    Daily
    Previous Pool Name:             Scratch_Pool
    Vault Flags:                    -
    Vault Container:                -
    Vault Name:                     -
    Vault Slot:                     -
    Session ID:                     -
    Date Vaulted:                   -
    Return Date:                    -
    Media on Hold:                  0
    ====================================================================
    Command completed successfully.

    C:\Program Files\Veritas\NetBackup\bin\admincmd>

  • RiaanBadenhorst's avatar
    RiaanBadenhorst
    Level 6
    11 years ago

    From the dump it seems that 000008 is in the drive, and there are 2 allocations for HO0002 without any drives assigned. You said there are only 2 drives in your system. Is this not blocking the restore as it wants to mount both?

  • GulzarShaikhAUS's avatar
    GulzarShaikhAUS
    Level 6
    11 years ago

    Thanks Riaan. I think it is as it is supposed to be but the strange thing is why there are two allocations for HO0002?

  • BTLOMS's avatar
    BTLOMS
    Level 5
    11 years ago

    Suspend SLP, kill both allocations and activate SLP again. I have seen this in jobs with hung services.

  • GulzarShaikhAUS's avatar
    GulzarShaikhAUS
    Level 6
    11 years ago

    I tried restore from the same image and it worked ... Now its clear that there is no issue with image or media ...

    Can it be an issue with nbrb - We see this error

    8/6/2014 18:28:24.349 [RbActionHandler::evaluate] PEND is set, MDS defined pend: (PendingRequest_Record: mediaId=HO0002 barcode=HO0002 density=14 accessMode=R
    actionCode=1 ()  actionDriveName= actionMediaServerName=asbackup.asic-hq.com robotNum=-1 robotType=0 volumeGroupName=000_00001_TLD actionAcs=-1 actionLsm=-1 pen
    dingRequestString=MDS_PEND_ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0 000_00001_TLD -1 -1 0)

  • RiaanBadenhorst's avatar
    RiaanBadenhorst
    Level 6
    11 years ago

    I saw there were 2, don't know if that's normal. Never seen it before.

     

    Maybe just kill those mds allocations. And try from scratch.

  • Nicolai's avatar
    Nicolai
    Moderator
    11 years ago

    ​Just a idea

    Check density of the tape drive. HO0002 is HCART2, if the tape drives isn't HCART2 the restore request will queue as manual request with no tape drive allocation.

    Update: Just re-read the thread. If images duplicate of HO0002 it not a density issue

  • Marianne's avatar
    Marianne
    Level 6
    11 years ago

    Which pool is selected for the duplication?

    If Daily pool is selected for duplication, it is possible that HO0002 is selected for source and destination.

    Try to suspend HO0002 and see if that makes a difference for duplication job.
    Or select a different pool to duplicate to.

  • GulzarShaikhAUS's avatar
    GulzarShaikhAUS
    Level 6
    11 years ago

    The destination volume pool is different and finally I concluded that the issue is ONLY limitted to one image. I cancelled it from the duplication phase of SLP and now we dont see any errors....

    It was very strange.... the density is same .. it can be used for the same purpose for another job by same policy ... :)