cancel
Showing results for 
Search instead for 
Did you mean: 

A pending request has been generated for this resource request

GulzarShaikhAUS
Level 6
Partner Accredited Certified

Hi All,

A duplication job gets hung with folowing message in the job details "A pending request has been generated for this resource request"

I am pasting all possible information you might need. Its single master media 7507 on windows 2008, single tape library with 2 drives. All backups are multiplexed. Duplication worked for all other images. Some images recides on single media and some of two. The one in question resides on two. Other images with multiple medias goes fine. The backup-id of failed job is asnetapp03_1406917805 and the medias it belong to are HO0002 and HO0023.

There is another image on same media HO0002 and HO0023 but it duplicates without an issue. The diference is it mounts HO0023 and then HO0002 where as the other images which fails tries to mount HO0002 and goes into pending. Ran mcontent on HO0002 and it works well.

Here are some of the outputs -

Job detailed status -

8/6/2014 6:19:19 PM - begin Duplicate
8/6/2014 6:19:20 PM - requesting resource asbackup-hcart2-robot-tld-1
8/6/2014 6:19:20 PM - requesting resource HO0023
8/6/2014 6:19:20 PM - reserving resource HO0023
8/6/2014 6:19:20 PM - reserving resource HO0002
8/6/2014 6:19:20 PM - reserved resource HO0023
8/6/2014 6:19:20 PM - reserved resource HO0002
8/6/2014 6:19:20 PM - granted resource 000008
8/6/2014 6:19:20 PM - granted resource HP.ULTRIUM5-SCSI.001
8/6/2014 6:19:20 PM - granted resource asbackup-hcart2-robot-tld-1
8/6/2014 6:19:20 PM - granted resource HO0023
8/6/2014 6:19:20 PM - granted resource HP.ULTRIUM5-SCSI.000
8/6/2014 6:19:21 PM - Info bptm(pid=4356) start           
8/6/2014 6:19:21 PM - started process bptm (4356)
8/6/2014 6:19:21 PM - Info bptm(pid=4356) using 65536 data buffer size       
8/6/2014 6:19:21 PM - Info bptm(pid=4356) setting receive network buffer to 263168 bytes     
8/6/2014 6:19:21 PM - Info bptm(pid=4356) using 30 data buffers        
8/6/2014 6:19:22 PM - Info bptm(pid=4356) start backup          
8/6/2014 6:19:22 PM - Info bptm(pid=1412) start           
8/6/2014 6:19:22 PM - started process bptm (1412)
8/6/2014 6:19:22 PM - Info bptm(pid=4356) setting receive network buffer to 263168 bytes     
8/6/2014 6:19:22 PM - Info bpdm(pid=1412) reading backup image         
8/6/2014 6:19:22 PM - Info bptm(pid=4356) backup child process is pid 3324.1928      
8/6/2014 6:19:22 PM - Info bptm(pid=4356) Waiting for mount of media id 000008 (copy 2) on server asbackup.asic-hq.com.
8/6/2014 6:19:22 PM - Info bptm(pid=3324) start           
8/6/2014 6:19:22 PM - started process bptm (4356)
8/6/2014 6:19:22 PM - started process bptm (3324)
8/6/2014 6:19:22 PM - mounting 000008
8/6/2014 6:19:22 PM - Info bptm(pid=1412) using 30 data buffers        
8/6/2014 6:19:22 PM - Info bptm(pid=4356) INF - Waiting for mount of media id 000008 on server asbackup.asic-hq.com for writing.
8/6/2014 6:19:22 PM - Info bptm(pid=1412) spawning a child process        
8/6/2014 6:19:22 PM - Info bptm(pid=5732) start           
8/6/2014 6:19:22 PM - Info bptm(pid=1412) child pid: 5732         
8/6/2014 6:19:22 PM - started process bptm (5732)
8/6/2014 6:19:22 PM - requesting resource HO0002
8/6/2014 6:19:22 PM - awaiting resource HO0002 A pending request has been generated for this resource request.
  Operator action may be required. Pending Action: No action.,
  Media ID: HO0002, Barcode: HO0002, Density: hcart2, Access Mode: Read,
  Action Drive Name: N/A, Action Media Server: asbackup.asic-hq.com, Robot Number: N/A, Robot Type: NONE,
  Volume Group: 000_00001_TLD, Action Acs: N/A, Action Lsm: N/A
 
8/6/2014 6:20:13 PM - Info bptm(pid=4356) media id 000008 mounted on drive index 2, drivepath {5,0,1,0}, drivename HP.ULTRIUM5-SCSI.001, copy 2
8/6/2014 6:20:21 PM - Info bptm(pid=4356) INF - Waiting for positioning of media id 000008 on server asbackup.asic-hq.com for writing.

nbrbutil -dump

C:\Program Files\Veritas\NetBackup\bin\admincmd>nbrbutil -dump

Allocation Requests
(AllocationRequestSeq
         index=0 (AllocationRequest: id={0D708F2D-87D1-4F0F-8272-BB6646FABE3D} p
riority=50000 secondPriority=0 userid=jobid=23396 description=FOREIGN_JOB_23396
(RequestSeq
         index=0 (Request provider=ReservationGroupProvider resourcename=Reserva
tionGroupProvider  userSequence=-1 (ReservationGroupRequest: groupid={6775CE61-2
6BC-4079-804A-BAA5B55EEB1F} requested=(RequestSeq
         index=0 (Request provider=DriveOperationProvider resourcename=MEDIA RES
OURCE  userSequence=0 (MediaRequest: mediaId=HO0002 mediaServer=asbackup.asic-hq
.com mediaKey=0 userReservationId= assignedTime=1406914111 client=asnetapp03 usa
geType=10 mustBeNdmp=yes driveName= drivePath= mediaPool= robotNumber=-1 slotNum
ber=-1 density=-1 ndmpControlHost= failIfNoMedia=yes externalFile= mediaType=2 m
ediaSubType=0 isNdmp=true isTirRestore=false isFlashbackupRestore=false isBlockM
apRead=false isCatalogBackup=false isGcsCatalogBackup=false isVMWare=false isLif
eCycle=false preferVtlToDirectAttachedTape=false useFt=false failIfNoFt=false is
GranularExchange=false REQ_IS_HYPER_V=false REQ_IS_EXCHANGE14=false REQ_IS_MPX_N
DMP=true REQ_IS_VXVI=false REQ_IS_EARI=false REQ_IS_SNAPDUPE=false REQ_IS_SNAPRE
PLICATE=false REQ_IS_ALLOW_NDMP_STUS_FOR_NON_NDMP_POLICIES=false NDMPHostName=))
)
)))
))


Allocations
(AllocationSeq
         index=0 (Allocation: id={7CDB4B47-6E83-4A2B-99D4-FF62315260D3} provider
=ReservationGroupProvider resourcename=aResourceGroup masterserver=asbackup.asic
-hq.com groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=-1 userid="j
obid=23396"  firstuserid="jobid=23396" (ReservationGroupAllocation: groupId={677
5CE61-26BC-4079-804A-BAA5B55EEB1F}))
         index=1 (Allocation: id={F28AD460-F6DA-4F88-9453-522F43B4E518} provider
=ReservationGroupProvider resourcename=HO0023 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=2 userid="jobid=2339
6"  firstuserid="jobid=23396" (MediaReservation: mountCount=1 reservationKey=217
191 request=(MediaRequest: mediaId=HO0023 mediaServer=asbackup.asic-hq.com media
Key=4000056 userReservationId= assignedTime=0 client= usageType=0 mustBeNdmp=no
driveName= drivePath= mediaPool= robotNumber=-1 slotNumber=-1 density=-1 ndmpCon
trolHost= failIfNoMedia=no externalFile= mediaType=2 mediaSubType=0 isNdmp=true
isTirRestore=false isFlashbackupRestore=true isBlockMapRead=false isCatalogBacku
p=true isGcsCatalogBackup=false isVMWare=false isLifeCycle=true preferVtlToDirec
tAttachedTape=true)))
         index=2 (Allocation: id={230ED960-5F87-4CF9-B140-B66D98816DB3} provider
=ReservationGroupProvider resourcename=HO0002 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=3 userid="jobid=2339
6"  firstuserid="jobid=23396" (MediaReservation: mountCount=1 reservationKey=217
192 request=(MediaRequest: mediaId=HO0002 mediaServer=asbackup.asic-hq.com media
Key=4000023 userReservationId= assignedTime=0 client= usageType=0 mustBeNdmp=no
driveName= drivePath= mediaPool= robotNumber=-1 slotNumber=-1 density=-1 ndmpCon
trolHost= failIfNoMedia=yes externalFile= mediaType=2 mediaSubType=0 isNdmp=true
 isTirRestore=true isFlashbackupRestore=true isBlockMapRead=true isCatalogBackup
=true isGcsCatalogBackup=true isVMWare=true isLifeCycle=true preferVtlToDirectAt
tachedTape=true)))
         index=3 (Allocation: id={EBB7DA81-B679-4913-B9DC-B214A0FB710B} provider
=ReservationGroupProvider resourcename=asbackup-hcart2-robot-tld-1 masterserver=
asbackup.asic-hq.com groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence
=0 userid="jobid=23396"  firstuserid="jobid=23396" (Media_Drive_Allocation_Recor
d: allocationKey=217194 (Media_Drive_Record: MediaKey=4000066 MediaId=000008 Med
iaServer=asbackup.asic-hq.com DriveKey=2000010 DriveName=HP.ULTRIUM5-SCSI.001 Pr
imaryPath={5,0,1,0} PoolName=Duplication_Pool RobotNum=1 RobotType=8 MediaTypeNa
me=NetBackup HCART2 DriveTypeName=NetBackup HCART2 NdmpControlHost= RetentionLev
el=3 PolicyType=1 JobType=9 MasterServer=asbackup.asic-hq.com) (Storage_Unit_Rec
ord: STU=asbackup-hcart2-robot-tld-1 STUType=2 MasterServer=asbackup.asic-hq.com
 MediaServer=asbackup.asic-hq.com RobotType=8 RobotNumber=1 Density=14 OnDemandO
nly=0 ConcurrentJobs=2 ActiveJobs=0 MaxMultiplexing=8 NdmpAttachHost= AbsolutePa
th=) (Bptm_Strings_Record: 0="MEDIADB 1 217194 000008 4000066 ------ 14 14073333
92 1407338114 1409600894 0 113424454 2 2 3 12 0 0 1024 0 1772264 0" 1="VOLUME 1
000008 4000066 000008 Duplication_Pool HP G130603306 14 8 1 18 0 {00000000-0000-
0000-0000-000000000000} 0" 2="DRIVE 3 HP.ULTRIUM5-SCSI.001 2000010 C38D390004 {5
,0,1,0} -1 -1 -1 -1 -1 -1 -1 -1 *NULL* *NULL* *NULL* *NULL* 1 0 0 1 0 0" 3="STOR
AGE 1 asbackup-hcart2-robot-tld-1 14 1048576 2 1 0 0 asbackup.asic-hq.com asback
up.asic-hq.com *NULL*" 4="DISKGROUP 0 6 *NULL* 6 *NULL* 6 *NULL*" 5="DISKVOLUME
0 6 *NULL* 6 *NULL* 0" 6="DISKMOUNTPOINT 0 6 *NULL*" ) TpReqFileName=))
         index=4 (Allocation: id={71323FB1-6330-4B84-8F8F-05E7B7F4EEBF} provider
=ReservationGroupProvider resourcename=HO0023 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=1 userid="jobid=2339
6"  firstuserid="jobid=23396" (Media_Drive_Allocation_Record: allocationKey=2171
93 (Media_Drive_Record: MediaKey=4000056 MediaId=HO0023 MediaServer=asbackup.asi
c-hq.com DriveKey=2000009 DriveName=HP.ULTRIUM5-SCSI.000 PrimaryPath={4,0,1,0} P
oolName=Daily RobotNum=1 RobotType=8 MediaTypeName=NetBackup HCART2 DriveTypeNam
e=NetBackup HCART2 NdmpControlHost= RetentionLevel=0 PolicyType=2 JobType=10 Mas
terServer=asbackup.asic-hq.com) (Storage_Unit_Record: STU= STUType=0 MasterServe
r= MediaServer= RobotType=0 RobotNumber=0 Density=0 OnDemandOnly=0 ConcurrentJob
s=0 ActiveJobs=0 MaxMultiplexing=0 NdmpAttachHost= AbsolutePath=) (Bptm_Strings_
Record: 0="MEDIADB 1 217193 HO0023 4000056 ------ 14 1406744263 1406917809 14075
22609 1407336502 2131813218 32 32 0 8 0 552 1024 0 29425378 0" 1="VOLUME 1 HO002
3 4000056 HO0023 Daily FUJIFILM ENAVEEM7M7 14 8 1 19 0 {00000000-0000-0000-0000-
000000000000} 0" 2="DRIVE 3 HP.ULTRIUM5-SCSI.000 2000009 C38D390000 {4,0,1,0} -1
 -1 -1 -1 -1 -1 -1 -1 *NULL* *NULL* *NULL* *NULL* 1 16 0 1 0 0" 3="STORAGE 1 *NU
LL* 0 0 0 0 0 0 asbackup.asic-hq.com asbackup.asic-hq.com *NULL*" 4="DISKGROUP 0
 6 *NULL* 6 *NULL* 6 *NULL*" 5="DISKVOLUME 0 6 *NULL* 6 *NULL* 0" 6="DISKMOUNTPO
INT 0 6 *NULL*" ) TpReqFileName=))
         index=5 (Allocation: id={C6F32E27-876D-4740-B91D-651A9FA2D430} provider
=ReservationGroupProvider resourcename=HO0002 masterserver=asbackup.asic-hq.com
groupid={6775CE61-26BC-4079-804A-BAA5B55EEB1F} userSequence=0 userid="jobid=2339
6"  firstuserid="jobid=23396" (Media_Drive_Allocation_Record: allocationKey=2171
95 (Media_Drive_Record: MediaKey=4000023 MediaId=HO0002 MediaServer=asbackup.asi
c-hq.com DriveKey=0 DriveName= PrimaryPath= PoolName=Daily RobotNum=0 RobotType=
0 MediaTypeName=NetBackup HCART2 DriveTypeName= NdmpControlHost= RetentionLevel=
0 PolicyType=1 JobType=10 MasterServer=asbackup.asic-hq.com) (Storage_Unit_Recor
d: STU= STUType=0 MasterServer= MediaServer= RobotType=0 RobotNumber=0 Density=0
 OnDemandOnly=0 ConcurrentJobs=0 ActiveJobs=0 MaxMultiplexing=0 NdmpAttachHost=
AbsolutePath=) (Bptm_Strings_Record: 0="MEDIADB 1 217195 HO0002 4000023 ------ 1
4 1406914111 1407173505 1407778305 1407336755 2156184778 18 18 0 8 0 512 1024 0
33690450 0" 1="VOLUME 1 HO0002 4000023 HO0002 Daily FUJIFILM EP9LRG84KA 14 8 1 2
3 0 {00000000-0000-0000-0000-000000000000} 0" 2="DRIVE 3 *NULL* 0 *NULL* *NULL*
0 0 0 0 0 0 0 0 *NULL* *NULL* *NULL* *NULL* 0 16 0 1 0 0" 3="STORAGE 1 *NULL* 0
0 0 0 0 0 asbackup.asic-hq.com asbackup.asic-hq.com *NULL*" 4="DISKGROUP 0 6 *NU
LL* 6 *NULL* 6 *NULL*" 5="DISKVOLUME 0 6 *NULL* 6 *NULL* 0" 6="DISKMOUNTPOINT 0
6 *NULL*" ) TpReqFileName=)))

MDS allocations in EMM:

        MdsAllocation: allocationKey=217191 jobType=27 mediaKey=4000056 mediaId=
HO0023 driveKey=0 driveName= drivePath= stuName= masterServerName=asbackup.asic-
hq.com mediaServerName= ndmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=0
 fatPipeKey=0 scsiResType=0 serverStateFlags=0
        MdsAllocation: allocationKey=217192 jobType=27 mediaKey=4000023 mediaId=
HO0002 driveKey=0 driveName= drivePath= stuName= masterServerName=asbackup.asic-
hq.com mediaServerName= ndmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=0
 fatPipeKey=0 scsiResType=0 serverStateFlags=0
        MdsAllocation: allocationKey=217193 jobType=10 mediaKey=4000056 mediaId=
HO0023 driveKey=2000009 driveName=HP.ULTRIUM5-SCSI.000 drivePath={4,0,1,0} stuNa
me= masterServerName=asbackup.asic-hq.com mediaServerName=asbackup.asic-hq.com n
dmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=0 fatPipeKey=0 scsiResType
=1 serverStateFlags=1
        MdsAllocation: allocationKey=217194 jobType=9 mediaKey=4000066 mediaId=0
00008 driveKey=2000010 driveName=HP.ULTRIUM5-SCSI.001 drivePath={5,0,1,0} stuNam
e=asbackup-hcart2-robot-tld-1 masterServerName=asbackup.asic-hq.com mediaServerN
ame=asbackup.asic-hq.com ndmpTapeServerName= diskVolumeKey=0 mountKey=0 linkKey=
0 fatPipeKey=0 scsiResType=1 serverStateFlags=1
        MdsAllocation: allocationKey=217195 jobType=10 mediaKey=4000023 mediaId=
HO0002 driveKey=0 driveName= drivePath= stuName= masterServerName=asbackup.asic-
hq.com mediaServerName=asbackup.asic-hq.com ndmpTapeServerName= diskVolumeKey=0
mountKey=0 linkKey=0 fatPipeKey=0 scsiResType=0 serverStateFlags=0

vxlogview for nbrb -

C:\Program Files\Veritas\NetBackup\bin>vxlogview -p nb -i nbrb -S
8/6/2014 18:28:24.255 V-118-105 [ResBroker_i::doEvaluation] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=105; DefaultMsg=]
8/6/2014 18:28:24.255 V-118-226 [ResBroker_i::evaluateOne] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=226; DefaultMsg=]
8/6/2014 18:28:24.318 V-118-211 [EMMAccess::reallocate] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=211; DefaultMsg=]
8/6/2014 18:28:24.318 [EMMAccess::reallocate] reallocated: mediaId=HO0002, driveName=, allocationKey=217195
8/6/2014 18:28:24.349 [RbActionHandler::evaluate] PEND is set, MDS defined pend: (PendingRequest_Record: mediaId=HO0002 barcode=HO0002 density=14 accessMode=R
actionCode=1 ()  actionDriveName= actionMediaServerName=asbackup.asic-hq.com robotNum=-1 robotType=0 volumeGroupName=000_00001_TLD actionAcs=-1 actionLsm=-1 pen
dingRequestString=MDS_PEND_ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0 000_00001_TLD -1 -1 0)
8/6/2014 18:28:24.380 V-118-139 [ResBroker_i::evaluateOne] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=139; DefaultMsg=]
8/6/2014 18:28:24.380 [ResBroker_i::evaluateOne] request has pending allocations, requestId={0D708F2D-87D1-4F0F-8272-BB6646FABE3D}, userId=jobid=23396, errorSta
tus=(RBErrorInfo: errorStatus=2005035 retryClass="MDS Defined Pend" retryReason=1 retryText="MDS_PEND_ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0
 000_00001_TLD -1 -1 0" retryResource=asbackup.asic-hq.com)
8/6/2014 18:28:24.380 [ResBroker_i::holdOne] new error status (RBErrorInfo: errorStatus=2005035 retryClass="MDS Defined Pend" retryReason=1 retryText="MDS_PEND_
ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0 000_00001_TLD -1 -1 0" retryResource=asbackup.asic-hq.com)
8/6/2014 18:28:24.380 V-118-106 [ResBroker_i::doEvaluation] [V-1-3 Invalid arguments are passed. Locale=English_United States.1252; TextId=106; DefaultMsg=]
8/6/2014 18:28:24.380 [ResBroker_i::doEvaluation] <EVALPERF> Evaluated 1 requests, evalTime=124 msec, numSucceeded=0, numQueued=1, numPended=1, numFailed=0, num
MultipleCopyJobs=0, numMdsCacheMisses=0, restartedEvalCycle=0, numDriveReleasesBeforeEval=0, numDrivesAvailStart=1, numDrivesAvailEnd=1, requestQueueSize=0
 

Attaching the bptm

10 REPLIES 10

GulzarShaikhAUS
Level 6
Partner Accredited Certified

More info  - I tried nbrbutil -resetall. It does not work either.

Some more info -

C:\Program Files\Veritas\NetBackup\bin\admincmd>bpimagelist -backupid asnetapp03
_1406917805 -L

Client:            asnetapp03
Backup ID:         asnetapp03_1406917805
Policy:            FileServer_SLP
Policy Type:       NDMP (19)
Proxy Client:      (none specified)
Creator:           root
Name1:             (none specified)
Sched Label:       Daily_Full
Schedule Type:     FULL (0)
Retention Level:   1 week (0)
Backup Time:            8/1/2014 9:30:05 PM (1406917805)
Elapsed Time:      17043 second(s)
Expiration Time:        8/8/2014 9:30:05 PM (1407522605)
Compressed:        no
Client Encrypted:  no
Kilobytes:         560585356
Number of Files:   1071266
Number of Copies:  1
Number of Fragments:   9
Histogram:         0 0 0 0 0 0 0 0 0 0
DB Compressed:     no
Files File Name:   FileServer_SLP_1406917805_FULL.f
Previous Backup Files File Name:   (none specified)
Parent Backup Image File Name:   (none specified)
SW Version:        (none specified)
Options:           0x0
MPX:               1
TIR Info:          0
TIR Expiration:         1/1/1970 3:00:00 AM (0)
Keyword:           (none specified)
Ext Security Info: no
File Restore Raw:  no
Image Dump Level:  0
File System Only:  no
Object Descriptor: (none specified)
Previous BI Time:       1/1/1970 3:00:00 AM (0)
BI Full Time:           1/1/1970 3:00:00 AM (0)
Request Pid:       0
Backup Status:     0
Stream Number:     2
Backup Copy:       Standard (0)
Files File size:     152471140
PFI type:     0
IMAGE_ATTRIBUTE:     32
Primary Copy:      1
Image Type:        0  (Regular)
Job ID:            23173
Num Resumes:       16
Resume Expiration:      1/1/1970 3:00:00 AM (0)
Data Classification:    (none specified)
Data_Classification_ID: (none specified)
Storage Lifecycle Policy:    Daily_Full
Storage Lifecycle Policy Version:    3
STL_Completed:      3
Remote Expiration Time:      1/1/1970 3:00:00 AM (0)
Origin Master Server:  (none specified)
Origin Master GUID:    (none specified)
Snap Time:           1/1/1970 3:00:00 AM (0)
IR Enabled:      no
Client Character Set:     0
Image On Hold:     0
Indexing Status:   0
Copy number:       1
 Fragment:         TIR (-1)
 Kilobytes:        148898
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         11
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           24068454
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Key tag:          *NULL*
 STL tag:          *NULL*
 Copy on hold:     0
Copy number:       1
 Fragment:         1
 Kilobytes:        0
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         31
 ID:               HO0023
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           33278310
 Media Date:           7/30/2014 9:17:43 PM (1406744263)
 Dev Written On:   1
 Flags:            0x0
 Media Descriptor:        ?
 Expiration Time:       8/8/2014 9:30:05 PM (1407522605)
 MPX:              1
 retention_lvl:    1 week (0)
 Try to Keep Time:       8/8/2014 9:30:05 PM (1407522605)
 Copy Creation Time:       8/2/2014 2:14:08 AM (1406934848)
 Data Format:      NDMP
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         2
 Kilobytes:        0
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         32
 ID:               HO0023
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           33278855
 Media Date:           7/30/2014 9:17:43 PM (1406744263)
 Dev Written On:   1
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         3
 Kilobytes:        133058752
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         1
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           2
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         4
 Kilobytes:        92864
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         3
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           7337756
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         5
 Kilobytes:        11304576
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         4
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           7341897
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         6
 Kilobytes:        87268608
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         6
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           7947167
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         7
 Kilobytes:        18176576
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         8
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           13093994
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0
Copy number:       1
 Fragment:         8
 Kilobytes:        310535082
 Remainder:        0
 Media Type:       Media Manager (2)
 Density:          hcart2 (14)
 File Num:         10
 ID:               HO0002
 Host:             asbackup.asic-hq.com
 Block Size:       65536
 Offset:           13987501
 Media Date:            8/1/2014 8:28:31 PM (1406914111)
 Dev Written On:   2
 Flags:            0x0
 Media Descriptor:        ?
 checkpoint:       0
 resume num:       0
 Copy on hold:     0

C:\Program Files\Veritas\NetBackup\bin\admincmd>nbemmcmd -listmedia -mediaid  HO
0002
NBEMMCMD, Version: 7.5.0.7
====================================================================
Media GUID:                     4873178e-9293-4c62-b6f3-d8dd5108eded
Media ID:                       HO0002
Partner:                        -
Media Type:                     HCART2
Volume Group:                   000_00001_TLD
Application:                    Netbackup
Media Flags:                    1
Description:                    Added by Media Manager
Barcode:                        HO0002
Partner Barcode:                --------
Last Write Host:                asbackup.asic-hq.com
Created:                        03/25/2013 08:47
Time Assigned:                  08/01/2014 20:28
First Mount:                    03/31/2013 15:18
Last Mount:                     08/06/2014 18:56
Volume Expiration:              -
Data Expiration:                08/11/2014 20:31
Last Written:                   08/04/2014 20:31
Last Read:                      08/06/2014 18:56
Robot Type:                     TLD
Robot Control Host:             asbackup.asic-hq.com
Robot Number:                   1
Slot:                           23
Side/Face:                      -
Cleanings Remaining:            -
Number of Mounts:               260
Maximum Mounts Allowed:         0
Media Status:                   MPX
Kilobytes:                      2156184778
Images:                         18
Valid Images:                   18
Retention Period:               0
Number of Restores:             0
Optical Header Size Bytes:      1024
Optical Sector Size Bytes:      0
Optical Partition Size Bytes:   0
Last Header Offset:             33690448
Adamm Guid:                     00000000-0000-0000-0000-000000000000
Rsm Guid:                       00000000-0000-0000-0000-000000000000
Origin Host:                    NONE
Master Host:                    asbackup.asic-hq.com
Server Group:                   NO_SHARING_GROUP
Upgrade Conflicts Flag:
Pool Number:                    8
Volume Pool:                    Daily
Previous Pool Name:             Scratch_Pool
Vault Flags:                    -
Vault Container:                -
Vault Name:                     -
Vault Slot:                     -
Session ID:                     -
Date Vaulted:                   -
Return Date:                    -
Media on Hold:                  0
====================================================================
Command completed successfully.

C:\Program Files\Veritas\NetBackup\bin\admincmd>

RiaanBadenhorst
Level 6
Partner    VIP    Accredited Certified

From the dump it seems that 000008 is in the drive, and there are 2 allocations for HO0002 without any drives assigned. You said there are only 2 drives in your system. Is this not blocking the restore as it wants to mount both?

GulzarShaikhAUS
Level 6
Partner Accredited Certified

Thanks Riaan. I think it is as it is supposed to be but the strange thing is why there are two allocations for HO0002?

BTLOMS
Level 5

Suspend SLP, kill both allocations and activate SLP again. I have seen this in jobs with hung services.

GulzarShaikhAUS
Level 6
Partner Accredited Certified

I tried restore from the same image and it worked ... Now its clear that there is no issue with image or media ...

Can it be an issue with nbrb - We see this error

8/6/2014 18:28:24.349 [RbActionHandler::evaluate] PEND is set, MDS defined pend: (PendingRequest_Record: mediaId=HO0002 barcode=HO0002 density=14 accessMode=R
actionCode=1 ()  actionDriveName= actionMediaServerName=asbackup.asic-hq.com robotNum=-1 robotType=0 volumeGroupName=000_00001_TLD actionAcs=-1 actionLsm=-1 pen
dingRequestString=MDS_PEND_ACT 1 HO0002 HO0002 14 82 *NULL* asbackup.asic-hq.com -1 0 000_00001_TLD -1 -1 0)

RiaanBadenhorst
Level 6
Partner    VIP    Accredited Certified

I saw there were 2, don't know if that's normal. Never seen it before.

 

Maybe just kill those mds allocations. And try from scratch.

GulzarShaikhAUS
Level 6
Partner Accredited Certified

I tried several times. Even I tried with nbrbutil -resetall but the issue persisit.

Nicolai
Moderator
Moderator
Partner    VIP   

​Just a idea

Check density of the tape drive. HO0002 is HCART2, if the tape drives isn't HCART2 the restore request will queue as manual request with no tape drive allocation.

Update: Just re-read the thread. If images duplicate of HO0002 it not a density issue

Marianne
Level 6
Partner    VIP    Accredited Certified

Which pool is selected for the duplication?

If Daily pool is selected for duplication, it is possible that HO0002 is selected for source and destination.

Try to suspend HO0002 and see if that makes a difference for duplication job.
Or select a different pool to duplicate to.

GulzarShaikhAUS
Level 6
Partner Accredited Certified

The destination volume pool is different and finally I concluded that the issue is ONLY limitted to one image. I cancelled it from the duplication phase of SLP and now we dont see any errors....

It was very strange.... the density is same .. it can be used for the same purpose for another job by same policy ... :)