FDI Error = Cabinet not found

[Amr_Hussein_-_O]

Hello...

we have 2 evault servers with  v8 sp5   with Building blocks implemented.

we have configured  the migration of partitions to move CAB files older than 5 yeas to a 2nd storage ...

we a user tries to access one of archived item which is older than 5 years , we got the following message :

"the item is no longer in vault"

we have tied to rebuild / repiar the user index the we have find that indexmissing.log includes 24950 item.

event viewer :

Failed to recall a Saveset from its Collection.

Reason: The system cannot find the file specified.  [0x80070002]
Relative Saveset Filename: 2003\04\30\07\626000000000000~200304300722520000~0.DVS
Relative Collection Filename: 2003\04\30\Collection505.cab
PartitionEntryID: 17C1F876321094195AF50E2969979E0C81q10000vault.r.xxxx.corp
PartitionGUID: 7C1F876321094195AF50E2969979E0C8
Partition Root Path: \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1
Secondary Location: \\t0-evfiler-p01\p1ev5yptn1\ArchData
Migrated File Id: 

Retrieval of saveset failed.
Archive Id: 1C0194934CD335C41B0C161E5F429352F1110000vault.r.xxxx.corp
Transaction Id: FBF78D446390401880848526C3E3DBE
Extended information: The system cannot find the file specified.  [0x80070002]

then we have tried to run dtrace :

16    12:46:44.443     [4128]    (StorageCrawler)    <10756>    EV:M    SQLSvrDBBroker::BuildSQL : SELECT ArchivePointId,ArchivePointIdentity,ArchivedItems,ArchivedItemsSize,CreatedDate,HighestIndexSeqNo,IndexAddsPending,IndexDeletesPending,ModifiedDate FROM ArchivePoint WHERE ArchivePointId = '1C0194934CD335C41B0C161E5F429352F1110000vault.r.xxxx.corp'
17    12:46:44.443     [4128]    (StorageCrawler)    <10756>    EV:H    Deprecated CADODataAccess::GetField [ArchivePointId].
24    12:46:44.443     [4128]    (StorageCrawler)    <10756>    EV:M    SQLSvrDBBroker::BuildSQL : SELECT ArchivePointIdentity,ArchivedItems,ArchivedItemsSize,CreatedDate,MeanRecallTime,ModifiedDate,Recalls,Restores,VaultID,VaultIdentity FROM Vault WHERE VaultID = '1C0194934CD335C41B0C161E5F429352F1110000vault.r.xxxx.corp'
25    12:46:44.443     [4128]    (StorageCrawler)    <10756>    EV:H    Deprecated CADODataAccess::GetField [VaultID].
26    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:M    CArchiveRevisions::IdentifyNextItem Start scan. ArchiveId:1C0194934CD335C41B0C161E5F429352F1110000vault.r.xxxx.corp (GRATEAU, Viviane) NextISN:7762 MaxISN:7762 (hr=Success  [0])
27    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:L    CVaultStoreDB::IndexAdditionsCrawlerItemsNext - TransactionID = [{05EB7ED0-94C9-4BE7-B365-337ED6573010}] CollectionId = [340] VaultID = [1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp] SavesetIdentity = [315410] SisPartCount = [0]
28    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:M    CArchiveRevisions::IdentifyNextItem ArchiveId:1C0194934CD335C41B0C161E5F429352F1110000vault.r.xxxx.corp (GRATEAU, Viviane) NextISN:7762 MaxISN:7762|Descriptor:1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1 SSID:373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301 ItemISN:7762 (hr=Success  [0])
29    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:L    CItemFetcher::RequestItem New fetch request NextISN:7762 ItemISN:7762 SSID:373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301 (hr=Success  [0])
30    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:M    CItemFetcher::RequestItem (BTID:5024) NextISN:7762 MaxISN:7762 Format:3 MaxMarshallSize:10240 (KB) IIRebuildMode:1 (hr=Success  [0])
31    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CItemFetcher::FindFirstPendingRequest [0] Request Info: [7762, IndexMetadata, 10240 (KB), 4426908, 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1, 7762, The data necessary to complete this operation is not yet available.  [0x8000000a]]
32    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CItemFetcher::ProcessRequests (PTID:10756) Processing...|Request Info: [7762, IndexMetadata, 10240 (KB), 4426908, 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1, 7762, The data necessary to complete this operation is not yet available.  [0x8000000a]]
33    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:L    CItemFetcher::WaitForItem Request Info: [7762, IndexMetadata, 10240 (KB), 4426908, 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1, 7762, The data necessary to complete this operation is not yet available.  [0x8000000a]]
34    12:46:44.584     [4128]    (StorageCrawler)    <10756>    EV:L    CItemFetcher::WaitForItem waiting NextISN:7762 Wait:5 (secs)
35    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CStore::IsOpenVault (Entry) |
36    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CStore::IsOpenVault|Requested: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp Current: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp Open: TRUE
37    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CStore::IsOpenVault (Exit) |
38    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CVault::RetrieveSaveset (Entry) |
39    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:H    CVault::RetrieveSaveset|Selector: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1
40    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CVault::RetrieveItem (Entry) |
41    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CVault::GetItemProperties (Entry) |
42    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:H    CVault::GetItemProperties|Selector: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1
43    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:L    CVault::ReadPartitionEntry (Entry) |
44    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::ReadPartitionEntry|Id: 0
45    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CVaultStorePartitionCache::ReadEntry Id:179B178D65CA7D445BDE2E576C1FE1AF51210000vault.r.xxxx.corp hr:0
46    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::ReadPartitionEntry|Partition Id:0VaultStore:179B178D65CA7D445BDE2E576C1FE1AF51210000vault.r.xxxx.corp HR=Success  [0]
47    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::ReadPartitionEntry (Exit) |Success  [0] |
48    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CSSASCache::ReadEntry Id:1DE146555CE13864599C7F0A58D2C363C1e10000vault.r.xxxx.corp hr:0
50    12:46:44.584     [4128]    (StorageCrawler)    <5024>    EV:M    CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]
51    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:L    CBaseDirectoryServiceWrapper::CreateDirectoryService() - Successfully communicated with an EV Directory Service on the local machine
52    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CRetentionCategoryIdentityCache::LoadEntry EntryId:0 SiteId:19C224A6CC06F774FA7472A2B86675AE21d10000vault.r.xxxx.corp hr:c0041a64
53    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CRetentionCategoryIdentityCache::ReadEntry Id:0 SiteId:19C224A6CC06F774FA7472A2B86675AE21d10000vault.r.xxxx.corp hr:c0041a64
54    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::GetItemProperties|RC Lookup failure:19C224A6CC06F774FA7472A2B86675AE21d10000vault.r.xxxx.corp/0Error reading Retention Category entry from Vault Directory  %1      [0xc0041a64]
55    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::GetItemProperties|Sel:1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1 Seq No:7762 Partition ID:0 Store Id:2002\09\18\Collection340.CAB CollectionId:TRUE
56    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::GetItemProperties (Exit) |Success  [0] |
57    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSaveset2::get_Saveset (Entry)
58    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSaveset2::get_Saveset (Exit). hr=Success  [0]
59    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:L    CVault::GetSaveset (Entry) |
60    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Getting saveset containing all content conversion
61    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSisPartConstructorBase::Build (Entry)
62    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Building item: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1
63    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSisPartConstructorBase::InitializeSisPartConstructor (Entry)
64    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSisPartConstructorBase::InitializeSisPartConstructor (Exit). hr=Success  [0]
65    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSisPartConstructorBase::LoadSaveset (Entry)
66    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Loading the DVS file
67    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CStorageSavesetReader<class CVaultStoreEMCCentera>::AccessSaveset (Entry)
68    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Locating item Id: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1
69    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSavesetLocator::LocateSaveset (Entry)
70    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Locating Item: 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp+373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301+0+2002\\09\\18\\Collection340.CAB+340+0+38201.71939232639100000+18+7762++19214+116+315410+1
71    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Valid saveset descriptor, using this to locate saveset
72    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSavesetLocator::LocateFromSavesetDescriptor (Entry)
73    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CVaultStorePartitionCache::ReadEntry Id:179B178D65CA7D445BDE2E576C1FE1AF51210000vault.r.xxxx.corp hr:0
74    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Saveset Location:
75    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    archivedDate = 38201.719392
76    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    collectionIdentity = 340
77    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    dirStructVersion = 0
78    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    foundLocation = 1
79    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    migratedFileId =
80    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    partitionId = 0
81    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    savesetId = 373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301
82    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    storeIdentifier = 2002\09\18\Collection340.CAB
83    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    transactionId = 05EB7ED094C94BE7B365337ED6573010
84    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    vaultEntryId = 1A39CE12049DEB84082FBAA34ADA04FEC1110000vault.r.xxxx.corp
85    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    vaultStoreidentity = 2
86    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:L    CSavesetLocator::LocateFromSavesetDescriptor Information : Total [0] sis parts present in saveset descriptor string passed in.
87    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSavesetLocator::LocateFromSavesetDescriptor (Exit). hr=Success  [0]
88    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSavesetLocator::LocateSaveset (Exit). hr=Success  [0]
89    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CStorageSavesetReader<class CVaultStoreEMCCentera>::AccessSaveset (Exit). hr=Success  [0]
90    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CStorageSavesetReader<class CVaultStoreEMCCentera>::GetDVSFile (Entry)
91    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSavesetLocator::GetSavesetLocation (Entry)
92    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CSavesetLocator::GetSavesetLocation (Exit). hr=Success  [0]
93    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Reading DVS file
94    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CStorageReader<class CVaultStoreEMCCentera>::CreateStorageDeviceReader (Entry)
95    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    Sis part on vaultstoreIdentity 2, partition Id 0
96    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CVaultStorePartitionCache::ReadEntry Id:179B178D65CA7D445BDE2E576C1FE1AF51210000vault.r.xxxx.corp hr:0
97    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    creating NTFS reader, partition root path \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1
98    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CStorageReader<class CVaultStoreEMCCentera>::CreateStorageDeviceReader (Exit). hr=Success  [0]
99    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetDVSSaveset (Entry)
100    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetSavesetFileStream (Entry)
101    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetSavesetFileStream: Getting .DVS file
102    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetFileStream (Entry)
103    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageHelper::GetFileLocation (Entry)
104    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageHelper::GetFileLocation (Exit). hr=Success  [0]
105    12:46:44.600     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::LoadCollectedFile (Entry)
106    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    EVCollectorPublic : xmlFiles = <files><f>2002\09\18\15\373000000000000~200209181537320000~0.DVS</f></files>|
107    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    EVCabinet (ExtractFromCab) : Failed to extract files <files><f>2002\09\18\15\373000000000000~200209181537320000~0.DVS</f></files>| from Collection file \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1\2002\09\18\Collection340.cab. Extract Operation = 0, HRESULT = 80070002, FDI Error =
108    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    EVCabinet (ExtractFromCab) : Failed to extract files <files><f>2002\09\18\15\373000000000000~200209181537320000~0.DVS</f></files>| from Collection file \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1\2002\09\18\Collection340.ARCHCAB. Extract Operation = 0, HRESULT = 80070002, FDI Error =
109    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : Entered : PartitionEntryId = 17C1F876321094195AF50E2969979E0C81q10000vault.r.xxxx.corp
110    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : Creating MigratorCallback object
111    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : Initializing MigratorCallback object
112    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : IStorageSystemCallbackPrimer.QueryInterface for IMigratorCallback
113    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : Obtaining Migrator ProgId for Partition 17C1F876321094195AF50E2969979E0C81q10000vault.r.xxxx.corp
114    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : PartitionEntryId = 17C1F876321094195AF50E2969979E0C81q10000vault.r.xxxx.corp, Migrator ProgId = EnterpriseVault.Migrator
115    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::AccessMigrator : Creating Migrator object with ProgId EnterpriseVault.Migrator
116    12:46:44.631     [4128]    (StorageCrawler)    <5024>    EV:M    CMigratorHelper::ExtractFromCab : PartitionEntryId = 17C1F876321094195AF50E2969979E0C81q10000vault.r.xxxx.corp, Migrator ProgId = EnterpriseVault.Migrator, SecondaryLocation = \\t0-evfiler-p01\p1ev5yptn1\ArchData
117    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CCabFileMutex::wait[LOCK] :  Attempting to take a lock on file \\t0-evfiler-p01\p1ev5yptn1\ArchData\7C1F876321094195AF50E2969979E0C8\2002\09\18\Collection340.cab.lock
118    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CCabFileMutex::wait :  handle: 1040
119    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CCabFileMutex::wait[LOCK] :  Lock taken on file \\t0-evfiler-p01\p1ev5yptn1\ArchData\7C1F876321094195AF50E2969979E0C8\2002\09\18\Collection340.cab.lock, slept for 0 ms
120    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    EVCabinet (ExtractFromCab) : Setting last-access time for Collection file \\t0-evfiler-p01\p1ev5yptn1\ArchData\7C1F876321094195AF50E2969979E0C8\2002\09\18\Collection340.cab. HRESULT = 0
121    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    EVCabinet (FDI.cpp) : FDIERROR_CABINET_NOT_FOUND
122    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CCabFileMutex::wait[LOCK] :  Cleaning up lock file \\t0-evfiler-p01\p1ev5yptn1\ArchData\7C1F876321094195AF50E2969979E0C8\2002\09\18\Collection340.cab.lock
123    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CCabFileMutex::wait[LOCK] :  Lock released on file \\t0-evfiler-p01\p1ev5yptn1\ArchData\7C1F876321094195AF50E2969979E0C8\2002\09\18\Collection340.cab.lock
124    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    EVCabinet (ExtractFromCab) : Failed to extract files <files><f>2002\09\18\15\373000000000000~200209181537320000~0.DVS</f></files>| from Collection file \\t0-evfiler-p01\p1ev5yptn1\ArchData\7C1F876321094195AF50E2969979E0C8\2002\09\18\Collection340.cab. Extract Operation = 0, HRESULT = 80070002, FDI Error = Cabinet not found
125    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    SSID: 373000000000000~200209181537320000~0~05EB7ED094C94BE7B365337ED657301, Recalled file: \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1\2002\09\18\Collection340.cab
126    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CNTFSStorageDeviceReader::LoadCollectedFile _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
127    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV~E    Event ID: 6838 Failed to recall a Saveset from its Collection. |Reason: The system cannot find the file specified.  [0x80070002] |Relative Saveset Filename: 2002\09\18\15\373000000000000~200209181537320000~0.DVS |Relative Collection Filename: 2002\09\18\Collection340.cab |PartitionEntryID: 17C1F876321094195AF50E2969979E0C81q10000vault.r.xxxx.corp |PartitionGUID: 7C1F876321094195AF50E2969979E0C8 |Partition Root Path: \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1 |Secondary Location: \\t0-evfiler-p01\p1ev5yptn1\ArchData |Migrated File Id:  |Reference: NSDR/LMF |
128    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::LoadCollectedFile (Exit). hr=The system cannot find the file specified.  [0x80070002]
129    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CNTFSStorageDeviceReader::GetFileStream _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
130    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetFileStream (Exit). hr=The system cannot find the file specified.  [0x80070002]
131    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CNTFSStorageDeviceReader::GetSavesetFileStream _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
132    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetSavesetFileStream (Exit). hr=The system cannot find the file specified.  [0x80070002]
133    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CNTFSStorageDeviceReader::GetDVSSaveset _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
134    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CNTFSStorageDeviceReader::GetDVSSaveset (Exit). hr=The system cannot find the file specified.  [0x80070002]
135    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CStorageSavesetReader<class CVaultStoreEMCCentera>::GetDVSFile _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
136    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CStorageSavesetReader<class CVaultStoreEMCCentera>::GetDVSFile (Exit). hr=The system cannot find the file specified.  [0x80070002]
137    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CSisPartConstructorBase::LoadSaveset _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
138    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CSisPartConstructorBase::LoadSaveset (Exit). hr=The system cannot find the file specified.  [0x80070002]
139    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CSisPartConstructorBase::Build _com_error exception. hr=The system cannot find the file specified.  [0x80070002]
140    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CSisPartConstructorBase::Build (Exit). hr=The system cannot find the file specified.  [0x80070002]
141    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:M    CVault::GetSaveset (Exit) |The system cannot find the file specified.  [0x80070002] |
142    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:L    CVault::GetItemProperties (Entry) |
143    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CVault::GetItemProperties|Selector: 05EB7ED094C94BE7B365337ED657301
144    12:46:44.646     [4128]    (StorageCrawler)    <5024>    EV:H    CSavesetIdentifier::ExtractTransactionId Invalid saveset identifier:

thank you for looking into this

[Amr_Hussein_-_O]

i need to add the following note :

all locations mentioned above in dtrace can be accessed on disk and CABs can be found..

don't know exatcly why EV can't access them

[JesusWept3]

So if you combine the exact secondary location and the root path and paste it in to a start -> run, the cab opens?? You may want to try a procmon filtered on that cab file name and see exactly where EV is trying to open it and what errors windows gives

[Amr_Hussein_-_O]

Please fine the answer below

So if you combine the exact secondary location and the root path and paste it in to a start -> run, the cab opens??

NO.. 

 i have tired to open the cab path :

CAB path is ok  but when i try to open it nothoing happend .. no erorr message nothing at alll as sams i did nothing...

[CFreeX]

Saveset mentioned on Event log and dtrace doesn't match, but can you manually extract 2002\09\18\15\373000000000000~200209181537320000~0.DVS from \\47.25.2.130\pevvsg1vs1ptn1\VS1EV03PTN1\2002\09\18\Collection340.cab?

[JesusWept3]

Errrr So ok let me understand this Secondary location is a NetApp filer correct? Do you use OnTap? And when you access the location in windows explorer it opens But the path specified does NOT exist Are there any folders beneath there or is it completely empty??

[CFreeX]

Oops, didn't see the previous comment. If you cannot open/extract the DVS from the CAB then you have a problem with the file itself.

[Amr_Hussein_-_O]

Secondary location is a NetApp filer correct?

Both praimary & secondary are Netapp filers

Do you use OnTap?

we are using CIFS shares

i can open the path  of the 2nd filer from windows explorer and the cab file exists...

if i open the cab by double click : nothing happens

when i try to copy the cab or local drive i get access diened .. seeems like all cabs or locked..

hope this helps

[JesusWept3]

Can you try turning off opportunistic locking on the EV server and the NetApp? To disable it on windows: http://support.microsoft.com/?id=296264 To disable it on the NetApp: http://hd.kvsconsulting.us/netappdoc/801docs/html/ontap/filesag/GUID-1F0F0CCB-9292-4A7E-8A3E-148C1889F663.html Also is antivirus excluded from scanning that location on the EV server? Ready though it sounds like you may want to consult your NetApp admins to help with this one as its not strictly an EV issue and is a file system issue You may also want to look at if any other applications have the file locked or in use etc

[Amr_Hussein_-_O]

opportunistic locking is already disabled from server & filer side..

AV exluded these locations

any idea??

[Amr_Hussein_-_O]

the only thing i can do is to rename files which will allow me to copy them to local drive on evault server then open them successfully..

seems all *.cab are locked ..."only if i try thmee from the 2nd filer"

as i mentioned if i rename .cab to .cabx i can copy them then open them but i can't rename it back...

something i don't understand

hope this will help

[JesusWept3]

What if you open the cab file from a different machine? Maybe it's a windows config issue??

[Amr_Hussein_-_O]

it's the same issue... from another server i can't open / copy directly the cab from the 2nd filer path.

i even have tried with 7zip.  then i got :  access is denied..

but once i rename the cab to cabx and copy loclally it can be opened successfully

[JesusWept3 · Accepted solution]

Ok so either the files are locked or you have a gpo causing issues

[Amr_Hussein_-_O]

could you suggest something .. to check if the cab files are locked or it's a gpo issue..

thank you

[Amr_Hussein_-_O]

the issue has been fixed after turnning of the AV scan option of the netapp filer

[JesusWept3]

Good job man, had me totally stumped :)