I have a customer who implemented EV FSA from 2 filers and chose to create Placeholder shortcuts. Post which, they migrated the domains. The older domain has been decommissioned and the trust between old and new domain has also been taken off. Now, when customer tried to access the placeholder shortcuts from the filers he get 'Access Denied' error. However, the same file is accessible through Arcvhive Explorer. Customer also implemented FSA on few more filers post migration. The placholder shortcuts from those new filers are working fine. This is what I did to troubleshoot:
1. Verfied EV Services are running under correct account.
2. Stopped and restarted all EV services.
3. Verified the credentials on the Filer( for EV, EV is part of domain admins) and made sure they are synchronized to the Archives.
4. Even explicitly defined the login user and gave full control to the archives from EV Admin Console.
5. Checked Fpolicy. Its enabled.
6. Tried copying placeholder shortcut to the same FS. It errored out.
7. Did Sync of the permissions once again.
8. Reset the Vault Service Account.
8. Run dtrace on the retrieval task and other components. Here is the output:
DTrace trace log
[Opened: 2008/05/31 14:37:29]
Enabled Trace options
Id Name Detail Include Events
2 - AgentClientBroker Verbose Yes
33 - EvNetAppPHSvr Verbose Yes
72 - RetrievalTask Verbose Yes
74 - ShoppingService Verbose Yes
81 - StorageOnlineOpns Verbose Yes
82 - StorageRestore Verbose Yes
86 - w3wp Verbose Yes
-----
Display Filter:
Include strings:
EV-
EV:
EV~
Exclude strings:
CMMStream
DBFramework
DirectoryConnection
-----
Running in Terminal Services session...
Monitoring debug output from processes running in the console session
Monitoring debug output from processes running in the current Terminal Services session
1 14:37:29.310 [4724] (EvNetAppPHSvr) <7124> EV:M Filer: gefiler03.ind.ge.ad requested the Fpolicy server status - returning OK
3 14:37:56.530 [4724] (EvNetAppPHSvr) <7124> EV:L OpenFileWorkItem::OpenFileWorkItem (Entry) |
4 14:37:56.530 [4724] (EvNetAppPHSvr) <7196> EV:H Flatten::Flatten
5 14:37:56.530 [4724] (EvNetAppPHSvr) <7196> EV:M CFolderPermSyncWrapper SynchronizeEveryoneSID is 1
6 14:37:56.530 [4724] (EvNetAppPHSvr) <7196> EV:H CFolderPermSyncWrapper::SynchroniseFolder - Expand local groups:0
7 14:37:56.530 [4724] (EvNetAppPHSvr) <7124> EV:L OpenFileWorkItem::OpenFileWorkItem (Exit) |Success [0] |
8 14:37:56.530 [4724] (EvNetAppPHSvr) <7124> EV:L CQueue::EnQueue (Entry) |
9 14:37:56.530 [4724] (EvNetAppPHSvr) <7124> EV:M CQueue::EnQueue item enQueued
10 14:37:56.530 [4724] (EvNetAppPHSvr) <7124> EV:L CQueue::EnQueue (Exit) |Success [0] |
11 14:37:56.530 [4724] (EvNetAppPHSvr) <5076> EV:M CQueue::DeQueue item deQueued, currently 1 items on the queue
12 14:37:56.530 [4724] (EvNetAppPHSvr) <5076> EV:L CFileLock::Lock (Entry) |
13 14:37:56.530 [4724] (EvNetAppPHSvr) <5076> EV:M The exclusive FileLock was granted for the file: \\?\UNC\GEFILER04.IND.GE.AD\ONTAP_ADMIN$\VOL\GEFILER04_FLEX_NORMAL\1003_NORMAL\GCF AUSTRALIA\ACCOUNT COVER.DOC
14 14:37:56.530 [4724] (EvNetAppPHSvr) <5076> EV:L CFileLock::Lock (Exit) |Success [0] |
15 14:37:56.530 [4724] (EvNetAppPHSvr) <5076> EV:L OpenFileWorkItem::Process (Entry) |
16 14:37:56.577 [4724] (EvNetAppPHSvr) <5076> EV:M The file \\GEFILER04\1003_Normal\GCF Australia\Account Cover.doc is not having its data accessed, i.e. attributes are being manipulated or the file is being deleted. Not recalling.
17 14:37:56.639 [4724] (EvNetAppPHSvr) <5076> EV:L OpenFileWorkItem::Process (Exit) |Success [0] |
18 14:37:56.639 [4724] (EvNetAppPHSvr) <5076> EV:L CFileLock::~CFileLock (Entry) |
19 14:37:56.639 [4724] (EvNetAppPHSvr) <5076> EV:M The exclusive FileLock was released for the file: \\?\UNC\GEFILER04.IND.GE.AD\ONTAP_ADMIN$\VOL\GEFILER04_FLEX_NORMAL\1003_NORMAL\GCF AUSTRALIA\ACCOUNT COVER.DOC
20 14:37:56.639 [4724] (EvNetAppPHSvr) <5076> EV:L CFileLock::~CFileLock (Exit) |Success [0] |
21 14:37:56.639 [4724] (EvNetAppPHSvr) <5076> EV:M IsTimeToTrimCache
22 14:37:56.639 [4724] (EvNetAppPHSvr) <5076> EV:L CQueue::DeQueue (Entry) |
24 14:37:57.202 [4724] (EvNetAppPHSvr) <5232> EV:M Pinging Filer: gefiler03.ind.ge.ad to check its still alive
25 14:37:57.202 [4724] (EvNetAppPHSvr) <5232> EV:M Successful ping of connection to filer: gefiler03.ind.ge.ad. Resetting retry count
26 14:37:57.202 [4724] (EvNetAppPHSvr) <4752> EV:L CArchiveSvr::CheckWorkerThreads (Entry) |
77 14:37:57.202 [4724] (EvNetAppPHSvr) <4752> EV:L CArchiveSvr::CheckWorkerThreads (Exit) |Success [0] |
78 14:37:59.202 [4724] (EvNetAppPHSvr) <5236> EV:M Pinging Filer: gefiler04.ind.ge.ad to check its still alive
79 14:37:59.202 [4724] (EvNetAppPHSvr) <5236> EV:M Successful ping of connection to filer: gefiler04.ind.ge.ad. Resetting retry count
80 14:37:59.311 [4724] (EvNetAppPHSvr) <7124> EV:M Filer: gefiler03.ind.ge.ad requested the Fpolicy server status - returning OK
81 14:38:04.296 [4724] (EvNetAppPHSvr) <7124> EV:L OpenFileWorkItem::OpenFileWorkItem (Entry) |
82 14:38:04.296 [4724] (EvNetAppPHSvr) <7196> EV:H Flatten::Flatten
83 14:38:04.296 [4724] (EvNetAppPHSvr) <7196> EV:M CFolderPermSyncWrapper SynchronizeEveryoneSID is 1
84 14:38:04.296 [4724] (EvNetAppPHSvr) <7196> EV:H CFolderPermSyncWrapper::SynchroniseFolder - Expand local groups:0
85 14:38:04.296 [4724] (EvNetAppPHSvr) <7124> EV:L OpenFileWorkItem::OpenFileWorkItem (Exit) |Success [0] |
86 14:38:04.296 [4724] (EvNetAppPHSvr) <7124> EV:L CQueue::EnQueue (Entry) |
87 14:38:04.296 [4724] (EvNetAppPHSvr) <7124> EV:M CQueue::EnQueue item enQueued
88 14:38:04.296 [4724] (EvNetAppPHSvr) <7124> EV:L CQueue::EnQueue (Exit) |Success [0] |
89 14:38:04.296 [4724] (EvNetAppPHSvr) <5080> EV:M CQueue::DeQueue item deQueued, currently 1 items on the queue
90 14:38:04.296 [4724] (EvNetAppPHSvr) <5080> EV:L CFileLock::Lock (Entry) |
91 14:38:04.296 [4724] (EvNetAppPHSvr) <5080> EV:M The exclusive FileLock was granted for the file: \\?\UNC\GEFILER04.IND.GE.AD\ONTAP_ADMIN$\VOL\GEFILER04_FLEX_NORMAL\1003_NORMAL\GCF AUSTRALIA\ACCOUNT COVER.DOC
92 14:38:04.296 [4724] (EvNetAppPHSvr) <5080> EV:L CFileLock::Lock (Exit) |Success [0] |
93 14:38:04.296 [4724] (EvNetAppPHSvr) <5080> EV:L OpenFileWorkItem::Process (Entry) |
94 14:38:04.312 [4724] (EvNetAppPHSvr) <5080> EV:M The file \\GEFILER04\1003_Normal\GCF Australia\Account Cover.doc is an Enterprise Vault placeholder and will recalled
95 14:38:04.312 [4724] (EvNetAppPHSvr) <5080> EV:L WorkItem::ExtractplaceholderData (Entry) |
96 14:38:04.327 [4724] (EvNetAppPHSvr) <5080> EV:L WorkItem::ExtractplaceholderData (Exit) |Success [0] |
97 14:38:04.327 [4724] (EvNetAppPHSvr) <5080> EV:L OpenFileWorkItem::DownloadFile (Entry) |
98 14:38:04.327 [4724] (EvNetAppPHSvr) <7168> EV:L CDownloadFile::UpdateIntranetZoneSites (Entry) |
99 14:38:04.327 [4724] (EvNetAppPHSvr) <7168> EV:H |[CDownloadFile] Inside UpdateIntranetZoneSites
100 14:38:04.343 [4724] (EvNetAppPHSvr) <7168> EV:L CDownloadFile::UpdateIntranetZoneSites (Exit) |Success [0] |
101 14:38:04.343 [4724] (EvNetAppPHSvr) <7168> EV:L WinHttpConnect handle = 0x54f9000 for URL=http://ggn3ev01/EnterpriseVault/download.asp?VaultID=11F6FC8CDCBF99047A863EF63739961C91110000EVSITE01&SavesetId=309140000000000~200305021150100000~0~484A1889C74D4FC19C33C146C85F9A5&Request=NativeItem&EVHeaders=1
102 14:38:04.343 [4724] (EvNetAppPHSvr) <7168> EV:H ConnectForSegment:/EnterpriseVault/download.asp?VaultID=11F6FC8CDCBF99047A863EF63739961C91110000EVSITE01&SavesetId=309140000000000~200305021150100000~0~484A1889C74D4FC19C33C146C85F9A5&Request=NativeItem&EVHeaders=1&Segment=0
103 14:38:04.437 [4724] (EvNetAppPHSvr) <7168> EV:H BC 1
104 14:38:04.437 [4724] (EvNetAppPHSvr) <7168> EV:H dwcode 401
105 14:38:04.437 [4724] (EvNetAppPHSvr) <7168> EV:H BT 1
Any help would be appreciated? Also, I am not a Net App expert, so just want to know if there is any trace of the older domain in the fpolicy on the filer which might be preventing the access to archives through placeholder shortucts? How can we see the content of the fpolicy?