After upgrade from 9.0.4 to 10.0.3, FSA placeholders no longer retrieving

[SheltonS]

After upgrading from 9.0.4 to 10.0.3, users can no longer retrieve archived files using the placeholder.  After doing some troubleshooting, we found the following in a DTRACE on the file server:

9144 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:L {RequestArchivedFile::GetDefaultWebAppURL} (Entry)

9145 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:H GetDefaultWebAppURL() expireCache: 1 Url: http://wri-hou-fsvault.domain.com/EnterpriseVault/download.asp?VaultID=133C903ED276CD94C9CE5BADA6C08CF461110000archive.weingarten.com&SavesetId=201211082339062~200606202158140000~Z~103987813CBF161498C8DE24BCDA7101&Request=NativeItem&EVHeaders=1&HashName=SHA256

9146 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:L {RequestArchivedFile::CalculateDefaultWebAppURL} (Entry)

9147 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:M Attempting to calculate the placeholder base URL

9149 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:L CBaseDirectoryServiceWrapper::CreateDirectoryService() - Entry [m_nNumTries = 40]

9150 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:L CBaseDirectoryServiceWrapper::CreateDirectoryService() - Will try to connect to EV Directory Service on ARCHIVE.DOMAIN.COM

9151 17:16:28.403  [1620] (EvPlaceholderService) <1952> EV:L {VaultCoCreateInstanceEx} Attempt [1] to create COM object failed. CLSID [{F4D3EB5B-C7C5-11D1-90DB-0000F879BE6A}] Server Name [ARCHIVE.WEINGARTEN.COM] Elapsed [0.002s] Result [The parameter is incorrect.  (0x80070057)]

9152 17:16:28.606  [1620] (EvPlaceholderService) <1952> EV:L CHostNameHelper: IsLocalMachineExtendedCheck returned [False] for server [ARCHIVE.WEINGARTEN.COM].

9153 17:16:28.606  [1620] (EvPlaceholderService) <1952> EV:L {VaultCoCreateInstanceEx} Attempt [2] to create COM object failed. CLSID [{F4D3EB5B-C7C5-11D1-90DB-0000F879BE6A}] Server Name [172.16.15.121] Elapsed [0.002s] Result [The parameter is incorrect.  (0x80070057)]

9154 17:16:29.012  [1620] (EvPlaceholderService) <1952> EV:L {VaultCoCreateInstanceEx} Attempt [3] to create COM object failed. CLSID [{F4D3EB5B-C7C5-11D1-90DB-0000F879BE6A}] Server Name [172.16.15.121] Elapsed [0.002s] Result [The parameter is incorrect.  (0x80070057)]

9155 17:16:29.621  [1620] (EvPlaceholderService) <1952> EV:L {VaultCoCreateInstanceEx} Attempt [4] to create COM object failed. CLSID [{F4D3EB5B-C7C5-11D1-90DB-0000F879BE6A}] Server Name [172.16.15.121] Elapsed [0.002s] Result [The parameter is incorrect.  (0x80070057)]

9156 17:16:30.434  [1620] (EvPlaceholderService) <1952> EV:L {VaultCoCreateInstanceEx} Attempt [5] to create COM object failed. CLSID [{F4D3EB5B-C7C5-11D1-90DB-0000F879BE6A}] Server Name [172.16.15.121] Elapsed [0.002s] Result [The parameter is incorrect.  (0x80070057)]

9157 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:H {VaultCoCreateInstanceEx} CLSID [{F4D3EB5B-C7C5-11D1-90DB-0000F879BE6A}] Server Name [ARCHIVE.WEINGARTEN.COM] Used Server Name [172.16.15.121] Num of attempts [6] Total elapsed [3.028s] Result [The parameter is incorrect.  (0x80070057)]

9158 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:M CBaseDirectoryServiceWrapper::CreateDirectoryService() failed.|Hr: 0x80070057|Retries: 6|TryLocal: false|Directory Name: ARCHIVE.WEINGARTEN.COM|

9159 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:H {CBaseDirectoryServiceWrapper::GetInterface} HRXEX fn trace : Error [0x80070057], ref(1): [ARCHIVE.WEINGARTEN.COM], [.\DirectoryServiceWrapper.cpp, lines {630,657,681}, built Dec 11 16:18:57 2012].

9160 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:H {CBaseDirectoryServiceWrapper::Invoke} HRXEX fn trace : Error [0x80070057], [.\DirectoryServiceWrapper.cpp, lines {369,375}, built Dec 11 16:18:57 2012].

9161 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:H {CReadDirectoryServiceWrapper::Invoke} HRXEX fn trace : Error [0x80070057], [.\DirectoryServiceWrapper.cpp, lines {892,908}, built Dec 11 16:18:57 2012].

9163 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:M Failed to read default webApp url, error = 0x80070057 - The parameter is incorrect.

9164 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:H {RequestArchivedFile::CalculateDefaultWebAppURL} (Exit) Status: [The parameter is incorrect.  (0x80070057)]

9165 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV~E Event ID: 20542 Failed to read the site default WebApp Url. |

9166 17:16:31.434  [1620] (EvPlaceholderService) <1952> EV:L {RequestArchivedFile::GetDefaultWebAppURL} (Exit)

The bolded server name in line 2 is an old server from our 7.x environment that has been decommissioned for several years.  Not sure where this is coming from but I think it is the root of our issue.  I think it is using this to query for the WebApp URL.

These are the Event Log entries:

The Placeholder service on FS4 says it can’t get the WebApp URL and then the request fails with a malformed URL.  You can see the malformed URL in the second error where I bolded it.

1^st error

Log Name:      Symantec Enterprise Vault

Source:        Enterprise Vault

Date:          4/20/2013 3:12:06 PM

Event ID:      20542

Task Category: File Placeholder Service

Level:         Error

Keywords:      Classic

User:          N/A

Computer:      FILESERVER

Description:

Failed to read the site default WebApp Url.

For more information, see Help and Support Center at http://entced.symantec.com/entt?product=ev&language=english&version=10.0.3.0&build=10.0.3.1090&erro...

2^nd error

Log Name:      Symantec Enterprise Vault

Source:        Enterprise Vault

Date:          4/20/2013 3:12:06 PM

Event ID:      20491

Task Category: File Placeholder Service

Level:         Error

Keywords:      Classic

User:          N/A

Computer:      FILESERVER

Description:

Error downloading file: \\?\I:\Shared\Michelle\Leasing\monthly reports\2013\SSNOI\SSNOI YTD 3-13 Actuals.xls, Url: /download.asp?VaultID=1A5799B6499E0FB43BC8A5C2A5FCBF60B1110000archive.weingarten.com&SavesetId=201304125730348~201304101454140000~Z~1009DCC73CBF8C69219DEE48E5AA2731&Request=NativeItem&EVHeaders=1&HashName=SHA256

Error <0x80072ee6> 

The bolded server name in line 2 is an old server from our 7.x environment that has been decommissioned for several years.  Not sure where this is coming from but I think it is the root of our issue.  I think it is using this to query for the WebApp URL.

I have uninstalled / re-installed the FSA Agent several time to no change.

Anyone have any ideas?

[JesusWept3]

Not being funny but you did install the new placeholder service on your file servers right, not just upgraded the EV servers only? As a quick workaround you could add a hosts file entry for it to go the new server so retrievals will work at least but there could be other issues

[SheltonS]

Installed the Fsa agent, uninstalled it, installed again. I tried the spoofing idea using DNS but things didn't work correctly. Thanks for the suggestions.