Backup Exec Server service hung on starting

[raymunda]

I am unable to restart the backup server service. Event ID is 7022 service hung on starting.

Server is a Windows 2003 R2 with Exchange Server 2007 installed.

I have attached the beserver -console output.

[10088] 12/04/15 10:30:30 Starting agent in console mode -- use 'Q' to stop
[10088] 12/04/15 10:30:30 Service status: Starting, error = 0, checkpoint = 1, wait hint = 10000
[10088] 12/04/15 10:30:30 Service status: Starting, error = 0, checkpoint = 2, wait hint = 10000
[10088] 12/04/15 10:30:30 Error accessing regkey: Software\Symantec\Backup Exec For Windows\Open File Option\ConfigOrphaned snaped can't be cleaned up. Maybe a privilage issue
[10088] 12/04/15 10:30:30 CleanupOrphanedSnapshots(). Lauching cleanup thread..
[10088] 12/04/15 10:30:30 CleanupOrphanedSnapshots(). Cleanup thread lauched. Exiting.
[7616] 12/04/15 10:30:30 VssSnapshotVolume::CleanupOrphanedSnapshots(). No orphaned snaphots found
[7840] 12/04/15 10:30:30 FS_InitFileSys
[7840] 12/04/15 10:30:30   loaded bedsnt5.dll
[7840] 12/04/15 10:30:30   loaded bedsadc.dll
[7840] 12/04/15 10:30:30   loaded bedssql2.dll
[7840] 12/04/15 10:30:30   bedsxchg.dll could not be loaded: The specified module could not be found.
[7840] 12/04/15 10:30:30 VirtApi DLL WAS LOADED FROM VirtApi.dll.
[7840] 12/04/15 10:30:30 VirtApi DLL load check succeeded.
[7840] 12/04/15 10:30:30 Virtual DB's WILL BE USED!
[7840] 12/04/15 10:30:30   loaded bedsxese.dll
[7840] 12/04/15 10:30:30   loaded bedsmbox.dll
[7840] 12/04/15 10:30:30   bedspush.dll could not be loaded: The specified module could not be found.
[7840] 12/04/15 10:30:30   loaded bedsnote.dll
[7840] 12/04/15 10:30:30   loaded bedsmdoc.dll
[7840] 12/04/15 10:30:30   loaded bedssps2.dll
[7840] 12/04/15 10:30:30   loaded bedssps3.dll
[7840] 12/04/15 10:30:30   loaded bedsupfs.dll
[7840] 12/04/15 10:30:30   loaded bedsshadow.dll
[7840] 12/04/15 10:30:30   loaded bedsoffhost.dll
[7840] 12/04/15 10:30:30   bedsdpm.dll could not be loaded: The specified module could not be found.
[7840] 12/04/15 10:30:30   loaded bedscps.dll
[7840] 12/04/15 10:30:30   bedsvx.dll could not be loaded: The specified module could not be found.
[7840] 12/04/15 10:30:30   bedsorcl.dll could not be loaded: The specified module could not be found.
[7840] 12/04/15 10:30:30   loaded bedssmsp.dll
[7840] 12/04/15 10:30:30   loaded bedsra.dll
[7840] 12/04/15 10:30:30   loaded bedsrman.dll
[7840] 12/04/15 10:30:30   loaded bedsdb2.dll
[7840] 12/04/15 10:30:30   loaded bedsss.dll
[7840] 12/04/15 10:30:30 VirtApi DLL WAS LOADED FROM VirtApi.dll.
[7840] 12/04/15 10:30:30 VirtApi DLL load check succeeded.
[7840] 12/04/15 10:30:30 Virtual DB's WILL BE USED!
[7840] 12/04/15 10:30:30   loaded bedsadgran.dll
[7840] 12/04/15 10:30:30   loaded bedsev.dll
[7840] 12/04/15 10:30:30 Initializing FSs
[7840] 12/04/15 10:30:30 calling mapi initialize
[7840] 12/04/15 10:30:30 MapiInitialize returned 80004005
[7840] 12/04/15 10:30:30 Mailbox: InitializeDAPI failed.
[7840] 12/04/15 10:30:30 Notes Agent:CLNPartitions::InitializeLNUCJWrapper
[7840] 12/04/15 10:30:30 Notes Agent:CLNPartitions::InitializeLNUCJWrapper - Exiting[0]
[7840] 12/04/15 10:30:30 Notes Agent:CLNPartitions::InitializeAllVolumes
[7840] 12/04/15 10:30:30 Notes Agent - CLNVolume::InitInstance - ReturnValue[0]
[7840] 12/04/15 10:30:30 Notes Agent - CLNVolume::InitInstance - ReturnValue[0]
[7840] 12/04/15 10:30:30 Notes Agent - CLNVolume::InitInstance - ReturnValue[0]
[7840] 12/04/15 10:30:30 Notes Agent - CLNVolume::InitInstance - ReturnValue[0]
[7840] 12/04/15 10:30:30 Notes Agent - CLNVolume::InitInstance - ReturnValue[0]
[7840] 12/04/15 10:30:30 Notes Agent - CLNVolume::InitInstance - ReturnValue[0]
[7840] 12/04/15 10:30:30 Notes Agent:CLNPartitions::InitializeAllVolumes - Exiting[0]
[7840] 12/04/15 10:30:30 Notes Agent:CLNPartitions::InitInstance - Exiting[2]
[7840] 12/04/15 10:30:30 Function called: RMAN_InitFileSys
[7840] 12/04/15 10:30:30 IsIDRInProgressPriv: 0x0
[7840] 12/04/15 10:30:30 IsIDRInProgressPriv: 0x0
[7840] 12/04/15 10:30:30 Informational: Initializing the BeDiskFind library 'BEDiskFind.dll' in SHADOW::InitBeDiskFindHelperApis
[7840] 12/04/15 10:30:30 Informational: BeDiskFind library 'BEDiskFind.dll' initialized in SHADOW::InitBeDiskFindHelperApis
[6280] 12/04/15 10:30:30 Event: Global\RxService CREATED
[7840] 12/04/15 10:30:30 Informational: Initializing the BeDisk library 'BeDisk.dll' in SHADOW::InitBeDiskHelperApis
[7840] 12/04/15 10:30:30 Informational: BeDisk library 'BeDisk.dll' initialized in SHADOW::InitBeDiskHelperApis
[7840] 12/04/15 10:30:30 first load attempt of esebcli2.dll failed: The specified module could not be found.
[7840] 12/04/15 10:30:30 esebcli2.dll found in BackupRestore dll directory
[7840] 12/04/15 10:30:30 ESE_InitPlatinum loaded esebcli2.dll from E:\Program Files\Microsoft\Exchange Server\bin\esebcli2.dll.
[7840] 12/04/15 10:30:30 Status Unknown (0x00000002) opening Cps registry key 'Software\Symantec\Backup Exec CPS' in CPS::InitCpsHelperApis:379
[7840] 12/04/15 10:30:30 Informational: Initializing the Cps library 'C:\Program Files\Symantec\Continuous Protection Server\Services\CPSVersion.dll' in CPS::InitCpsHelperApis:410
[7840] 12/04/15 10:30:30 Status Unknown (0x0000007E) loading Cps library 'C:\Program Files\Symantec\Continuous Protection Server\Services\CPSVersion.dll' in CPS::InitCpsHelperApis:417
[7840] 12/04/15 10:30:30 Status Unknown (0x0000007E) initializing Cps library in CPS::InitFsys:93
[7840] 12/04/15 10:30:30 Function called: DB2_InitFileSys
[7840] 12/04/15 10:30:30 ADC_InitFileSys entered
[7840] 12/04/15 10:30:30 ADC_InitFileSys: established top domain <GC://DC=regard,DC=local>
[7840] 12/04/15 10:30:30 evFileSystem::EV_InitFileSys entered
[7840] 12/04/15 10:30:30 evFileSystem::isMSXMLInstalled: Registry Key for MSXML6 found.
[7840] 12/04/15 10:30:30 evFileSystem::isMSXMLInstalled: MSXML 6.0 is installed.
[7840] 12/04/15 10:30:30 evFileSystem::EV_InitFileSys - Initialised COM in Multithreaded model
[7840] 12/04/15 10:30:30 CXMLHandler::Initialize called
[7840] 12/04/15 10:30:30 CXMLHandler::Initialize calling CheckPresenceOfXSLFiles()
[7840] 12/04/15 10:30:30 CXMLHandler::CheckPresenceOfXSLFiles: The BE Install path obtained is (E:\Program Files\Symantec\Backup Exec)
[7840] 12/04/15 10:30:30 CXMLHandler::CheckPresenceOfXSLFiles: XSL file (E:\Program Files\Symantec\Backup Exec\EVAdvertise.xsl) found.
[7840] 12/04/15 10:30:30 CXMLHandler::CheckPresenceOfXSLFiles:  XSL file (E:\Program Files\Symantec\Backup Exec\EVDrives.xsl) found.
[7840] 12/04/15 10:30:30 CXMLHandler::Initialize: szAdvertiseXSLPath = (E:\Program Files\Symantec\Backup Exec\EVAdvertise.xsl)
[7840] 12/04/15 10:30:30 CXMLHandler::Initialize: szDrivesXSLPath = (E:\Program Files\Symantec\Backup Exec\EVDrives.xsl)
[7840] 12/04/15 10:30:30 CEvServices::GetEvClusterName: Failed to read EV Cluster registry: EV may not be clustered!
[7840] 12/04/15 10:30:30 CXMLHandler::Initialize: Local Parameter(TRP-EXCHANGE) added to XSLs
[7840] 12/04/15 10:30:30 CXMLHandler::Initialize: XSL Initialization Done.
[7840] 12/04/15 10:30:30 Could not resolve the "ndmp" service, error code: 10109, using port 10000
[7840] 12/04/15 10:30:30 Could not create an IPv6 socket at this time, reason:An error occurred during a socket creation operation: Error Code: 10047, System Error Message: An address incompatible with the requested protocol was used.
[7840] 12/04/15 10:30:30 @@@@@@@MyCloseSocket called with sockfd = 1036(0x40c)    retval = 0
[7840] 12/04/15 10:30:30 SocketService::IsSystemDualIP: No support found for IPv6 currently
[7840] 12/04/15 10:30:30 BETCPListener::Bind: Could not bind to port 10000 on IPv4, An error occurred during a socket bind operation: Error Code: 10048, System Error Message: Only one usage of each socket address (protocol/network address/port) is normally permitted.
[7840] 12/04/15 10:30:30 @@@@@@@MyCloseSocket called with sockfd = 1032(0x408)    retval = 0
[7840] 12/04/15 10:30:30 Could not start NDMP Listener on port 10000: An error occurred during a socket creation operation: Error Code: 10048, System Error Message: Only one usage of each socket address (protocol/network address/port) is normally permitted.
[7840] 12/04/15 10:30:30 FS_RemoveFileSys
[10092] 12/04/15 10:30:40 NrdsAdvertiserThread: advertisement cycle started.
[10092] 12/04/15 10:30:40 Informational: Restrict Anonymous Support is enabled
[10092] 12/04/15 10:30:40 creating DLE for local machine
[10092] 12/04/15 10:30:40 BENetConfigEx: Successfully refreshed adapter information.
[10092] 12/04/15 10:30:40 EnumClusterDLEs: Could not opening cluster :
[10092] 12/04/15 10:30:40 NrdsAdvertiserThread: EnumSelfDLE for file system 7 returned 0(0x0) and 1 DLEs
[10092] 12/04/15 10:30:40 NrdsAdvertiserThread: Nrds Message Len : 137.
[10092] 12/04/15 10:30:40 RMAN_EnumSelfDLE: AgentConfig GetOracleDBNames returned error. If Oracle Agent is installed, please run AgentConfig.
[10092] 12/04/15 10:30:40 NrdsAdvertiserThread: EnumSelfDLE for file system 14 returned 0(0x0) and 0 DLEs
[10092] 12/04/15 10:30:40 evFileSystem::EV_EnumSelfDLE:
[10092] 12/04/15 10:30:40 evFileSystem::RefreshTopology()
[10092] 12/04/15 10:30:40 CEvServices::GetEVInstallPath : Could not find EV registry key.
[10092] 12/04/15 10:30:40 CEvServices::GetEVInstallPath : Probably EV is not installed on this machine.
[10092] 12/04/15 10:30:40 This EV version is not supported by Backup Exec.
[10092] 12/04/15 10:30:40 evFileSystem::RefreshTopology: Failed while requesting XML.
[10092] 12/04/15 10:30:40 NrdsAdvertiserThread: EnumSelfDLE for file system 37 returned 1(0x1) and 0 DLEs
[10092] 12/04/15 10:30:40 ConnectToServerEndPoint: dest=TRP-EXCHANGE, service=6101
[10092] 12/04/15 10:30:41 BETCPConnection::LoopThroughListAndConnect: Could not connect to remote address "192.168.25.15" Error:10061.
[10092] 12/04/15 10:30:41 @@@@@@@MyCloseSocket called with sockfd = 1112(0x458)    retval = 0
[10092] 12/04/15 10:30:41 BETCPConnection::CreateConnectionFromHostAndPort: Remote Host: "TRP-EXCHANGE": There were no addresses returned, belonging to family: IPv6
[10092] 12/04/15 10:30:41 BETCPConnection::CreateConnectionFromHostAndPort: Could not create a connection to "TRP-EXCHANGE" because attempts with both IPv4 and IPv6 protocols failed
[10092] 12/04/15 10:30:41 Could not create a BETCPConnection object from address: TRP-EXCHANGE error=An error occurred during a socket connect operation: Error Code: 10061, System Error Message: No connection could be made because the target machine actively refused it.
[10092] 12/04/15 10:30:41 NrdsAdvertiserThread: connect to target=TRP-EXCHANGE port=6101 failed
[10092] 12/04/15 10:30:41 ConnectToServerEndPoint: dest=TRP-EXCHANGE, service=6101
[10092] 12/04/15 10:30:42 BETCPConnection::LoopThroughListAndConnect: Could not connect to remote address "192.168.25.15" Error:10061.
[10092] 12/04/15 10:30:42 @@@@@@@MyCloseSocket called with sockfd = 1104(0x450)    retval = 0
[10092] 12/04/15 10:30:42 BETCPConnection::CreateConnectionFromHostAndPort: Remote Host: "TRP-EXCHANGE": There were no addresses returned, belonging to family: IPv6
[10092] 12/04/15 10:30:42 BETCPConnection::CreateConnectionFromHostAndPort: Could not create a connection to "TRP-EXCHANGE" because attempts with both IPv4 and IPv6 protocols failed
[10092] 12/04/15 10:30:42 Could not create a BETCPConnection object from address: TRP-EXCHANGE error=An error occurred during a socket connect operation: Error Code: 10061, System Error Message: No connection could be made because the target machine actively refused it.
[10092] 12/04/15 10:30:42 NrdsAdvertiserThread: connect to target=TRP-EXCHANGE port=6101 failed
[10092] 12/04/15 10:30:42 NrdsAdvertiserThread: Retrying in 60 seconds
[9244] 12/04/15 10:30:45 NrdsAdvertiserThread: negative (purge) advertisement cycle started.
[9244] 12/04/15 10:30:45 NrdsAdvertiserThread: no purge is pending.
[9244] 12/04/15 10:30:45 NrdsAdvertiserThread: negative (purge) advertisement cycle complete.  Waiting 240 minutes before advertising again.
[7840] 12/04/15 10:30:45 Function called: RMAN_DeInitFileSys
[7840] 12/04/15 10:30:45 Informational: De-initializing the BeDiskFind library 'BEDiskFind.dll' in SHADOW::DeInitBeDiskFindHelperApis
[7840] 12/04/15 10:30:45 Informational: De-initializing the BeDisk library 'BeDisk.dll' in SHADOW::DeInitBeDiskHelperApis
[7840] 12/04/15 10:30:45 Informational: De-initializing the Cps library 'CPSVersion.dll' in CPS::DeInitCpsHelperApis:553
[7840] 12/04/15 10:30:45 Function called: DB2_DeInitFileSys
[7840] 12/04/15 10:30:45 ADC_DeInitFileSys entered
[7840] 12/04/15 10:30:45 evFileSystem::EV_DeInitFileSys entered
[7840] 12/04/15 10:30:45   unloading bedssmsp.dll
[7840] 12/04/15 10:30:45   unloading bedsmbox.dll
[7840] 12/04/15 10:30:45   unloading bedsnote.dll
[7840] 12/04/15 10:30:45 Notes Agent:CLNPartitions::DestroyInstance
[7840] 12/04/15 10:30:45   unloading bedsrman.dll
[7840] 12/04/15 10:30:45   unloading bedsnt5.dll
[7840] 12/04/15 10:30:45   unloading bedssql2.dll
[7840] 12/04/15 10:30:45   unloading bedsmdoc.dll
[7840] 12/04/15 10:30:45   unloading bedsshadow.dll
[7840] 12/04/15 10:30:45   unloading bedsupfs.dll
[7840] 12/04/15 10:30:45   unloading bedssps2.dll
[7840] 12/04/15 10:30:45   unloading bedsra.dll
[7840] 12/04/15 10:30:45   unloading bedsoffhost.dll
[7840] 12/04/15 10:30:45   unloading bedscps.dll
[7840] 12/04/15 10:30:45   unloading bedsdb2.dll
[7840] 12/04/15 10:30:45   unloading bedsss.dll
[7840] 12/04/15 10:30:45   unloading bedsadgran.dll
[7840] 12/04/15 10:30:45   unloading bedsadc.dll
[7840] 12/04/15 10:30:45   unloading bedsxese.dll
[7840] 12/04/15 10:30:45   unloading bedssps3.dll
[7840] 12/04/15 10:30:45   unloading bedsev.dll
[10088] 12/04/15 10:30:45 Service status: Starting, error = 0, checkpoint = 3, wait hint = 10000
[10088] 12/04/15 10:30:45 Service status: Stopped, error = 0, checkpoint = 0, wait hint = 0
[10088] 12/04/15 10:30:45 Exit with code 0

OpenThreadToken failed, lastError = 000003F0
VirtFile was already loaded.
Unable to load VirtFile
VirtFile interface version is (1): 1

Thanks

[raymunda]

thanks

[pkh]

Disable IPv6 on the server.