cancel
Showing results for 
Search instead for 
Did you mean: 

Failover not working - partial online

ntenz
Level 2

Greetings,

 

We have a win2ksp2-std-64 cluster enviroment with veritas 5.0.0 and 5.0 RP1a installed running MSSQL 2005. When SQL have problems or we want to evacuate to the secundary side of the cluster we only get partial online and the setup fails.

 

2008/08/27 14:47:39 VCS INFO V-16-1-50135 User admin fired command: hagrp -clear SQL_VS  PUBRODB05  from 127.0.0.1
2008/08/27 14:47:39 VCS INFO V-16-1-10307 Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (Not initiated by VCS)
2008/08/27 14:47:42 VCS INFO V-16-1-50135 User admin fired command: hagrp -online SQL_VS  PUBRODB05  localclus  from 127.0.0.1
2008/08/27 14:47:42 VCS NOTICE V-16-1-10166 Initiating manual online of group SQL_VS on system PUBRODB05
2008/08/27 14:47:42 VCS NOTICE V-16-1-10233 Clearing Restart attribute for group SQL_VS on all nodes
2008/08/27 14:47:42 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/27 14:47:42 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/27 14:47:43 VCS INFO V-16-1-10298 Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/27 14:47:43 VCS INFO V-16-1-10298 Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/27 14:47:43 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-SQLAgService (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/27 14:47:43 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/27 14:47:43 VCS INFO V-16-1-10298 Resource SQL_VS-MSSearch (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/27 14:47:53 VCS INFO V-16-1-10298 Resource SQL_VS-SQLAgService (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/27 14:50:20 VCS INFO V-16-1-50135 User admin fired command: MSG_RES_PROBE SQL_VS-SQLOlapService  PUBRODB05  from 127.0.0.1
2008/08/27 14:50:24 VCS INFO V-16-1-50135 User admin fired command: MSG_RES_PROBE SQL_VS-SQLOlapService  PUBRODB06  from 127.0.0.1
2008/08/27 14:50:33 VCS INFO V-16-1-50135 User admin fired command: hares -online SQL_VS-SQLOlapService  PUBRODB05  from 127.0.0.1
2008/08/27 14:50:33 VCS NOTICE V-16-1-10233 Clearing Restart attribute for group SQL_VS on all nodes
2008/08/27 14:53:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 20 invocations of the clean procedure have failed.
2008/08/27 15:03:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 30 invocations of the clean procedure have failed.
2008/08/27 15:13:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 40 invocations of the clean procedure have failed.
2008/08/27 15:15:56 VCS INFO V-16-1-50135 User admin fired command: haconf -dump from 127.0.0.1
2008/08/27 15:23:21 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 50 invocations of the clean procedure have failed.
2008/08/27 15:33:21 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 60 invocations of the clean procedure have failed.
2008/08/27 15:43:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 70 invocations of the clean procedure have failed.
2008/08/27 15:53:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 80 invocations of the clean procedure have failed.
2008/08/27 16:03:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 90 invocations of the clean procedure have failed.
2008/08/27 16:13:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 100 invocations of the clean procedure have failed.
2008/08/27 16:23:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 110 invocations of the clean procedure have failed.
2008/08/27 16:33:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 120 invocations of the clean procedure have failed.
2008/08/27 16:43:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 130 invocations of the clean procedure have failed.
2008/08/27 16:53:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 140 invocations of the clean procedure have failed.
2008/08/27 17:03:20 VCS ERROR V-16-2-13079 (PUBRODB05) Resource(SQL_VS-SQLOlapService): The last 150 invocations of the clean procedure have failed.

 

 

 
PUBRODB05

SQLSERVER2005_A

2008/08/25 20:37:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:38:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:39:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:40:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:41:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:42:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:43:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:44:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:45:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:46:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:47:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:48:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:49:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 20:50:26 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.

2008/08/25 20:51:02 VCS ERROR V-16-2-13120 Thread(1072) Error receiving from the engine. Agent(SQLServer2005) is exiting.
2008/08/25 21:19:01 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:20:00 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.

2008/08/25 21:20:58 VCS ERROR V-16-2-13120 Thread(1304) Error receiving from the engine. Agent(SQLServer2005) is exiting.
2008/08/25 21:25:03 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:25:03 VCS WARNING V-16-20050-14 SQLServer2005:SQL_VS-SQLServer2005:monitor:The 'MSSQLSERVER' service is not in stopped or running state. State=3.


2008/08/25 21:26:13 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:26:42 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:online:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:26:46 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:27:56 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:29:07 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:30:18 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:30:48 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:31:54 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:32:57 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:34:01 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:35:05 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:36:09 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:37:11 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:38:13 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:39:14 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:40:14 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:41:16 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:42:17 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:43:17 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:44:17 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.

2008/08/25 21:44:17 VCS ERROR V-16-2-13067 Thread(4840) Agent is calling clean for resource(SQL_VS-SQLServer2005) because the resource became OFFLINE unexpectedly, on its own.
2008/08/25 21:44:17 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:clean:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:44:17 VCS ERROR V-16-2-13068 Thread(4840) Resource(SQL_VS-SQLServer2005) - clean completed successfully.
2008/08/25 21:44:17 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:49:19 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:54:19 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:monitor:SQL Server Instance name is not specified. Agent will operate on the default instance.
2008/08/25 21:54:53 VCS NOTICE V-16-20050-10 SQLServer2005:SQL_VS-SQLServer2005:online:SQL Server Instance name is not specified. Agent will operate on the default instance.

 

Please let me know if you need more info. Any help would be appreciated.

 

Best regards,

 

Daniel

 

 

 

1 REPLY 1

ntenz
Level 2
Engine_A.txt

2008/08/26 21:32:36 VCS ERROR V-16-2-13067 (PUBRODB05) Agent is calling clean for resource(SQL_VS-SQLAgService) because the resource became OFFLINE unexpectedly, on its own.
2008/08/26 21:32:36 VCS INFO V-16-2-13068 (PUBRODB05) Resource(SQL_VS-SQLAgService) - clean completed successfully.
2008/08/26 21:32:36 VCS INFO V-16-1-10307 Resource SQL_VS-SQLAgService (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (Not initiated by VCS)
2008/08/26 21:32:36 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:36 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-SQLOlapService (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:36 VCS ERROR V-16-2-13067 (PUBRODB05) Agent is calling clean for resource(SQL_VS-SQLServer2005) because the resource became OFFLINE unexpectedly, on its own.
2008/08/26 21:32:36 VCS INFO V-16-2-13068 (PUBRODB05) Resource(SQL_VS-SQLServer2005) - clean completed successfully.
2008/08/26 21:32:36 VCS INFO V-16-1-10307 Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (Not initiated by VCS)
2008/08/26 21:32:37 VCS INFO V-16-1-10305 Resource SQL_VS-MSSearch (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:37 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:37 VCS INFO V-16-1-10305 Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:42 VCS INFO V-16-1-10305 Resource SQL_VS-SQLOlapService (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS INFO V-16-1-10305 Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS INFO V-16-1-10305 Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:42 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:42 VCS INFO V-16-1-10305 Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:47 VCS INFO V-16-1-10305 Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:47 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:47 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:47 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:47 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:47 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:32:53 VCS INFO V-16-1-10305 Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (VCS initiated)
2008/08/26 21:32:53 VCS ERROR V-16-1-10205 Group SQL_VS is faulted on system PUBRODB05
2008/08/26 21:32:53 VCS NOTICE V-16-1-10446 Group SQL_VS is offline on system PUBRODB05
2008/08/26 21:32:53 VCS INFO V-16-1-10493 Evaluating PUBRODB05 as potential target node for group SQL_VS
2008/08/26 21:32:53 VCS INFO V-16-1-50010 Group SQL_VS is online or faulted on system PUBRODB05
2008/08/26 21:32:53 VCS INFO V-16-1-10493 Evaluating PUBRODB06 as potential target node for group SQL_VS
2008/08/26 21:32:53 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:32:53 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:32:53 VCS INFO V-16-6-15004 (PUBRODB05) hatrigger:Failed to send trigger for postoffline; script doesn't exist
2008/08/26 21:32:54 VCS INFO V-16-1-10298 Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:32:54 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:02 VCS INFO V-16-1-10298 Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:02 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:02 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:02 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:02 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:02 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:06 VCS INFO V-16-1-10298 Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:06 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:06 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:06 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:06 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:07 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:07 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:10 VCS INFO V-16-1-10298 Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) is online on PUBRODB06 (VCS initiated)
2008/08/26 21:33:19 VCS INFO V-16-1-50133 User admin has logged in from 127.0.0.1
2008/08/26 21:33:48 VCS INFO V-16-1-50135 User admin fired command: hagrp -clear SQL_VS  PUBRODB05  from 127.0.0.1
2008/08/26 21:33:48 VCS INFO V-16-1-10307 Resource SQL_VS-SQLAgService (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (Not initiated by VCS)
2008/08/26 21:33:48 VCS INFO V-16-1-10307 Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB05 (Not initiated by VCS)
2008/08/26 21:33:57 VCS INFO V-16-1-50135 User admin fired command: hagrp -switch SQL_VS  PUBRODB05  localclus  from 127.0.0.1
2008/08/26 21:33:57 VCS NOTICE V-16-1-10208 Initiating switch of group SQL_VS from system PUBRODB06 to system PUBRODB05
2008/08/26 21:33:57 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:57 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:57 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:57 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:57 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:57 VCS INFO V-16-1-10305 Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:33:57 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:33:57 VCS INFO V-16-1-10305 Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:34:01 VCS INFO V-16-1-10305 Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:34:01 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:34:01 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:34:01 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:34:39 VCS INFO V-16-1-50135 User admin fired command: hagrp -switch SQL_VS  PUBRODB05  localclus  from 127.0.0.1
2008/08/26 21:34:40 VCS NOTICE V-16-1-10208 Initiating switch of group SQL_VS from system PUBRODB06 to system PUBRODB05
2008/08/26 21:34:51 VCS INFO V-16-1-50135 User admin fired command: hagrp -offline SQL_VS  PUBRODB06  localclus  from 127.0.0.1
2008/08/26 21:35:05 VCS INFO V-16-1-50135 User admin fired command: hagrp -online SQL_VS  PUBRODB06  localclus  from 127.0.0.1
2008/08/26 21:35:48 VCS INFO V-16-1-50135 User admin fired command: hagrp -switch SQL_VS  PUBRODB05  localclus  from 127.0.0.1
2008/08/26 21:35:48 VCS NOTICE V-16-1-10208 Initiating switch of group SQL_VS from system PUBRODB06 to system PUBRODB05
2008/08/26 21:36:07 VCS ERROR V-16-2-13066 (PUBRODB06) Agent is calling clean for resource(SQL_VS-RegRep-MSSearch) because the resource is not up even after online completed.
2008/08/26 21:36:07 VCS ERROR V-16-2-13066 (PUBRODB06) Agent is calling clean for resource(SQL_VS-RegRep-MSSQL) because the resource is not up even after online completed.
2008/08/26 21:36:07 VCS INFO V-16-2-13068 (PUBRODB06) Resource(SQL_VS-RegRep-MSSearch) - clean completed successfully.
2008/08/26 21:36:07 VCS INFO V-16-2-13071 (PUBRODB06) Resource(SQL_VS-RegRep-MSSearch): reached OnlineRetryLimit(0).
2008/08/26 21:36:07 VCS INFO V-16-2-13068 (PUBRODB06) Resource(SQL_VS-RegRep-MSSQL) - clean completed successfully.
2008/08/26 21:36:07 VCS INFO V-16-2-13071 (PUBRODB06) Resource(SQL_VS-RegRep-MSSQL): reached OnlineRetryLimit(0).
2008/08/26 21:36:07 VCS ERROR V-16-1-10303 Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) is FAULTED (timed out) on sys PUBRODB06
2008/08/26 21:36:08 VCS ERROR V-16-1-10303 Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) is FAULTED (timed out) on sys PUBRODB06
2008/08/26 21:36:08 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:36:12 VCS INFO V-16-1-10305 Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:36:12 VCS NOTICE V-16-1-10300 Initiating Offline of Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) on System PUBRODB06
2008/08/26 21:36:19 VCS INFO V-16-1-10305 Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (VCS initiated)
2008/08/26 21:36:19 VCS NOTICE V-16-1-10446 Group SQL_VS is offline on system PUBRODB06
2008/08/26 21:36:19 VCS ERROR V-16-1-10205 Group SQL_VS is faulted on system PUBRODB06
2008/08/26 21:36:19 VCS NOTICE V-16-1-10446 Group SQL_VS is offline on system PUBRODB06
2008/08/26 21:36:19 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:19 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:19 VCS INFO V-16-1-10298 Resource SQL_VS-IP (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:19 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:27 VCS INFO V-16-1-10298 Resource SQL_VS-VMDg (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:27 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:27 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:27 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:27 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:27 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:27 VCS INFO V-16-1-50135 User admin fired command: hagrp -clear SQL_VS  PUBRODB06  from 127.0.0.1
2008/08/26 21:36:28 VCS INFO V-16-1-10307 Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (Not initiated by VCS)
2008/08/26 21:36:28 VCS INFO V-16-1-10307 Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) is offline on PUBRODB06 (Not initiated by VCS)
2008/08/26 21:36:29 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-3 (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:29 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-4 (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:31 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-1 (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:31 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:31 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:31 VCS INFO V-16-1-10298 Resource SQL_VS-MountV (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:31 VCS INFO V-16-1-10298 Resource SQL_VS-MountV-2 (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:32 VCS INFO V-16-1-10298 Resource SQL_VS-RegRep-MSSearch (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:32 VCS INFO V-16-1-10298 Resource SQL_VS-RegRep-MSSQL (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:36 VCS INFO V-16-1-10298 Resource SQL_VS-Lanman (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:36 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:39 VCS INFO V-16-1-10298 Resource SQL_VS-SQLServer2005 (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:39 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-SQLOlapService (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:39 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-SQLAgService (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:39 VCS NOTICE V-16-1-10301 Initiating Online of Resource SQL_VS-MSSearch (Owner: unknown, Group: SQL_VS) on System PUBRODB05
2008/08/26 21:36:39 VCS INFO V-16-1-10298 Resource SQL_VS-MSSearch (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:39 VCS INFO V-16-1-10298 Resource SQL_VS-SQLAgService (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:55 VCS INFO V-16-1-10298 Resource SQL_VS-SQLOlapService (Owner: unknown, Group: SQL_VS) is online on PUBRODB05 (VCS initiated)
2008/08/26 21:36:55 VCS NOTICE V-16-1-10447 Group SQL_VS is online on system PUBRODB05
2008/08/26 21:36:55 VCS NOTICE V-16-1-10448 Group SQL_VS failed over to system PUBRODB05
2008/08/26 21:37:05 VCS INFO V-16-1-50135 User admin fired command: haconf -makerw from 127.0.0.1
2008/08/26 21:37:05 VCS INFO V-16-1-50135 User admin fired command: hagrp -freeze -persistent SQL_VS  from 127.0.0.1