MySQL resource goes FAULTED on A/P clustering (ERROR V-292-2-718)

Question

Hello,

I am trying to install A/P cluster with MySQL resource. I installed MySQL agent successfuly. But mysqldatabase resources goes to FAULTED state on node2. Sometimes it works fine on node1.

Agent trace log (MySQL_A.log) details attached, shown as below.&nbsp;

2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:messageEngineLog:[AMF amfregister ERROR V-292-2-718

I couldn't find any solution document about&nbsp;V-292-2-718 error. Looks like the problem is related with&nbsp;imf_register function.

How can I solve it?

&nbsp;

Platform:

Redhat 6.6 x86_64

Package list:

[root@node2 ~]# rpm -qa | grep VRTS
	VRTSperl-5.20.1.3-RHEL6.x86_64
	VRTSgab-7.1.0.000-RHEL6.x86_64
	VRTSglm-7.1.0.000-RHEL6.x86_64
	VRTSvcswiz-7.1.0.000-RHEL6.x86_64
	VRTSvxvm-7.1.0.000-RHEL6.x86_64
	VRTSvcs-7.1.0.000-RHEL6.x86_64
	VRTSodm-7.1.0.000-RHEL6.x86_64
	VRTSspt-7.1.0.000-RHEL6.noarch
	VRTSfsadv-7.1.0.000-RHEL6.x86_64
	VRTSamf-7.1.0.000-RHEL6.x86_64
	VRTSvcsea-7.1.0.000-RHEL6.x86_64
	VRTSgms-7.1.0.000-RHEL6.x86_64
	VRTSvbs-7.1.0.000-GA_Linux.x86_64
	VRTSvlic-3.02.71.004-RHEL6.x86_64
	VRTSvxfs-7.1.0.000-RHEL6.x86_64
	VRTSvxfen-7.1.0.000-RHEL6.x86_64
	VRTSvcsag-7.1.0.000-RHEL6.x86_64
	VRTScavf-7.1.0.000-RHEL6.x86_64
	VRTSsfmh-7.1.0.0-0.x86_64
	VRTSacclib-6.2.0.0-GENERIC.noarch
	VRTSaslapm-7.1.0.000-RHEL6.x86_64
	VRTScps-7.1.0.000-RHEL6.x86_64
	VRTSdbac-7.1.0.000-RHEL6.x86_64
	VRTSmysql-6.2.0.0-GENERIC.noarch
	VRTSllt-7.1.0.000-RHEL6.x86_64
	VRTSdbed-7.1.0.000-RHEL.x86_64
	VRTSsfcpi-7.1.0.000-GENERIC.noarc

&nbsp;

logs:

2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:LogInt:SetDebugLevel:Information, Set Logging Level To [TRACE]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:SetupLogging:[imf_register] Entered by resource instance [mysqldatabase]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Subroutine &lt;MySQL::ArgsValid&gt; called with:
	&nbsp; EntryPointName &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; [imf_register]
	&nbsp; MySQLUser &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[mysql]
	&nbsp; MySQLAdmin &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; [root]
	&nbsp; MySQLAdminPasswd &nbsp; &nbsp; &nbsp; &nbsp; []
	&nbsp; EnvFile &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[]
	&nbsp; BaseDir &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[/usr]
	&nbsp; DataDir &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[/leon]
	&nbsp; MyCnf &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[]
	&nbsp; HostName &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; []
	&nbsp; Port &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; [3306]
	&nbsp; SecondLevelMonitor &nbsp; &nbsp; &nbsp; [0]
	&nbsp; MonitorProgram &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; []
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:RunSecondLevelMonitor:Subroutine VCSagentFW::RunSecondLevelMonitor called with: SecondLevelMonitor [1]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:RunSecondLevelMonitor:&lt;VCSagentFW::RunSecondLevelMonitor&gt; Got request to remove SLM file [/tmp/.VRTSMySQL/mysqldatabase/SLM/mysqldatabase.slm]. Returning with [1]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;imf_register&gt; All arguments validated successfully!
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Subroutine &lt;main::Imf_registerEntryPoint&gt; called
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;main::Imf_registerEntryPoint&gt; IMFMonitorSwitch &lt;1&gt; IMFResState &lt;0&gt;
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Subroutine &lt;MySQL::GetEngineTimeout&gt; called with:
	&nbsp; UseMargin &nbsp;[0]

2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;MySQL::GetEngineTimeout&gt; Using AEPTimeout [270] as EP timeout value
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;main::Imf_registerEntryPoint&gt;: Entrypoint Timeout set to [270]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Sys:RunWithEnvCmdWithOutputWithTimeOut:Subroutine &lt;Sys::RunWithEnvCmdWithOutputWithTimeOut&gt; called with:
	&nbsp; EnvFile &nbsp; &nbsp; &nbsp; []
	&nbsp; Command &nbsp; &nbsp; &nbsp; [/opt/VRTSamf/bin/amfregister]
	&nbsp; Arguments &nbsp; &nbsp; []
	&nbsp; User &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[root]
	&nbsp; Timeout &nbsp; &nbsp; &nbsp; [270]
	&nbsp; OutFile &nbsp; &nbsp; &nbsp; [&lt;undef&gt;]
	&nbsp; FromDir &nbsp; &nbsp; &nbsp; [&lt;undef&gt;]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Sys:RunWithEnvCmdWithOutputWithTimeOut:Environment file not set
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Sys:RunWithEnvCmdWithOutputWithTimeOut:Going to run command line [/opt/VRTSamf/bin/amfregister ], as User [root]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Sys:RunWithEnvCmdWithOutputWithTimeOut:Now going to run complete command line [/opt/VRTSamf/bin/amfregister ]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:Sys:RunWithEnvCmdWithOutputWithTimeOut:Command line [/opt/VRTSamf/bin/amfregister ] provided a non-zero exit code -- this does not necessarily indicate a problem... (Perl's OS error variable prior to the command-pipe close was [], and after the close was [] )
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:messageEngineLog:[AMF amfregister ERROR V-292-2-718
	Usage: amfregister -i|u|P -p|m|G [-n|f] -r &lt;reaper&gt; [-g &lt;group&gt;] [-c &lt;cookie&gt;] &lt;event type specific options&gt;

-Process Online Monitor: &nbsp;amfregister -ipn -r &lt;reaper&gt; [-g &lt;group&gt;] [-c &lt;cookie&gt;] &lt;pid&gt; [pid...]

-Process Offline Monitor: amfregister -ipf -r &lt;reaper&gt; [-g &lt;group&gt;] [-c &lt;cookie&gt;] [-a argv0 [-T &lt;substrflags&gt;]]
	&nbsp;[-o uid=&lt;uid&gt;,euid=&lt;euid&gt;,gid=&lt;gid&gt;,egid=&lt;egid&gt;] [-t &lt;substr&gt; [-T &lt;substrflags&gt;]] [-b &lt;argsflags&gt;] &lt;path&gt; &lt;args&gt;

-Mount Online Monitor: &nbsp; &nbsp;amfregister -imn -r &lt;reaper&gt; [-g &lt;group&gt;] [-c &lt;cookie&gt;] &lt;device&gt; &lt;mountpoint&gt; &lt;fstype&gt;

-Mount Offline Monitor: &nbsp; amfregister -imf -r &lt;reaper&gt; [-g &lt;group&gt;] [-c &lt;cookie&gt;] [-s &lt;1|2|3&gt;] &lt;device&gt; &lt;mountpoint&gt; &lt;fstype&gt;

-Generic Monitor: &nbsp;amfregister -i -r &lt;reaper&gt; [-g &lt;group&gt;] [-c &lt;cookie&gt;] -G &lt;string&gt;

-Unregister group or rid: amfregister -u -r &lt;reaper&gt; &lt;-g &lt;group&gt; | rid&gt;

-Update group or rid: amfregister -P &lt;a|p&gt; -r &lt;reaper&gt; -g &lt;group&gt;

]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;main::Imf_registerEntryPoint&gt;: Command [/opt/VRTSamf/bin/amfregister] with args [] was successful
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;main::Imf_registerEntryPoint&gt; Return code from amfregister command [1]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:&lt;main::Imf_registerEntryPoint&gt; Exit code from imf_register entry point [1]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:entryPointExit:Subroutine VCSagentFW::entryPointExit called with: Exit code [1]
	2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:entryPointExit:Exiting entry point [imf_register] with exit code [1]
	2016/06/24 15:01:19 VCS DBG_AGDEBUG PIPE output is - (mysqldatabase)
	&nbsp; &nbsp; &nbsp; &nbsp; VCSAgProcess.C:exec_script_with_pipe[1771]
	2016/06/24 15:01:19 VCS DBG_AGDEBUG script (/opt/VRTSagents/ha/bin/MySQL/imf_register) exited with status (1)
	&nbsp; &nbsp; &nbsp; &nbsp; VCSAgProcess.C:exec_script_with_pipe[1807]
	2016/06/24 15:01:19 VCS DBG_AGDEBUG Entry point (imf_register) returned (mysqldatabase) from pipe
	&nbsp; &nbsp; &nbsp; &nbsp; VCSAgType.C:_exec_script_with_pipe[3572]
	2016/06/24 15:01:19 VCS DBG_AGINFO Resource(mysqldatabase) - imf_register entry point exited with a return value 1
	&nbsp; &nbsp; &nbsp; &nbsp; VCSAgType.C:call_imf_register[2384]
	2016/06/24 15:01:19 VCS DBG_AGDEBUG Canceling timer for (mysqldatabase) op(1625)
	&nbsp; &nbsp; &nbsp; &nbsp; VCSAgTimer.C:_cancel[952]
	==============================================
	&nbsp;

riaanbadenhorst · Answer

Have you tried to turn of IMF to see if it works with regular agent?

c0derx · Answer

How can I turn off IMF?

I tried to run manually online command but I got some errors.

Details:

[root@node2 ~]# /opt/VRTSperl/bin/perl -Sw /opt/VRTSagents/ha/bin/MySQL/online mysqldatabase ResLogLevel 1 TRACE State 1 0 IState 1 1 MySQLUser 1 mysql MySQLAdmin 1 root MySQLAdminPasswd 1 123456 EnvFile 1 &nbsp;BaseDir 1 /usr DataDir 1 /leon MyCnf 1 &nbsp;HostName 1 &nbsp;Port 1 3306 SecondLevelMonitor 1 0 MonitorProgram 1 &nbsp;AEPTimeout 1 300
	Use of uninitialized value in concatenation (.) or string at /opt/VRTS/.ACCLib/system/Sys.pm line 79.
	Argument "/usr" isn't numeric in addition (+) at /opt/VRTSagents/ha/bin/MySQL/online line 163.
	Argument "Port" isn't numeric in addition (+) at /opt/VRTSagents/ha/bin/MySQL/online line 163.
	Can't use an undefined value as an ARRAY reference at /opt/VRTSagents/ha/bin/MySQL/online line 173.

riaanbadenhorst · Answer

Disabling intelligent resource monitoring To disable intelligent resource monitoring

1 &nbsp;Make the VCS configuration writable. # haconf -makerw

2 &nbsp;To disable intelligent resource monitoring for all the resources of a certain type, run the following command:

# hatype -modify MySQL IMF -update Mode 0

3 &nbsp;To disable intelligent resource monitoring for a specific resource, run the following command:

# hares -override resource_name IMF

# hares -modify resource_name IMF -update Mode 0

4 &nbsp;Save the VCS configuration.

# haconf -dump -makero

Forum Discussion

MySQL resource goes FAULTED on A/P clustering (ERROR V-292-2-718)

Related Content

Veritas 7.4 cluster resources goes offline automatically

Delete Private Queue Created Windows 2019 Cluster MSMQ Resource

Synchronise fails msmq not enough resources

Re: Windows Cluster (File Server) - Dedicated Backup NIC

Monitoring Cluster Resources

Recent Discussions

Configuring SQL Server in a VMware environment?

Configure two Mount type resources of nfs FStype attribute using the same share

order

key registration and reservation

Verifying that primary and dr clusters replication is synced