Highlighted

MySQL resource goes FAULTED on A/P clustering (ERROR V-292-2-718)

Hello,

I am trying to install A/P cluster with MySQL resource. I installed MySQL agent successfuly. But mysqldatabase resources goes to FAULTED state on node2. Sometimes it works fine on node1.

Agent trace log (MySQL_A.log) details attached, shown as below. 

2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:messageEngineLog:[AMF amfregister ERROR V-292-2-718

I couldn't find any solution document about V-292-2-718 error. Looks like the problem is related with imf_register function.

How can I solve it?

 

Platform:

Redhat 6.6 x86_64

Package list:

[root@node2 ~]# rpm -qa | grep VRTS
VRTSperl-5.20.1.3-RHEL6.x86_64
VRTSgab-7.1.0.000-RHEL6.x86_64
VRTSglm-7.1.0.000-RHEL6.x86_64
VRTSvcswiz-7.1.0.000-RHEL6.x86_64
VRTSvxvm-7.1.0.000-RHEL6.x86_64
VRTSvcs-7.1.0.000-RHEL6.x86_64
VRTSodm-7.1.0.000-RHEL6.x86_64
VRTSspt-7.1.0.000-RHEL6.noarch
VRTSfsadv-7.1.0.000-RHEL6.x86_64
VRTSamf-7.1.0.000-RHEL6.x86_64
VRTSvcsea-7.1.0.000-RHEL6.x86_64
VRTSgms-7.1.0.000-RHEL6.x86_64
VRTSvbs-7.1.0.000-GA_Linux.x86_64
VRTSvlic-3.02.71.004-RHEL6.x86_64
VRTSvxfs-7.1.0.000-RHEL6.x86_64
VRTSvxfen-7.1.0.000-RHEL6.x86_64
VRTSvcsag-7.1.0.000-RHEL6.x86_64
VRTScavf-7.1.0.000-RHEL6.x86_64
VRTSsfmh-7.1.0.0-0.x86_64
VRTSacclib-6.2.0.0-GENERIC.noarch
VRTSaslapm-7.1.0.000-RHEL6.x86_64
VRTScps-7.1.0.000-RHEL6.x86_64
VRTSdbac-7.1.0.000-RHEL6.x86_64
VRTSmysql-6.2.0.0-GENERIC.noarch
VRTSllt-7.1.0.000-RHEL6.x86_64
VRTSdbed-7.1.0.000-RHEL.x86_64
VRTSsfcpi-7.1.0.000-GENERIC.noarc

 

 

logs:

2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:LogIntSmiley FrustratedetDebugLevel:Information, Set Logging Level To [TRACE]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFWSmiley FrustratedetupLogging:[imf_register] Entered by resource instance [mysqldatabase]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedubroutine <MySQL::ArgsValid> called with:
  EntryPointName           [imf_register]
  MySQLUser                [mysql]
  MySQLAdmin               [root]
  MySQLAdminPasswd         []
  EnvFile                  []
  BaseDir                  [/usr]
  DataDir                  [/leon]
  MyCnf                    []
  HostName                 []
  Port                     [3306]
  SecondLevelMonitor       [0]
  MonitorProgram           []
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:RunSecondLevelMonitorSmiley Frustratedubroutine VCSagentFW::RunSecondLevelMonitor called with: SecondLevelMonitor [1]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:RunSecondLevelMonitor:<VCSagentFW::RunSecondLevelMonitor> Got request to remove SLM file [/tmp/.VRTSMySQL/mysqldatabase/SLM/mysqldatabase.slm]. Returning with [1]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<imf_register> All arguments validated successfully!
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedubroutine <main::Imf_registerEntryPoint> called
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<main::Imf_registerEntryPoint> IMFMonitorSwitch <1> IMFResState <0>
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedubroutine <MySQL::GetEngineTimeout> called with:
  UseMargin  [0]

2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<MySQL::GetEngineTimeout> Using AEPTimeout [270] as EP timeout value
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<main::Imf_registerEntryPoint>: Entrypoint Timeout set to [270]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedys:RunWithEnvCmdWithOutputWithTimeOutSmiley Frustratedubroutine <Sys::RunWithEnvCmdWithOutputWithTimeOut> called with:
  EnvFile       []
  Command       [/opt/VRTSamf/bin/amfregister]
  Arguments     []
  User          [root]
  Timeout       [270]
  OutFile       [<undef>]
  FromDir       [<undef>]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedys:RunWithEnvCmdWithOutputWithTimeOut:Environment file not set
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedys:RunWithEnvCmdWithOutputWithTimeOut:Going to run command line [/opt/VRTSamf/bin/amfregister ], as User [root]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedys:RunWithEnvCmdWithOutputWithTimeOut:Now going to run complete command line [/opt/VRTSamf/bin/amfregister ]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_registerSmiley Frustratedys:RunWithEnvCmdWithOutputWithTimeOut:Command line [/opt/VRTSamf/bin/amfregister ] provided a non-zero exit code -- this does not necessarily indicate a problem... (Perl's OS error variable prior to the command-pipe close was [], and after the close was [] )
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:messageEngineLog:[AMF amfregister ERROR V-292-2-718
Usage: amfregister -i|u|P -p|m|G [-n|f] -r <reaper> [-g <group>] [-c <cookie>] <event type specific options>

-Process Online Monitor:  amfregister -ipn -r <reaper> [-g <group>] [-c <cookie>] <pid> [pid...]

-Process Offline Monitor: amfregister -ipf -r <reaper> [-g <group>] [-c <cookie>] [-a argv0 [-T <substrflags>]]
 [-o uid=<uid>,euid=<euid>,gid=<gid>,egid=<egid>] [-t <substr> [-T <substrflags>]] [-b <argsflags>] <path> <args>

-Mount Online Monitor:    amfregister -imn -r <reaper> [-g <group>] [-c <cookie>] <device> <mountpoint> <fstype>

-Mount Offline Monitor:   amfregister -imf -r <reaper> [-g <group>] [-c <cookie>] [-s <1|2|3>] <device> <mountpoint> <fstype>

-Generic Monitor:  amfregister -i -r <reaper> [-g <group>] [-c <cookie>] -G <string>

-Unregister group or rid: amfregister -u -r <reaper> <-g <group> | rid>

-Update group or rid: amfregister -P <a|p> -r <reaper> -g <group>

]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<main::Imf_registerEntryPoint>: Command [/opt/VRTSamf/bin/amfregister] with args [] was successful
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<main::Imf_registerEntryPoint> Return code from amfregister command [1]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:<main::Imf_registerEntryPoint> Exit code from imf_register entry point [1]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:entryPointExitSmiley Frustratedubroutine VCSagentFW::entryPointExit called with: Exit code [1]
2016/06/24 15:01:18 VCS DBG_5 MySQL:mysqldatabase:imf_register:VCSagentFW:entryPointExit:Exiting entry point [imf_register] with exit code [1]
2016/06/24 15:01:19 VCS DBG_AGDEBUG PIPE output is - (mysqldatabase)
        VCSAgProcess.C:exec_script_with_pipe[1771]
2016/06/24 15:01:19 VCS DBG_AGDEBUG script (/opt/VRTSagents/ha/bin/MySQL/imf_register) exited with status (1)
        VCSAgProcess.C:exec_script_with_pipe[1807]
2016/06/24 15:01:19 VCS DBG_AGDEBUG Entry point (imf_register) returned (mysqldatabase) from pipe
        VCSAgType.C:_exec_script_with_pipe[3572]
2016/06/24 15:01:19 VCS DBG_AGINFO Resource(mysqldatabase) - imf_register entry point exited with a return value 1
        VCSAgType.C:call_imf_register[2384]
2016/06/24 15:01:19 VCS DBG_AGDEBUG Canceling timer for (mysqldatabase) op(1625)
        VCSAgTimer.C:_cancel[952]
==============================================
 

3 Replies

Re: MySQL resource goes FAULTED on A/P clustering (ERROR V-292-2-718)

Have you tried to turn of IMF to see if it works with regular agent?

Re: MySQL resource goes FAULTED on A/P clustering (ERROR V-292-2-718)

How can I turn off IMF?

I tried to run manually online command but I got some errors.

Details:

[root@node2 ~]# /opt/VRTSperl/bin/perl -Sw /opt/VRTSagents/ha/bin/MySQL/online mysqldatabase ResLogLevel 1 TRACE State 1 0 IState 1 1 MySQLUser 1 mysql MySQLAdmin 1 root MySQLAdminPasswd 1 123456 EnvFile 1  BaseDir 1 /usr DataDir 1 /leon MyCnf 1  HostName 1  Port 1 3306 SecondLevelMonitor 1 0 MonitorProgram 1  AEPTimeout 1 300
Use of uninitialized value in concatenation (.) or string at /opt/VRTS/.ACCLib/system/Sys.pm line 79.
Argument "/usr" isn't numeric in addition (+) at /opt/VRTSagents/ha/bin/MySQL/online line 163.
Argument "Port" isn't numeric in addition (+) at /opt/VRTSagents/ha/bin/MySQL/online line 163.
Can't use an undefined value as an ARRAY reference at /opt/VRTSagents/ha/bin/MySQL/online line 173.

Re: MySQL resource goes FAULTED on A/P clustering (ERROR V-292-2-718)

Disabling intelligent resource monitoring To disable intelligent resource monitoring

  1. 1  Make the VCS configuration writable. # haconf -makerw

  2. 2  To disable intelligent resource monitoring for all the resources of a certain type, run the following command:

                          # hatype -modify MySQL IMF -update Mode 0
    
  3. 3  To disable intelligent resource monitoring for a specific resource, run the following command:

    # hares -override resource_name IMF

    # hares -modify resource_name IMF -update Mode 0

  4. 4  Save the VCS configuration.

                          # haconf -dump -makero