Forum Discussion

shahfar's avatar
shahfar
Level 5
14 years ago

CVMVolDg resource goes offline in VCS but disk group is still imported

Hi Everyone,

I have a SF RAC 5.1 SP1 setup on Solaris 10 with Oracle RAC 11G R2. The cluster consists of a 2 node primary and a single node secondary using GCO and EMC SRDF agent for replication.

When the global resource group goes down (when brough offline to switch over), the shared disk groups are still in an imported state (CVMVolDG resource has the correct volume and DG names). The logs show the CVMVolDg resource as going offline and show no errors in either the engine log or the voldg agent log. CVMDeportOnOffline is set to 0. Has anyone faced this issue? Thanks.

SW

  • Deporting a diskgroup in CVM deports diskgroup on all nodes and therefore normally the CVMVolDg resource does not deport the diskgroup as this would not be possible if another node still had filesystems mounted, so the CVMVolDg resource normally just sets activation mode to off for that node.

    The way this used to work with SRDF in GCO is that you would create "SupportedActions" on the CVMVolDg resource of "import" and "deport" and this handles deport of diskgroup which is required so that you can do an SDRF role swap.  I think the CVMVolDg action is called by the SRDF agent when it onlines on remote node using cross-cluster communication.

    However in 5.1SP1, I see that a new "CVMDeportOnOffline" has been added, so maybe this can be used in stead o the CVMVolDG actions. Note if you use set this attribute to 1, then the diskgroup will only be deported when the CVMVolDg resources offlines on the last node.  It took a while to find CVMVolDg agent definition as it has moved from cfs_admin guide in 5.0 to cfs_install in 5.1 and I tried to look find an SRDF 5.1SP1 doc, but I couldn't find it, so I don't know if this means if it is has been moved elsewhere or the agent has not changed from 5.1 to SP1.

    If the SRDF agent still works the way it used to then the installation of the SDRF agent will have created an actions directory in /opt/VRTSvcs/bin/CVMVolDG which should contain 3 scripts "deport", "import" and "vxdctlenable" - this being the case, follow the instructions in the SDRF install & config guide which is basically:

     

     haconf -makerw
    
    hatype -modify CVMVolDg SupportedActions import deport vxdctlenable
    
    haconf -dump -makero 

    If this is not the case, then you should check 5.1SP1 SRDF guide to see if you are supposed to use the CVMDeportOnOffline attribute, or you could just try setting this to 1.

    As you have CVMDeportOnOffline set to zero then I would not expect diskgroup to offline so VCS is doing the right thing (if you have not setup CVMVolDg action scripts)

    Mike

     

  • Deporting a diskgroup in CVM deports diskgroup on all nodes and therefore normally the CVMVolDg resource does not deport the diskgroup as this would not be possible if another node still had filesystems mounted, so the CVMVolDg resource normally just sets activation mode to off for that node.

    The way this used to work with SRDF in GCO is that you would create "SupportedActions" on the CVMVolDg resource of "import" and "deport" and this handles deport of diskgroup which is required so that you can do an SDRF role swap.  I think the CVMVolDg action is called by the SRDF agent when it onlines on remote node using cross-cluster communication.

    However in 5.1SP1, I see that a new "CVMDeportOnOffline" has been added, so maybe this can be used in stead o the CVMVolDG actions. Note if you use set this attribute to 1, then the diskgroup will only be deported when the CVMVolDg resources offlines on the last node.  It took a while to find CVMVolDg agent definition as it has moved from cfs_admin guide in 5.0 to cfs_install in 5.1 and I tried to look find an SRDF 5.1SP1 doc, but I couldn't find it, so I don't know if this means if it is has been moved elsewhere or the agent has not changed from 5.1 to SP1.

    If the SRDF agent still works the way it used to then the installation of the SDRF agent will have created an actions directory in /opt/VRTSvcs/bin/CVMVolDG which should contain 3 scripts "deport", "import" and "vxdctlenable" - this being the case, follow the instructions in the SDRF install & config guide which is basically:

     

     haconf -makerw
    
    hatype -modify CVMVolDg SupportedActions import deport vxdctlenable
    
    haconf -dump -makero 

    If this is not the case, then you should check 5.1SP1 SRDF guide to see if you are supposed to use the CVMDeportOnOffline attribute, or you could just try setting this to 1.

    As you have CVMDeportOnOffline set to zero then I would not expect diskgroup to offline so VCS is doing the right thing (if you have not setup CVMVolDg action scripts)

    Mike