β10-25-2012 12:07 PM
Hello
I am new in VCS using the CVMVolDg concepts.
Please take a look at my steps to create my share disk group and then present it to VCS.
Before I update my production VCS, could anyone point any possible mistakes ?
1) In my VCS Master Node (vxdctl -c mode), I create a dg and turn it to a share using (vxdg deport arch1dg / vxdg -s import arch1dg)
2) Listing the dgs:
svmediador2:/# vxdg list
NAME STATE ID
bgw1dg enabled,shared 1338943751.50.svmediador1
arch1dg enabled,shared 1351182830.67.svmediador2
ora1dg enabled,shared 1338925017.17.svmediador1
3) After this, was created the Volume - vxassist -g arch1dg make vol01 100g
4) Then, make the FS - mkfs -F vxfs /dev/vx/rdsk/arch1dg/vol01
5) Testing, I can mount the filesystem in both VCS cluster nodes, but not at the same time. One mount at a time.
6) Configuring this arch1dg at VCS, enabling to mount at the both nodes, some parts of my main.cf is:
6.1) INSERTING THE ARCH1DG IN THE CVM GROUP:
group cvm (
SystemList = { svmediador1 = 0, svmediador2 = 1 }
AutoFailOver = 0
Parallel = 1
AutoStartList = { svmediador1, svmediador2 }
)
CFSfsckd vxfsckd (
ActivationMode @svmediador1 = { bgw1dg = sw, arch1dg = sw, ora1dg = sw}
ActivationMode @svmediador2 = { bgw1dg = sw, arch1dg = sw, ora1dg = sw}
)
CVMCluster cvm_clus (
CVMClustName = MediatorCluster
CVMNodeId = { svmediador1 = 0, svmediador2 = 1 }
CVMTransport = gab
CVMTimeout = 200
)
CVMVxconfigd cvm_vxconfigd (
Critical = 0
CVMVxconfigdArgs = { syslog }
)
cvm_clus requires cvm_vxconfigd
vxfsckd requires cvm_clus
6.2) INSERTING MY NEW ARCH1DG IN THE ora_DG GROUP:
group ora_DG (
SystemList = { svmediador1 = 0, svmediador2 = 1 }
AutoFailOver = 0
Parallel = 1
AutoStartList = { svmediador1, svmediador2 }
)
CFSMount cfsmount4 (
Critical = 0
MountPoint = "/var/opt/mediation/ora"
BlockDevice = "/dev/vx/dsk/ora1dg/vol01"
NodeList = { svmediador1, svmediador2 }
)
CFSMount cfsmount13 (
Critical = 0
MountPoint = "/oraarch"
BlockDevice = "/dev/vx/dsk/arch1dg/vol01"
NodeList = { svmediador1, svmediador2 }
)
CVMVolDg cvmvoldg4 (
Critical = 0
CVMDiskGroup = ora1dg
CVMActivation @svmediador1 = sw
CVMActivation @svmediador2 = sw
)
CVMVolDg cvmvoldg13 (
Critical = 0
CVMDiskGroup = arch1dg
CVMActivation @svmediador1 = sw
CVMActivation @svmediador2 = sw
)
requires group cvm online local firm
cfsmount4 requires cvmvoldg4
cfsmount13 requires cvmvoldg13
6.3) Oracle1 Group REQUIRES THE ora_DG
group Oracle1 (
SystemList = { svmediador1 = 1, svmediador2 = 2 }
AutoStartList = { svmediador1 }
)
IPMultiNIC Oracle1_IP (
Address = "192.168.4.98"
NetMask = "255.255.255.0"
MultiNICResName = MultiNICA
IfconfigTwice = 1
)
ORACLE bgw (
)
Proxy Oracle1_NIC_PROXY (
TargetResName = MultiNICA
)
requires group ora_DG online local firm
Oracle1_IP requires Oracle1_NIC_PROXY
bgw requires Oracle1_IP
7) Did I forget anything ? This mess is going to work?
Thanks a lot
Alexandre Andrich
Solved! Go to Solution.
β10-26-2012 05:08 AM
So the 2 outputs you gave both show CVMVolume attribute which is required as per CFS Admin guide for Solaris 5.0MP3 below (on page 113):
Mike
β10-25-2012 03:31 PM
Looks ok - a couple of points:
For the CVMVolDg agent, the CVMVolume attribute is required so you should list at least one volume in this attribute.
You can create a shared diskgroup using "vxdg -s init .... " if you want, rather than created as non-shared and then converting.
Mike
β10-25-2012 11:34 PM
Do you have MultiNICA resource as part of separate group? Could you share that config as well?
β10-26-2012 03:00 AM
Yes, Mr. Bafna
Thats my Network Group.
group Network (
SystemList = { svmediador1 = 1, svmediador2 = 2 }
Parallel = 1
AutoStartList = { svmediador1, svmediador2 }
)
MultiNICA MultiNICA (
Device @svmediador1 = { e1000g0 = "192.168.4.93",
e1000g2 = "192.168.4.93" }
Device @svmediador2 = { e1000g0 = "192.168.4.94",
e1000g2 = "192.168.4.94" }
NetMask = "255.255.255.0"
ArpDelay = 5
RouteOptions = "192.168.4.1"
IfconfigTwice = 1
NetworkHosts = { "192.168.4.1" }
)
Phantom Phantom (
)
β10-26-2012 03:14 AM
Mr. Mikebounds
I am not seeing any CVMVolume attribute specified in the main.cf.
I am just inserting a new dg in a working configuration.
Take a look in the other existing group:
group lic_DG (
SystemList = { svmediador1 = 0, svmediador2 = 1 }
AutoFailOver = 0
Parallel = 1
AutoStartList = { svmediador1, svmediador2 }
)
CFSMount cfsmount5 (
Critical = 0
MountPoint = "/var/opt/sentinel"
BlockDevice = "/dev/vx/dsk/lic1dg/vol01"
NodeList = { svmediador1, svmediador2 }
)
CFSMount cfsmount6 (
Critical = 0
MountPoint = "/var/opt/mediation/fmmdb"
BlockDevice = "/dev/vx/dsk/fmm1dg/vol01"
NodeList = { svmediador1, svmediador2 }
)
CVMVolDg cvmvoldg5 (
Critical = 0
CVMDiskGroup = lic1dg
CVMActivation @svmediador1 = sw
CVMActivation @svmediador2 = sw
)
CVMVolDg cvmvoldg6 (
Critical = 0
CVMDiskGroup = fmm1dg
CVMActivation @svmediador1 = sw
CVMActivation @svmediador2 = sw
)
requires group cvm online local firm
cfsmount5 requires cvmvoldg5
cfsmount6 requires cvmvoldg6
Is this attibute a prerequisite or my new mount will be work any way?
Thanks
Alexandre Andrich
β10-26-2012 03:35 AM
Other point:
Do I have to deport my SHARED DG before start the VCS?
Thats my dgs in this moment in both nodes:
svmediador1:/# vxdisk -o alldgs list
DEVICE TYPE DISK GROUP STATUS
emcpower0s2 auto:sliced bgw1dgemcpower0 bgw1dg online shared
emcpower3s2 auto:cdsdisk - (fendg) online
emcpower4s2 auto:cdsdisk - (fendg) online
emcpower5s2 auto:cdsdisk - (fendg) online
emcpower8s2 auto:sliced ora1dgemcpower8 ora1dg online shared
emcpower13s2 auto:sliced arch1dgemcpower13 arch1dg online shared
svmediador1:/# vxdg list
NAME STATE ID
arch1dg enabled,shared 1351182830.67.svmediador2
bgw1dg enabled,shared 1338925892.34.svmediador1
ora1dg enabled,shared 1338925017.17.svmediador1
svmediador2:/# vxdisk -o alldgs list
DEVICE TYPE DISK GROUP STATUS
emcpower0s2 auto:sliced bgw1dgemcpower0 bgw1dg online shared
emcpower1s2 auto:cdsdisk - (fendg) online
emcpower6s2 auto:cdsdisk - (fendg) online
emcpower10s2 auto:cdsdisk - (fendg) online
emcpower11s2 auto:sliced ora1dgemcpower8 ora1dg online shared
emcpower13s2 auto:sliced arch1dgemcpower13 arch1dg online shared
svmediador2:/# vxdg list
NAME STATE ID
arch1dg enabled,shared 1351182830.67.svmediador2
bgw1dg enabled,shared 1338925892.34.svmediador1
ora1dg enabled,shared 1338925017.17.svmediador1
β10-26-2012 04:14 AM
According to the bundled agents guide, the CVMVolume attibribute is a required attribute and so it must be configured. I have never tried NOT configuring this attribute, but I would have though the resource should not work without it because I believe the agent does a "dd" read of the volume to determine the health of the resource. You can see this attribute several ways:
You should NOT deport diskgroup before started VCS as the CVMVolDg resource does not import the diskgroup, it only enables it, and it must be imported as a shared diskgroup as it is shown to be now.
What O/S and version of VCS are you using?
Mike
β10-26-2012 04:38 AM
My SO is Solaris 10 adnd my VCS is 5.0.
Thats my CVMTypes.cf and the output from hares -display cvmvoldg5.
type CVMCluster (
static int NumThreads = 1
static int OnlineRetryLimit = 2
static int OnlineTimeout = 400
static str ArgList[] = { CVMTransport, CVMClustName, CVMNodeAddr, CVMNodeId, PortConfigd, PortKmsgd, CVMTimeout }
str CVMClustName
str CVMNodeAddr{}
str CVMNodeId{}
str CVMTransport
int PortConfigd
int PortKmsgd
int CVMTimeout
)
type CVMVolDg (
static keylist RegList = { CVMActivation, CVMVolume }
static str ArgList[] = { CVMDiskGroup, CVMVolume, CVMActivation }
str CVMDiskGroup
keylist CVMVolume
str CVMActivation
temp int voldg_stat
)
type CVMVxconfigd (
static int FaultOnMonitorTimeouts = 2
static int RestartLimit = 5
static str ArgList[] = { CVMVxconfigdArgs }
static str Operations = OnOnly
keylist CVMVxconfigdArgs
)
#####################################################################
svmediador2:/# hares -display cvmvoldg5
#Resource Attribute System Value
cvmvoldg5 Group global lic_DG
cvmvoldg5 Type global CVMVolDg
cvmvoldg5 AutoStart global 1
cvmvoldg5 Critical global 0
cvmvoldg5 Enabled global 1
cvmvoldg5 LastOnline global svmediador1
cvmvoldg5 MonitorOnly global 0
cvmvoldg5 ResourceOwner global unknown
cvmvoldg5 TriggerEvent global 0
cvmvoldg5 ArgListValues svmediador1 lic1dg 0 sw
cvmvoldg5 ArgListValues svmediador2 lic1dg 0 sw
cvmvoldg5 ConfidenceLevel svmediador1 100
cvmvoldg5 ConfidenceLevel svmediador2 100
cvmvoldg5 Flags svmediador1
cvmvoldg5 Flags svmediador2
cvmvoldg5 IState svmediador1 not waiting
cvmvoldg5 IState svmediador2 not waiting
cvmvoldg5 Probed svmediador1 1
cvmvoldg5 Probed svmediador2 1
cvmvoldg5 Start svmediador1 1
cvmvoldg5 Start svmediador2 1
cvmvoldg5 State svmediador1 ONLINE
cvmvoldg5 State svmediador2 ONLINE
cvmvoldg5 CVMDiskGroup global lic1dg
cvmvoldg5 CVMVolume global
cvmvoldg5 ComputeStats global 0
cvmvoldg5 voldg_stat global 0
cvmvoldg5 CVMActivation svmediador1 sw
cvmvoldg5 CVMActivation svmediador2 sw
cvmvoldg5 MonitorTimeStats svmediador1 Avg 0 TS
cvmvoldg5 MonitorTimeStats svmediador2 Avg 0 TS
cvmvoldg5 ResourceInfo svmediador1 State Valid Msg TS
cvmvoldg5 ResourceInfo svmediador2 State Valid Msg TS
β10-26-2012 04:53 AM
Hi andrich,
Your MultiNICA configuration looks fine. Only issue I see is RouteOptions attribute value.
RouteOptions attribute should be used only when configuring the local host as default gateway.
Please refer to Bundled Agent's Reference Guide for more details.
Thanks and Regards,
Paresh Bafna
β10-26-2012 05:08 AM
So the 2 outputs you gave both show CVMVolume attribute which is required as per CFS Admin guide for Solaris 5.0MP3 below (on page 113):
Mike
β10-26-2012 05:33 AM
Thanks Mike
How can I see if my Volume is a share volume?
If I have shared my DG, my Volume create under this DG is going to be share too ?
β10-26-2012 05:41 AM
Correct - all volumes in a shared diskgroup are shared.
Mike
β10-26-2012 06:34 AM
Thanks all. I am more relax now to introduce the new configuration to my Production Environment.