MultiNIC faulted and then switchover the base+virtual IP to another interface

Make sure you have other IPs on the 192.168.253  subnet on other servers and routers as VCS will ping out to check network. 

A few other points:

1. You should use interfaces from different physical cards so the quad card is not a single point of failure, so for example use bge0 and qfe0
2. It is much better to use MulltiNCB with Solaris IPMP - this is considerably faster - a few seconds compared to over a minute.  If you don't want to use Solaris IPMP, then MulltiNCB is still quicker (just requires more IP addresses)
3. I would recommend using NetworkHosts attribute as specifying IPs in this attribute is much more efficient than doing a broadcast which is what happens if you leave this attribute blank 

Mike

Yes I have one IP assigned on a server 192.168.253.1

1.) That was testing phase but I configured bge0 and qfe0

2.) right now I want to use MultiNIC

3.) Yes this attribute is set

But still same problem ... When I unplugged a active NIC(bge0) cable the resource(MultiNIC) got faulted and after a while MultiNIC resource got up and IP's assigned on backup NIC(qfe0)

Dont know why the MultiNIC resource getting faulted

I might did something wrong. I created a new service group and did add the MultiNIC and IP MultiNIC resource and linked them both. See the below main.cf file for reference. But now when I unplugged the LAN cable no Service Group is faulting even no IP(Base+Virtual) is switching to the backup NIC/interface. Solaris is saying the IP is live but that IP is not pingable from outside

                                                     """"base IP and virtual IP""""

( # ping 192.168.253.254
192.168.253.254 is alive

# ping 192.168.253.250
192.168.253.254 is alive

)

                                                               """"main.cf file""""

bash-3.00# cat /etc/VRTSvcs/conf/config/main.cf

include "OracleASMTypes.cf"

include "types.cf"

include "Db2udbTypes.cf"

include "OracleTypes.cf"

include "SybaseTypes.cf"

 

cluster CLUSTERA (

        UserNames = { admin = bIJbIDiFJeJJhRJdIG }

        Administrators = { admin }

        )

 

system solaris (

        )

 

group CLUSTERA-SG (

        SystemList = { solaris = 0 }

        )

 

        IPMultiNIC IPMnic (

                Address = "192.168.253.250"

                NetMask = "255.255.0.0"

                MultiNICResName = MultiNIC

                )

 

        MultiNICA MultiNIC (

                Device @solaris = { bge0 = "192.168.253.254",

                         qfe0 = "192.168.253.254" }

                NetMask = "255.255.0.0"

                NetworkHosts = { "192.168.253.1" }

                )

 

        IPMnic requires MultiNIC

 

 

        // resource dependency tree

        //

        //      group CLUSTERA-SG

        //      {

        //      IPMultiNIC IPMnic

        //          {

        //          MultiNICA MultiNIC

        //          }

        //      }

                                                           """"ifconfig -a""""
 

# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
qfe0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 52
        inet 0.0.0.0 netmask ff000000
        ether 8:0:20:ea:2:2c
qfe1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 47
        inet 192.168.253.240 netmask ffff0000 broadcast 192.168.255.255
        ether 8:0:20:ea:2:2d
bge0: flags=1000803<UP,BROADCAST,MULTICAST,IPv4> mtu 1500 index 51
        inet 192.168.253.254 netmask ffff0000 broadcast 192.168.255.255
        ether 0:3:ba:78:61:75
bge0:1: flags=1000803<UP,BROADCAST,MULTICAST,IPv4> mtu 1500 index 51
        inet 192.168.253.250 netmask ffff0000 broadcast 192.168.255.255
 

The base and virtual ip got stuck with bge0 and did not failover

From the VCS 6.0 Bundled Agents reference guide

http://www.symantec.com/business/support/resources/sites/BUSINESS/content/live/DOCUMENTATION/5000/DOC5233/en_US/vcs_bundled_agents_60_sol.pdf

----------
MultiNICA notes
[...]
The MultiNICA agent supports only one active interface on one IP subnet; the agent does not work with multiple active interfaces on the same subnet.

On Solaris, for example, you have two active NICs, hme0 (10.128.2.5) and qfe0 (10.128.2.8). You configure a third NIC, qfe1, as the backup NIC to hme0. The agent does not fail over from hme0 to qfe1 because all ping tests are redirected through qfe0 on the same subnet. The redirect makes the MultiNICA monitor return an online status. Note that using ping -i does not enable the use of multiple active NICs.
[...]
----------

in your ifconfig output, you still have qfe1 configured on the same subnet - so the ping tests are going through this interface, so it doesn't think the multinic group (bge/qfe0) is offline

qfe1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 47
        inet 192.168.253.240 netmask ffff0000 broadcast 192.168.255.255
        ether 8:0:20:ea:2:2d

What may be the suggested subnet in this scererio ?

???????????

If you actually read the document, it's saying don't put other interfaces (not in the MultiNIC group) on the same subnet.

So, take qfe1 down, or give it another IP address on another subnet (ie: not 192.168.253.x), so MultiNIC can manage qfe0, bge0 properly

As in earlier post "VCS will ping out to check network" and as Grace as says, VCS things MulitNIC is up, because it can ping 192.168.253.1 (via qfe1)  Not sure what you mean by  "What may be the suggested subnet in this scererio ?"  Why do you need 2 networks on the same subnet.

Another thing is that you may want to configure "IfconfigTwice" as without this, many routers will not get the new mac address of the IP when IP fails over, which stops you being able to ping from outside.

Mike

Resource faulted. After a while base ip + virtual ip failed over to qfe0

bash-3.00# ifconfig -a

lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1

        inet 127.0.0.1 netmask ff000000

qfe0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 54

        inet 192.168.253.254 netmask ffff0000 broadcast 192.168.255.255

        ether 8:0:20:ea:2:2c

qfe0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 54

        inet 192.168.253.250 netmask ffff0000 broadcast 192.168.255.255

qfe1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 47

        inet 10.0.0.1 netmask ff000000 broadcast 10.255.255.255

        ether 8:0:20:ea:2:2d

==========

I have to plumb the bge0. Its not in the ifconfig -a result after failed over

So is it all working now?

From what I can remember (it has been a long time since I have used MultiNICA as most customers use MultiNICB), it is normal for unused interface to be unplumbed.

Mike

No mike. See my above last post please