setting llt (low prio net) in a bond configured in a bridge
Hi,
I want to set a low prio network over a bond which is part of a bridge. I have a cluster with two nodes.
This is the network configuration (it is the same for both nodes):
node 2:
[root@node2 ]# cat /proc/version
Linux version 2.6.32-504.el6.x86_64 (mockbuild@x86-023.build.eng.bos.redhat.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Tue Sep 16 01:56:35 EDT 2014
[root@node2 ]# ifconfig | head -n 24
bond0 Link encap:Ethernet HWaddr 52:54:00:14:13:21
inet6 addr: fe80::5054:ff:fe14:1321/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:761626 errors:0 dropped:0 overruns:0 frame:0
TX packets:605968 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:1188025449 (1.1 GiB) TX bytes:582093867 (555.1 MiB)br0 Link encap:Ethernet HWaddr 52:54:00:14:13:21
inet addr:10.10.11.102 Bcast:10.10.11.255 Mask:255.255.255.0
inet6 addr: fe80::5054:ff:fe14:1321/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:49678 errors:0 dropped:0 overruns:0 frame:0
TX packets:50264 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:44061727 (42.0 MiB) TX bytes:28800387 (27.4 MiB)eth0 Link encap:Ethernet HWaddr 52:54:00:14:13:21
UP BROADCAST RUNNING PROMISC SLAVE MULTICAST MTU:1500 Metric:1
RX packets:761626 errors:0 dropped:0 overruns:0 frame:0
TX packets:605968 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1188025449 (1.1 GiB) TX bytes:582093867 (555.1 MiB)
[root@node2 ]# brctl show
bridge name bridge id STP enabled interfaces
br0 8000.525400141321 no bond0[root@node2 ]# cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v3.6.0 (September 26, 2009)Bonding Mode: fault-tolerance (active-backup)
Primary Slave: None
Currently Active Slave: eth0
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: 52:54:00:14:13:21
Slave queue ID: 0
node 1:
[root@node1]# ifconfig | head -n 24
bond0 Link encap:Ethernet HWaddr 52:54:00:2E:6D:23
inet6 addr: fe80::5054:ff:fe2e:6d23/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:816219 errors:0 dropped:0 overruns:0 frame:0
TX packets:668207 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:1194971130 (1.1 GiB) TX bytes:607831273 (579.6 MiB)br0 Link encap:Ethernet HWaddr 52:54:00:2E:6D:23
inet addr:10.10.11.101 Bcast:10.10.11.255 Mask:255.255.255.0
inet6 addr: fe80::5054:ff:fe2e:6d23/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:813068 errors:0 dropped:0 overruns:0 frame:0
TX packets:640374 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:1181039350 (1.0 GiB) TX bytes:604216197 (576.2 MiB)eth0 Link encap:Ethernet HWaddr 52:54:00:2E:6D:23
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:816219 errors:0 dropped:0 overruns:0 frame:0
TX packets:668207 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1194971130 (1.1 GiB) TX bytes:607831273 (579.6 MiB)[root@node1]# brctl show
bridge name bridge id STP enabled interfaces
br0 8000.5254002e6d23 no bond0[root@node1 ]# cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v3.6.0 (September 26, 2009)Bonding Mode: fault-tolerance (active-backup)
Primary Slave: None
Currently Active Slave: eth0
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: 52:54:00:2e:6d:23
Slave queue ID: 0
the llt configuration files are the following:
[root@node1 ]# cat /etc/llttab
set-node node2
set-cluster 1042
link eth3 eth3-52:54:00:c3:a0:55 - ether - -
link eth2 eth2-52:54:00:35:f6:a5 - ether - -link-lowpri bond0 bond0 - ether - -
[root@node1 ]# cat /etc/llttab
set-node node1
set-cluster 1042
link eth3 eth3-52:54:00:bc:9b:e5 - ether - -
link eth2 eth2-52:54:00:31:fb:31 - ether - -link-lowpri bond0 bond0 - ether - -
However this seems that is not working. When I check the llt status, the node thinks the interface is down in the other one.
[root@node2 ]# lltstat -nvv | head
LLT node information:
Node State Link Status Address
0 node1 OPEN
eth3 UP 52:54:00:BC:9B:E5
eth2 UP 52:54:00:31:FB:31
bond0 DOWN
* 1 node2 OPEN
eth3 UP 52:54:00:C3:A0:55
eth2 UP 52:54:00:35:F6:A5
bond0 UP 52:54:00:14:13:21
[root@node2 ]# lltstat -nvv | head
LLT node information:
Node State Link Status Address
* 0 node1 OPEN
eth3 UP 52:54:00:BC:9B:E5
eth2 UP 52:54:00:31:FB:31
bond0 UP 52:54:00:2E:6D:23
1 node2 OPEN
eth3 UP 52:54:00:C3:A0:55
eth2 UP 52:54:00:35:F6:A5
bond0 DOWN
Do you know if I have something worng?
Is this a valid configuration?
Thanks,
Javier