cancel
Showing results for 
Search instead for 
Did you mean: 

Replication showing behind and disconnected but connectivity establish between Primary and DR

Zahid_Haseeb
Moderator
Moderator
Partner    VIP    Accredited

Environment

SFHA/DR (Global Cluster)  = 6.1

OS = RHEL 6.3

 

Query

In the first picture replication got DC, in the second picture vrstat showing 0.00 Kbps. This seems that the connectivity between both sites got disconnected. But at the same time in the third picture I am able to ping both sites.

BandwidthShows 00.png

Furthermore I am getting the below messages under /var/log/messages.

[root@NODE-2 ~]# tail -f /var/log/messages
Mar 12 17:46:56 NODE-2 kernel: VxVM VVR vxio V-5-0-1930 Enabled Secondary Logging on RVG APP-RVG
Mar 12 17:46:56 NODE-2 kernel:
Mar 12 17:46:56 NODE-2 kernel: VxVM VVR vxio V-5-0-1929 Enabled Bulk Transfer on RVG APP-RVG
Mar 12 17:46:56 NODE-2 kernel:
Mar 12 17:46:59 NODE-2 xinetd[10835]: START: hostlen pid=18511 from=::ffff:192.168.2.199
Mar 12 17:47:05 NODE-2 xinetd[10835]: START: hostlen pid=18532 from=::ffff:192.168.172.2
Mar 12 17:47:07 NODE-2 kernel: VxVM VVR vxio V-5-0-1404 Heartbeat unacknowledged from node 172.16.203.2 for 8 seconds
Mar 12 17:47:15 NODE-2 xinetd[10835]: START: hostlen pid=18550 from=::ffff:192.168.166.2
Mar 12 17:47:18 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=22842 duration=26118(sec)
Mar 12 17:47:38 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=29497 duration=4495(sec)








Mar 12 17:48:32 NODE-2 xinetd[10835]: START: hostlen pid=19197 from=::ffff:192.168.135.2
Mar 12 17:48:38 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=707 duration=10520(sec)
Mar 12 17:48:59 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=14757 duration=34793(sec)
Mar 12 17:49:08 NODE-2 xinetd[10835]: START: atmlen pid=19270 from=::ffff:192.168.230.5
Mar 12 17:49:08 NODE-2 xinetd[10835]: EXIT: atmlen status=255 pid=19270 duration=0(sec)
Mar 12 17:49:11 NODE-2 xinetd[10835]: EXIT: atmlen status=255 pid=1235 duration=17128(sec)
Mar 12 17:49:12 NODE-2 xinetd[10835]: EXIT: atmlen status=255 pid=11077 duration=83480(sec)
Mar 12 17:49:16 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=15574 duration=722(sec)
Mar 12 17:49:34 NODE-2 xinetd[10835]: START: hostlen pid=19436 from=::ffff:192.168.50.34
Mar 12 17:49:35 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=6254 duration=2753(sec)
Mar 12 17:50:05 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=7322 duration=29596(sec)
Mar 12 17:51:21 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=23141 duration=33181(sec)
Mar 12 17:51:35 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=18532 duration=270(sec)
Mar 12 17:51:39 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=20062 duration=33834(sec)
Mar 12 17:52:57 NODE-2 xinetd[10835]: START: hostlen pid=20359 from=::ffff:10.69.216.2
Mar 12 17:53:14 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=18550 duration=359(sec)
Mar 12 17:53:36 NODE-2 xinetd[10835]: START: hostlen pid=20498 from=::ffff:192.168.172.2
Mar 12 17:54:10 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=23433 duration=33286(sec)
Mar 12 17:54:16 NODE-2 xinetd[10835]: START: atmlen pid=20628 from=::ffff:192.168.158.5
Mar 12 17:54:40 NODE-2 xinetd[10835]: START: hostlen pid=20746 from=::ffff:192.168.171.2
Mar 12 17:55:05 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=28326 duration=32240(sec)
Mar 12 17:56:32 NODE-2 xinetd[10835]: START: atmlen pid=21068 from=::ffff:192.168.244.69
Mar 12 17:56:32 NODE-2 xinetd[10835]: EXIT: atmlen status=255 pid=21068 duration=0(sec)
Mar 12 17:56:37 NODE-2 kernel: VxVM VVR vxio V-5-0-267 Rlink rlk_172.16.203.2_APP-RVG disconnecting due to ack timeout on update message
Mar 12 17:56:37 NODE-2 kernel: VxVM VVR vxio V-5-0-266 Rlink rlk_172.16.203.2_APP-RVG disconnected from remote

Mar 12 17:56:38 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=21259 duration=33861(sec)
Mar 12 17:56:38 NODE-2 kernel: VxVM VVR vxio V-5-0-1851 Compression is not enabled for rlink rlk_172.16.203.2_APP-RVG
Mar 12 17:56:38 NODE-2 kernel: VxVM VVR vxio V-5-0-1448 'Disable Checksum' feature is off completely
Mar 12 17:56:38 NODE-2 kernel: VxVM VVR vxio V-5-0-265 Rlink rlk_172.16.203.2_APP-RVG connected to remote
Mar 12 17:56:38 NODE-2 kernel: VxVM VVR vxio V-5-0-1930 Enabled Secondary Logging on RVG APP-RVG
Mar 12 17:56:38 NODE-2 kernel:
Mar 12 17:56:38 NODE-2 kernel: VxVM VVR vxio V-5-0-1929 Enabled Bulk Transfer on RVG APP-RVG
Mar 12 17:56:38 NODE-2 kernel:
Mar 12 17:56:38 NODE-2 kernel: VxVM VVR vxio V-5-0-1019 Disconnecting rlink rlk_172.16.203.2_APP-RVG to reconnect from new position
Mar 12 17:56:39 NODE-2 xinetd[10835]: START: atmlen pid=21094 from=::ffff:192.168.244.69
Mar 12 17:56:39 NODE-2 kernel: VxVM VVR vxio V-5-0-266 Rlink rlk_172.16.203.2_APP-RVG disconnected from remote
Mar 12 17:56:40 NODE-2 kernel: VxVM VVR vxio V-5-0-1851 Compression is not enabled for rlink rlk_172.16.203.2_APP-RVG
Mar 12 17:56:40 NODE-2 kernel: VxVM VVR vxio V-5-0-1448 'Disable Checksum' feature is off completely
Mar 12 17:56:40 NODE-2 kernel: VxVM VVR vxio V-5-0-265 Rlink rlk_172.16.203.2_APP-RVG connected to remote
Mar 12 17:56:40 NODE-2 kernel: VxVM VVR vxio V-5-0-1930 Enabled Secondary Logging on RVG APP-RVG
Mar 12 17:56:40 NODE-2 kernel:
Mar 12 17:56:40 NODE-2 kernel: VxVM VVR vxio V-5-0-1929 Enabled Bulk Transfer on RVG APP-RVG
Mar 12 17:56:40 NODE-2 kernel:
Mar 12 17:56:59 NODE-2 xinetd[10835]: EXIT: hostlen status=255 pid=27081 duration=19027(sec)
 

1 REPLY 1

Zahid_Haseeb
Moderator
Moderator
Partner    VIP    Accredited

I am able to fix it after decreasing the packet size from default to 1500. But this time keep monitoring.