HI Guys, I am configuring the replication with our 2 node cluster using cluster. but when adding the node is giving the error. i am not able to get proper logs also in engine.log and RVG.log. please help. [root@AOSCEDA01 ~]# vradmin -g jceda_dg addsec jceda_rvg AOSCEDA01 AOSCEDA02 prlink=to_AOSCEDA01 srlink=to_AOSCEDA02 VxVM VVR vradmin ERROR V-5-52-417 RVG jceda_rvg already exists in disk group jceda_dg. VxVM VVR vradmin ERROR V-5-52-802 Cannot start command execution on Secondary. [root@AOSCEDA01 ~]#

I don't know why config is still messed up, so I would re-create: vradmin -g jceda_dg delsec jceda_rvg vradmin -g jceda_dg delpri jceda_rvg (may need -f) vradmin -g jceda_dg createpri jceda_rvg lvol01,lvol2 Lvol_SRL vradmin -g jceda_dg addsec jceda_rvg AOSCEDA01 AOSCEDA02 prlink=to_AOSCEDA02 srlink=to_AOSCEDA01 vradmin -g jceda_dg -a startrep jceda_rvg It may also be worth making sure AOSCEDA01 and AOSCEDA02 resolve on both hosts by adding to DNS or local hosts file on both hosts. Mike

VVR Replication configuration

Gaurav_S
Moderator
10 years ago
Hi,

It seems like command is already executed once & objects are existing .. What is the SF version you are using on both the nodes ? OS version ?

Can you paste a vxprint output from both the sites ..

Primary # vxprint -qthg jceda_dg

Secondary# vxprint -qthg jceda_dg

Primary # vxprint -Pl

Secondary# vxprint -Pl

Primary# vxprint -g jceda_dg -l printrvg

Secondary# vxprint -g jceda_dg -l printrvg

Primary# vxprint -g jceda_dg -l repstatus jceda_rvg
lazaur
Level 4
10 years ago
Hi Gaurav,

Please fins the output.

[root@AOSCEDA01 ~]# vxprint -qthg jceda_dg
dg jceda_dg     default      default 25000    1437551934.10.AOSCEDA01.DTP.AE

dm jvl01        disk_0       auto     65536    104788368 -
dm jvl02        disk_1       auto     65536    209639920 -
dm jvl03        disk_2       auto     65536    104788368 -

rl rlinkA       -            DETACHED UNASSOC AOSCEDA01 jceda_dg rlinkB
rl rlinkB       -            DETACHED UNASSOC AOSCEDA02 jceda_dg rlinkA

rv jceda_rvg    0            ENABLED ACTIVE   primary 2         Lvol_SRL
v lvol01       jceda_rvg    ENABLED ACTIVE   104857600 SELECT   -        fsgen
pl lvol01-01    lvol01       ENABLED ACTIVE   104857600 CONCAT   -        RW
sd jvl02-01     lvol01-01    jvl02    0        104857600 0        disk_1   ENA
pl lvol01-02    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-03     lvol01-02    jvl02    209574720 512     LOG       disk_1   ENA
pl lvol01-03    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-02     lvol01-03    jvl03    10485760 512      LOG       disk_2   ENA
v lvol02       jceda_rvg    ENABLED ACTIVE   209505488 SELECT   -        fsgen
pl lvol02-01    lvol02       ENABLED ACTIVE   209505488 CONCAT   -        RW
sd jvl01-01     lvol02-01    jvl01    0        104788368 0        disk_0   ENA
sd jvl02-02     lvol02-01    jvl02    104857600 104717120 104788368 disk_1 ENA
pl lvol02-02    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-04     lvol02-02    jvl02    209575232 512     LOG       disk_1   ENA
pl lvol02-03    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-03     lvol02-03    jvl03    10486272 512      LOG       disk_2   ENA
v Lvol_SRL     jceda_rvg    ENABLED ACTIVE   10485760 SELECT    -        SRL
pl Lvol_SRL-01 Lvol_SRL     ENABLED ACTIVE   10485760 CONCAT    -        RW
sd jvl03-01     Lvol_SRL-01 jvl03    0        10485760 0         disk_2   ENA
[root@AOSCEDA01 ~]#

[root@AOSCEDA02 /]# vxprint -qthg jceda_dg
dg jceda_dg     default      default 18000    1437914284.6.AOSCEDA02.DTP.AE

dm jvl01        disk_1       auto     65536    104788368 -
dm jvl02        disk_2       auto     65536    209639920 -
dm jvl03        disk_3       auto     65536    104788368 -

rv jceda_rvg    0            ENABLED ACTIVE   primary 2         Lvol_SRL
v lvol01       jceda_rvg    ENABLED ACTIVE   104857600 SELECT   -        fsgen
pl lvol01-01    lvol01       ENABLED ACTIVE   104857600 CONCAT   -        RW
sd jvl02-01     lvol01-01    jvl02    0        104857600 0        disk_2   ENA
pl lvol01-02    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-04     lvol01-02    jvl02    207687792 512     LOG       disk_2   ENA
pl lvol01-03    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-03     lvol01-03    jvl03    10486272 512      LOG       disk_3   ENA
v lvol02       jceda_rvg    ENABLED ACTIVE   207618048 SELECT   -        fsgen
pl lvol02-01    lvol02       ENABLED ACTIVE   207618048 CONCAT   -        RW
sd jvl01-01     lvol02-01    jvl01    0        104788368 0        disk_1   ENA
sd jvl02-02     lvol02-01    jvl02    104857600 102829680 104788368 disk_2 ENA
pl lvol02-02    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-03     lvol02-02    jvl02    207687280 512     LOG       disk_2   ENA
pl lvol02-03    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-02     lvol02-03    jvl03    10485760 512      LOG       disk_3   ENA
v Lvol_SRL     jceda_rvg    ENABLED ACTIVE   10485760 SELECT    -        SRL
pl Lvol_SRL-01 Lvol_SRL     ENABLED ACTIVE   10485760 CONCAT    -        RW
sd jvl03-01     Lvol_SRL-01 jvl03    0        10485760 0         disk_3   ENA
You have new mail in /var/spool/mail/root
[root@AOSCEDA02 /]#

[root@AOSCEDA01 ~]# vxprint -Pl
Disk group: jceda_dg

Rlink:    rlinkA
info:     timeout=500 rid=0.1189
          latency_high_mark=10000 latency_low_mark=9950
          bandwidth_limit=none
state:    state=UNASSOC
          synchronous=off latencyprot=off srlprot=dcm
assoc:    rvg=(dissoc)
          remote_host=AOSCEDA01 IP_addr=192.168.0.170 port=
          remote_dg=jceda_dg
          remote_dg_dgid=
          remote_rvg_version=unknown
          remote_rlink=rlinkB
          remote_rlink_rid=0.0
          local_host=AOSCEDA01 IP_addr=192.168.0.170 port=4145
protocol: TCP/IP
flags:    write disabled detached inconsistent cant_sync disconnected

Rlink:    rlinkB
info:     timeout=500 rid=0.1186
          latency_high_mark=10000 latency_low_mark=9950
          bandwidth_limit=none
state:    state=UNASSOC
          synchronous=off latencyprot=off srlprot=dcm
assoc:    rvg=(dissoc)
          remote_host=AOSCEDA02 IP_addr=192.168.0.171 port=
          remote_dg=jceda_dg
          remote_dg_dgid=
          remote_rvg_version=unknown
          remote_rlink=rlinkA
          remote_rlink_rid=0.0
          local_host=AOSCEDA01 IP_addr=192.168.0.170 port=4145
protocol: TCP/IP
flags:    write disabled detached inconsistent cant_sync disconnected

You have new mail in /var/spool/mail/root
[root@AOSCEDA01 ~]#

nothing display on secondry site

[root@AOSCEDA02 /]# vxprint -Pl
[root@AOSCEDA02 /]#

[root@AOSCEDA01 ~]# vxprint -g jceda_dg -l printrvg
VxVM vxprint ERROR V-5-1-924 Record printrvg not found
[root@AOSCEDA01 ~]#

[root@AOSCEDA02 /]# vxprint -g jceda_dg -l printrvg
VxVM vxprint ERROR V-5-1-924 Record printrvg not found
[root@AOSCEDA02 /]#

[root@AOSCEDA01 ~]# vxprint -g jceda_dg -l repstatus jceda_rvg
VxVM vxprint ERROR V-5-1-924 Record repstatus not found
Rvg:      jceda_rvg
info:     rid=0.1168 version=3 rvg_version=45 last_tag=2
state:    state=ACTIVE kernel=ENABLED
assoc:    datavols=lvol01,lvol02
          srl=Lvol_SRL
          rlinks=(none)
          exports=(none)
          vsets=(none)
att:      rlinks=(none)
flags:    closed primary enabled attached
device:   minor=25003 bdev=199/25003 cdev=199/25003 path=/dev/vx/dsk/jceda_dg/jceda_rvg
perms:    user=root group=root mode=0600

[root@AOSCEDA01 ~]#

[root@AOSCEDA02 /]# vxprint -g jceda_dg -l repstatus jceda_rvg
VxVM vxprint ERROR V-5-1-924 Record repstatus not found
Rvg:      jceda_rvg
info:     rid=0.1099 version=3 rvg_version=45 last_tag=2
state:    state=ACTIVE kernel=ENABLED
assoc:    datavols=lvol01,lvol02
          srl=Lvol_SRL
          rlinks=(none)
          exports=(none)
          vsets=(none)
att:      rlinks=(none)
flags:    closed primary enabled attached
device:   minor=18003 bdev=199/18003 cdev=199/18003 path=/dev/vx/dsk/jceda_dg/jceda_rvg
perms:    user=root group=root mode=0600

[root@AOSCEDA02 /]#
lazaur
Level 4
10 years ago
hi Gaurav,

Please find the out put.

[root@AOSCEDA01 jceda]# vxprint -qthg jceda_dg
dg jceda_dg     default      default 25000    1437551934.10.AOSCEDA01.DTP.AE

dm jvl01        disk_0       auto     65536    104788368 -
dm jvl02        disk_1       auto     65536    209639920 -
dm jvl03        disk_2       auto     65536    104788368 -

rl rlinkA       -            DETACHED UNASSOC AOSCEDA01 jceda_dg rlinkB
rl rlinkB       -            DETACHED UNASSOC AOSCEDA02 jceda_dg rlinkA

rv jceda_rvg    0            ENABLED ACTIVE   primary 2         Lvol_SRL
v lvol01       jceda_rvg    ENABLED ACTIVE   104857600 SELECT   -        fsgen
pl lvol01-01    lvol01       ENABLED ACTIVE   104857600 CONCAT   -        RW
sd jvl02-01     lvol01-01    jvl02    0        104857600 0        disk_1   ENA
pl lvol01-02    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-03     lvol01-02    jvl02    209574720 512     LOG       disk_1   ENA
pl lvol01-03    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-02     lvol01-03    jvl03    10485760 512      LOG       disk_2   ENA
v lvol02       jceda_rvg    ENABLED ACTIVE   209505488 SELECT   -        fsgen
pl lvol02-01    lvol02       ENABLED ACTIVE   209505488 CONCAT   -        RW
sd jvl01-01     lvol02-01    jvl01    0        104788368 0        disk_0   ENA
sd jvl02-02     lvol02-01    jvl02    104857600 104717120 104788368 disk_1 ENA
pl lvol02-02    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-04     lvol02-02    jvl02    209575232 512     LOG       disk_1   ENA
pl lvol02-03    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-03     lvol02-03    jvl03    10486272 512      LOG       disk_2   ENA
v Lvol_SRL     jceda_rvg    ENABLED ACTIVE   10485760 SELECT    -        SRL
pl Lvol_SRL-01 Lvol_SRL     ENABLED ACTIVE   10485760 CONCAT    -        RW
sd jvl03-01     Lvol_SRL-01 jvl03    0        10485760 0         disk_2   ENA
[root@AOSCEDA01 jceda]#

[root@AOSCEDA02 jceda]# vxprint -qthg jceda_dg
dg jceda_dg     default      default 18000    1437914284.6.AOSCEDA02.DTP.AE

dm jvl01        disk_1       auto     65536    104788368 -
dm jvl02        disk_2       auto     65536    209639920 -
dm jvl03        disk_3       auto     65536    104788368 -

rv jceda_rvg    0            ENABLED ACTIVE   primary 2         Lvol_SRL
v lvol01       jceda_rvg    ENABLED ACTIVE   104857600 SELECT   -        fsgen
pl lvol01-01    lvol01       ENABLED ACTIVE   104857600 CONCAT   -        RW
sd jvl02-01     lvol01-01    jvl02    0        104857600 0        disk_2   ENA
pl lvol01-02    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-04     lvol01-02    jvl02    207687792 512     LOG       disk_2   ENA
pl lvol01-03    lvol01       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-03     lvol01-03    jvl03    10486272 512      LOG       disk_3   ENA
v lvol02       jceda_rvg    ENABLED ACTIVE   207618048 SELECT   -        fsgen
pl lvol02-01    lvol02       ENABLED ACTIVE   207618048 CONCAT   -        RW
sd jvl01-01     lvol02-01    jvl01    0        104788368 0        disk_1   ENA
sd jvl02-02     lvol02-01    jvl02    104857600 102829680 104788368 disk_2 ENA
pl lvol02-02    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl02-03     lvol02-02    jvl02    207687280 512     LOG       disk_2   ENA
pl lvol02-03    lvol02       ENABLED ACTIVE   LOGONLY CONCAT    -        RW
sd jvl03-02     lvol02-03    jvl03    10485760 512      LOG       disk_3   ENA
v Lvol_SRL     jceda_rvg    ENABLED ACTIVE   10485760 SELECT    -        SRL
pl Lvol_SRL-01 Lvol_SRL     ENABLED ACTIVE   10485760 CONCAT    -        RW
sd jvl03-01     Lvol_SRL-01 jvl03    0        10485760 0         disk_3   ENA
[root@AOSCEDA02 jceda]#

[root@AOSCEDA01 jceda]# vxprint -Pl
Disk group: jceda_dg

Rlink:    rlinkA
info:     timeout=500 rid=0.1189
          latency_high_mark=10000 latency_low_mark=9950
          bandwidth_limit=none
state:    state=UNASSOC
          synchronous=off latencyprot=off srlprot=dcm
assoc:    rvg=(dissoc)
          remote_host=AOSCEDA01 IP_addr=192.168.0.170 port=
          remote_dg=jceda_dg
          remote_dg_dgid=
          remote_rvg_version=unknown
          remote_rlink=rlinkB
          remote_rlink_rid=0.0
          local_host=AOSCEDA01 IP_addr=192.168.0.170 port=4145
protocol: TCP/IP
flags:    write disabled detached inconsistent cant_sync disconnected

Rlink:    rlinkB
info:     timeout=500 rid=0.1186
          latency_high_mark=10000 latency_low_mark=9950
          bandwidth_limit=none
state:    state=UNASSOC
          synchronous=off latencyprot=off srlprot=dcm
assoc:    rvg=(dissoc)
          remote_host=AOSCEDA02 IP_addr=192.168.0.171 port=
          remote_dg=jceda_dg
          remote_dg_dgid=
          remote_rvg_version=unknown
          remote_rlink=rlinkA
          remote_rlink_rid=0.0
          local_host=AOSCEDA01 IP_addr=192.168.0.170 port=4145
protocol: TCP/IP
flags:    write disabled detached inconsistent cant_sync disconnected

[root@AOSCEDA01 jceda]#

[root@AOSCEDA02 jceda]# vxprint -Pl
[root@AOSCEDA02 jceda]#

[root@AOSCEDA01 jceda]# vxprint -g jceda_dg -l printrvg
VxVM vxprint ERROR V-5-1-924 Record printrvg not found
[root@AOSCEDA01 jceda]# vxprint -g jceda_dg -l repstatus jceda_rvg
VxVM vxprint ERROR V-5-1-924 Record repstatus not found
Rvg:      jceda_rvg
info:     rid=0.1168 version=3 rvg_version=45 last_tag=2
state:    state=ACTIVE kernel=ENABLED
assoc:    datavols=lvol01,lvol02
          srl=Lvol_SRL
          rlinks=(none)
          exports=(none)
          vsets=(none)
att:      rlinks=(none)
flags:    closed primary enabled attached
device:   minor=25003 bdev=199/25003 cdev=199/25003 path=/dev/vx/dsk/jceda_dg/jceda_rvg
perms:    user=root group=root mode=0600

[root@AOSCEDA01 jceda]#

[root@AOSCEDA02 jceda]# vxprint -g jceda_dg -l printrvg
VxVM vxprint ERROR V-5-1-924 Record printrvg not found
[root@AOSCEDA02 jceda]#
mikebounds
Level 6
10 years ago
You have an RVG on both sites, but only an rlink on site 01, therefore you either need to:

Create the rlink at site 02

OR

Remove the RVG at site 02 and the rlink at site01 so you can then run the vxrvg addsec (which adds rlink at both sites and RVG at secondary site).

Mike
mikebounds
Level 6
10 years ago
Having looked at your config some more, I can see it is in a mess as you have 2 rlinks (but only 1 RVG), both rlinks are disassociated and you have a primary RVG on both sites (yone should be a secondary RVG) so you need to clean up the config for which the following should work:

Node: AOSCEDA01

vxedit -g jceda_dg rm rlinkA vxedit -g jceda_dg rm rlinkB

Node: OSCEDA02

vradmin -g jceda_dg delpri jceda_rvg

Then re-run your addsec command:

vradmin -g jceda_dg addsec jceda_rvg AOSCEDA01 AOSCEDA02 prlink=to_AOSCEDA01 srlink=to_AOSCEDA02

Mike
Gaurav_S
Moderator
10 years ago
I agree with Mike, the setup looks like you don't have a rlink at secondary at all .. Look at below output as there is no "rl" object ....

root@AOSCEDA02 /]# vxprint -qthg jceda_dg
dg jceda_dg     default      default 18000    1437914284.6.AOSCEDA02.DTP.AE

dm jvl01        disk_1       auto     65536    104788368 -
dm jvl02        disk_2       auto     65536    209639920 -
dm jvl03        disk_3       auto     65536    104788368 -

rv jceda_rvg    0            ENABLED ACTIVE   primary 2         Lvol_SRL
v lvol01       jceda_rvg    ENABLED ACTIVE   104857600 SELECT   -        fsgen
pl lvol01-01    lvol01       ENABLED ACTIVE   104857600 CONCAT   -        RW
sd jvl02-01     lvol01-01    jvl02    0        104857600 0        disk_2   ENA

While your primary has 2 rl objects meaning 2 rlinks however both are not part of RVG .. basically on primary you are missing an associated rlink from primary to secondary while on secondary you are missing with rlink itself.

Let us know how above suggested commands go through ...
lazaur
Level 4
10 years ago
Hi Mike,

i am getting below error now.

[root@AOSCEDA01 test]# vradmin -g jceda_dg addsec jceda_rvg AOSCEDA01 AOSCEDA02 prlink=to_AOSCEDA01 srlink=to_AOSCEDA02
Message from Host AOSCEDA02:
VxVM VVR vradmin ERROR V-5-52-422 Primary disk group 1437551934.10.AOSCEDA01.DTP.AE is not authenticated.
VxVM VVR vradmin ERROR V-5-52-802 Cannot start command execution on Secondary.
[root@AOSCEDA01 test]#

[root@AOSCEDA01 test]# cat /etc/vx/vras/.rdg
1437551934.10.AOSCEDA01.DTP.AE
[root@AOSCEDA01 test]# vxprint -l jceda_dg | grep dgid
info: dgid=1437551934.10.AOSCEDA01.DTP.AE noautoimport
[root@AOSCEDA01 test]#

[root@AOSCEDA02 ~]# cat /etc/vx/vras/.rdg
1437914284.6.AOSCEDA02.DTP.AE
[root@AOSCEDA02 ~]# vxprint -l jceda_dg | grep dgid
info: dgid=1437914284.6.AOSCEDA02.DTP.AE noautoimport
[root@AOSCEDA02 ~]#

suggest me rdg configuration is correct
Gaurav_S
Moderator
10 years ago
you are missing with diskgroup authentication as well ..

Find out the diskgroup ID using "vxdg list <diskgroup>" command & add it to below file on secondary

/etc/vx/vras/.rdg

For e.g

# vxdg list
NAME STATE ID
rootdg enabled 730344554.1025.tweety
newdg enabled 731118794.1213.tweety

Add this ID to /etc/vx/vras/.rdg file on secondary host

Same way, find diskgroup ID on secondary machine using same command & add the ID on same file on primary machine. This is required if you switch the roles later where secondary node becomes primary while primary becomes secondary.

G
mikebounds
Level 6
10 years ago
You need to add "1437551934.10.AOSCEDA01.DTP.AE" to /etc/vx/vras/.rdg on node AOSCEDA02 (or you can add a "+" to allow or nodes to create RVG objects.

Mike
lazaur
Level 4
10 years ago
Hi Gaurav/Mike,

I am new to VVR so please guide me i can do the reconfiguration.

Forum Discussion

VVR Replication configuration

Related Content

How to check VVR replication status

need to fix vvr replication

vvr primary -primary configuration error

VVR - Replication via Heartbeat

MySql Replication with VVR