Global Cluster, can you verify my config - setup - architecture ?

Question

I&nbsp;need to build a Disaster Recovery using Veritas Cluster and VVR. I&nbsp;need to have HA&nbsp;on Oracle 10g and Tomcat. This should be cheap as possible. This is not so data-intensive application.
This would be only 2 servers setup. I will have 2 clusters. Each with 1 server. I will use local disks. Then there will be replication between and having a Global cluster.
This are the only 2 servers on network with no domain or DNS. So one of these servers should be DNS&nbsp;and Domain. I&nbsp;think the backup server should be domain and DNS server. Is this OKay ?&nbsp;Or the domain server should be on third server or both servers ?&nbsp;Isn't this (domain and DNS) a single point of failure ? I&nbsp;am not sure how to setup this.
I&nbsp;will use 5.1 VCS HA with VVR on Windows 2003 R2 SE. Any help or idea appreciated.

wally_heim · Accepted Answer

If you are concerned with loosing 1 site enirely then you should have domain controllers avaialable at each site. Having doman controllers at each site is good if you loose communications completely between the sites. The DC at both sites will ensure that site is usable even without access to anything from the other site.

-Wally

-Wally

wally_heim · Answer

Hi Hraju,

Ideally, the domain features should be on nodes not in the cluster.&nbsp; I'm not sure if Oracle has a problem running on domain controller but I have seen issues with MSDTC when used on domain controllers in a cluster.&nbsp; I'm also not sure if you are going to use MSDTC in your configuration or not.

You need to be aware that you may run into problems with using local storage.&nbsp; If you have internal RAID&nbsp;controllers they may not allow the correct SCSI commands to the disks to allow the cluster to control them correctly.&nbsp; I would suggest running the following test to see if you will have problems.

1. Create&nbsp; a clustered disk group with the internal disk(s)&nbsp; (they have to different physical disks than what is used by the OS - system and boot disks.)
2.&nbsp; Deport the clustered disk group.
3.&nbsp; Import the clustered disk group.

If you can create it, deport and import it again without errors then you will be fine.&nbsp; If not you will need to contact Technical Support to see if there is something that they can do for you.&nbsp;

If you just have a problem creating the disk group, you may simply need to run the following command:&nbsp;

&nbsp;&nbsp; vxclus usesystembus on
This will allow you to create clustered disk groups on the same bus that the system and boot disks are on.

You might also be able to get around the use of a Domain all together.&nbsp; The cluster can be configured manually without the wizards or domain.&nbsp; However, you should contact your sale rep to talk to them about a support exception to maintain a supported configuration without a domain and to get the steps needed to configure it.

Thanks,
Wally

&nbsp;

hraju · Answer

Thank you Wally for answer.

I will test internall raid controller as you suggested.&nbsp; I will not use MSDTC. But I am still not sure, if I&nbsp;should use domain controller on both Global cluster sites or only on one.

hraju · Answer

Wally,

So as you said, my configuration is not working when I&nbsp;create clustered Disk Group. When I deport and import it as cluster&nbsp;DG. It is failing. I already created support case.
I have IBM x3650 with eight internal SAS disks. I created 3 RAIDed disks in bios:
1) 2disks mirrored
2) 4disks in RAID5
3) 2disks mirrored

Do you think that I should not use RAID at all ?

I use Veritas Storage Foundation HA 5.1 with latest upgrade with "vxclus usesystembus on".
I have one primary Disk Group with boot disk. Then I want to create clustered Disk Group with rest of the disks. 
Creating Clustered DG raise this error:
V-76-58645-542 Unable to reserve a majority of dynamic disks group members. Failed to start SCSI reservation thread.
Importing DG as clustered raise this error:
V-76-58645-585 Failed to reserve the majority of disks

I tried "vxclus enable -gClusterDG -p", "vxassist rescan", "vxassist refresh", "vxassist resetbus" with no avail.

C:\Documents and Settings\Administrator.MERKUR&gt;vxdisk list
Name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MediaName&nbsp;&nbsp; Diskgroup&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DiskStyle&nbsp; Size(MB)&nbsp;&nbsp; FreeSpace(M
B)&nbsp;&nbsp;&nbsp;&nbsp; Status&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; EnclosureID&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P#C#T#L#&nbsp; ProvisionType&nbsp; ProvisionedSize Ser
ialNumber&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; VDID
Harddisk0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Disk1&nbsp;&nbsp;&nbsp; BasicDG&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MBR&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 285145&nbsp;&nbsp;&nbsp;&nbsp; 245148
Imported&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DISKS@S&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P4C1T0L0 -&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 600605B00177FDF012A7C27C84290582
Harddisk1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Disk1&nbsp;&nbsp;&nbsp; ClusterDG&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; GPT&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 855315&nbsp;&nbsp;&nbsp;&nbsp; 855315
Offline&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DISKS@S&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P4C1T1L0 -&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 600605B00177FDF012A7C27C8431F30A
Harddisk2&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Disk2&nbsp;&nbsp;&nbsp; ClusterDG&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; GPT&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 285019&nbsp;&nbsp;&nbsp;&nbsp; 285019
Offline&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DISKS@S&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P4C1T2L0 -&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 600605B00177FDF012A7C27E8443914D

C:\Documents and Settings\Administrator.MERKUR&gt;vxdisk diskinfo Harddisk0
Disk information
&nbsp;&nbsp;&nbsp; Device Name :&nbsp;&nbsp; Harddisk0
&nbsp;&nbsp;&nbsp; Media Name&nbsp; :&nbsp;&nbsp; Disk1
&nbsp;&nbsp;&nbsp; Disk Group&nbsp; :&nbsp;&nbsp; BasicDG
&nbsp;&nbsp;&nbsp; Disk Style&nbsp; :&nbsp;&nbsp; MBR
&nbsp;&nbsp;&nbsp; Length&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; 298997121024
&nbsp;&nbsp;&nbsp; FreeSpace&nbsp;&nbsp; :&nbsp;&nbsp; 257056418304
&nbsp;&nbsp;&nbsp; BusType&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; 0
&nbsp;&nbsp;&nbsp; EnclosureId :&nbsp;&nbsp; DISKS@S
&nbsp;&nbsp;&nbsp; Port&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; 4
&nbsp;&nbsp;&nbsp; Target&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; 0
&nbsp;&nbsp;&nbsp; Channel&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; 1
&nbsp;&nbsp;&nbsp; LUN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; 0
&nbsp;&nbsp;&nbsp; Signature&nbsp;&nbsp; :&nbsp;&nbsp; 2285879348
&nbsp;&nbsp;&nbsp; Status&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; Imported
&nbsp;&nbsp;&nbsp; Serial Number:
&nbsp;&nbsp;&nbsp; Vendor ID&nbsp;&nbsp; :&nbsp;&nbsp; IBM
&nbsp;&nbsp;&nbsp; Product ID&nbsp; :&nbsp;&nbsp; ServeRAID-MR10i
&nbsp;&nbsp;&nbsp; Adapter&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; RAID Controller
&nbsp;&nbsp;&nbsp; Comment&nbsp;&nbsp;&nbsp;&nbsp; :
&nbsp;&nbsp;&nbsp; Spare&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; No
&nbsp;&nbsp;&nbsp; Reserved&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; No
&nbsp;&nbsp;&nbsp; Hot Use&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; Yes
&nbsp;&nbsp;&nbsp; Write Cache Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; No
&nbsp;&nbsp;&nbsp; SCSI-3 Reserved&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp; No
&nbsp;&nbsp;&nbsp; Track Alignment
&nbsp;&nbsp;&nbsp; VID/PID&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp;&nbsp; Default/Default
&nbsp;&nbsp;&nbsp; Track Alignment Offset&nbsp;&nbsp; :&nbsp;&nbsp;&nbsp; 64
&nbsp;&nbsp;&nbsp; Track Alignment Setting&nbsp; :&nbsp;&nbsp;&nbsp; Disable
&nbsp;&nbsp;&nbsp; Thin Provisioning
&nbsp;&nbsp;&nbsp; Provision Type&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp;&nbsp; -
&nbsp;&nbsp;&nbsp; Provisioned Size&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp;&nbsp; -
&nbsp;&nbsp;&nbsp; Allocation Unit&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :&nbsp;&nbsp;&nbsp; -
&nbsp;&nbsp;&nbsp; Veritas Disk ID (VDID)&nbsp;&nbsp; :&nbsp;&nbsp;&nbsp; 600605B00177FDF012A7C27C84290582
&nbsp;&nbsp;&nbsp; Subdisks
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Disk1-01

wally_heim · Answer

Hi hraju,

Sorry for not getting back to you sooner.&nbsp; I'm not sure if you are still having this issue or not.

Using internal disks with a RAID controller can be problematic as some RAID&nbsp;controllers do not fully support all SCSI commands (like reservations)&nbsp;to the physical disks.&nbsp; I'm guessing that your RAID controller is one that does not allow SCSI&nbsp;reservation commands and thus causing problems with importing the clustered disk group.

You can do basically two items to resolve this.

1.&nbsp; Replace the RAID&nbsp;controller with&nbsp;a RAID&nbsp;controller or SCSI&nbsp;controller&nbsp;that does support SCSI-2 reservations.
2.&nbsp; Contact Technical Support to see if a patch is available for the version of the product that you are running to by-pass the SCSI-2 reservation requirement.&nbsp; I think there maybe a patch available but it might be limited as to which versions of the product it is for.

Thanks,
Wally

hraju · Answer

Hello,

Thank you for reply. I needed it asap, so I&nbsp;decided to make my solution this way (if youre interested):
I created cluster from two servers with internal disks. Then I created new service group from Oracle template. I deleted MountV and VMDg (I dont mount volume) and added one script, that take care of replication migration/takeover (depends on what is possible). This is how the script look like:

set ERRORLEVEL=
echo date: %date% &gt;&gt;C:\script\log.log
echo time: %time% &gt;&gt;C:\script\log.log
:: check if P is primary RVG - replication source
vxrlink status Prlink &gt;&gt;C:\script\log.log
if ERRORLEVEL 0 GOTO END
ping 192.168.110.20 -n 1
if ERRORLEVEL 0 GOTO MIGRATE
if ERRORLEVEL 1 GOTO TAKEOVER

:MIGRATE
echo "I see secondary S. Trying to migrate...."&gt;&gt;C:\script\log.log
vxrds migrate OracleRVG 192.168.110.10 &gt;&gt;C:\script\log.log
echo Return code for migration: %ERRORLEVEL% &gt;&gt;C:\script\log.log
IF %ERRORLEVEL% NEQ 0 GOTO TAKEOVER
GOTO END

:TAKEOVER
vxrds -autofb takeover OracleRVG &gt;&gt;C:\script\log.log
echo Return code for replication takeover: %ERRORLEVEL% &gt;&gt;C:\script\log.log
GOTO END

:END
echo &gt; c:\script\marker.id

I think that Veritas could support this kind of replicated clusters officially, having special resource to monitor replication and do migration or takeover. This way it is possible to use only two servers with internall disks and on long distance locations (they dont use same disk array). I&nbsp;am thinking to put this into Symantec Ideas. What do you think ?

Forum Discussion

Global Cluster, can you verify my config - setup - architecture ?

8 Replies

Related Content

Global Cluster Setup

Global Cluster or HA/DR functionality

VCS global cluster configuration

VCS global cluster licence

How to disable Windows Open File Backups globally

Recent Discussions

Configure two Mount type resources of nfs FStype attribute using the same share

order

key registration and reservation

Verifying that primary and dr clusters replication is synced

vcs can create logical nic