Cannot vxdisksetup EMC disks

[Jack_Ab]

Hello Experts,

I have an EMC AX4-5F attached to 2 servers. Both internal disks of the servers have been initialized, encap and mirrored with Veritas. But my problem is to initialize the EMC disks. Btw, im new with Veritas, hope you experts can help this.

# vxdisksetup -i -f c2t0d1 format=sliced
VxVM vxdisksetup ERROR V-5-2-3628 The dmpnode c2t0d1s2 is disabled.Can not
proceed with vxdisksetup.
#
# vxdisksetup -i -f c3t0d0 format=sliced
VxVM vxdisksetup ERROR V-5-2-3628 The dmpnode c3t0d0s2 is disabled.Can not
proceed with vxdisksetup.

Disk is always with "nolabel" status although it has been labelled many times with "format".

# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#

Some of output worth looking for troubleshooting:

# vxdisk path
SUBPATH                     DANAME               DMNAME       GROUP        STATE
c1t0d0s2                    c1t0d0s2             rootdg01     rootdg       ENABLED
c1t1d0s2                    c1t1d0s2             rootdg02     rootdg       ENABLED
emcpower0c                  c2t0d1s2             -            -            DISABLED
emcpower2c                  c3t0d0s2             -            -            DISABLED
#

# vxdmpadm enable path=emcpower2c
#
# vxdisk path
SUBPATH                     DANAME               DMNAME       GROUP        STATE
c1t0d0s2                    c1t0d0s2             rootdg01     rootdg       ENABLED
c1t1d0s2                    c1t1d0s2             rootdg02     rootdg       ENABLED
emcpower0c                  c2t0d1s2             -            -            DISABLED
emcpower2c                  c3t0d0s2             -            -            DISABLED
#

# vxdmpadm getsubpaths dmpnodename=c2t0d1s2
NAME         STATE[A]   PATH-TYPE[M] CTLR-NAME  ENCLR-TYPE   ENCLR-NAME    ATTRS
================================================================================
emcpower0c   DISABLED     -          emcp       PP_EMC_CLARiiON pp_emc_clariion0    -
#
# vxdmpadm getsubpaths dmpnodename=c3t0d0s2
NAME         STATE[A]   PATH-TYPE[M] CTLR-NAME  ENCLR-TYPE   ENCLR-NAME    ATTRS
================================================================================
emcpower2c   DISABLED     -          emcp       PP_EMC_CLARiiON pp_emc_clariion0    -
#

# vxdisk scandisks
#
#
# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#
# vxdisk list c2t0d1s2
Device:    c2t0d1s2
devicetag: c2t0d1
type:      auto
flags:     nolabel private autoconfig
pubpaths:  block=/dev/vx/dmp/c2t0d1s2 char=/dev/vx/rdmp/c2t0d1s2
guid:      -
udid:      DGC%5FRAID%205%5FSL7F1104900006%5F6006016006102B008EDF9BF36FBFE011
site:      -
Multipathing information:
numpaths:   1
emcpower0c      state=disabled
#
# vxdisk list  c3t0d0s2
Device:    c3t0d0s2
devicetag: c3t0d0
type:      auto
flags:     nolabel private autoconfig
pubpaths:  block=/dev/vx/dmp/c3t0d0s2 char=/dev/vx/rdmp/c3t0d0s2
guid:      -
udid:      DGC%5FRAID%205%5FSL7F1104900006%5F6006016006102B005E1475D96FBFE011
site:      -
Multipathing information:
numpaths:   1
emcpower2c      state=disabled
#

# vxdmpadm listctlr all
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c1              Disk            ENABLED      disk
emcp            PP_EMC_CLARiiON DISABLED     pp_emc_clariion0
#

# vxdmpadm enable ctlr=emcp
VxVM vxdmpadm ERROR V-5-1-11771 Operation not supported.
#
# vxdctl enable
#
# devfsadm
#
# vxdctl enable
#
# vxdisk list  
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#
# vxdmpadm listctlr all
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c1              Disk            ENABLED      disk
emcp            PP_EMC_CLARiiON DISABLED     pp_emc_clariion0
#

# modinfo | grep vx
 46 7be1c000  3eea0 313   1  vxdmp (VxVM 5.0MP3RP2: DMP Driver)
 48 7ba00000 20bbf0 314   1  vxio (VxVM 5.0MP3RP2 I/O driver)
 50 7bbeb508    c78 315   1  vxspec (VxVM 5.0MP3RP2 control/status d)
235 7afcf1c8    cb0 308   1  vxportal (VxFS 5.0_REV-5.0MP3RP2f_sol por)
236 7a600000 1dcc00  21   1  vxfs (VxFS 5.0_REV-5.0MP3RP2f_sol Sun)
239 7aabc000  521d8 312   1  vxfen (VRTS Fence 5.0MP3RP2)
240 7b324000  21ec0 316   1  vxglm (VxGLM 5.0MP3 (SunOS 5.10))
241 7a7ec000   54c0 317   1  vxgms (VxGMS 5.0MP3 (SunOS))
#

# vxddladm set namingscheme=osn
# vxdmpadm listenclosure all
ENCLR_NAME        ENCLR_TYPE     ENCLR_SNO      STATUS       ARRAY_TYPE     LUN_COUNT
===================================================================================
pp_emc_clariion0  PP_EMC_CLARiiON SL7F1104900006       DISCONNECTED A/A         2
disk              Disk           DISKS                CONNECTED    Disk        2
#
# vxdmpadm setattr enclosure pp_emc_clariion0 tpdmode=native
#
# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#

Any idea is appreciated! Thanks!

Jack

[Marianne]

c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel

Use 'format' to label these disks. All you need to do is select the 1st disk in format, answer 'y' to question 'disk is not labelled, label it now?'. Do the same for the the 2nd disk.

Next, run 'vxdctl enable'.

You should now be able to initialize (vxdisksetup) these disks.

PS: I am moving this thread to the Storage Foundation Forum: https://www-secure.symantec.com/connect/storage-management/forums/storage-foundation

[Jack_Ab]

Hi,

I already labelled the disks many time but still the same. So, what i did was "unassign" EMC disks from both servers. After re-assign and, reboot and re-label, i got different status now (error).

# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            error
c3t0d0s2     auto            -            -            error
#

I enable, and still same error.

# vxdctl enable
#
# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            error
c3t0d0s2     auto            -            -            error
#

# vxdisksetup -i c2t0d1 format=sliced
VxVM vxdisksetup ERROR V-5-2-3628 The dmpnode c2t0d1s2 is disabled.Can not
proceed with vxdisksetup.
#

I still cannot vxdisksetup. Anybody has an idea?

Thanks.

br/jack

[rregunta]

Hello,

Could you please colect below command outputs:

# format <disk name>

# prtvtoc /dev/rdsk/<disk name>

Also try below steps and let me know if it helps-

Step -1

======

1.] rm /dev/vx/rdmp/*

2.] rm /dev/vx/dmp/*

3.] mv /etc/vx/disk.info /etc/vx/disk.orig

4.] mv /etc/vx/array.info /etc/vx/array.orig

Step-2

======

1.] vxddladm excludearray all

2.] vxddladm disablescsi3

3.] mv /etc/vx/jbod.info /etc/vx/jbod.orig

4.] vxconfigd -k -m enable -x syslog

Step-3

======

1.] vxddladm includearray all

2.] vxddladm enablescsi3

3.] vxdctl scandisks

4.] vxdctl enable

regards

Rajesh

[Jeff_Jacobs_2]

After labeling the disks, you will sometimes have to update the device symbolic links with "devfsadm -c disk"  and then kick start vxvm with a "vxdctl enable".

Later

[TonyGriffiths]

Hi

Its also worth checking the systelog (messages) file to see if there are any i/o errors from these devices.

The prtvtoc (that rregunta advised) command will show if the disk has a label and the disk is readable.

Also I see these are managed by EMC PowerPath. Are the devices healthy from a Powerpath perspective ?

cheers

tony

[Jeff_Jacobs_2]

If the easy fix didn't work then let's start from the beginning.

Looks like you are using EMC PowerPath, so.....

1) ensure mpxio is disabled in all /kernel/drv/*.conf files (a reboot maybe reqquired after any edits)

2a) Located HBAs - "cfgadm -a"

sample output:

c1                             fc-fabric    connected    configured   unknown
c2                             fc           connected    unconfigured unknown
c3                             scsi-bus     connected    unconfigured unknown
c4                             fc-fabric    connected    configured   unknown

2b) Configure HBAs - "cfgadm -c configure c1; cfgadm -c configure c4"

3) Scan HBAs - "powercf -q"

4) Configure devices - "powermt config"

5) Save configuration - "powermt save"

6) Check point - "powermt display dev=all" ensure all pathes to emcpower devices are active and alive.

    if not and powerpath is licensed (emcpreg -list) set the failover policy - "powermt set policy=co dev=all"

    If still having issues here, then begin powerpath trouble shooting.

7) format - label all emcpower?? devices

8) devfsadm -c disk

9) vxdctl enable

10) check point - "vxdisk list" should show disk status as "online invalid"

11) proceed with disk setups.

[Jack_Ab · Accepted solution]

Hi,

Thanks for all the ideas, they do help in the troubleshooting.

Anyway, the problem is solved now. The reason the EMC disks was not "recognised" previously is because by default, the disk label is of type SMI. I just had to change the label to EFI, then everything works fine.

format> l
[0] SMI Label
[1] EFI Label
Specify Label type[0]: 1
Warning: This disk has an SMI label. Changing to EFI label will erase all
current partitions.
Continue? y

Thanks again guys!