Forum Discussion

Jack_Ab's avatar
Jack_Ab
Level 2
14 years ago

Cannot vxdisksetup EMC disks

Hello Experts,

I have an EMC AX4-5F attached to 2 servers. Both internal disks of the servers have been initialized, encap and mirrored with Veritas. But my problem is to initialize the EMC disks. Btw, im new with Veritas, hope you experts can help this.

# vxdisksetup -i -f c2t0d1 format=sliced
VxVM vxdisksetup ERROR V-5-2-3628 The dmpnode c2t0d1s2 is disabled.Can not
proceed with vxdisksetup.
#
# vxdisksetup -i -f c3t0d0 format=sliced
VxVM vxdisksetup ERROR V-5-2-3628 The dmpnode c3t0d0s2 is disabled.Can not
proceed with vxdisksetup.

Disk is always with "nolabel" status although it has been labelled many times with "format".

# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#

Some of output worth looking for troubleshooting:

# vxdisk path
SUBPATH                     DANAME               DMNAME       GROUP        STATE
c1t0d0s2                    c1t0d0s2             rootdg01     rootdg       ENABLED
c1t1d0s2                    c1t1d0s2             rootdg02     rootdg       ENABLED
emcpower0c                  c2t0d1s2             -            -            DISABLED
emcpower2c                  c3t0d0s2             -            -            DISABLED
#

# vxdmpadm enable path=emcpower2c
#
# vxdisk path
SUBPATH                     DANAME               DMNAME       GROUP        STATE
c1t0d0s2                    c1t0d0s2             rootdg01     rootdg       ENABLED
c1t1d0s2                    c1t1d0s2             rootdg02     rootdg       ENABLED
emcpower0c                  c2t0d1s2             -            -            DISABLED
emcpower2c                  c3t0d0s2             -            -            DISABLED
#

# vxdmpadm getsubpaths dmpnodename=c2t0d1s2
NAME         STATE[A]   PATH-TYPE[M] CTLR-NAME  ENCLR-TYPE   ENCLR-NAME    ATTRS
================================================================================
emcpower0c   DISABLED     -          emcp       PP_EMC_CLARiiON pp_emc_clariion0    -
#
# vxdmpadm getsubpaths dmpnodename=c3t0d0s2
NAME         STATE[A]   PATH-TYPE[M] CTLR-NAME  ENCLR-TYPE   ENCLR-NAME    ATTRS
================================================================================
emcpower2c   DISABLED     -          emcp       PP_EMC_CLARiiON pp_emc_clariion0    -
#

# vxdisk scandisks
#
#
# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#
# vxdisk list c2t0d1s2
Device:    c2t0d1s2
devicetag: c2t0d1
type:      auto
flags:     nolabel private autoconfig
pubpaths:  block=/dev/vx/dmp/c2t0d1s2 char=/dev/vx/rdmp/c2t0d1s2
guid:      -
udid:      DGC%5FRAID%205%5FSL7F1104900006%5F6006016006102B008EDF9BF36FBFE011
site:      -
Multipathing information:
numpaths:   1
emcpower0c      state=disabled
#
# vxdisk list  c3t0d0s2
Device:    c3t0d0s2
devicetag: c3t0d0
type:      auto
flags:     nolabel private autoconfig
pubpaths:  block=/dev/vx/dmp/c3t0d0s2 char=/dev/vx/rdmp/c3t0d0s2
guid:      -
udid:      DGC%5FRAID%205%5FSL7F1104900006%5F6006016006102B005E1475D96FBFE011
site:      -
Multipathing information:
numpaths:   1
emcpower2c      state=disabled
#

# vxdmpadm listctlr all
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c1              Disk            ENABLED      disk
emcp            PP_EMC_CLARiiON DISABLED     pp_emc_clariion0
#

# vxdmpadm enable ctlr=emcp
VxVM vxdmpadm ERROR V-5-1-11771 Operation not supported.
#
# vxdctl enable
#
# devfsadm
#
# vxdctl enable
#
# vxdisk list  
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#
# vxdmpadm listctlr all
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c1              Disk            ENABLED      disk
emcp            PP_EMC_CLARiiON DISABLED     pp_emc_clariion0
#

# modinfo | grep vx
 46 7be1c000  3eea0 313   1  vxdmp (VxVM 5.0MP3RP2: DMP Driver)
 48 7ba00000 20bbf0 314   1  vxio (VxVM 5.0MP3RP2 I/O driver)
 50 7bbeb508    c78 315   1  vxspec (VxVM 5.0MP3RP2 control/status d)
235 7afcf1c8    cb0 308   1  vxportal (VxFS 5.0_REV-5.0MP3RP2f_sol por)
236 7a600000 1dcc00  21   1  vxfs (VxFS 5.0_REV-5.0MP3RP2f_sol Sun)
239 7aabc000  521d8 312   1  vxfen (VRTS Fence 5.0MP3RP2)
240 7b324000  21ec0 316   1  vxglm (VxGLM 5.0MP3 (SunOS 5.10))
241 7a7ec000   54c0 317   1  vxgms (VxGMS 5.0MP3 (SunOS))
#

# vxddladm set namingscheme=osn
# vxdmpadm listenclosure all
ENCLR_NAME        ENCLR_TYPE     ENCLR_SNO      STATUS       ARRAY_TYPE     LUN_COUNT
===================================================================================
pp_emc_clariion0  PP_EMC_CLARiiON SL7F1104900006       DISCONNECTED A/A         2
disk              Disk           DISKS                CONNECTED    Disk        2
#
# vxdmpadm setattr enclosure pp_emc_clariion0 tpdmode=native
#
# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c1t0d0s2     auto:sliced     rootdg01     rootdg       online
c1t1d0s2     auto:sliced     rootdg02     rootdg       online
c2t0d1s2     auto            -            -            nolabel
c3t0d0s2     auto            -            -            nolabel
#

Any idea is appreciated! Thanks!

Jack

business continuity
Error messages
Storage Foundation
Troubleshooting
  • Jack_Ab's avatar
    Jack_Ab
    14 years ago

    Hi,

    Thanks for all the ideas, they do help in the troubleshooting.

    Anyway, the problem is solved now. The reason the EMC disks was not "recognised" previously is because by default, the disk label is of type SMI. I just had to change the label to EFI, then everything works fine.

    format> l
    [0] SMI Label
    [1] EFI Label
    Specify Label type[0]: 1
    Warning: This disk has an SMI label. Changing to EFI label will erase all
    current partitions.
    Continue? y

    Thanks again guys!

  • Marianne's avatar
    Marianne
    Level 6
    14 years ago

    c2t0d1s2     auto            -            -            nolabel
    c3t0d0s2     auto            -            -            nolabel

    Use 'format' to label these disks. All you need to do is select the 1st disk in format, answer 'y' to question 'disk is not labelled, label it now?'. Do the same for the the 2nd disk.

    Next, run 'vxdctl enable'.

    You should now be able to initialize (vxdisksetup) these disks.

    PS: I am moving this thread to the Storage Foundation Forum: https://www-secure.symantec.com/connect/storage-management/forums/storage-foundation

  • Jack_Ab's avatar
    Jack_Ab
    Level 2
    14 years ago

    Hi,

    I already labelled the disks many time but still the same. So, what i did was "unassign" EMC disks from both servers. After re-assign and, reboot and re-label, i got different status now (error).

    # vxdisk list
    DEVICE       TYPE            DISK         GROUP        STATUS
    c1t0d0s2     auto:sliced     rootdg01     rootdg       online
    c1t1d0s2     auto:sliced     rootdg02     rootdg       online
    c2t0d1s2     auto            -            -            error
    c3t0d0s2     auto            -            -            error
    #

    I enable, and still same error.

    # vxdctl enable
    #
    # vxdisk list
    DEVICE       TYPE            DISK         GROUP        STATUS
    c1t0d0s2     auto:sliced     rootdg01     rootdg       online
    c1t1d0s2     auto:sliced     rootdg02     rootdg       online
    c2t0d1s2     auto            -            -            error
    c3t0d0s2     auto            -            -            error
    #

    # vxdisksetup -i c2t0d1 format=sliced
    VxVM vxdisksetup ERROR V-5-2-3628 The dmpnode c2t0d1s2 is disabled.Can not
    proceed with vxdisksetup.
    #

    I still cannot vxdisksetup. Anybody has an idea?

    Thanks.

    br/jack

  • rregunta's avatar
    rregunta
    Level 4
    14 years ago

    Hello,

     

    Could you please colect below command outputs:

    # format <disk name>

    # prtvtoc /dev/rdsk/<disk name>

    Also try below steps and let me know if it helps-

     

    Step -1
    ======
    1.] rm /dev/vx/rdmp/*
    2.] rm /dev/vx/dmp/*
    3.] mv /etc/vx/disk.info /etc/vx/disk.orig
    4.] mv /etc/vx/array.info /etc/vx/array.orig
     
    Step-2
    ======
    1.] vxddladm excludearray all
    2.] vxddladm disablescsi3
    3.] mv /etc/vx/jbod.info /etc/vx/jbod.orig
    4.] vxconfigd -k -m enable -x syslog
     
    Step-3
    ======
    1.] vxddladm includearray all
    2.] vxddladm enablescsi3
    3.] vxdctl scandisks
    4.] vxdctl enable
     
    regards
    Rajesh
     
  • Jeff_Jacobs_2's avatar
    Jeff_Jacobs_2
    Level 2
    14 years ago

    After labeling the disks, you will sometimes have to update the device symbolic links with "devfsadm -c disk"  and then kick start vxvm with a "vxdctl enable".

     

    Later

  • TonyGriffiths's avatar
    TonyGriffiths
    Level 6
    14 years ago

    Hi

    Its also worth checking the systelog (messages) file to see if there are any i/o errors from these devices.

    The prtvtoc (that rregunta advised) command will show if the disk has a label and the disk is readable.

    Also I see these are managed by EMC PowerPath. Are the devices healthy from a Powerpath perspective ?

     

    cheers

    tony

  • Jeff_Jacobs_2's avatar
    Jeff_Jacobs_2
    Level 2
    14 years ago

    If the easy fix didn't work then let's start from the beginning.

    Looks like you are using EMC PowerPath, so.....

    1) ensure mpxio is disabled in all /kernel/drv/*.conf files (a reboot maybe reqquired after any edits)

    2a) Located HBAs - "cfgadm -a"

    sample output:

    c1                             fc-fabric    connected    configured   unknown
    c2                             fc           connected    unconfigured unknown
    c3                             scsi-bus     connected    unconfigured unknown
    c4                             fc-fabric    connected    configured   unknown

    2b) Configure HBAs - "cfgadm -c configure c1; cfgadm -c configure c4"

    3) Scan HBAs - "powercf -q"

    4) Configure devices - "powermt config"

    5) Save configuration - "powermt save"

    6) Check point - "powermt display dev=all" ensure all pathes to emcpower devices are active and alive.

        if not and powerpath is licensed (emcpreg -list) set the failover policy - "powermt set policy=co dev=all"

        If still having issues here, then begin powerpath trouble shooting.

    7) format - label all emcpower?? devices

    8) devfsadm -c disk

    9) vxdctl enable

    10) check point - "vxdisk list" should show disk status as "online invalid"

    11) proceed with disk setups.

  • Jack_Ab's avatar
    Jack_Ab
    Level 2
    14 years ago

    Hi,

    Thanks for all the ideas, they do help in the troubleshooting.

    Anyway, the problem is solved now. The reason the EMC disks was not "recognised" previously is because by default, the disk label is of type SMI. I just had to change the label to EFI, then everything works fine.

    format> l
    [0] SMI Label
    [1] EFI Label
    Specify Label type[0]: 1
    Warning: This disk has an SMI label. Changing to EFI label will erase all
    current partitions.
    Continue? y

    Thanks again guys!