cancel
Showing results for 
Search instead for 
Did you mean: 

VxVM not detecting newly add LUN

timus
Level 4

Configuration details -
OS - HP-UX B.11.23 U ia64
VxVM version 5.0

Problem description-

Added a new 70GB LUN from EMC CX-380 to the host.


diskinfo /dev/rdsk/c19t5d6
SCSI describe of /dev/rdsk/c19t5d6:
vendor: DGC
product id: CX3-80WDR5
type: direct access
size: 70709760 Kbytes
bytes per sector: 512

The new LUN is detected by OS, but VxVM is not able to detect it. i.e the LUN does not show in "vxdisk list" output.
also no dmp device path seen for the LUN in  /dev/vx/dmp/

Steps done so far -

1- ioscan -fnC disk
2- vxdctl enable / vxdisk scandisks
3- vxdisksetup -if c19t5d6
VxVM vxdisksetup ERROR V-5-2-43 c19t5d6: Invalid disk device for vxdisksetup

Please suggest any solution except "reboot"

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Kimberley
Level 6
Partner

I just wanted to provide a quick follow-up on this. Tech Support has escalated the case to engineering to investigate further. Thanks @timus for all the details you've provided here.

Best,

Kimberley

View solution in original post

25 REPLIES 25

Gaurav_S
Moderator
Moderator
   VIP    Certified

Is this is a clustered setup ?

Have you tried moving the disk.info file ?

 

Gaurav

timus
Level 4

Hi Gaurav,

 

Yes this is a Service Guard cluster.

I haven't moved "disk.info" file as of yet. I just wanted to confirm if I delete /etc/vx/disk.info file and recreate it using - vxdctl init `hostname` command will it affect the system ?

 

Thanks

Gaurav_S
Moderator
Moderator
   VIP    Certified

hi timus,

vxdctl init `hostname`  initializes the volboot file & not disk.info ..  we need not to do this...

before suggesting next actions, can you confirm following:

# /etc/vx/diag.d/vxdmpinq /dev/rdsk/c19t5d6

(path to vxdmpinq may be different, search for it if not in /etc/vx/diag.d)

Here would be my suggestion once you confirm me above:

to re-init the disk.info file we need to restart vxconfigd daemon.. but since you are using the cluster, you need to make sure that your services/applications are taken care properly..

what I would suggest is:

-- make sure your applications are frozen or offline or moved to other node

-- mv /etc/vx/disk.info /etc/vx/disk.info.old

-- rm /dev/vx/rdmp/*

-- rm /dev/vx/dmp/*

-- scan all devices from HP using ioscan -fnC

-- vxconfigd -k -x syslog  (restart vxconfigd daemon)

This will re-generate all your device tree in /dev/vx/rdmp & /dev/vx/dmp .. also it will re-create the disk.info file

Gaurav

timus
Level 4

Gautam,

 

Below is the o/p of vxdmpinq -

/etc/vx/diag.d/vxdmpinq /dev/rdsk/c19t5d6

Inquiry for /dev/rdsk/c19t5d6, evpd 0x0, page code 0x0
Vendor id             : DGC
Product id             : CX3-80WDR5
Revision Number        : HP03
Serial Number          : Ch2 CONTROLL

 

Thanks,

Sumit

RiaanBadenhorst
Moderator
Moderator
Partner    VIP    Accredited Certified

Hi Sumit,

 

Might be a silly questions but does the ioscan -fnC show the new disks with /dev/rdsk/ entries? I had something similar last week where they  were listed by ioscan, but did not have device entries e.g. /dev/rdsk/c10t0d0

 

if so, run insf -e

 

then

vxdisk scandisks

 

then 

 

vxdctl enable

timus
Level 4

Hi Riaan,

 

Yes the new device (LUN) has proper device file entries in /dev/dsk and /dev/rdsk . It is properly detected by OS. I am able to read/write to the new device using "dd".

 

Thanks,

Gaurav_S
Moderator
Moderator
   VIP    Certified
Hello Sumit, I believe you will need to follow the plan I suggested above.. Gaurav

timus
Level 4

Hi Gaurav,

 

Performed the following steps in the below mentioned order, but the problem still persists, any suggestions why is it happening ?


   mv /etc/vx/array.info /etc/vx/array.info.old
   mv /etc/vx/disk.info /etc/vx/disk.info.old
   rm /dev/vx/dmp/*
   rm /dev/vx/rdmp/*
   vxddladm disablescsi3
   ioscan  -fnC disk and insf -e

   vxconfigd -k -x syslog

 

Thanks

Gaurav_S
Moderator
Moderator
   VIP    Certified

Is anything excluded ?

# ls -l /etc/vx/*exclude*

If any exclude file is there, can you paste the contents of the file ?

Also paste

# vxdmpadm listexclude all

# vxddladm listexclude all

# vxdmpadm listenclosure all

# vxdmpadm listctlr all

Can you also tell the exact model of the array ?

 

Gaurav

nmcherla
Level 3

Did you label the disk ? If you are using EMC powerpath, then you should also run "powermt config" before identifying the disk in veritas. 

timus
Level 4

Hi Gaurav,

 

below is the o/p of commands you asked for -

 

1- cat /etc/vx/disks.exclude
c0t0d0
c2t0d0

2- vxdmpadm listexclude all
Devices excluded from VxVM:
--------------------------
Paths : None

Controllers : None

VID:PID : None

Devices excluded from multipathing by vxdmp:
-------------------------------------------
Paths : None

VID:PID : None

Pathgroups : None
----------

3- vxddladm listexclude all

The Diskarrays excluded
-----------------------

Based on Library names:
-----------------------
                libvxCLARiiON.sl.1

Based on VID, PID Combination:

 

4-  vxdmpadm listenclosure all
ENCLR_NAME        ENCLR_TYPE     ENCLR_SNO      STATUS       ARRAY_TYPE
============================================================================
Disk              Disk           DISKS                CONNECTED    Disk
EMC_CLARiiON0     EMC_CLARiiON   HK190081100024       CONNECTED    CLR-A/P
EMC0              EMC            105058               CONNECTED    A/A
EMC1              EMC            105354               CONNECTED    A/A

5-  vxdmpadm listctlr all
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c2              Disk            ENABLED      Disk
c0              Disk            ENABLED      Disk
c19             EMC_CLARiiON    ENABLED      EMC_CLARiiON0
c21             EMC_CLARiiON    ENABLED      EMC_CLARiiON0
c20             EMC_CLARiiON    ENABLED      EMC_CLARiiON0
c18             EMC_CLARiiON    ENABLED      EMC_CLARiiON0
c25             EMC             ENABLED      EMC0
c24             EMC             ENABLED      EMC0
c23             EMC             ENABLED      EMC0
c22             EMC             ENABLED      EMC0
c11             EMC             ENABLED      EMC0
c6              EMC             ENABLED      EMC0
c9              EMC             ENABLED      EMC0
c4              EMC             ENABLED      EMC0
c29             EMC             ENABLED      EMC0
c28             EMC             ENABLED      EMC0
c27             EMC             ENABLED      EMC0
c26             EMC             ENABLED      EMC0
c37             EMC             ENABLED      EMC0
c36             EMC             ENABLED      EMC0
c35             EMC             ENABLED      EMC0
c34             EMC             ENABLED      EMC0
c33             EMC             ENABLED      EMC0
c31             EMC             ENABLED      EMC0
c32             EMC             ENABLED      EMC0
c30             EMC             ENABLED      EMC0
c39             EMC             ENABLED      EMC0
c38             EMC             ENABLED      EMC0
                EMC             DISABLED     EMC0
                EMC             DISABLED     EMC0
c43             EMC             ENABLED      EMC0
                EMC             DISABLED     EMC0
                EMC             DISABLED     EMC0
c40             EMC             ENABLED      EMC0
c50             EMC             ENABLED      EMC1
c47             EMC             ENABLED      EMC1
c49             EMC             ENABLED      EMC1
c46             EMC             DISABLED     EMC1
                EMC             DISABLED     EMC1
                EMC             DISABLED     EMC1

------------------------------

 

6- The Array Model is EMC Clariion CX3-80

Gaurav_S
Moderator
Moderator
   VIP    Certified

I see that you have excluded one of ASL libraries however I am not sure what that library is for ... This could be a reason of why you are not seeing the disks IF the Lun you have added is coming from the supported array by this library..

 

DO you know why this library was excluded ?

 

Can you give this output:

# vxddladm listsupport all

# vxddladm listsupport libname=libvxveritas.so

 

If the Lun is coming from an array which is supported by this library, you might want to consider including the library again, but make sure you know the reason why this was excluded before..

 

Gaurav

timus
Level 4

here are the required o/p's -

# vxddladm listsupport all
LIBNAME              VID
==============================================================================
libvxautoraid.sl     HP
libvxcscovrts.sl     CSCOVRTS
libvxCLARiiON.sl     DGC
libvxemc.sl          EMC
libvxfc60.sl         HP
libvxva.sl           HP
libvxhdsalua.sl      HITACHI
libvxhpalua.sl       HP, COMPAQ
libvxshark.sl        IBM
libvxhds9980.sl      HITACHI
libvxhdsusp.sl       HITACHI
libvxibmds8k.sl      IBM
libvxxp1281024.sl    HP
libvxxp12k.sl        HP

 

# vxddladm listsupport libname=libvxCLARiiON.sl
ATTR_NAME            ATTR_VALUE
=======================================================================
LIBNAME              libvxCLARiiON.sl
VID                  DGC
ARRAY_TYPE           CLR-A/P, CLR-A/PF
ARRAY_NAME           EMC_CLARiiON

 

As a part of troubleshooting, we excluded the above ASL and then included it again. as you can see from the o/p of vxddladm listsupport all, libvxCLARiiON.sl is included.

Gaurav_S
Moderator
Moderator
   VIP    Certified

you mean to say, after including ASL , still you are not seeing the Lun ?

the initial steps you tried of moving disk.info & restarting vxconfigd, did you ran them when ASL was exlcuded or included ?

 

Gaurav

timus
Level 4

Yes thats right, after including ASL, still I am unable to see the LUN.

all the steps of removing /etc/vx/disk.info, and restarting vxconfigd were done when ASL was included. 

Is the root cause of problem due to some previous stale entries in vxvm configuration database which is not getting refreshed ? is there any way to refresh it without impacting the running system ?

Gaurav_S
Moderator
Moderator
   VIP    Certified

I don't believe its problem of stale devices because we have already cleared the disk.info file which has all veritas device mappings..

can you paste full output of

# vxdisk list

# vxdisk -e list

 

Gaurav

timus
Level 4

Please find the attchment containing vxdisk list and vxdsik -e list o/p .

 

there are few devices in vxdisk -e list o/p that shows- 

c38t8d3      auto      -             -            offline      0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
c38t8d4      auto      -             -            offline      0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000

Don't know what does that mean . pls suggest

Gaurav_S
Moderator
Moderator
   VIP    Certified

hmm looks strange... not sure what those 00000 mean.....

moreover none of the disk in vxdisk list or vxdisk -e list starts from c19 ... is it the first disk with 19 controller to be introduced ?

I know disk is visible to OS but have you confirmed that settings on the array are correct, I mean zoning, array failover mode etc etc..

Have a look at HCL for 5.0MP3 & confirm if everything on array is as per recommendations..

HCL can be tracked at

https://sort.symantec.com/documents

 

Gaurav

timus
Level 4

"I know disk is visible to OS but have you confirmed that settings on the array are correct, I mean zoning, array failover mode etc etc.."

-- Zoning and Array settings are ok, I dont think it has anything to do with Array failover mode. below is the o/p of vxdmpadm getsubpaths for c19, not sure if its helpful ..

 

vxdmpadm getsubpaths ctlr=c19
NAME         STATE[A]   PATH-TYPE[M] DMPNODENAME  ENCLR-TYPE   ENCLR-NAME   ATTRS
================================================================================
c19t0d0      ENABLED(A) PRIMARY      c18t0d0      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d1      ENABLED    SECONDARY    c18t0d1      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d2      ENABLED    SECONDARY    c18t0d2      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d3      ENABLED(A) PRIMARY      c18t0d3      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d4      ENABLED(A) PRIMARY      c18t0d4      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d5      ENABLED(A) PRIMARY      c18t0d5      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d6      ENABLED    SECONDARY    c18t0d6      EMC_CLARiiON EMC_CLARiiON0   -
c19t0d7      ENABLED    SECONDARY    c18t0d7      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d0      ENABLED(A) PRIMARY      c18t1d0      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d1      ENABLED(A) PRIMARY      c18t1d1      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d2      ENABLED(A) PRIMARY      c18t1d2      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d3      ENABLED    SECONDARY    c18t1d3      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d4      ENABLED    SECONDARY    c18t1d4      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d5      ENABLED    SECONDARY    c18t1d5      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d6      ENABLED    SECONDARY    c18t1d6      EMC_CLARiiON EMC_CLARiiON0   -
c19t1d7      ENABLED(A) PRIMARY      c18t1d7      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d0      ENABLED    SECONDARY    c18t2d0      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d1      ENABLED(A) PRIMARY      c18t2d1      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d2      ENABLED(A) PRIMARY      c18t2d2      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d3      ENABLED    SECONDARY    c18t2d3      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d4      ENABLED(A) PRIMARY      c18t2d4      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d5      ENABLED    SECONDARY    c18t2d5      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d6      ENABLED    SECONDARY    c18t2d6      EMC_CLARiiON EMC_CLARiiON0   -
c19t2d7      ENABLED    SECONDARY    c18t2d7      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d0      ENABLED    SECONDARY    c18t3d0      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d1      ENABLED(A) PRIMARY      c18t3d1      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d2      ENABLED    SECONDARY    c18t3d2      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d3      ENABLED(A) PRIMARY      c18t3d3      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d4      ENABLED    SECONDARY    c18t3d4      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d5      ENABLED(A) PRIMARY      c18t3d5      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d6      ENABLED    SECONDARY    c18t3d6      EMC_CLARiiON EMC_CLARiiON0   -
c19t3d7      ENABLED(A) PRIMARY      c18t3d7      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d0      ENABLED(A) PRIMARY      c18t4d0      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d1      ENABLED(A) PRIMARY      c18t4d1      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d2      ENABLED(A) PRIMARY      c18t4d2      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d3      ENABLED(A) PRIMARY      c18t4d3      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d4      ENABLED    SECONDARY    c18t4d4      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d5      ENABLED(A) PRIMARY      c18t4d5      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d6      ENABLED(A) PRIMARY      c18t4d6      EMC_CLARiiON EMC_CLARiiON0   -
c19t4d7      ENABLED    SECONDARY    c18t4d7      EMC_CLARiiON EMC_CLARiiON0   -
c19t5d0      ENABLED(A) PRIMARY      c18t5d0      EMC_CLARiiON EMC_CLARiiON0   -
c19t5d1      ENABLED    SECONDARY    c18t5d1      EMC_CLARiiON EMC_CLARiiON0   -
c19t5d2      ENABLED    SECONDARY    c18t5d2      EMC_CLARiiON EMC_CLARiiON0   -
c19t5d3      ENABLED(A) PRIMARY      c18t5d3      EMC_CLARiiON EMC_CLARiiON0   -
c19t5d4      ENABLED(A) PRIMARY      c18t5d4      EMC_CLARiiON EMC_CLARiiON0   -