11-17-2010 10:26 PM
Configuration details -
OS - HP-UX B.11.23 U ia64
VxVM version 5.0
Problem description-
Added a new 70GB LUN from EMC CX-380 to the host.
diskinfo /dev/rdsk/c19t5d6
SCSI describe of /dev/rdsk/c19t5d6:
vendor: DGC
product id: CX3-80WDR5
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
The new LUN is detected by OS, but VxVM is not able to detect it. i.e the LUN does not show in "vxdisk list" output. also no dmp device path seen for the LUN in /dev/vx/dmp/
Steps done so far -
1- ioscan -fnC disk
2- vxdctl enable / vxdisk scandisks
3- vxdisksetup -if c19t5d6
VxVM vxdisksetup ERROR V-5-2-43 c19t5d6: Invalid disk device for vxdisksetup
Please suggest any solution except "reboot"
Thanks
Solved! Go to Solution.
12-02-2010 05:23 PM
I just wanted to provide a quick follow-up on this. Tech Support has escalated the case to engineering to investigate further. Thanks @timus for all the details you've provided here.
Best,
Kimberley
11-17-2010 10:47 PM
Is this is a clustered setup ?
Have you tried moving the disk.info file ?
Gaurav
11-17-2010 10:53 PM
Hi Gaurav,
Yes this is a Service Guard cluster.
I haven't moved "disk.info" file as of yet. I just wanted to confirm if I delete /etc/vx/disk.info file and recreate it using - vxdctl init `hostname` command will it affect the system ?
Thanks
11-17-2010 11:11 PM
hi timus,
vxdctl init `hostname` initializes the volboot file & not disk.info .. we need not to do this...
before suggesting next actions, can you confirm following:
# /etc/vx/diag.d/vxdmpinq /dev/rdsk/c19t5d6
(path to vxdmpinq may be different, search for it if not in /etc/vx/diag.d)
Here would be my suggestion once you confirm me above:
to re-init the disk.info file we need to restart vxconfigd daemon.. but since you are using the cluster, you need to make sure that your services/applications are taken care properly..
what I would suggest is:
-- make sure your applications are frozen or offline or moved to other node
-- mv /etc/vx/disk.info /etc/vx/disk.info.old
-- rm /dev/vx/rdmp/*
-- rm /dev/vx/dmp/*
-- scan all devices from HP using ioscan -fnC
-- vxconfigd -k -x syslog (restart vxconfigd daemon)
This will re-generate all your device tree in /dev/vx/rdmp & /dev/vx/dmp .. also it will re-create the disk.info file
Gaurav
11-18-2010 12:05 AM
Gautam,
Below is the o/p of vxdmpinq -
/etc/vx/diag.d/vxdmpinq /dev/rdsk/c19t5d6
Inquiry for /dev/rdsk/c19t5d6, evpd 0x0, page code 0x0
Vendor id : DGC
Product id : CX3-80WDR5
Revision Number : HP03
Serial Number : Ch2 CONTROLL
Thanks,
Sumit
11-18-2010 12:31 AM
Hi Sumit,
Might be a silly questions but does the ioscan -fnC show the new disks with /dev/rdsk/ entries? I had something similar last week where they were listed by ioscan, but did not have device entries e.g. /dev/rdsk/c10t0d0
if so, run insf -e
then
vxdisk scandisks
then
vxdctl enable
11-18-2010 12:35 AM
Hi Riaan,
Yes the new device (LUN) has proper device file entries in /dev/dsk and /dev/rdsk . It is properly detected by OS. I am able to read/write to the new device using "dd".
Thanks,
11-18-2010 12:54 AM
11-18-2010 02:26 AM
Hi Gaurav,
Performed the following steps in the below mentioned order, but the problem still persists, any suggestions why is it happening ?
mv /etc/vx/array.info /etc/vx/array.info.old
mv /etc/vx/disk.info /etc/vx/disk.info.old
rm /dev/vx/dmp/*
rm /dev/vx/rdmp/*
vxddladm disablescsi3
ioscan -fnC disk and insf -e
vxconfigd -k -x syslog
Thanks
11-18-2010 03:41 AM
Is anything excluded ?
# ls -l /etc/vx/*exclude*
If any exclude file is there, can you paste the contents of the file ?
Also paste
# vxdmpadm listexclude all
# vxddladm listexclude all
# vxdmpadm listenclosure all
# vxdmpadm listctlr all
Can you also tell the exact model of the array ?
Gaurav
11-18-2010 09:03 AM
Did you label the disk ? If you are using EMC powerpath, then you should also run "powermt config" before identifying the disk in veritas.
11-18-2010 08:23 PM
Hi Gaurav,
below is the o/p of commands you asked for -
1- cat /etc/vx/disks.exclude
c0t0d0
c2t0d0
2- vxdmpadm listexclude all
Devices excluded from VxVM:
--------------------------
Paths : None
Controllers : None
VID:PID : None
Devices excluded from multipathing by vxdmp:
-------------------------------------------
Paths : None
VID:PID : None
Pathgroups : None
----------
3- vxddladm listexclude all
The Diskarrays excluded
-----------------------
Based on Library names:
-----------------------
libvxCLARiiON.sl.1
Based on VID, PID Combination:
4- vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE
============================================================================
Disk Disk DISKS CONNECTED Disk
EMC_CLARiiON0 EMC_CLARiiON HK190081100024 CONNECTED CLR-A/P
EMC0 EMC 105058 CONNECTED A/A
EMC1 EMC 105354 CONNECTED A/A
5- vxdmpadm listctlr all
CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
=====================================================
c2 Disk ENABLED Disk
c0 Disk ENABLED Disk
c19 EMC_CLARiiON ENABLED EMC_CLARiiON0
c21 EMC_CLARiiON ENABLED EMC_CLARiiON0
c20 EMC_CLARiiON ENABLED EMC_CLARiiON0
c18 EMC_CLARiiON ENABLED EMC_CLARiiON0
c25 EMC ENABLED EMC0
c24 EMC ENABLED EMC0
c23 EMC ENABLED EMC0
c22 EMC ENABLED EMC0
c11 EMC ENABLED EMC0
c6 EMC ENABLED EMC0
c9 EMC ENABLED EMC0
c4 EMC ENABLED EMC0
c29 EMC ENABLED EMC0
c28 EMC ENABLED EMC0
c27 EMC ENABLED EMC0
c26 EMC ENABLED EMC0
c37 EMC ENABLED EMC0
c36 EMC ENABLED EMC0
c35 EMC ENABLED EMC0
c34 EMC ENABLED EMC0
c33 EMC ENABLED EMC0
c31 EMC ENABLED EMC0
c32 EMC ENABLED EMC0
c30 EMC ENABLED EMC0
c39 EMC ENABLED EMC0
c38 EMC ENABLED EMC0
EMC DISABLED EMC0
EMC DISABLED EMC0
c43 EMC ENABLED EMC0
EMC DISABLED EMC0
EMC DISABLED EMC0
c40 EMC ENABLED EMC0
c50 EMC ENABLED EMC1
c47 EMC ENABLED EMC1
c49 EMC ENABLED EMC1
c46 EMC DISABLED EMC1
EMC DISABLED EMC1
EMC DISABLED EMC1
------------------------------
6- The Array Model is EMC Clariion CX3-80
11-18-2010 10:09 PM
I see that you have excluded one of ASL libraries however I am not sure what that library is for ... This could be a reason of why you are not seeing the disks IF the Lun you have added is coming from the supported array by this library..
DO you know why this library was excluded ?
Can you give this output:
# vxddladm listsupport all
# vxddladm listsupport libname=libvxveritas.so
If the Lun is coming from an array which is supported by this library, you might want to consider including the library again, but make sure you know the reason why this was excluded before..
Gaurav
11-18-2010 11:03 PM
here are the required o/p's -
# vxddladm listsupport all
LIBNAME VID
==============================================================================
libvxautoraid.sl HP
libvxcscovrts.sl CSCOVRTS
libvxCLARiiON.sl DGC
libvxemc.sl EMC
libvxfc60.sl HP
libvxva.sl HP
libvxhdsalua.sl HITACHI
libvxhpalua.sl HP, COMPAQ
libvxshark.sl IBM
libvxhds9980.sl HITACHI
libvxhdsusp.sl HITACHI
libvxibmds8k.sl IBM
libvxxp1281024.sl HP
libvxxp12k.sl HP
# vxddladm listsupport libname=libvxCLARiiON.sl
ATTR_NAME ATTR_VALUE
=======================================================================
LIBNAME libvxCLARiiON.sl
VID DGC
ARRAY_TYPE CLR-A/P, CLR-A/PF
ARRAY_NAME EMC_CLARiiON
As a part of troubleshooting, we excluded the above ASL and then included it again. as you can see from the o/p of vxddladm listsupport all, libvxCLARiiON.sl is included.
11-18-2010 11:52 PM
you mean to say, after including ASL , still you are not seeing the Lun ?
the initial steps you tried of moving disk.info & restarting vxconfigd, did you ran them when ASL was exlcuded or included ?
Gaurav
11-19-2010 12:10 AM
Yes thats right, after including ASL, still I am unable to see the LUN.
all the steps of removing /etc/vx/disk.info, and restarting vxconfigd were done when ASL was included.
Is the root cause of problem due to some previous stale entries in vxvm configuration database which is not getting refreshed ? is there any way to refresh it without impacting the running system ?
11-19-2010 01:25 AM
I don't believe its problem of stale devices because we have already cleared the disk.info file which has all veritas device mappings..
can you paste full output of
# vxdisk list
# vxdisk -e list
Gaurav
11-19-2010 02:16 AM
Please find the attchment containing vxdisk list and vxdsik -e list o/p .
there are few devices in vxdisk -e list o/p that shows-
c38t8d3 auto - - offline 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
c38t8d4 auto - - offline 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Don't know what does that mean . pls suggest
11-19-2010 02:31 AM
hmm looks strange... not sure what those 00000 mean.....
moreover none of the disk in vxdisk list or vxdisk -e list starts from c19 ... is it the first disk with 19 controller to be introduced ?
I know disk is visible to OS but have you confirmed that settings on the array are correct, I mean zoning, array failover mode etc etc..
Have a look at HCL for 5.0MP3 & confirm if everything on array is as per recommendations..
HCL can be tracked at
https://sort.symantec.com/documents
Gaurav
11-19-2010 02:41 AM
"I know disk is visible to OS but have you confirmed that settings on the array are correct, I mean zoning, array failover mode etc etc.."
-- Zoning and Array settings are ok, I dont think it has anything to do with Array failover mode. below is the o/p of vxdmpadm getsubpaths for c19, not sure if its helpful ..
vxdmpadm getsubpaths ctlr=c19
NAME STATE[A] PATH-TYPE[M] DMPNODENAME ENCLR-TYPE ENCLR-NAME ATTRS
================================================================================
c19t0d0 ENABLED(A) PRIMARY c18t0d0 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d1 ENABLED SECONDARY c18t0d1 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d2 ENABLED SECONDARY c18t0d2 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d3 ENABLED(A) PRIMARY c18t0d3 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d4 ENABLED(A) PRIMARY c18t0d4 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d5 ENABLED(A) PRIMARY c18t0d5 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d6 ENABLED SECONDARY c18t0d6 EMC_CLARiiON EMC_CLARiiON0 -
c19t0d7 ENABLED SECONDARY c18t0d7 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d0 ENABLED(A) PRIMARY c18t1d0 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d1 ENABLED(A) PRIMARY c18t1d1 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d2 ENABLED(A) PRIMARY c18t1d2 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d3 ENABLED SECONDARY c18t1d3 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d4 ENABLED SECONDARY c18t1d4 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d5 ENABLED SECONDARY c18t1d5 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d6 ENABLED SECONDARY c18t1d6 EMC_CLARiiON EMC_CLARiiON0 -
c19t1d7 ENABLED(A) PRIMARY c18t1d7 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d0 ENABLED SECONDARY c18t2d0 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d1 ENABLED(A) PRIMARY c18t2d1 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d2 ENABLED(A) PRIMARY c18t2d2 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d3 ENABLED SECONDARY c18t2d3 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d4 ENABLED(A) PRIMARY c18t2d4 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d5 ENABLED SECONDARY c18t2d5 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d6 ENABLED SECONDARY c18t2d6 EMC_CLARiiON EMC_CLARiiON0 -
c19t2d7 ENABLED SECONDARY c18t2d7 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d0 ENABLED SECONDARY c18t3d0 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d1 ENABLED(A) PRIMARY c18t3d1 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d2 ENABLED SECONDARY c18t3d2 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d3 ENABLED(A) PRIMARY c18t3d3 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d4 ENABLED SECONDARY c18t3d4 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d5 ENABLED(A) PRIMARY c18t3d5 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d6 ENABLED SECONDARY c18t3d6 EMC_CLARiiON EMC_CLARiiON0 -
c19t3d7 ENABLED(A) PRIMARY c18t3d7 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d0 ENABLED(A) PRIMARY c18t4d0 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d1 ENABLED(A) PRIMARY c18t4d1 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d2 ENABLED(A) PRIMARY c18t4d2 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d3 ENABLED(A) PRIMARY c18t4d3 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d4 ENABLED SECONDARY c18t4d4 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d5 ENABLED(A) PRIMARY c18t4d5 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d6 ENABLED(A) PRIMARY c18t4d6 EMC_CLARiiON EMC_CLARiiON0 -
c19t4d7 ENABLED SECONDARY c18t4d7 EMC_CLARiiON EMC_CLARiiON0 -
c19t5d0 ENABLED(A) PRIMARY c18t5d0 EMC_CLARiiON EMC_CLARiiON0 -
c19t5d1 ENABLED SECONDARY c18t5d1 EMC_CLARiiON EMC_CLARiiON0 -
c19t5d2 ENABLED SECONDARY c18t5d2 EMC_CLARiiON EMC_CLARiiON0 -
c19t5d3 ENABLED(A) PRIMARY c18t5d3 EMC_CLARiiON EMC_CLARiiON0 -
c19t5d4 ENABLED(A) PRIMARY c18t5d4 EMC_CLARiiON EMC_CLARiiON0 -