02-11-2015 10:17 PM
Hi,
I have a case as below,
Please extend below file systems from 30G to 50G on server island.
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2 30G 15G 14G 52% /oracle/VRP/sapdata2
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4 30G 15G 14G 51% /oracle/VRP/sapdata4
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1 30G 14G 15G 49% /oracle/VRP/sapdata1
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3 30G 27G 2.7G 91% /oracle/VRP/sapdata3
root@myers# vxdisk -o alldgs -e list
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTR
emcpower22s2 auto VRP_PRD_sapcent_dg01 VRP_PRD_sapcent_dg online emcpower22c -
emcpower23s2 auto emcpower23s2 VRP_PRD_ora_data_dg online emcpower23c -
emcpower24s2 auto emcpower24s2 VRP_PRD_ora_data_dg online emcpower24c -
emcpower25s2 auto emcpower25s2 VRP_PRD_ora_data_dg online emcpower25c -
emcpower26s2 auto emcpower26s2 VRP_PRD_ora_data_dg online emcpower26c -
emcpower27s2 auto emcpower27s2 VRP_PRD_ora_bin_dg online emcpower27c -
emcpower28s2 auto VRP_PRD_ora_arch_dg01 VRP_PRD_ora_arch_dg online emcpower28c -
======================================================================================
These are the 4 new luns of 30 GB assigned by Storage.
57. emcpower29e <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@29
58. emcpower30a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@30
59. emcpower33a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@33
60. emcpower34b <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@34
====================================================================
When I tried to label them they are giving errors as,
57. emcpower29e <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@29
58. emcpower30a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@30
59. emcpower33a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@33
60. emcpower34b <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
/pseudo/emcp@34
Specify disk (enter its number): 57
selecting emcpower29e
[disk formatted]
Disk not labeled. Label it now? y
Warning: error writing VTOC.
Warning: no backup labels
Write label failed
FORMAT MENU:
disk - select a disk
type - select (define) a disk type
partition - select (define) a partition table
current - describe the current disk
format - format and analyze the disk
repair - repair a defective sector
label - write label to the disk
analyze - surface analysis
defect - defect list management
backup - search for backup labels
verify - read and display labels
save - save new disk/partition definitions
inquiry - show vendor, product and revision
volname - set 8-character volume name
!<cmd> - execute <cmd>, then return
===========================================================================
There are 4 luns emcpower29e,emcpower30a,emcpower33a,emcpower34b which is require to initilize it and add them to the VRP_PRD_ora_data_dg diskgroup to increase filesystem to 20 GB more.
Shall I have to proceed with the disk initilization in vxvm without labeling it or Please help me to proceed step by step activities required for this.
Thanks,
Solved! Go to Solution.
02-24-2015 02:22 AM
sapdata1 is a striped volume across 2 disks :
v sapdata1 - ENABLED ACTIVE 62914560 SELECT sapdata1-01 fsgen
pl sapdata1-01 sapdata1 ENABLED ACTIVE 62914560 STRIPE 2/128 RW
sd emcpower23s2-01 sapdata1-01 emcpower23s2 0 31457280 0/0 emcpower23 ENA
sd emcpower24s2-01 sapdata1-01 emcpower24s2 0 31457280 1/0 emcpower24 ENA
(same disks used for sapdata3)
As per my previous post, a resize needs to maintain the same volume layout.
You will need to add a minimum of 2 disks to the diskgroup in order to grow this volume (and other volumes that are striped as well).
02-25-2015 02:16 AM
I would recommend you use maxgrow and not maxsize for growing filesystems as in post:
as this takes striping into account - i.e if you use maxgrow with a 2-way stripe and specify 1 disk, it will say there is no space as oppose to maxsize which will give you the space on the one disk.
Mike
02-11-2015 11:10 PM
Post the entire output of root@myers# vxdisk -o alldgs -e list
Not just the ones in the DG. If the new disk do not show "error" then you can use vxdisksetup -i to initialize.
02-11-2015 11:48 PM
I agree with Riaan, post the entire output of vxdisk list for new 4 luns.
What I see is you are unable to label them, are these fresh disks from storage ? (double check if these disks doesn't contain any data)
Check if these disks are not zoned to any other host or if zoning from SAN switches is done correctly for this host to have write access, or these disks were used in cluster before which had any IOFencing on it (SCSI 3 PR reservations) which is blocking your access on the disk.
G
02-12-2015 12:11 AM
root@myers# vxdisk list
DEVICE TYPE DISK GROUP STATUS
emcpower22s2 auto:cdsdisk VRP_PRD_sapcent_dg01 VRP_PRD_sapcent_dg online
emcpower23s2 auto:cdsdisk emcpower23s2 VRP_PRD_ora_data_dg online
emcpower24s2 auto:cdsdisk emcpower24s2 VRP_PRD_ora_data_dg online
emcpower25s2 auto:cdsdisk emcpower25s2 VRP_PRD_ora_data_dg online
emcpower26s2 auto:cdsdisk emcpower26s2 VRP_PRD_ora_data_dg online
emcpower27s2 auto:cdsdisk emcpower27s2 VRP_PRD_ora_bin_dg online
emcpower28s2 auto:cdsdisk VRP_PRD_ora_arch_dg01 VRP_PRD_ora_arch_dg online
=====================================================================
I am unable to view the new luns in vxdisk o/p.
Yes, those luns are assigned fresh from storage.
But, as i checked in Partition table,
format> p
PARTITION MENU:
0 - change `0' partition
1 - change `1' partition
2 - change `2' partition
3 - change `3' partition
4 - change `4' partition
5 - change `5' partition
6 - change `6' partition
7 - change `7' partition
select - select a predefined table
modify - modify a predefined partition table
name - name the current table
print - display the current table
label - write partition map and label to the disk
!<cmd> - execute <cmd>, then return
quit
partition> p
Current partition table (default):
Total disk cylinders available: 29158 + 2 (reserved cylinders)
Part Tag Flag Cylinders Size Blocks
0 root wm 0 0 (0/0/0) 0
1 swap wu 0 0 (0/0/0) 0
2 backup wu 0 - 29157 26.69GB (29158/0/0) 55983360
3 unassigned wm 0 0 (0/0/0) 0
4 unassigned wm 0 0 (0/0/0) 0
5 unassigned wm 0 0 (0/0/0) 0
6 usr wm 0 - 29157 26.69GB (29158/0/0) 55983360
7 unassigned wm 0 0 (0/0/0) 0
================================================
Slice 6 is showing 26.69 GB.Is that due to which I was unable to label it?
02-12-2015 12:47 AM
run
vxdclt enable
vxdisk scandisks
then check
vxdisk -o alldgs list
02-12-2015 01:21 AM
root@myers# vxdisk -o alldgs list
DEVICE TYPE DISK GROUP STATUS
emcpower22s2 auto:cdsdisk VRP_PRD_sapcent_dg01 VRP_PRD_sapcent_dg online
emcpower23s2 auto:cdsdisk emcpower23s2 VRP_PRD_ora_data_dg online
emcpower24s2 auto:cdsdisk emcpower24s2 VRP_PRD_ora_data_dg online
emcpower25s2 auto:cdsdisk emcpower25s2 VRP_PRD_ora_data_dg online
emcpower26s2 auto:cdsdisk emcpower26s2 VRP_PRD_ora_data_dg online
emcpower27s2 auto:cdsdisk emcpower27s2 VRP_PRD_ora_bin_dg online
emcpower28s2 auto:cdsdisk VRP_PRD_ora_arch_dg01 VRP_PRD_ora_arch_dg online
emcpower29s2 auto - - nolabel
emcpower30s2 auto - - nolabel
emcpower33s2 auto - - nolabel
emcpower34s2 auto - - nolabel
===================================================
But, when I try to initialze it shows the below error,
root@myers# vxdisksetup -i emcpower29s2 format=cdsdisk
bash: vxdisksetup: command not found
root@myers# /etc/vx/bin/vxdisksetup -i emcpower29s2 format=cdsdisk
VxVM vxdisksetup ERROR V-5-2-2206 emcpower29s2: An invalid device address was specified; it must be of
the form cCtTdD, mcCtTdD or <enclosurename>_<diskno> where
C = host bus adapter controller number
T = target device controller number, if used
D = logical unit (disk) number within target device controller
<enclosurename> is the logical name of the enclosure to which the
disk belongs
<diskno> is the logical number of the disk
How to proceed?
02-12-2015 02:26 AM
Ok, now you can proceed to label as we can see the disks have no label and VXVM reports it.
You'll need to troubleshoot the labeling with OS support.
02-12-2015 02:39 AM
Are you still facing errors while labelling disk ?
G
02-12-2015 03:02 AM
I have seen the same issue some years ago when Storage Admins assigned new luns to a server.
It turned out to be incorrect Lun settings at EMC array level (they never told us what exactly).
Ask storage admins to compare lun settings of working luns with newly added luns.
Required LUN/Array settings are listed in SF Host and Storage Configuration Guide for Dynamic Multi-Pathing : http://www.symantec.com/docs/TECH47728
02-12-2015 04:30 AM
Have you tried Format -> type -> Autoconfigure and then labelling?
02-12-2015 05:31 AM
Agree with other that if you cannot label from O/S then you need to address this before putting under VxVM control, but for the vxdisksetup command you need to take the s2 off the end so command should be:
vxdisksetup -i emcpower29 format=cdsdisk
Mike
02-13-2015 12:11 AM
Yes, I found that from the storage side, they didn't give R/W access, now they provided it.
I am now at this stage,
root@myers# vxdisksetup -i emcpower29 format=cdsdisk
bash: vxdisksetup: command not found
root@myers# /etc/vx/bin/vxdisksetup -i emcpower29 format=cdsdisk
root@myers# /etc/vx/bin/vxdisksetup -i emcpower30 format=cdsdisk
root@myers# /etc/vx/bin/vxdisksetup -i emcpower33 format=cdsdisk
root@myers# /etc/vx/bin/vxdisksetup -i emcpower34 format=cdsdisk
root@myers# vxdisk list
DEVICE TYPE DISK GROUP STATUS
emcpower22s2 auto:cdsdisk VRP_PRD_sapcent_dg01 VRP_PRD_sapcent_dg online
emcpower23s2 auto:cdsdisk emcpower23s2 VRP_PRD_ora_data_dg online
emcpower24s2 auto:cdsdisk emcpower24s2 VRP_PRD_ora_data_dg online
emcpower25s2 auto:cdsdisk emcpower25s2 VRP_PRD_ora_data_dg online
emcpower26s2 auto:cdsdisk emcpower26s2 VRP_PRD_ora_data_dg online
emcpower27s2 auto:cdsdisk emcpower27s2 VRP_PRD_ora_bin_dg online
emcpower28s2 auto:cdsdisk VRP_PRD_ora_arch_dg01 VRP_PRD_ora_arch_dg online
emcpower29s2 auto:cdsdisk - - online
emcpower30s2 auto:cdsdisk - - online
emcpower33s2 auto:cdsdisk - - online
emcpower34s2 auto:cdsdisk - - online
To increase these filesystems which is under VRP_PRD_ora_data_dg.Shall i have to add luns under VRP_PRD_ora_data_dg and then do vxresize.
Please confirm. Filesystems information are:
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2 30G 15G 14G 52% /oracle/VRP/sapdata2
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4 30G 15G 14G 51% /oracle/VRP/sapdata4
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1 30G 14G 15G 49% /oracle/VRP/sapdata1
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3 30G 27G 2.7G 91% /oracle/VRP/sapdata3
02-13-2015 12:30 AM
In my instance, under these devices emcpower29s2,emcpower30s2
How to add disk under VRP_PRD_ora_data_dg disk group & resizing ?
Thanks.
02-13-2015 03:13 AM
Add your disks to diskgroup using "vxdg -g <diskgroup> adddisk <daname=dmname>"
for e.g
vxdg -g VRP_PRD_ora_data_dg adddisk VRP_PRD_ora_arch_dg02=emcpower29s2
Once you have add all the four disks .. you can resize volume & FS using vxresize command
# vxresize -g <diskgroup> <volume> newsize
for e.g if you want to increase sapdata1 from 30G to 50G
# vxresize -g VRP_PRD_ora_data_dg sapdata1 50G
G
02-13-2015 03:24 AM
You need to:
Mike
02-19-2015 11:45 AM
root@myers# vxdisk -o alldgs -e list
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTR
emcpower22s2 auto VRP_PRD_sapcent_dg01 VRP_PRD_sapcent_dg online emcpower22c -
emcpower23s2 auto emcpower23s2 VRP_PRD_ora_data_dg online emcpower23c -
emcpower24s2 auto emcpower24s2 VRP_PRD_ora_data_dg online emcpower24c -
emcpower25s2 auto emcpower25s2 VRP_PRD_ora_data_dg online emcpower25c -
emcpower26s2 auto emcpower26s2 VRP_PRD_ora_data_dg online emcpower26c -
emcpower27s2 auto emcpower27s2 VRP_PRD_ora_bin_dg online emcpower27c -
emcpower28s2 auto VRP_PRD_ora_arch_dg01 VRP_PRD_ora_arch_dg online emcpower28c -
emcpower29s2 auto emcpower29s2 VRP_PRD_ora_data_dg online emcpower29c -
emcpower30s2 auto - - online emcpower30c -
emcpower33s2 auto - - online emcpower33c -
emcpower34s2 auto - - online emcpower34c -
I have made emcpower29s2 in VRP_PRD_ora_data_dg online and now going to resize the filesystem.
But, unable to judge which filesystem should I have to take to resize it.
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2 30G 15G 14G 52% /oracle/VRP/sapdata2
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4 30G 15G 14G 51% /oracle/VRP/sapdata4
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1 30G 14G 15G 49% /oracle/VRP/sapdata1
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3 30G 27G 2.7G 91% /oracle/VRP/sapdata3
Shall i do in this way,
root@myers# vxresize -g VRP_PRD_ora_data_dg /dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1 +20g
and proceed one by one after adding disk to resize the filesystem.
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4
/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3
Shall i do randomly?
02-20-2015 01:49 AM
Kindly put suggestions.. thanks
02-20-2015 03:11 AM
But, unable to judge which filesystem should I have to take to resize it.
We cannot tell you.
From what I see, sapdata3 has least available space - 91% full.
If this was my environment, I would resize this one first.
Have you checked current volume layout?
vxprint -htr
Volume resize will by default maintain the same volume layout.
Follow the examples in Mike's post of 13 Feb, such as 'vxassist ..... maxgrow .... ', etc.
02-20-2015 05:07 AM
What filesystems you grow depend on what you have been asked to do. My guess is that you have had 4 disks assigned to grow each of the 4 filesystems, so in this case you can pick filesystem randomly and then add next disk and choose next filesystem to grow, so you do this 4 times for your 4 disks and 4 filesystems.
Mike
02-23-2015 03:45 PM
Getting this error message while extending filesystem,
root@myers# /etc/vx/bin/vxresize -g VRP_PRD_ora_data_dg sapdata1 +20g emcpower29s2
VxVM vxassist ERROR V-5-1-436 Cannot allocate space to grow volume to 104857600 blocks
VxVM vxresize ERROR V-5-1-4703 Problem running vxassist command for volume sapdata1, in diskgroup VRP_PRD_ora_data_dg
root@myers# vxprint -hvt
Disk group: VRP_PRD_ora_data_dg
V NAME RVG/VSET/CO KSTATE STATE LENGTH READPOL PREFPLEX UTYPE
PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM MODE
SC NAME PLEX CACHE DISKOFFS LENGTH [COL/]OFF DEVICE MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO
EX NAME ASSOC VC PERMS MODE STATE
v media - ENABLED ACTIVE 188743680 SELECT - fsgen
pl media-01 media ENABLED ACTIVE 188743680 CONCAT - RW
sd emcpower23s2-03 media-01 emcpower23s2 62914560 48990208 0 emcpower23 ENA
sd emcpower24s2-03 media-01 emcpower24s2 62914560 48990208 48990208 emcpower24 ENA
sd emcpower25s2-03 media-01 emcpower25s2 62914560 48990208 97980416 emcpower25 ENA
sd emcpower26s2-03 media-01 emcpower26s2 62914560 41773056 146970624 emcpower26 ENA
v sapdata1 - ENABLED ACTIVE 62914560 SELECT sapdata1-01 fsgen
pl sapdata1-01 sapdata1 ENABLED ACTIVE 62914560 STRIPE 2/128 RW
sd emcpower23s2-01 sapdata1-01 emcpower23s2 0 31457280 0/0 emcpower23 ENA
sd emcpower24s2-01 sapdata1-01 emcpower24s2 0 31457280 1/0 emcpower24 ENA
v sapdata2 - ENABLED ACTIVE 62914560 SELECT sapdata2-01 fsgen
pl sapdata2-01 sapdata2 ENABLED ACTIVE 62914560 STRIPE 2/128 RW
sd emcpower25s2-01 sapdata2-01 emcpower25s2 0 31457280 0/0 emcpower25 ENA
sd emcpower26s2-01 sapdata2-01 emcpower26s2 0 31457280 1/0 emcpower26 ENA
v sapdata3 - ENABLED ACTIVE 62914560 SELECT sapdata3-01 fsgen
pl sapdata3-01 sapdata3 ENABLED ACTIVE 62914560 STRIPE 2/128 RW
sd emcpower23s2-02 sapdata3-01 emcpower23s2 31457280 31457280 0/0 emcpower23 ENA
sd emcpower24s2-02 sapdata3-01 emcpower24s2 31457280 31457280 1/0 emcpower24 ENA
v sapdata4 - ENABLED ACTIVE 62914560 SELECT sapdata4-01 fsgen
pl sapdata4-01 sapdata4 ENABLED ACTIVE 62914560 STRIPE 2/128 RW
sd emcpower25s2-02 sapdata4-01 emcpower25s2 31457280 31457280 0/0 emcpower25 ENA
sd emcpower26s2-02 sapdata4-01 emcpower26s2 31457280 31457280 1/0 emcpower26 ENA
Disk group: VRP_PRD_ora_arch_dg
V NAME RVG/VSET/CO KSTATE STATE LENGTH READPOL PREFPLEX UTYPE
PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM MODE
SC NAME PLEX CACHE DISKOFFS LENGTH [COL/]OFF DEVICE MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO
EX NAME ASSOC VC PERMS MODE STATE
v oraarch - ENABLED ACTIVE 62914560 SELECT - fsgen
pl oraarch-01 oraarch ENABLED ACTIVE 62914560 CONCAT - RW
sd VRP_PRD_ora_arch_dg01-01 oraarch-01 VRP_PRD_ora_arch_dg01 0 62914560 0 emcpower28 ENA
Please help to resolve?