cancel
Showing results for 
Search instead for 
Did you mean: 

Issue while Extending file system in vxvm

allaboutunix
Level 6

Hi,

I have a case as below,

Please extend below file systems from 30G to 50G on server island.

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2    30G    15G    14G    52%    /oracle/VRP/sapdata2

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4    30G    15G    14G    51%    /oracle/VRP/sapdata4

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1    30G    14G    15G    49%    /oracle/VRP/sapdata1

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3    30G    27G   2.7G    91%    /oracle/VRP/sapdata3

 

root@myers# vxdisk -o alldgs -e list
DEVICE       TYPE      DISK         GROUP        STATUS       OS_NATIVE_NAME   ATTR
emcpower22s2 auto      VRP_PRD_sapcent_dg01  VRP_PRD_sapcent_dg online       emcpower22c  -
emcpower23s2 auto      emcpower23s2  VRP_PRD_ora_data_dg online       emcpower23c  -
emcpower24s2 auto      emcpower24s2  VRP_PRD_ora_data_dg online       emcpower24c  -
emcpower25s2 auto      emcpower25s2  VRP_PRD_ora_data_dg online       emcpower25c  -
emcpower26s2 auto      emcpower26s2  VRP_PRD_ora_data_dg online       emcpower26c  -
emcpower27s2 auto      emcpower27s2  VRP_PRD_ora_bin_dg online       emcpower27c  -
emcpower28s2 auto      VRP_PRD_ora_arch_dg01  VRP_PRD_ora_arch_dg online       emcpower28c  -

 

======================================================================================

These are the 4 new  luns of 30 GB assigned by Storage.

 57. emcpower29e <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@29
      58. emcpower30a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@30
      59. emcpower33a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@33
      60. emcpower34b <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@34

====================================================================

When I tried to label them they are giving errors as,

 57. emcpower29e <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@29
      58. emcpower30a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@30
      59. emcpower33a <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@33
      60. emcpower34b <EMC-SYMMETRIX-5874 cyl 29158 alt 2 hd 15 sec 128>
          /pseudo/emcp@34
Specify disk (enter its number): 57
selecting emcpower29e
[disk formatted]
Disk not labeled.  Label it now? y
Warning: error writing VTOC.
Warning: no backup labels
Write label failed


FORMAT MENU:
        disk       - select a disk
        type       - select (define) a disk type
        partition  - select (define) a partition table
        current    - describe the current disk
        format     - format and analyze the disk
        repair     - repair a defective sector
        label      - write label to the disk
        analyze    - surface analysis
        defect     - defect list management
        backup     - search for backup labels
        verify     - read and display labels
        save       - save new disk/partition definitions
        inquiry    - show vendor, product and revision
        volname    - set 8-character volume name
        !<cmd>     - execute <cmd>, then return

===========================================================================

There are 4 luns emcpower29e,emcpower30a,emcpower33a,emcpower34b which is require to initilize it and add them to the VRP_PRD_ora_data_dg    diskgroup to increase filesystem to 20 GB more.

 

Shall  I have to proceed with the disk initilization in vxvm without labeling it or Please help me to proceed step by step activities required for this.

 

 

Thanks,

 

 

2 ACCEPTED SOLUTIONS

Accepted Solutions

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

sapdata1 is a striped volume across 2 disks :

v  sapdata1     -            ENABLED  ACTIVE   62914560 SELECT    sapdata1-01 fsgen
pl sapdata1-01  sapdata1     ENABLED  ACTIVE   62914560 STRIPE    2/128    RW
sd emcpower23s2-01 sapdata1-01 emcpower23s2 0  31457280 0/0       emcpower23 ENA
sd emcpower24s2-01 sapdata1-01 emcpower24s2 0  31457280 1/0       emcpower24 ENA

(same disks used for sapdata3)

As per my previous post, a resize needs to maintain the same volume layout.

You will need to add a minimum of 2 disks to the diskgroup in order to grow this volume (and other volumes that are striped as well).

 

 

View solution in original post

mikebounds
Level 6
Partner Accredited

I would recommend you use maxgrow and not maxsize for growing filesystems as in post:

https://www-secure.symantec.com/connect/forums/issue-while-extending-file-system-vxvm#comment-108884...

as this takes striping into account - i.e if you use maxgrow with a 2-way stripe and specify 1 disk, it will say there is no space as oppose to maxsize which will give you the space on the one disk.

Mike

View solution in original post

24 REPLIES 24

RiaanBadenhorst
Moderator
Moderator
Partner    VIP    Accredited Certified

Post the entire output of root@myers# vxdisk -o alldgs -e list

 

Not just the ones in the DG. If the new disk do not show "error" then you can use vxdisksetup -i to initialize.

Gaurav_S
Moderator
Moderator
   VIP    Certified

I agree with Riaan, post the entire output of vxdisk list for new 4 luns.

What I see is you are unable to label them, are these fresh disks from storage ? (double check if these disks doesn't contain any data)

Check if these disks are not zoned to any other host or if zoning from SAN switches is done correctly for this host to have write access, or these disks were used in cluster before which had any IOFencing on it (SCSI 3 PR reservations) which is blocking your access on the disk.

 

G

allaboutunix
Level 6

root@myers# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
emcpower22s2 auto:cdsdisk    VRP_PRD_sapcent_dg01  VRP_PRD_sapcent_dg online
emcpower23s2 auto:cdsdisk    emcpower23s2  VRP_PRD_ora_data_dg online
emcpower24s2 auto:cdsdisk    emcpower24s2  VRP_PRD_ora_data_dg online
emcpower25s2 auto:cdsdisk    emcpower25s2  VRP_PRD_ora_data_dg online
emcpower26s2 auto:cdsdisk    emcpower26s2  VRP_PRD_ora_data_dg online
emcpower27s2 auto:cdsdisk    emcpower27s2  VRP_PRD_ora_bin_dg online
emcpower28s2 auto:cdsdisk    VRP_PRD_ora_arch_dg01  VRP_PRD_ora_arch_dg online

=====================================================================

I am unable to view the new luns in vxdisk o/p.

Yes, those luns are assigned fresh from storage.

But, as i checked in Partition table,

 

format> p


PARTITION MENU:
        0      - change `0' partition
        1      - change `1' partition
        2      - change `2' partition
        3      - change `3' partition
        4      - change `4' partition
        5      - change `5' partition
        6      - change `6' partition
        7      - change `7' partition
        select - select a predefined table
        modify - modify a predefined partition table
        name   - name the current table
        print  - display the current table
        label  - write partition map and label to the disk
        !<cmd> - execute <cmd>, then return
        quit
partition> p
Current partition table (default):
Total disk cylinders available: 29158 + 2 (reserved cylinders)

Part      Tag    Flag     Cylinders         Size            Blocks
  0       root    wm       0                0         (0/0/0)            0
  1       swap    wu       0                0         (0/0/0)            0
  2     backup    wu       0 - 29157       26.69GB    (29158/0/0) 55983360
  3 unassigned    wm       0                0         (0/0/0)            0
  4 unassigned    wm       0                0         (0/0/0)            0
  5 unassigned    wm       0                0         (0/0/0)            0
  6        usr    wm       0 - 29157       26.69GB    (29158/0/0) 55983360
  7 unassigned    wm       0                0         (0/0/0)            0

================================================

Slice 6 is showing 26.69 GB.Is that due to which I was unable to label it?

 

 

 

 

RiaanBadenhorst
Moderator
Moderator
Partner    VIP    Accredited Certified

run

vxdclt enable

vxdisk scandisks

then check

vxdisk -o alldgs list

allaboutunix
Level 6

root@myers# vxdisk -o alldgs list
DEVICE       TYPE            DISK         GROUP        STATUS
emcpower22s2 auto:cdsdisk    VRP_PRD_sapcent_dg01  VRP_PRD_sapcent_dg online
emcpower23s2 auto:cdsdisk    emcpower23s2  VRP_PRD_ora_data_dg online
emcpower24s2 auto:cdsdisk    emcpower24s2  VRP_PRD_ora_data_dg online
emcpower25s2 auto:cdsdisk    emcpower25s2  VRP_PRD_ora_data_dg online
emcpower26s2 auto:cdsdisk    emcpower26s2  VRP_PRD_ora_data_dg online
emcpower27s2 auto:cdsdisk    emcpower27s2  VRP_PRD_ora_bin_dg online
emcpower28s2 auto:cdsdisk    VRP_PRD_ora_arch_dg01  VRP_PRD_ora_arch_dg online
emcpower29s2 auto            -            -            nolabel
emcpower30s2 auto            -            -            nolabel
emcpower33s2 auto            -            -            nolabel
emcpower34s2 auto            -            -            nolabel

===================================================

But, when I try to initialze it shows the below error,

 

root@myers# vxdisksetup -i emcpower29s2 format=cdsdisk
bash: vxdisksetup: command not found
root@myers# /etc/vx/bin/vxdisksetup -i emcpower29s2 format=cdsdisk
VxVM vxdisksetup ERROR V-5-2-2206 emcpower29s2: An invalid device address was specified; it must be of
the form cCtTdD, mcCtTdD or <enclosurename>_<diskno> where

    C = host bus adapter controller number
    T = target device controller number, if used
    D = logical unit (disk) number within target device controller

    <enclosurename> is the logical name of the enclosure to which the
                    disk belongs
    <diskno> is the logical number of the disk

 

How to proceed?

RiaanBadenhorst
Moderator
Moderator
Partner    VIP    Accredited Certified

Ok, now you can proceed to label as we can see the disks have no label and VXVM reports it.

 

You'll need to troubleshoot the labeling with OS support.

Gaurav_S
Moderator
Moderator
   VIP    Certified

Are you still facing errors while labelling disk ?

 

G

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

I have seen the same issue some years ago when Storage Admins assigned new luns to a server.

It turned out to be incorrect Lun settings at EMC array level (they never told us what exactly).

Ask storage admins to compare lun settings of working luns with newly added luns.

Required LUN/Array settings are listed in SF Host and Storage Configuration Guide for Dynamic Multi-Pathing :  http://www.symantec.com/docs/TECH47728

KNR
Level 3
Certified

Have you tried Format -> type -> Autoconfigure and then labelling? 

mikebounds
Level 6
Partner Accredited

Agree with other that if you cannot label from O/S then you need to address this before putting under VxVM control, but for the vxdisksetup command you need to take the s2 off the end so command should be:

vxdisksetup -i emcpower29 format=cdsdisk

Mike

allaboutunix
Level 6

Yes, I found that from the storage side, they didn't give R/W access, now they provided it.

I am now at this stage,

 

root@myers# vxdisksetup -i emcpower29 format=cdsdisk
bash: vxdisksetup: command not found
root@myers# /etc/vx/bin/vxdisksetup -i emcpower29 format=cdsdisk
root@myers# /etc/vx/bin/vxdisksetup -i emcpower30 format=cdsdisk
root@myers# /etc/vx/bin/vxdisksetup -i emcpower33 format=cdsdisk
root@myers# /etc/vx/bin/vxdisksetup -i emcpower34 format=cdsdisk
root@myers# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
emcpower22s2 auto:cdsdisk    VRP_PRD_sapcent_dg01  VRP_PRD_sapcent_dg online
emcpower23s2 auto:cdsdisk    emcpower23s2  VRP_PRD_ora_data_dg online
emcpower24s2 auto:cdsdisk    emcpower24s2  VRP_PRD_ora_data_dg online
emcpower25s2 auto:cdsdisk    emcpower25s2  VRP_PRD_ora_data_dg online
emcpower26s2 auto:cdsdisk    emcpower26s2  VRP_PRD_ora_data_dg online
emcpower27s2 auto:cdsdisk    emcpower27s2  VRP_PRD_ora_bin_dg online
emcpower28s2 auto:cdsdisk    VRP_PRD_ora_arch_dg01  VRP_PRD_ora_arch_dg online
emcpower29s2 auto:cdsdisk    -            -            online
emcpower30s2 auto:cdsdisk    -            -            online
emcpower33s2 auto:cdsdisk    -            -            online
emcpower34s2 auto:cdsdisk    -            -            online

To increase  these filesystems which is under VRP_PRD_ora_data_dg.Shall i have to add luns under VRP_PRD_ora_data_dg and then do vxresize.

Please confirm. Filesystems information are:

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2    30G    15G    14G    52%    /oracle/VRP/sapdata2

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4    30G    15G    14G    51%    /oracle/VRP/sapdata4

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1    30G    14G    15G    49%    /oracle/VRP/sapdata1

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3    30G    27G   2.7G    91%    /oracle/VRP/sapdata3

 

allaboutunix
Level 6

In my instance, under these devices emcpower29s2,emcpower30s2 

How to add disk under VRP_PRD_ora_data_dg disk group & resizing ?

 

 

Thanks.

 

Gaurav_S
Moderator
Moderator
   VIP    Certified

Add your disks to diskgroup using "vxdg -g <diskgroup> adddisk <daname=dmname>"

for e.g

vxdg -g VRP_PRD_ora_data_dg adddisk VRP_PRD_ora_arch_dg02=emcpower29s2

Once you have add all the four disks .. you can resize volume & FS using vxresize command

# vxresize -g <diskgroup> <volume> newsize

for e.g if you want to increase sapdata1 from 30G to 50G

# vxresize -g VRP_PRD_ora_data_dg sapdata1 50G


G

mikebounds
Level 6
Partner Accredited

You need to:

  1. Add disks to disks to diskgroup - example
    vxdg -g VRP_PRD_ora_bin_dg adddisk emcpower29s2

    Run this for each disk you want to add
     
  2. See how much you can resize volume by - example:
    vxassist -g VRP_PRD_ora_bin_dg maxgrow sapdata1 

    If you want to grow onto a particular disk then use:
    vxassist -g VRP_PRD_ora_bin_dg maxgrow sapdata1 emcpower29s2
     
  3. Grow filesystem up to size given in last command - example:
    vxresize -g VRP_PRD_ora_bin_dg  sapdata1 +10g

    If you want to grow onto a particular disk then use:
    vxresize -g VRP_PRD_ora_bin_dg  sapdata1 +10g emcpower29s2

    Note you can use +10G to say grow by 10G or just 40G to say grow to 40G

Mike

 

allaboutunix
Level 6

root@myers# vxdisk -o alldgs -e list
DEVICE       TYPE      DISK         GROUP        STATUS       OS_NATIVE_NAME   ATTR
emcpower22s2 auto      VRP_PRD_sapcent_dg01  VRP_PRD_sapcent_dg online       emcpower22c  -
emcpower23s2 auto      emcpower23s2  VRP_PRD_ora_data_dg online       emcpower23c  -
emcpower24s2 auto      emcpower24s2  VRP_PRD_ora_data_dg online       emcpower24c  -
emcpower25s2 auto      emcpower25s2  VRP_PRD_ora_data_dg online       emcpower25c  -
emcpower26s2 auto      emcpower26s2  VRP_PRD_ora_data_dg online       emcpower26c  -
emcpower27s2 auto      emcpower27s2  VRP_PRD_ora_bin_dg online       emcpower27c  -
emcpower28s2 auto      VRP_PRD_ora_arch_dg01  VRP_PRD_ora_arch_dg online       emcpower28c  -
emcpower29s2 auto      emcpower29s2  VRP_PRD_ora_data_dg online       emcpower29c  -
emcpower30s2 auto      -             -            online       emcpower30c  -
emcpower33s2 auto      -             -            online       emcpower33c  -
emcpower34s2 auto      -             -            online       emcpower34c  -

 

I have made emcpower29s2  in VRP_PRD_ora_data_dg online and now going to resize the filesystem.

But, unable to judge which filesystem should I have to take to resize it.

 

 

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2    30G    15G    14G    52%    /oracle/VRP/sapdata2

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4    30G    15G    14G    51%    /oracle/VRP/sapdata4

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1    30G    14G    15G    49%    /oracle/VRP/sapdata1

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3    30G    27G   2.7G    91%    /oracle/VRP/sapdata3

 

Shall i do in this way,

root@myers# vxresize -g VRP_PRD_ora_data_dg /dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata1 +20g

 

and proceed one by one after adding disk to resize the filesystem.

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata2    

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata4

/dev/vx/dsk/VRP_PRD_ora_data_dg/sapdata3

Shall i do randomly?

 

 

 

allaboutunix
Level 6

Kindly put suggestions.. thanks

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified

But, unable to judge which filesystem should I have to take to resize it. 

We cannot tell you. 
From what I see, sapdata3 has least available space - 91% full.
If this was my environment, I would resize this one first.

Have you checked current volume layout?
vxprint -htr

Volume resize will by default maintain the same volume layout.

Follow the examples in Mike's post of 13 Feb, such as 'vxassist ..... maxgrow .... ', etc.

mikebounds
Level 6
Partner Accredited

What filesystems you grow depend on what you have been asked to do.  My guess is that you have had 4 disks assigned to grow each of the 4 filesystems, so in this case you can pick filesystem randomly and then add next disk and choose next filesystem to grow, so you do this 4 times for your 4 disks and 4 filesystems.

Mike

allaboutunix
Level 6

Getting this error message while extending filesystem,

root@myers# /etc/vx/bin/vxresize -g VRP_PRD_ora_data_dg sapdata1 +20g emcpower29s2


VxVM vxassist ERROR V-5-1-436 Cannot allocate space to grow volume to 104857600 blocks
VxVM vxresize ERROR V-5-1-4703 Problem running vxassist command for volume sapdata1, in diskgroup VRP_PRD_ora_data_dg

 

 

 

root@myers# vxprint -hvt
Disk group: VRP_PRD_ora_data_dg

V  NAME         RVG/VSET/CO  KSTATE   STATE    LENGTH   READPOL   PREFPLEX UTYPE
PL NAME         VOLUME       KSTATE   STATE    LENGTH   LAYOUT    NCOL/WID MODE
SD NAME         PLEX         DISK     DISKOFFS LENGTH   [COL/]OFF DEVICE   MODE
SV NAME         PLEX         VOLNAME  NVOLLAYR LENGTH   [COL/]OFF AM/NM    MODE
SC NAME         PLEX         CACHE    DISKOFFS LENGTH   [COL/]OFF DEVICE   MODE
DC NAME         PARENTVOL    LOGVOL
SP NAME         SNAPVOL      DCO
EX NAME         ASSOC        VC                       PERMS    MODE     STATE

v  media        -            ENABLED  ACTIVE   188743680 SELECT   -        fsgen
pl media-01     media        ENABLED  ACTIVE   188743680 CONCAT   -        RW
sd emcpower23s2-03 media-01  emcpower23s2 62914560 48990208 0     emcpower23 ENA
sd emcpower24s2-03 media-01  emcpower24s2 62914560 48990208 48990208 emcpower24 ENA
sd emcpower25s2-03 media-01  emcpower25s2 62914560 48990208 97980416 emcpower25 ENA
sd emcpower26s2-03 media-01  emcpower26s2 62914560 41773056 146970624 emcpower26 ENA

v  sapdata1     -            ENABLED  ACTIVE   62914560 SELECT    sapdata1-01 fsgen
pl sapdata1-01  sapdata1     ENABLED  ACTIVE   62914560 STRIPE    2/128    RW
sd emcpower23s2-01 sapdata1-01 emcpower23s2 0  31457280 0/0       emcpower23 ENA
sd emcpower24s2-01 sapdata1-01 emcpower24s2 0  31457280 1/0       emcpower24 ENA

v  sapdata2     -            ENABLED  ACTIVE   62914560 SELECT    sapdata2-01 fsgen
pl sapdata2-01  sapdata2     ENABLED  ACTIVE   62914560 STRIPE    2/128    RW
sd emcpower25s2-01 sapdata2-01 emcpower25s2 0  31457280 0/0       emcpower25 ENA
sd emcpower26s2-01 sapdata2-01 emcpower26s2 0  31457280 1/0       emcpower26 ENA

v  sapdata3     -            ENABLED  ACTIVE   62914560 SELECT    sapdata3-01 fsgen
pl sapdata3-01  sapdata3     ENABLED  ACTIVE   62914560 STRIPE    2/128    RW
sd emcpower23s2-02 sapdata3-01 emcpower23s2 31457280 31457280 0/0 emcpower23 ENA
sd emcpower24s2-02 sapdata3-01 emcpower24s2 31457280 31457280 1/0 emcpower24 ENA

v  sapdata4     -            ENABLED  ACTIVE   62914560 SELECT    sapdata4-01 fsgen
pl sapdata4-01  sapdata4     ENABLED  ACTIVE   62914560 STRIPE    2/128    RW
sd emcpower25s2-02 sapdata4-01 emcpower25s2 31457280 31457280 0/0 emcpower25 ENA
sd emcpower26s2-02 sapdata4-01 emcpower26s2 31457280 31457280 1/0 emcpower26 ENA

Disk group: VRP_PRD_ora_arch_dg

V  NAME         RVG/VSET/CO  KSTATE   STATE    LENGTH   READPOL   PREFPLEX UTYPE
PL NAME         VOLUME       KSTATE   STATE    LENGTH   LAYOUT    NCOL/WID MODE
SD NAME         PLEX         DISK     DISKOFFS LENGTH   [COL/]OFF DEVICE   MODE
SV NAME         PLEX         VOLNAME  NVOLLAYR LENGTH   [COL/]OFF AM/NM    MODE
SC NAME         PLEX         CACHE    DISKOFFS LENGTH   [COL/]OFF DEVICE   MODE
DC NAME         PARENTVOL    LOGVOL
SP NAME         SNAPVOL      DCO
EX NAME         ASSOC        VC                       PERMS    MODE     STATE

v  oraarch      -            ENABLED  ACTIVE   62914560 SELECT    -        fsgen
pl oraarch-01   oraarch      ENABLED  ACTIVE   62914560 CONCAT    -        RW
sd VRP_PRD_ora_arch_dg01-01 oraarch-01 VRP_PRD_ora_arch_dg01 0 62914560 0 emcpower28 ENA

 

 

Please help to resolve?