Forum Discussion

khalid00213's avatar
10 years ago

unable to mount the filesystem under veritas volume manager

# fsck -m /dev/vx/rdsk/ax4nonprod/MediaLibrary

** /dev/vx/rdsk/ax4nonprod/MediaLibrary

BAD SUPER BLOCK: MAGIC NUMBER WRONG

USE AN ALTERNATE SUPER-BLOCK TO SUPPLY NEEDED INFORMATION;

eg. fsck [-F ufs] -o b=# [special ...]

where # is the alternate super block. SEE fsck_ufs(1M).

 

 

# fsck -F vxfs /dev/vx/rdsk/ax4nonprod/MediaLibrary

UX:vxfs fsck: WARNING: V-3-20836: file system had I/O error(s) on meta-data.

UX:vxfs fsck: WARNING: V-3-20837: file system had I/O error(s) on user data.

log replay in progress

log replay failed to clean file system

file system is not clean, full fsck required

full file system check required, exiting ...

 

 

 

# fsck -F vxfs -o full /dev/vx/rdsk/ax4nonprod/MediaLibrary

UX:vxfs fsck: WARNING: V-3-20836: file system had I/O error(s) on meta-data.

UX:vxfs fsck: WARNING: V-3-20837: file system had I/O error(s) on user data.

log replay in progress

pass0 - checking structural files

pass1 - checking inode sanity and blocks

UX:vxfs fsck: ERROR: V-3-26117:  bc_read failure devid = 0, bno = 1804093680, off = 0, len = 131072

#

 

#  vxdg list

NAME         STATE           ID

ax4flexstor  enabled,cds          1212569692.93.PON140

ax4nonprod   enabled,cds          1211357290.341.PON140

ax4nonprod2  enabled,cds          1343120352.120.PON140

prod         enabled,cds          1163173573.213.PON140

#

#

#

# vxdg list ax4nonprod

Group:     ax4nonprod

dgid:      1211357290.341.PON140

import-id: 1024.91

flags:     cds

version:   120

alignment: 8192 (bytes)

ssb:            on

detach-policy: global

dg-fail-policy: dgdisable

copies:    nconfig=default nlog=default

config:    seqno=0.1660 permlen=1280 free=1202 templen=34 loglen=192

config disk emcpower29s2 copy 1 len=1280 disabled

config disk emcpower30s2 copy 1 len=1280 disabled

config disk emcpower31s2 copy 1 len=1280 disabled

config disk emcpower32s2 copy 1 len=1280 disabled

config disk emcpower33s2 copy 1 len=1280 disabled

config disk emcpower34s2 copy 1 len=1280 disabled

config disk emcpower35s2 copy 1 len=1280 disabled

config disk emcpower36s2 copy 1 len=1280 disabled

config disk emcpower37s2 copy 1 len=1280 disabled

config disk emcpower38s2 copy 1 len=1280 disabled

config disk emcpower39s2 copy 1 len=1280 disabled

config disk emcpower40s2 copy 1 len=1280 disabled

config disk emcpower41s2 copy 1 len=1280 state=clean online

config disk emcpower42s2 copy 1 len=1280 disabled

config disk emcpower43s2 copy 1 len=1280 state=clean online

config disk emcpower44s2 copy 1 len=1280 disabled

config disk emcpower45s2 copy 1 len=1280 disabled

config disk emcpower46s2 copy 1 len=1280 disabled

config disk emcpower47s2 copy 1 len=1280 disabled

config disk emcpower48s2 copy 1 len=1280 disabled

config disk emcpower49s2 copy 1 len=1280 state=clean online

config disk emcpower58s2 copy 1 len=48144 disabled

config disk emcpower59s2 copy 1 len=48144 disabled

config disk emcpower60s2 copy 1 len=48144 disabled

config disk emcpower61s2 copy 1 len=48144 disabled

config disk emcpower62s2 copy 1 len=48144 disabled

config disk emcpower63s2 copy 1 len=48144 disabled

config disk emcpower64s2 copy 1 len=48144 disabled

config disk emcpower66s2 copy 1 len=48144 disabled

config disk emcpower68s2 copy 1 len=48144 disabled

config disk emcpower69s2 copy 1 len=48144 state=clean online

config disk emcpower73s2 copy 1 len=48144 disabled

config disk emcpower74s2 copy 1 len=48144 disabled

config disk emcpower75s2 copy 1 len=48144 state=clean online

config disk emcpower76s2 copy 1 len=48144 disabled

config disk emcpower77s2 copy 1 len=48144 disabled

config disk emcpower78s2 copy 1 len=48144 disabled

config disk emcpower79s2 copy 1 len=48144 disabled

config disk emcpower80s2 copy 1 len=48144 disabled

config disk emcpower81s2 copy 1 len=48144 disabled

config disk emcpower82s2 copy 1 len=48144 disabled

config disk emcpower83s2 copy 1 len=48144 disabled

config disk emcpower84s2 copy 1 len=48144 disabled

config disk emcpower85s2 copy 1 len=48144 state=clean online

config disk emcpower102s2 copy 1 len=48144 disabled

config disk emcpower103s2 copy 1 len=48144 disabled

config disk emcpower104s2 copy 1 len=48144 disabled

config disk emcpower105s2 copy 1 len=48144 disabled

config disk emcpower106s2 copy 1 len=48144 state=clean online

config disk emcpower107s2 copy 1 len=48144 disabled

log disk emcpower29s2 copy 1 len=192 disabled

log disk emcpower30s2 copy 1 len=192

log disk emcpower31s2 copy 1 len=192 disabled

log disk emcpower32s2 copy 1 len=192 disabled

log disk emcpower33s2 copy 1 len=192 disabled

log disk emcpower34s2 copy 1 len=192

log disk emcpower35s2 copy 1 len=192

log disk emcpower36s2 copy 1 len=192 disabled

log disk emcpower37s2 copy 1 len=192 disabled

log disk emcpower38s2 copy 1 len=192 disabled

log disk emcpower39s2 copy 1 len=192 disabled

log disk emcpower40s2 copy 1 len=192 disabled

log disk emcpower41s2 copy 1 len=192 disabled

log disk emcpower42s2 copy 1 len=192 disabled

log disk emcpower43s2 copy 1 len=192 disabled

log disk emcpower44s2 copy 1 len=192 disabled

log disk emcpower45s2 copy 1 len=192 disabled

log disk emcpower46s2 copy 1 len=192 disabled

log disk emcpower47s2 copy 1 len=192

log disk emcpower48s2 copy 1 len=192 disabled

log disk emcpower49s2 copy 1 len=192 disabled

log disk emcpower58s2 copy 1 len=7296 disabled

log disk emcpower59s2 copy 1 len=7296 disabled

log disk emcpower60s2 copy 1 len=7296 disabled

log disk emcpower61s2 copy 1 len=7296 disabled

log disk emcpower62s2 copy 1 len=7296

log disk emcpower63s2 copy 1 len=7296 disabled

log disk emcpower64s2 copy 1 len=7296 disabled

log disk emcpower66s2 copy 1 len=7296

log disk emcpower68s2 copy 1 len=7296 disabled

log disk emcpower69s2 copy 1 len=7296 disabled

log disk emcpower73s2 copy 1 len=7296 disabled

log disk emcpower74s2 copy 1 len=7296 disabled

log disk emcpower75s2 copy 1 len=7296 disabled

log disk emcpower76s2 copy 1 len=7296 disabled

log disk emcpower77s2 copy 1 len=7296 disabled

log disk emcpower78s2 copy 1 len=7296

log disk emcpower79s2 copy 1 len=7296 disabled

log disk emcpower80s2 copy 1 len=7296 disabled

log disk emcpower81s2 copy 1 len=7296 disabled

log disk emcpower82s2 copy 1 len=7296 disabled

log disk emcpower83s2 copy 1 len=7296 disabled

log disk emcpower84s2 copy 1 len=7296 disabled

log disk emcpower85s2 copy 1 len=7296 disabled

log disk emcpower102s2 copy 1 len=7296 disabled

log disk emcpower103s2 copy 1 len=7296 disabled

log disk emcpower104s2 copy 1 len=7296 disabled

log disk emcpower105s2 copy 1 len=7296 disabled

log disk emcpower106s2 copy 1 len=7296 disabled

log disk emcpower107s2 copy 1 len=7296 disabled

#

 

# vxdisk -g ax4nonprod -e list

DEVICE       TYPE      DISK         GROUP        STATUS       OS_NATIVE_NAME

emcpower29s2 auto      ax4nonprod01  ax4nonprod   online       emcpower29c

emcpower30s2 auto      ax4nonprod02  ax4nonprod   online       emcpower30c

emcpower31s2 auto      ax4nonprod03  ax4nonprod   online       emcpower31c

emcpower32s2 auto      ax4nonprod04  ax4nonprod   online       emcpower32c

emcpower33s2 auto      ax4nonprod05  ax4nonprod   online       emcpower33c

emcpower34s2 auto      ax4nonprod06  ax4nonprod   online       emcpower34c

emcpower35s2 auto      ax4nonprod07  ax4nonprod   online       emcpower35c

emcpower36s2 auto      ax4nonprod08  ax4nonprod   online       emcpower36c

emcpower37s2 auto      ax4nonprod09  ax4nonprod   online       emcpower37c

emcpower38s2 auto      ax4nonprod10  ax4nonprod   online       emcpower38c

emcpower39s2 auto      ax4nonprod11  ax4nonprod   online       emcpower39c

emcpower40s2 auto      ax4nonprod12  ax4nonprod   online       emcpower40c

emcpower41s2 auto      ax4nonprod13  ax4nonprod   online       emcpower41c

emcpower42s2 auto      ax4nonprod14  ax4nonprod   online       emcpower42c

emcpower43s2 auto      ax4nonprod15  ax4nonprod   online       emcpower43c

emcpower44s2 auto      ax4nonprod16  ax4nonprod   online       emcpower44c

emcpower45s2 auto      ax4nonprod17  ax4nonprod   online       emcpower45c

emcpower46s2 auto      ax4nonprod18  ax4nonprod   online       emcpower46c

emcpower47s2 auto      ax4nonprod19  ax4nonprod   online       emcpower47c

emcpower48s2 auto      ax4nonprod20  ax4nonprod   online       emcpower48c

emcpower49s2 auto      ax4nonprod21  ax4nonprod   online       emcpower49c

emcpower58s2 auto      ax4nonprod22  ax4nonprod   online       emcpower58c

emcpower59s2 auto      ax4nonprod23  ax4nonprod   online       emcpower59c

emcpower60s2 auto      ax4nonprod24  ax4nonprod   online       emcpower60c

emcpower61s2 auto      ax4nonprod25  ax4nonprod   online       emcpower61c

emcpower62s2 auto      ax4nonprod26  ax4nonprod   online       emcpower62c

emcpower63s2 auto      ax4nonprod27  ax4nonprod   online       emcpower63c

emcpower64s2 auto      ax4nonprod28  ax4nonprod   online       emcpower64c

emcpower66s2 auto      ax4nonprod29  ax4nonprod   online       emcpower66c

emcpower68s2 auto      ax4nonprod30  ax4nonprod   online       emcpower68c

emcpower69s2 auto      ax4nonprod31  ax4nonprod   online       emcpower69c

emcpower73s2 auto      ax4nonprod39  ax4nonprod   online       emcpower73c

emcpower74s2 auto      ax4nonprod40  ax4nonprod   online       emcpower74c

emcpower75s2 auto      ax4nonprod41  ax4nonprod   online       emcpower75c

emcpower76s2 auto      ax4nonprod42  ax4nonprod   online       emcpower76c

emcpower77s2 auto      ax4nonprod43  ax4nonprod   online       emcpower77c

emcpower78s2 auto      ax4nonprod44  ax4nonprod   online       emcpower78c

emcpower79s2 auto      ax4nonprod32  ax4nonprod   online       emcpower79c

emcpower80s2 auto      ax4nonprod33  ax4nonprod   online       emcpower80c

emcpower81s2 auto      ax4nonprod34  ax4nonprod   online       emcpower81c

emcpower82s2 auto      ax4nonprod35  ax4nonprod   online       emcpower82c

emcpower83s2 auto      ax4nonprod36  ax4nonprod   online       emcpower83c

emcpower84s2 auto      ax4nonprod37  ax4nonprod   online       emcpower84c

emcpower85s2 auto      ax4nonprod38  ax4nonprod   online       emcpower85c

emcpower102s2 auto      ax4nonprod45  ax4nonprod   online       emcpower102c

emcpower103s2 auto      ax4nonprod46  ax4nonprod   online       emcpower103c

emcpower104s2 auto      ax4nonprod47  ax4nonprod   online       emcpower104c

emcpower105s2 auto      ax4nonprod48  ax4nonprod   online       emcpower105c

emcpower106s2 auto      ax4nonprod49  ax4nonprod   online       emcpower106c

emcpower107s2 auto      ax4nonprod50  ax4nonprod   online       emcpower107c

 

 

# vxdisk list | grep -i ax4nonprod

emcpower29s2 auto:cdsdisk    ax4nonprod01  ax4nonprod   online

emcpower30s2 auto:cdsdisk    ax4nonprod02  ax4nonprod   online

emcpower31s2 auto:cdsdisk    ax4nonprod03  ax4nonprod   online

emcpower32s2 auto:cdsdisk    ax4nonprod04  ax4nonprod   online

emcpower33s2 auto:cdsdisk    ax4nonprod05  ax4nonprod   online

emcpower34s2 auto:cdsdisk    ax4nonprod06  ax4nonprod   online

emcpower35s2 auto:cdsdisk    ax4nonprod07  ax4nonprod   online

emcpower36s2 auto:cdsdisk    ax4nonprod08  ax4nonprod   online

emcpower37s2 auto:cdsdisk    ax4nonprod09  ax4nonprod   online

emcpower38s2 auto:cdsdisk    ax4nonprod10  ax4nonprod   online

emcpower39s2 auto:cdsdisk    ax4nonprod11  ax4nonprod   online

emcpower40s2 auto:cdsdisk    ax4nonprod12  ax4nonprod   online

emcpower41s2 auto:cdsdisk    ax4nonprod13  ax4nonprod   online

emcpower42s2 auto:cdsdisk    ax4nonprod14  ax4nonprod   online

emcpower43s2 auto:cdsdisk    ax4nonprod15  ax4nonprod   online failing

emcpower44s2 auto:cdsdisk    ax4nonprod16  ax4nonprod   online

emcpower45s2 auto:cdsdisk    ax4nonprod17  ax4nonprod   online

emcpower46s2 auto:cdsdisk    ax4nonprod18  ax4nonprod   online

emcpower47s2 auto:cdsdisk    ax4nonprod19  ax4nonprod   online

emcpower48s2 auto:cdsdisk    ax4nonprod20  ax4nonprod   online

emcpower49s2 auto:cdsdisk    ax4nonprod21  ax4nonprod   online

emcpower58s2 auto:cdsdisk    ax4nonprod22  ax4nonprod   online

emcpower59s2 auto:cdsdisk    ax4nonprod23  ax4nonprod   online

emcpower60s2 auto:cdsdisk    ax4nonprod24  ax4nonprod   online

emcpower61s2 auto:cdsdisk    ax4nonprod25  ax4nonprod   online

emcpower62s2 auto:cdsdisk    ax4nonprod26  ax4nonprod   online

emcpower63s2 auto:cdsdisk    ax4nonprod27  ax4nonprod   online

emcpower64s2 auto:cdsdisk    ax4nonprod28  ax4nonprod   online

emcpower66s2 auto:cdsdisk    ax4nonprod29  ax4nonprod   online

emcpower68s2 auto:cdsdisk    ax4nonprod30  ax4nonprod   online

emcpower69s2 auto:cdsdisk    ax4nonprod31  ax4nonprod   online

emcpower73s2 auto:cdsdisk    ax4nonprod39  ax4nonprod   online

emcpower74s2 auto:cdsdisk    ax4nonprod40  ax4nonprod   online

emcpower75s2 auto:cdsdisk    ax4nonprod41  ax4nonprod   online

emcpower76s2 auto:cdsdisk    ax4nonprod42  ax4nonprod   online

emcpower77s2 auto:cdsdisk    ax4nonprod43  ax4nonprod   online

emcpower78s2 auto:cdsdisk    ax4nonprod44  ax4nonprod   online

emcpower79s2 auto:cdsdisk    ax4nonprod32  ax4nonprod   online

emcpower80s2 auto:cdsdisk    ax4nonprod33  ax4nonprod   online

emcpower81s2 auto:cdsdisk    ax4nonprod34  ax4nonprod   online

emcpower82s2 auto:cdsdisk    ax4nonprod35  ax4nonprod   online

emcpower83s2 auto:cdsdisk    ax4nonprod36  ax4nonprod   online

emcpower84s2 auto:cdsdisk    ax4nonprod37  ax4nonprod   online

emcpower85s2 auto:cdsdisk    ax4nonprod38  ax4nonprod   online

emcpower94s2 auto:cdsdisk    ax4nonprod205  ax4nonprod2  online

emcpower95s2 auto:cdsdisk    ax4nonprod206  ax4nonprod2  online

emcpower96s2 auto:cdsdisk    ax4nonprod207  ax4nonprod2  online

emcpower97s2 auto:cdsdisk    ax4nonprod208  ax4nonprod2  online

emcpower98s2 auto:cdsdisk    ax4nonprod203  ax4nonprod2  online

emcpower99s2 auto:cdsdisk    ax4nonprod204  ax4nonprod2  online

emcpower100s2 auto:cdsdisk    ax4nonprod201  ax4nonprod2  online

emcpower101s2 auto:cdsdisk    ax4nonprod202  ax4nonprod2  online

emcpower102s2 auto:cdsdisk    ax4nonprod45  ax4nonprod   online

emcpower103s2 auto:cdsdisk    ax4nonprod46  ax4nonprod   online

emcpower104s2 auto:cdsdisk    ax4nonprod47  ax4nonprod   online

emcpower105s2 auto:cdsdisk    ax4nonprod48  ax4nonprod   online

emcpower106s2 auto:cdsdisk    ax4nonprod49  ax4nonprod   online

emcpower107s2 auto:cdsdisk    ax4nonprod50  ax4nonprod   online

  • Have a look at http://www.symantec.com/business/support/index?page=content&id=TECH73786 - this says:

    These errors indicate a complete loss of data on the file system, and there is no other option but to re-create file system, then restore data from backup.

     

    However you also have a failing disk:

    emcpower43s2 auto:cdsdisk    ax4nonprod15  ax4nonprod   online failing

    So you should check this disk is ok (from a disk array point of view) and if you are happy that disk is ok then set failing to off:

    vxedit -g ax4nonprod    set failing=off ax4nonprod15  
    
    


    ​Also check volume is ok:

    vxprint -vg ax4nonprod    ​​

     

    I would then check you can dd read from your filesystem:

    dd if=/dev/vx/rdsk/ax4nonprod/MediaLibrary count=10 of=/dev/null

     

    If you can read from raw device, then you probably need to re-create file system and restore data from backup, if fsck is still failing.

    Mike

     

  • Have a look at http://www.symantec.com/business/support/index?page=content&id=TECH73786 - this says:

    These errors indicate a complete loss of data on the file system, and there is no other option but to re-create file system, then restore data from backup.

     

    However you also have a failing disk:

    emcpower43s2 auto:cdsdisk    ax4nonprod15  ax4nonprod   online failing

    So you should check this disk is ok (from a disk array point of view) and if you are happy that disk is ok then set failing to off:

    vxedit -g ax4nonprod    set failing=off ax4nonprod15  
    
    


    ​Also check volume is ok:

    vxprint -vg ax4nonprod    ​​

     

    I would then check you can dd read from your filesystem:

    dd if=/dev/vx/rdsk/ax4nonprod/MediaLibrary count=10 of=/dev/null

     

    If you can read from raw device, then you probably need to re-create file system and restore data from backup, if fsck is still failing.

    Mike

     

  • bc_read failure devid = 0, bno = 1804093680, off = 0, len = 131072

    There should be something in syslog (/var/adm/messages) that indicates hardware failure.

    Hope you have good backups....