Adding Shared Storage - Possible Inconsistancy?

Question

Hi Folks,
Can you clarify my understandinging?
I have added an extra disk into a server, however when I view it from&nbsp;mylittleexpensiveserver02 I get a different view see below

DEVICE &nbsp; &nbsp; &nbsp; TYPE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;DISK &nbsp; &nbsp; &nbsp; &nbsp; GROUP &nbsp; &nbsp; &nbsp; &nbsp;STATUS
disk_0 &nbsp; &nbsp; &nbsp; auto:none &nbsp; &nbsp; &nbsp; - &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;online invalid
fas31400_1 &nbsp; auto:cdsdisk &nbsp; &nbsp;netbackup02 &nbsp;netbackup &nbsp; &nbsp;online thinrclm nohotuse
fas31400_2 &nbsp; auto:cdsdisk &nbsp; &nbsp;netbackup01 &nbsp;netbackup &nbsp; &nbsp;online thinrclm nohotuse
fas31400_3 &nbsp; auto:cdsdisk &nbsp; &nbsp;netbackup03 &nbsp;netbackup &nbsp; &nbsp;online thinrclm
fas31400_4 &nbsp; auto &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;error
[root@server01 ~]#&nbsp;
&nbsp;

DEVICE &nbsp; &nbsp; &nbsp; TYPE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;DISK &nbsp; &nbsp; &nbsp; &nbsp; GROUP &nbsp; &nbsp; &nbsp; &nbsp;STATUS
	disk_0 &nbsp; &nbsp; &nbsp; auto:none &nbsp; &nbsp; &nbsp; - &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;online invalid
	fas31400_1 &nbsp; auto:cdsdisk &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;(netbackup) &nbsp;online thinrclm
	fas31400_2 &nbsp; auto:cdsdisk &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;(netbackup) &nbsp;online thinrclm
	fas31400_3 &nbsp; auto &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;error
	fas31400_4 &nbsp; auto:cdsdisk &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;(netbackup) &nbsp;online thinrclm
	[root@server02 ~]#&nbsp;
	&nbsp;

group &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; resource &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; system &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; message &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			--------------- -------------------- -------------------- --------------------
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server01 &nbsp; &nbsp; &nbsp;RUNNING &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server02 &nbsp; &nbsp; &nbsp;RUNNING &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			nbu &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			nbu &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server02 &nbsp; &nbsp; &nbsp;OFFLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			-------------------------------------------------------------------------
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_dg &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_dg &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; server02 &nbsp; &nbsp; &nbsp;OFFLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_ip &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_ip &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; server02 &nbsp; &nbsp; &nbsp;OFFLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_mount &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			-------------------------------------------------------------------------
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_mount &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server02 &nbsp; &nbsp; &nbsp;OFFLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_server &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_server &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; server02 &nbsp; &nbsp; &nbsp;OFFLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_CISN-STOR-UNIX_proxy server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_CISN-STOR-UNIX_proxy server02 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			-------------------------------------------------------------------------
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_bond0_proxy &nbsp; &nbsp; &nbsp;server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_bond0_proxy &nbsp; &nbsp; &nbsp;server02 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_ie1csnap002_proxy server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_ie1csnap002_proxy server02 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_vol &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server01 &nbsp; &nbsp; &nbsp;ONLINE &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
			-------------------------------------------------------------------------
			&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; nbu_vol &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;server02 &nbsp; &nbsp; &nbsp;OFFLINE &nbsp;
			&nbsp;

I dont understand why I am seeing different views of the storage unless server02 is looking at it down a different scsi bus?
Any help appreciated
&nbsp;
--Steve

gaurav_s · Answer

Hi Steve,
On server 1
fas31400_4 &nbsp; auto &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;error
&amp; on Server 2
fas31400_3 &nbsp; auto &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;- &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;error
both above might be same disks however names are appearing different. I am saying this because I see other three Netbackup disks available already. The numbering here depends on how the device tree was built by operating system &amp; then by veritas in same order.
If you want to make sure that above are same disks, you can run a /etc/vx/diag.d/vxscsiinq&nbsp; command on these disks to find their serial number. If these disks are same, their serial numbers should be same.
As the disks are appearing in error state, it is possible that paths to disks are inaccessible. Paste below output&nbsp; to confirm
server01 # vxdisk list fas31400_4
server02# vxdisk list fas31400_3
Were these devices labelled at operating system ?&nbsp; what is the OS version &amp; vxvm version ?
&nbsp;
G

sherbertpunt · Answer

Hi G
&nbsp;
It looks like we have found the inconsistancy
--------- Decoded Inquiry Information for /dev/vx/dmp/fas31400_3

Vendor Identification : NETAPP
Product Identification : LUN
Revision Number : 811a
Serial Number : 2Fht/?Cl7FPY
[root@server001 ~]# /etc/vx/diag.d/vxscsiinq /dev/vx/dmp/fas31400_4

--------- Decoded Inquiry Information for /dev/vx/dmp/fas31400_4

Vendor Identification : NETAPP
Product Identification : LUN
Revision Number : 811a
Serial Number : 2Fht/?Cl7FP/
[root@server001 ~]#

[root@server002 ~]# /etc/vx/diag.d/vxscsiinq /dev/vx/dmp/fas31400_3

--------- Decoded Inquiry Information for /dev/vx/dmp/fas31400_3

Vendor Identification : NETAPP
Product Identification : LUN
Revision Number : 811a
Serial Number : 2Fht/?Cl7FPb
[root@server002 ~]# /etc/vx/diag.d/vxscsiinq /dev/vx/dmp/fas31400_4

--------- Decoded Inquiry Information for /dev/vx/dmp/fas31400_4

Vendor Identification : NETAPP
Product Identification : LUN
Revision Number : 811a
Serial Number : 2Fht/?Cl7FPY
[root@server002 ~]#
&nbsp;
&nbsp;

sherbertpunt · Answer

&nbsp;vxdisk list fas31400_3
	Device:&nbsp;&nbsp;&nbsp; fas31400_3
	devicetag: fas31400_3
	type:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; auto
	hostid:&nbsp;&nbsp;&nbsp; .my.domain
	disk:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; name=netbackup03 id=1392647523.10.server001.my.domain
	group:&nbsp;&nbsp;&nbsp;&nbsp; name=netbackup id=1294857196.7.server001.my.domain
	info:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; format=cdsdisk,privoffset=256,pubslice=3,privslice=3
	flags:&nbsp;&nbsp;&nbsp;&nbsp; online ready private autoconfig noautoimport imported thinrclm
	pubpaths:&nbsp; block=/dev/vx/dmp/fas31400_3s3 char=/dev/vx/rdmp/fas31400_3s3
	guid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {44bad38e-97e0-11e3-b5fe-76813428bcd1}
	udid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NETAPP%5FLUN%5F200000168250%5F2Fht%2F%3FCl7FPY
	site:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	version:&nbsp;&nbsp; 3.1
	iosize:&nbsp;&nbsp;&nbsp; min=512 (bytes) max=1024 (blocks)
	public:&nbsp;&nbsp;&nbsp; slice=3 offset=65792 len=1048561008 disk_offset=0
	private:&nbsp;&nbsp; slice=3 offset=256 len=65536 disk_offset=0
	update:&nbsp;&nbsp;&nbsp; time=1392647541 seqno=0.7
	ssb:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; actual_seqno=0.0
	headers:&nbsp;&nbsp; 0 240
	configs:&nbsp;&nbsp; count=1 len=51360
	logs:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; count=1 len=4096
	Defined regions:
	&nbsp;config&nbsp;&nbsp; priv 000048-000239[000192]: copy=01 offset=000000 enabled
	&nbsp;config&nbsp;&nbsp; priv 000256-051423[051168]: copy=01 offset=000192 enabled
	&nbsp;log&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; priv 051424-055519[004096]: copy=01 offset=000000 enabled
	&nbsp;lockrgn&nbsp; priv 055520-055663[000144]: part=00 offset=000000
	Multipathing information:
	numpaths:&nbsp;&nbsp; 1
	sdd&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; state=enabled

[root@server001 ~]# vxdisk list fas31400_4
	Device:&nbsp;&nbsp;&nbsp; fas31400_4
	devicetag: fas31400_4
	type:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; auto
	flags:&nbsp;&nbsp;&nbsp;&nbsp; error private autoconfig
	pubpaths:&nbsp; block=/dev/vx/dmp/fas31400_4 char=/dev/vx/rdmp/fas31400_4
	guid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	udid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NETAPP%5FLUN%5F200000168250%5F2Fht%2F%3FCl7FP%2F
	site:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	Multipathing information:
	numpaths:&nbsp;&nbsp; 1
	sde&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; state=enabled
	[root@server001 ~]#
	
	[root@server002 ~]# vxdisk list fas31400_3
	Device:&nbsp;&nbsp;&nbsp; fas31400_3
	devicetag: fas31400_3
	type:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; auto
	flags:&nbsp;&nbsp;&nbsp;&nbsp; error private autoconfig
	pubpaths:&nbsp; block=/dev/vx/dmp/fas31400_3 char=/dev/vx/rdmp/fas31400_3
	guid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	udid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NETAPP%5FLUN%5F200000168250%5F2Fht%2F%3FCl7FPb
	site:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	Multipathing information:
	numpaths:&nbsp;&nbsp; 1
	sde&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; state=enabled
	[root@server002 ~]#
	
	[root@server002 ~]# vxdisk list fas31400_4
	Device:&nbsp;&nbsp;&nbsp; fas31400_4
	devicetag: fas31400_4
	type:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; auto
	hostid:&nbsp;&nbsp;&nbsp; server001.my.domain
	disk:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; name= id=1392647523.10.server001.my.domain
	group:&nbsp;&nbsp;&nbsp;&nbsp; name=netbackup id=1294857196.7.server001.my.domain
	info:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; format=cdsdisk,privoffset=256,pubslice=3,privslice=3
	flags:&nbsp;&nbsp;&nbsp;&nbsp; online ready private autoconfig noautoimport thinrclm
	pubpaths:&nbsp; block=/dev/vx/dmp/fas31400_4s3 char=/dev/vx/rdmp/fas31400_4s3
	guid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	udid:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NETAPP%5FLUN%5F200000168250%5F2Fht%2F%3FCl7FPY
	site:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
	version:&nbsp;&nbsp; 3.1
	iosize:&nbsp;&nbsp;&nbsp; min=512 (bytes) max=1024 (blocks)
	public:&nbsp;&nbsp;&nbsp; slice=3 offset=65792 len=1048561008 disk_offset=0
	private:&nbsp;&nbsp; slice=3 offset=256 len=65536 disk_offset=0
	update:&nbsp;&nbsp;&nbsp; time=1392647541 seqno=0.7
	ssb:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; actual_seqno=0.0
	headers:&nbsp;&nbsp; 0 240
	configs:&nbsp;&nbsp; count=1 len=51360
	logs:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; count=1 len=4096
	Defined regions:
	&nbsp;config&nbsp;&nbsp; priv 000048-000239[000192]: copy=01 offset=000000 enabled
	&nbsp;config&nbsp;&nbsp; priv 000256-051423[051168]: copy=01 offset=000192 enabled
	&nbsp;log&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; priv 051424-055519[004096]: copy=01 offset=000000 enabled
	&nbsp;lockrgn&nbsp; priv 055520-055663[000144]: part=00 offset=000000
	Multipathing information:
	numpaths:&nbsp;&nbsp; 1
	sdd&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; state=enabled
	[root@server002 ~]#
	
	&nbsp;

gaurav_s · Answer

On Server 1, the serial number of disk is
Serial Number : 2Fht/?Cl7FP/
On Server 2, serial number of disk is
Serial Number : 2Fht/?Cl7FPb
which is different with a last digit, can you double check with storage team if these are indeen same Luns or different ? Though vxscsiinfo shouldn't report inconsistencies but here the difference is of 1 digit (last one) , would be better to confirm with storage team about both these Luns.
from vxdisk list output, the paths to disks are enabled. have you tried doing a fdisk, layout a partition table &amp; then do a "vxdisksetup" on the disk ? I am assuming this is new disk &amp; there is no data on the disk.
&nbsp;
G
&nbsp;
&nbsp;

Forum Discussion

Adding Shared Storage - Possible Inconsistancy?

Related Content

[Snapshot Manager] Inconsistency between Cloud and Storage sections

How to configure wasabi WORM storage

NetBackup Storage Space Full issue

Status 42 on VMware backups (somewhat inconsistent)

Storage server error

Recent Discussions

NFS service group getting offline automatically

Storage not sufficient

Issue updating EEB

Regarding service group freeze and offline service group

PLEASE do NOT post product queries in this forum