cancel
Showing results forΒ 
Search instead forΒ 
Did you mean:Β 

Netbackup appliance 5230 HBA failure - One path down

imtiaz4gis
Level 2

Hi Admins,

I have been troubleshooting an issue with our Netbackup appliance 5230 likely with a failed HBA.

The setup is designed in such a way that we are backing up VMware backups through FiberChannel SAN (Zoned through Cisco MDS 9148 switches) and ultimately the target as VNX 5400 storage with latest Flare code.

The appliance details are as below:

Appliance Model is NetBackup Appliance 5230.

Appliance Version is 2.7.2.

Appliance is configured as media server.

The master server for this media server appliance is xx-xx-xx-xx-01.

All storage partitions are below watermark.
--------------------------------------------------------------------------------
Network Settings
--------------------------------------------------------------------------------


BONDING [Enabled]
-------
bond0 : 10Gb/s FC PLUGGED|UP 10.10.30.4 -- None --
Mode (802.3ad) Slaves ( eth4 eth5 eth6 eth7 )

PHYSICAL DEVICE STATUS
-----------------------
eth0 : 1Gb/s TP UNPLUGGED|UP 192.168.229.233 - No IPv6 -
eth1 : 1Gb/s TP PLUGGED|UP 10.10.0.72 - No IPv6 -
eth2 : 1Gb/s TP UNPLUGGED|UP -- None -- - No IPv6 -
eth3 : 1Gb/s TP UNPLUGGED|UP -- None -- - No IPv6 -
eth4 : 10Gb/s FC PLUGGED|UP|BONDED bond0 - No IPv6 -
eth5 : 10Gb/s FC UNPLUGGED|UP|BONDED bond0 - No IPv6 -
eth6 : 10Gb/s FC UNPLUGGED|UP|BONDED bond0 - No IPv6 -
eth7 : 10Gb/s FC UNPLUGGED|UP|BONDED bond0 - No IPv6 -

ROUTING STATUS
-------------
10.10.1.9 10.10.0.1 eth1
10.1.20.0 10.10.0.1 eth1
default 10.10.30.1 bond0

** VNIC=Virtual Interface TP=Twisted Pair FC=Fibre channel DAC=Direct Attach Copper 1G/10G=1/10 Gigabit Ethernet


| FibreChannel HBA Information
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| ID | Status | Mode | PCI Slot | Port WWN | Speed | Remote Port | State |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 1 | Linkdown | Initiator* | Slot5 | 21:00:00:24:ff:5c:4a:0c | 8 gbit/s | - | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 2 | Linkdown | Initiator | Slot5 | 21:00:00:24:ff:5c:4a:0d | 8 gbit/s | - | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 3 | Linkdown | Initiator* | Slot6 | 21:00:00:24:ff:5f:e0:2e | 8 gbit/s | - | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 4 | Linkdown | Initiator | Slot6 | 21:00:00:24:ff:5f:e0:2f | 8 gbit/s | - | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 5 | Linkdown | Initiator | Slot4 | 21:00:00:24:ff:5c:4b:48 | 8 gbit/s | - | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 6 | Linkdown | Initiator | Slot4 | 21:00:00:24:ff:5c:4b:49 | 8 gbit/s | - | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 7 | Online | Initiator | Slot2 | 21:00:00:24:ff:5f:e1:28 | 8 gbit/s | 0x500143801600adfe* | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+
|| 8 | Online | Initiator | Slot2 | 21:00:00:24:ff:5f:e1:29 | 8 gbit/s | 0x5006016508605dfe* | OK |
|+----+----------+------------+----------+-------------------------+----------+---------------------+-------+


bt-plp-bsme-01.FC> show
- [Info] FTMS mode: none
- [Info] Ignoring port 0x5001438016008eae for 0000:82:00 - it is not online
- [Info] Ignoring port 0x5001438016008eb1 for 0000:82:00 - it is not online
**** FC HBA Cards ****
07:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
07:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
08:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
08:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
81:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
81:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
82:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
82:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)

**** Drivers ****
qla2xxx is loaded
windrvr6 is not loaded

**** Ports ****
Bus ID Slot Port WWN Status Mode Speed Remote Ports
07:00.0 Slot5 21:00:00:24:FF:5C:4A:0C Linkdown Initiator* 8 gbit/s
07:00.1 Slot5 21:00:00:24:FF:5C:4A:0D Linkdown Initiator 8 gbit/s
08:00.0 Slot6 21:00:00:24:FF:5F:E0:2E Linkdown Initiator* 8 gbit/s
08:00.1 Slot6 21:00:00:24:FF:5F:E0:2F Linkdown Initiator 8 gbit/s
81:00.0 Slot4 21:00:00:24:FF:5C:4B:48 Linkdown Initiator 8 gbit/s
81:00.1 Slot4 21:00:00:24:FF:5C:4B:49 Linkdown Initiator 8 gbit/s
82:00.0 Slot2 21:00:00:24:FF:5F:E1:28 Online Initiator 8 gbit/s 0x500143801600adfb
0x500143801600adfe
82:00.1 Slot2 21:00:00:24:FF:5F:E1:29 Online Initiator 8 gbit/s 0x5006016908605dfe
0x5006016508605dfe
0x5006016d08605dfe
0x5006016108605dfe

 

I tried swapping cables, swapping SFPs on the switch and much more but the the link is still showing as "Linkdown" on Slot 4 (as highlighted above). 

I opened a case with Veritas (Case # 21560972) but had no luck finding the issue behind this. A reboot was recommended by Veritas support but since many critical backup jobs run 24X7, I want to avoid going for a reboot of the complete appliance.

I strongly assume there is some "parameter" or setting on the appliance which has to be modified to get the LINK up on Slot 4.

 

Any suggestions are highly appreciated.

Thanks

Taz~

1 REPLY 1

RiaanBadenhorst
Moderator
Moderator
Partner    VIP    Accredited Certified

Hi

So if you move a cable from any of the slot2 ports (which are online) to the slot4 ports it doesn't change to online?

Have you checked from elevated mode if there is a change in the port state (syslog)?