cancel
Showing results for 
Search instead for 
Did you mean: 

High iowait on netbackup server

raunaz
Level 4
Certified

 

Hi All

we found High iowait on netbackup server. Please help me to identify the cause.

84 processes:  80 sleeping, 3 zombie, 1 on cpu
CPU states:  0.0% idle,  0.6% user,  1.3% kernel, 98.1% iowait,  0.0% swap
Memory: 4096M real, 2963M free, 243M swap in use, 11G swap free
 
bash-2.03$ iostat 2 5
   tty        md0           md1           md2           md5            cpu
 tin tout kps tps serv  kps tps serv  kps tps serv  kps tps serv   us sy wt id
   0    5  31   6   18   17   5   13   17   5   13    0   0   30    3 11 23 64
   0  117   0   0    0    0   0    0    0   0    0    0   0    0    4  5 91  0
   0   40   0   0    0    0   0    0    0   0    0    0   0    0    5  6 90  0
   0   40   0   0    0    0   0    0    0   0    0    0   0    0    0  1 98  0
   0   40   0   0    0    0   0    0    0   0    0    0   0    0    4  8 88  0
 

 

found no error on the IO, and no error on dmesg.

 

bash-2.03$ iostat -En
c0t0d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: SEAGATE  Product: ST314670LSUN146G Revision: 045A Serial No: 4742XAET
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c0t1d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: SEAGATE  Product: ST314670LSUN146G Revision: 045A Serial No: 4742XHCH
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c0t2d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: HUS10143ASUN146G Revision: PA05 Serial No: 26TVYSJR
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c0t3d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: HUS10143ASUN146G Revision: PA05 Serial No: 26TVYL48
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
rmt/1           Soft Errors: 0 Hard Errors: 4 Transport Errors: 0
Vendor: HP       Product: Ultrium 2-SCSI   Revision: F63Z Serial No:
rmt/4           Soft Errors: 0 Hard Errors: 0 Transport Errors: 40
Vendor: HP       Product: Ultrium 2-SCSI   Revision: F63Z Serial No:
rmt/2           Soft Errors: 0 Hard Errors: 1 Transport Errors: 0
Vendor: IBM      Product: ULTRIUM-TD2      Revision: 53Y3 Serial No:
rmt/0           Soft Errors: 0 Hard Errors: 0 Transport Errors: 8
Vendor: HP       Product: Ultrium 2-SCSI   Revision: F63Z Serial No:
bash-2.03$
 

 

4 REPLIES 4

Zahid_Haseeb
Moderator
Moderator
Partner    VIP    Accredited

What are you backing up or restore ?

What type of Policy ?

raunaz
Level 4
Certified

The server is backing up Oracle db. But currently i'm checking there is no backup running at the moment. 

BTW, the version is 

 

#cat /opt/openv/netbackup/bin/version
NetBackup-Solaris7 5.1MP3

Zahid_Haseeb
Moderator
Moderator
Partner    VIP    Accredited

While running other backups does Netbackup has same issue ? 

Note:

I have a friendly suggestion for you that upgrade your Netbackup Server.

 

Anton_Panyushki
Level 6
Certified

try prstat -mL to find out an exact CPU microstate that causes waits and iostat zxn 5 50 | grep rmt to discover what happens to tape drives while you are backing up.