A.I.R., Netbackup 7.6.0.2, DataDomain dd670
Environment:
Master Server Prod = VM ESXi 5.1, Red Hat Enterprise Linux Server release 5.9 (Tikanga), 64 bit, 32 GB, 8 vCPU, Netbackup v7.6.0.2, Capacity License
Media Servers Prod = (5) Windows Standard 2008 R2 64 bit, 32 GB, 8 and 16 Logical Processors, Netbackup 7.6.0.2 (Physical)
Backup Target = Data Domain dd670, 51 useable TB, Data is encrypted on the Data Domain
***
Master Server DR = VM ESXi 5.5, Red Hat Enterprise Linux Server release 6.5 (Santiago), 64 bit, 32 GB, 8 vCPU, Netbackup v7.6.0.2
Media Servers DR = (3) Windows Standard 2008 R2 64 bit, 32 GB, (6) Logical Processors, Netbackup v7.6.0.2 (Physical)
Backup Target = Data Domain dd670, 51 useable TB, data is encrypted on the Data Domain
***
Problematic operation = A.I.R. Imports in the DR environment are taking a long time.
Description: Our Production site initiates a replication from Prod Data Domain to DR Data Domain. This works as expected however the DR site is taking a very long time to import the replicated images into the DR catalog. Our consultant told us that only the "header" of the image is read and so each import should take roughly the same amount of time. Our research combined with our consultants found articles of other environments using Data Domains and A.I.R. where image importants were taking about 6 to 7 minutes each. We could live with that. Howerver, most imports are taking much longer. We have replications with Prod retention of 1 Mo and DR retention 1 Mo and these are essentially differential and Db log offloads. Our full backups have Prod retention of 1 Mo and DR retention of 6 Mo. and include some large file servers and most of our file (non-Db) backups. The 1 Mo to 1 Mo take around 16 to 40 minutes and the 1 Mo to 6 Mo can take as long as 8 hours or more for a single image for a large file server. Clearly this is not consistent with expectations that reading only the header of the image would yield similar import times and is completely unacceptable performance.
Our SLP parameters for imports are set as follows:
Min import images = 50
Max import images = 200
Force interval for small job = 20
***
Disk pool max i/o stream = 30
Storage Unit Max Concurrent = 30
We are using the latest ost plugins from EMC that are available. 2.6.2.0-410681
Please help. We are falling way behind with a queued jobs in excess of 1200 and rising thus we are also not meeting our SLA to the business units.
Thank You.
Hope I am not too late..
Stable DDOS version is 5.4.4.2. This version is only 20 days old. I have it on my 990,890,160,620. fixed issues related to Datadomain and AIR. I still have issues with SLOW AIR IMPORTS and working with support.
Cheers
