Forum Discussion

Nicenavin's avatar
Nicenavin
Level 4
11 years ago

Deduplication for Remote backups

Hi All,

I need good solution on the following;

There are 40 servers (Full backup data size is 4.2 TB) netbackup 7.1 clients in remote location (A). There I have 4.9 TB of space provided to accommodate the backup with 2months retention period.

Also, I have 5 TB space available in another location (B).

When I transferred the data from location A to B , per day (24hrs) 40 GB of data only able to transfer to location B.

If I enable client side deduplication, how it will work, I will get any good throughput over the WAN.

Anyone have good advice to move the backups?

 

Thanks in advance,

Regards,

Navin

7.1.x and Earlier
Backing Up
Backup and Recovery
NetBackup
Tip-How to
Windows Server (2003-2008)
  • Mark_Solutions's avatar
    Mark_Solutions
    11 years ago

    Client side de-dupe and accelerator work well for remote offices but if your storage is local to the remote site then MSDP on both sites is the way to go and just use a SLP to control the data flow - so backup is MSDP storage on remote site and Duplication to MSDP at local site

    Should work OK - just makes me wonder what else you do at the local site?

    If you have 4.5 TB at Site A and 5 TB at Site B i get the feeling that you probably do backups at site B too - so do make sure you actually have enough free space at Site B to duplicate the backups from Site A to it without filling it up - also set your retention periods carefully when doing this

     

    Generally if you do backups at both sites and want to duplicate one site to the other you would want a much larger MSDP pool at site B

    Hope this helps

11 Replies

Sort By
  • muhanad_daher's avatar
    muhanad_daher
    Level 6
    11 years ago

    Hello,

    you can use Accelerator feature beside client side ded on pure disk storage, upgrade the Netbackup to 7.5.0.x and then open ports between client and you storage host (10082, 10101, 10102, 10085).

     

  • bp_kill_all's avatar
    bp_kill_all
    Level 3
    11 years ago

    From what I understand you want to run local backups to site A, where you have 4.9TB disk for this purpose (this seems like it's possibly tight depending on your change rate).

    What you want is a media server with MSDP in location A and then optimized duplications using SLP's to site B where another MSDP pool should sit.

    Beware that the initial duplication will not gain much optimization from dedup as the receiving end will not have a dedup baseline.

  • Mark_Solutions's avatar
    Mark_Solutions
    Level 6
    11 years ago

    Client side de-dupe and accelerator work well for remote offices but if your storage is local to the remote site then MSDP on both sites is the way to go and just use a SLP to control the data flow - so backup is MSDP storage on remote site and Duplication to MSDP at local site

    Should work OK - just makes me wonder what else you do at the local site?

    If you have 4.5 TB at Site A and 5 TB at Site B i get the feeling that you probably do backups at site B too - so do make sure you actually have enough free space at Site B to duplicate the backups from Site A to it without filling it up - also set your retention periods carefully when doing this

     

    Generally if you do backups at both sites and want to duplicate one site to the other you would want a much larger MSDP pool at site B

    Hope this helps

  • Mark_Solutions's avatar
    Mark_Solutions
    Level 6
    11 years ago

    Dont forget once your question is answered to close the thread off using the "Mark as solution" option

  • Nicenavin's avatar
    Nicenavin
    Level 4
    11 years ago

    Configured Dedup volume in site A and B and staging process started for backup movement...

  • Marianne's avatar
    Marianne
    Level 6
    11 years ago

    Issue not yet resolved?

    It seems your issue is with transfer rates when you duplicate backups from site A to site B, right?

    The first duplication needs to send EVERYTHING. Nothing we can do about your bandwith. You need to allow this to complete. No way around this unless you can pick up media server and storage at Site A and move to site B to ensure best possible bandwidth for initial duplication.
    Only after initial copy (seeding) has completed will Optimized Duplication start and send only changed blocks to site B.

    If the changes are more than 40GB per day on site A, you need to upgrade the network between the 2 sites. Nothing can be done from NBU point of view if bandwith between sites is inadequate.