Verifying client side deduplication

[DPO]

We have 10 clients in a policy using the same storage unit (appliance diskpool). For policy " Disable client side dedup" is un-checked. And for testing purpose, I have added a client in Master server property specify "prefer to use client side dedup". Looks like client side dedup is not happening.

Did I miss anything here ?

How to ensure client side dedup is working or not.

[Nicolai]

Monitor the NIC during backup - if client side dedupe is active no increased NIC load should be seen.

[sri_vani]

Please verify the Datailed Backup Job Status
If client deduplication is enabed, message wld be somethings like

 (pid=xxx) Using OpenStorage client direct to backup from client nbuclient to nbumedia..

https://www-secure.symantec.com/connect/forums/how-esure-client-side-deduplication-being-used

[DPO]

Yes I can see the below entry. Is this only way to identify ?

(pid=xxx) Using OpenStorage client direct to backup from client nbuclient to nbumedia..

What I basically want to know is how much data was transferred over wire.

[Marianne]

Wait for job to finish.

You will see amount of actual data that was transferred and dedupe rate in Job Details.

[DPO]

Hi Marianne,

We use deduplication at media server and also client side dedup. For both backups , I can see "Scanned, Sent , CR sent" entries in Detailed status. But I couldn't distinguish exactly whether it is client side dedup or media server dedup (We use MSDP pools)

[DPO]

Any thoughts on this ?

[sri_vani]

Hi Ashok,

For Client deduplication jobs it shows two duplication rates.

1st duplication rate for the client data and the 2nd data for disk image header and TIR(if applicable)

also u will see in the begining lines Using OpenStorage client direct  xxxxxxx

For more details:

Please verify the below link

http://www.symantec.com/business/support/index?page=content&id=TECH135526

check page number 85 and 86

[DPO]

I see below lines in Detaied status. How do I interpret this.

12/04/2013 20:59:17 - Info MediaServer (pid=7573) Using OpenStorage client direct to backup from client ClientServer to MediaServer

12/04/2013 21:00:23 - Info MediaServer (pid=7573) StorageServer=PureDisk:MediaServer; Report=PDDO Stats for (MediaServer): scanned: 105312 KB, CR sent: 3192 KB, CR sent over FC: 0 KB, dedup: 97.0%

12/04/2013 21:00:23 - Info MediaServer (pid=7573) Using the media server to write NBU data for backup ClientServer_<backupid> to MediaServer

12/04/2013 21:00:24 - Info bptm (pid=7573) EXITING with status 0 <----------

12/04/2013 21:00:24 - Info MediaServer (pid=7573) StorageServer=PureDisk:MediaServer; Report=PDDO Stats for (MediaServer): scanned: 1 KB, CR sent: 0 KB, CR sent over FC: 0 KB, dedup: 100.0%

12/04/2013 21:00:24 - Info bpbrm (pid=7455) validating image for client ClientServer

12/04/2013 21:00:24 - Info bpbkar (pid=412) done. status: 0: the requested operation was successfully completed

12/04/2013 21:01:25 - end writing; write time: 0:01:06

the requested operation was successfully completed  (0)

[sri_vani · Accepted solution]

 It is a Client deduplication job :

Please verify below:

You have two duplication rates and the job begins with Using OpenStorage client

12/04/2013 20:59:17 - Info MediaServer (pid=7573) Using OpenStorage client direct to backup from client ClientServer to MediaServer

12/04/2013 21:00:23 - Info MediaServer (pid=7573) StorageServer=PureDisk:MediaServer; Report=PDDO Stats for (MediaServer): scanned: 105312 KB, CR sent: 3192 KB, CR sent over FC: 0 KB, dedup: 97.0%

12/04/2013 21:00:23 - Info MediaServer (pid=7573) Using the media server to write NBU data for backup ClientServer_<backupid> to MediaServer

12/04/2013 21:00:24 - Info bptm (pid=7573) EXITING with status 0 <----------

12/04/2013 21:00:24 - Info MediaServer (pid=7573) StorageServer=PureDisk:MediaServer; Report=PDDO Stats for (MediaServer): scanned: 1 KB, CR sent: 0 KB, CR sent over FC: 0 KB, dedup: 100.0%

12/04/2013 21:00:24 - Info bpbrm (pid=7455) validating image for client ClientServer

12/04/2013 21:00:24 - Info bpbkar (pid=412) done. status: 0: the requested operation was successfully completed

12/04/2013 21:01:25 - end writing; write time: 0:01:06