cancel
Showing results for 
Search instead for 
Did you mean: 

DEDUPE - the (yet) great unknown

aschoeggl
Level 3
Partner Accredited
I am trying to set it up BE2010 with dedupe option

i always ended up in errors or dedupe rates with 1,2:1 at the best
so i redid the b2d dedupe folder and started all over - now this time ill blog what happens

Servers:
  *) DC-01 (where BE 2010 is installed
  *) DC-02
  *) EVAULT-01
  *) EX08-01
  *) SRV-01
  *) SRV-02
every server has the latest agent for windows server (only)
every server got a job like:
 -new backup job
 -selection: whole computer from the windows network
 -destination: b2d dedupe folder with direct access using append and without verify
 - no ofo

this is a fresh install of BE

*) 1st job - DC-02 - vmware guest - 2k3 std sp2

  this is the 1st job ever - using dedupe

  Problems that occured:

  endpoint protection folder - using the internal db makes the job skip like every important file
  always having problems with the USER folder (files) (admin had various files / websites in use)
  "systen state" : DIREKT ACCESS WAS CONFIGURED BUT COULD NOT BE USED (translated error msg - unsure original one)

   Deduplication Stats::scanned: 13740079KB, sent: 13721364KB, dedup: 1 percent

  now thats poor - but ok, 1st job who cares
 
*) 2nd job - SRV-01 - vmware guest - 2k3 std sp2 -  fileserver

    skiped the D:\ containing gigs of data and i did remove the USER folder that did fail loads in the previous job above

   Deduplication Stats::PDDO Stats for (DC-01): scanned: 7742392 KB, stream rate: 13.12 MB/sec, CR sent: 7700200 KB, dedup: 0.5%, cache hits: 0 (0.0%)

    seriously ? what the heck is going on - 2nd 2k3 server and no dedupe ? agent recheck - installed and ok
 

*) SRV-02 - vmware guest - 2k3 std sp2 - terminalserver

  since i am testing during office hours - i have to remove users foler here too - which i wont once im done testing  

Deduplication Stats::PDDO Stats for (DS-DC-01): scanned: 11464983 KB, stream rate: 11.99 MB/sec, CR sent: 11409695 KB, dedup: 0.5%, cache hits: 0 (0.0%)

  dedupe anyone ? guess not ...

*) EX-01 - vmware guest - 2k8 64 sp2 - exchange 2007


  4th job, hours later:

Deduplication Stats::PDDO Stats for (DS-DC-01): scanned: 11474648 KB, stream rate: 13.43 MB/sec, CR sent: 11481064 KB, dedup: 0.0%, cache hits: 0 (0.0%)

  :(

*) DC-01 - hardware server running 2k8-64


  The BE2010 server with dedupe folder on iscsi target

   i saw that the job once hung quite some time trying to back up USER\purediskdbuser{..can not remember...}\STORE{something}
   so excluding the user folder like done all jobs before
   also excluding the iscsi targets (=b2d) and the local SQL (backupexec)

    %%% JOB SITLL RUNNING  - its trying to back up the following for now ~1h
Quelle               : Shadow?Copy?Components
Ziel                 : Medium erstellt am 16.02.2010 um 12:36:21
Aktuelles Verzeichnis: User?Data\Backup Exec Deduplication Storage
Aktuelle Datei       : Storage
  is that ok ?

UPDATE:
no its not ok - it looks like when u back up the systemstate it will copy the b2d folder into the b2d folder
because the job did back up ~90gig (syshdd is only 30) but b2d folder is ~80gb




and now the questions so far:


*) dedupe rate .. ?
*) excluding folders - what are save
*) excluding files - whats not needed (pagefile.sys i assume)
*) OFO - what thype of server is needed to be backed up with and whats a nogo to use ofo on
*) client access to dedupe folder on vmware guest machines on the same esx host - good or not
*) how to back up the server - i guess not with dedupe
3 REPLIES 3

aschoeggl
Level 3
Partner Accredited
reserved post in case space needed for future updates

jessemann
Level 2
I am having problem trying to set up de-duplication. Do we have any sort of documention for how to set it up?

Thanks
-Jesse

Dishant
Level 5
Partner Accredited

Client Side Deduplication

1. After configuring the dedup storage, configure the server on which you want to perform dedup with the following

"Remote Agent with Direct Access"

2. Define a Back Up Job keeping the following option unchecked

"Allow direct access to the media"

3. Then fire the job, it should work fine............