DeDup taking too long B2D - Backup Exec 2010 R3

[Overboard]

Hi All,

I was hoping someone can help me out.

Current Setup and hardware

Hardware
Central Admin Server (CAS)
Server 2008 R2
Backup 2010 R3 (updated with all patches)
Dell PowerEdge R510
2.67 Ghz  (2 Processors 8 Cores)
24Gig Ram
2x146Gb SAS 10K (Raid 1) 
10x2Tb SAS 7.2K (Raid 50)
IP 192.168.100.100 (connection 100meg LAN) 

Managed Media Server (MMS)
Server 2008 R2
Backup 2010 R3 (updated with all patches)
Dell PowerEdge R510
2.67 Ghz  (2 Processors 8 Cores)
24Gig Ram
2x146Gb SAS 10K (Raid 1) 
10x2Tb SAS 7.2K (Raid 50)
IP 192.168.1.100 (connection 100meg LAN different building offsite backup)

Backup Specs
We have 
Daily Incremental Job  - Backs up to the MMS.
Daily Verify Job - Starts right after the Incremental
Daily Deduplicate Job - Starts after Verify and backs up to the CAS

Weekly Full Job - Backs up to the MMS
Weekly Deduplicat Job - Starts after Full and backs up to CAS 

Data
Data is kept for 12 weeks
Currently only one server is backed up called File-Server (FS)
This server is a VM but we are only backing up flat files. FS has 2 logical drives R: (300/500 gigs full) and T: (800/1000 gigs full) 
MMS and CAS are connected over a LAN of 100 meg.

Backup are being stored on the MMS Raid 50 Drive
Dedup is being stored on the CAS Raid 50 Drive

CAS Server Location Type is set to Private Cloud
MMS Server Location Type is set to On-premise

BackupExec Job Log

Name	Media Server	Job Type	Job Status	Percent Complete	Start Time	End Time	Elapsed Time	Byte Count	Job Rate	Deduplication Ratio
Backup-Duplicate Weekly Data	MMS	Duplicate	Successful	100%	3/03/2013 7:40	4/03/2013 13:52	30:11:32	1,066,234,995,045	572.00 MB/min	695.0:1
Backup-Weekly Full	MMS	Backup	Successful	100%	1/03/2013 20:00	3/03/2013 7:40	35:40:28	1,066,234,995,045	798.00 MB/min	715.2:1
Backup-Daily Verify	CAS	Verify	Successful	100%	28/02/2013 21:47	28/02/2013 21:55	0:07:53	6,117,126,530	775.00 MB/min
Backup-Duplicate	MMS	Duplicate	Successful	100%	28/02/2013 20:22	28/02/2013 21:47	1:24:20	6,117,126,530	70.00 MB/min	2.5:1
Backup-Daily Inc	MMS	Backup	Successful	100%	28/02/2013 19:00	28/02/2013 20:22	1:22:26	6,117,126,530	78.00 MB/min	2.5:1
Backup-Daily Verify	CAS	Verify	Successful	100%	27/02/2013 22:06	27/02/2013 22:12	0:06:28	2,121,953,966	331.00 MB/min
Backup-Duplicate	MMS	Duplicate	Successful	100%	27/02/2013 20:19	27/02/2013 22:06	1:46:55	2,121,953,966	19.00 MB/min	3.7:1
Backup-Daily Inc	MMS	Backup	Successful	100%	27/02/2013 19:00	27/02/2013 20:19	1:18:59	2,121,953,966	28.00 MB/min	228.2:1
Backup-Daily Verify	CAS	Verify	Successful	100%	26/02/2013 21:54	26/02/2013 22:16	0:21:27	17,370,436,616	787.00 MB/min
Backup-Duplicate	MMS	Duplicate	Successful	100%	26/02/2013 20:41	26/02/2013 21:54	1:12:52	17,370,436,616	235.00 MB/min	14.6:1
Backup-Daily Inc	MMS	Backup	Successful	100%	26/02/2013 19:00	26/02/2013 20:41	1:41:27	17,370,436,616	214.00 MB/min	15.3:1

My Question is why is the weekly taking so long? When looking at the network stats between the CAS and MMS i see about 20 gigs getting tansfered over the network. I have tested the network link and there is no issues with it. I can transfer a 2gig from CAS to MMS in 5 mins.

Only thing that i can see is that one of the CPU Cores are doing 100% while the others are doing nothing. I had been reading up on this and it is correct when dedup runs it only uses one core but i thought the limiting factor was the RAM when deduping not the CPU.

Do i have my set up wrong?

the requirements for the business is to have a full back up weekly and inc daily. This backup needs to go offsite as well, which is where dedup comes in.

In future i would like to add more Servers to back up but currently i can't as the weekly is taking over 65 hours.

Thanks in advance.

Regards OB