Remember that if you are doing Exchange mailbox backups, they will always be much much slower than other types of backup.
If you have the luxury of additional NICs in your backup server and target server, and the switching infrastructure you need, you can create a separate backup network, in a different address range. I have this for some of my 'high volume' servers, and then fall back to the regular internal LAN for other lower use servers.