01-20-2021 10:29 AM - edited 01-20-2021 10:49 AM
My company is a little bit behind on the adoption of cloud technology; there hasn't been a compelling need to change anything.
Anyway, I was hoping to at least modify my disk-to-disk-to-tape backup scheme to a disk-to-disk-to-cloud one. Having to change tapes is a pain, especially now since I have to make a special trip into the office to do it.
There's no way to "budget" anything until I have some sense of how much this would all cost. Amazon has cost calculators, but they ask for metrics I have no way of getting at.
So as a test, I created an AWS S3 bucket and did some test Duplicate jobs from existing backup sets to the bucket.
The first ~15.5 GB backup set cost $1.59 to duplicate to 1Z-IA. So a full 3 TB backup would scale up to approximately $320 every week. Plus, with a 4-week retention period, 12 TB of data storage would be another $120/mo. That would be a nonstarter with management.
Then I dug into the Amazon Cost Explorer and found that most of this ($1.38) was Data Transfer out. The cost appeared because the duplicate job did a Verify, and to do that, the Backup Exec server had to read all that data back in from AWS. I verify the duplicate to tape because there's no cost to that.
If I skip the Verify, the weekly cost for AWS backups would drop a lot. A subsequent 70 GB Duplicate, without the verify, cost about 25 cents.
What would I lose if I skipped the verify? The backups to local disk would still be verified as part of the job that creates them. There's some error correction built into Ethernet, would that remove the need?
Getting rid of tapes, I could restructure the backups to do incremental forever, so I wouldn't need to keep 4 full backups in local storage or in the cloud. But I'd like to first estimate costs using the closest structure to existing practice.
01-20-2021 10:52 PM
Are you using OpenDedupe to replicate to cloud?
This will ensure that deduplicated data is sent to cloud and only changed blocks for subsequent backups (full or incremental).
You need to have Dedupe license (Included in Bronze, Silver and Gold licenses).
About Verify - the recommendation is to turn verify of for cloud backups (Default in recent versions) because cloud vendors charge for read operations.
https://www.veritas.com/content/support/en_US/doc/72686287-140583204-0/v128967126-140583204
Some Opendedupe reading matter:
https://www.veritas.com/support/en_US/article.100042352
https://www.veritas.com/support/en_US/article.100041148
https://www.veritas.com/content/support/en_US/doc/BackupExecInstallConfigOpenDedupeOST
https://www.veritas.com/support/en_US/article.100034234
What do you lose by not performing a Verify?
IMHO - I have learned to trust that successful status really means that the operation was successful.
My view is that regular restore tests is the best way to know - obviously at a cost when cloud is involved, but less than Verify after each replication.
01-21-2021 06:58 AM
It might also be worth checking out other cloud vendors that don't charge for egress (eg you don't pay to access or download your data once its there), such as Wasabi (https://wasabi.com/cloud-storage-pricing/) however I'm sure there are others out there too. This would mean no extra cost for running a verify.
Though appreciate choice of cloud provider may be regulated by your company policy.