Oracle RMAN backup - making oracle server as media server

[Gergely_B_]

Dear All, 

We would like to speed up our RMAN backups and I was wondering if the following would work:

(Environment: windows 2008 enterprise R2 x64, netbackup 7.5)

I'd like to install media server edition of Netbackup to Oracle server so it can do the backups to DataDomain 990 faster.

what else will be required? is my theory correct? 

thanks

g

[RamNagalla · Accepted solution]

its a good plan..it reduce one network hope...

make sure your oracle server has enough resources RAM/CPU/network to handle the media server load...

and anyhow licenses..

[Yasuhisa_Ishika · Accepted solution]

Data Protection Optimization license is required if you use NetBackup in traditional licensing model and you have never purchased. Also you may need DataDomain OST plugin and its license(both released by EMC) if you are to use DD as OST storage.

[Yasuhisa_Ishika]

It is better to check if the bottleneck of your backup is really on network hops. In stream-based Oracle backup, data transfer rate in Oracle side sometimes become low. If this host have enough free disk space, check native RMAN backup speed.

[Marianne · Accepted solution]

Good idea to have a look at recommendations for Oracle in dedupe environment:
http://www.symantec.com/docs/DOC3534 
For instance - filesperset should be 1 and Oracle compression disabled...

Making the Oracle client a Media server will help, as OST plugin will ensure that only changed blocks will be sent to DD.

[Gergely_B_]

Dear All,

thank you for your valuable feedback. please find below the details.

Introduction

we have the following backup infrastructure:

• EMC Data Domain

• Netbackup backup software

• Oracle databases

As the size of our databases grow the backups take more and more time and so the restores too. The Oracle way we backup oracle databases had also it’s own evolution:

1. We started with Template based backups.

   1. Templates are difficult to maintain

   2. Templates are not flexible

2. Later on we switched to script based backups

3. We also achieved significant performance gain by setting FILESPERSET=1 for database backups – instead of using the default value – which helps for deduplication. (for archivelog backups we use FILESPERSET=20)

4. Backups are not compressed and not encrypted in order to achieve the best deduplication rate.

5. The backups are done using VTLs (Virtual tape Library) which has it constraints:

   1. When we run out of VTLs the backups fail

   2. VTLs limit the access to one client (only one thread can backup/restore at a time from a single VTL)

To overcome these limitations and further enhance our backups/restores we have started looking into a technology called “DD Boost” (Data Domain Boost).

Pre-requisites

DD Boost is a software plugin provided by EMC which needs to be install along with the Netbackup software on the Database Server itself.

The Database server needs to be promoted to a Media Server too and both the Client and Server Netbackup Software needs to be installed on it including the OST Plugin.

 

How it works

When executing a backup/restore in OST mode there aren’t any VTLs used. It is still the Netbackup where backup jobs will be scheduled – there is an other way too which skips the Netbackup completely, this is out of the scope of this document – and we can still use rman command line to restore databases.

Using Netbackup this way is fully transparent to the database team. There is no change required to the RMAN scripts (we’ll still use SBT_TAPE device type for backup/restore)

When doing backups the Database Server acts like a Media Server and does deduplication. This adds an extra cpu cost (<10% total ) to each thread when the backup is running and only those data pieces are sent to the Data Domain which are new. On one hand this has the biggest impact when doing FULL (LEVEL 0) database backups, on the other hand the database still needs to be read from the disk. The benefits of using this mode:

• When only 10% of the database has changed since the last full backup, only 10% of the database will be sent across the network and only this amount needs to be written to the data domain.

• Boost will allow you to run recover sessions at the same time as you’re running backup sessions to the same volumes, and also allow you to run multiple restore sessions at the same time

• Reduce the write pressure on the Data Domain during the weekend backup windows and give more throughput to other systems

• Backups taken using the OST plugin can be restored ony any database server. In other words a database server doesn’t any special configuration to restore the backup taken using the OST plugin.

The disadvantages:

• Special configuration required to enable it

  • Switching the backup interface of the database servers to the VLAN used by the Media Servers

  • Different version of Netbackup Software (Client + Server + OST Plugin)

• Whenever there is a Netbackup Upgrade the above set of software needs to be upgraded at the same time on the database servers too.

Limitations:

• As a best oractice we need to keep in mind that we should not exceed 50 Mediaserver per master limit.

Where could we benefit from it?

huge Databases (>20TB)

Reason:  the benefit here would be the option to perform multiple restores at the same time.

Performance in numbers

The numbers were taken on xxxxxxx which was running on SATA disks. The bottleneck during all the below tests were the Storage array, so the below numbers are relative numbers.

Testcase	Type	Backup Type	Channels	Filesperset	Input Bytes	Output Bytes	Input Bytes per sec	Output Bytes per sec	Time taken
1	VTL	Full	8	64	431.03G	422.04G	231.21M	226.39M	00:31:49
2	OST	Full	8	64	431.03G	422.04G	226.11M	221.40M	00:32:32
3	OST	Full	8	64	431.03G	422.04G	202.09M	197.88M	00:36:24
4	OST	Full	8	1	431.03G	422.05G	259.48M	254.07M	00:28:21
5	OST	Full	8	1	431.03G	422.05G	251.64M	246.40M	00:29:14
6	OST	Full	20	1	431.03G	422.05G	384.81M	376.79M	00:19:07
7	OST	Full	24	1	431.03G	422.05G	449.47M	440.10M	00:16:22