Forum Discussion

EVRocks's avatar
EVRocks
Level 5
11 years ago

Backing up closed Partition and indexes

I wonder if you guys shed light on the on-going backup issue that we are having for backing up EV (dvs files).

Recently we have upgraded Netbackup to the latest version (7.5.0.6) and since then the backup process on the EV (10.0.4) have become very problematic.

the current problem that we have is that the full backup takes too long to complete and the reason our storage team given is that we have too many closed partitions and Indexes on 10 separate drives/LUNs. we are backing up closed partitions on a monthly basis and open partitions on a daily basis.

The suggestion we came up with is to build a second EV and move the closed partitions to this second EV so that when backup starts there are less drives to back up on the first EV server.

I am thinking of using the collections method which is cabbing small files in to a large file but I have never done collections and I don't know how EV react when it comes to users accessing archives from these collections or when retention take place.

 

Any ideas...!!

 

 

  • Collections is specifically designed to mitigate much of the issues you are experiencing.  There is a very slight performance impact on users (those who are not using virtual vault).  The biggest impact would be if you were doing a large recall of emails,  You'll need to ensure you have sufficient space on the storage drive to allow the cab files to be opened into individual file for a short period of time.  Additionally you can use the Migration process to move the CAB files to a near-line storage and reduce the impact on your primary storage platform.

     

  • Collections is specifically designed to mitigate much of the issues you are experiencing.  There is a very slight performance impact on users (those who are not using virtual vault).  The biggest impact would be if you were doing a large recall of emails,  You'll need to ensure you have sufficient space on the storage drive to allow the cab files to be opened into individual file for a short period of time.  Additionally you can use the Migration process to move the CAB files to a near-line storage and reduce the impact on your primary storage platform.

     

  • thank you WiTSend,

    will the CAB files be kept on the same drive/lun where the closed paritions are? What will happen if retention process starts on these closed parition.

    cheers

  • Hi EV,

    Yes the collection files are kept in exactly the same folder except one level up from where the DVS files are kept, it will speed up backups as well as WiT says above.

    Your users will not notice any difference in recall times whatsoever, it is so small that it isnt worth thinking about to be honest.

    It is well worth doing.

     

    In relation to retention, EV will still delete exactly what it is meant to delete in the exact same way so that is nothing to worry about either, it will simply mark for deletion the items that have reached the retention period (This process is called Sparse Collections) but, and this is where the difference is, it will only remove those actual files from the CAB files once the items within that cab file are a certain percentage of the file itself.

    Have a look here, its a very good explanation from JesusWept  -  https://www-secure.symantec.com/connect/articles/how-collections-and-sparse-collections-work

     

  • EV Rocks,

    Collections will definitely improve the speed of the backup process since it would backup less files. As Ben mentioned, collection files are kept in exactly the same folder except one level up from where the DVS files are kept. Also, this technote can provide you additional information about the sparse collections and some registry settings:

    How do Sparse Collections and the SparseCollectionPercentage setting work?
    http://www.symantec.com/docs/TECH87400

    Once all the DVS files are collected, since the partition is closed, you can take a full backup and you wouldn't need to backup the partition again since Enterprise Vault doesn't add more data to the closed partitions. However, when the DVS files are collected, if a user opens an archived item where the DVS files were collected, EV will extract the DVS files back to the partition with an ARCHDVS extension. This operation will consume additional space in your storage.

    I have seen cases, for instance with FSA archiving, where a teh DVS files are collected and then a user performs a mass recall of placeholders. In the Enterprise Vault partition, you might run out of space because EV will extract several DVS files for this operation. Normally, these ARCHDVS files are removed by the StorageFileWatch process later but this is something you might want to keep in mind after enabling collections.

    I hope this helps.

  • Personallly I would suggest keeping the 'once a month' backup procedure as deletions do happen, especially with Storage Expiry and Retentions, and if you do not backup the closed partitions, then you have a DR situation, you will be left with drastcially out of sync SQL references in relation to Physical storage data, leading onto a large EVSVR operation on the other end where you will need to delete a large amount of data stored on the closed partitions.

    Or at least a backup procedure that suits the business needs at the very least.

  • Yes.You are right ... I forgot about Storage Expiry and user deletions. Good catch,

  • I will follow your recommendation and Thank you all for your valuable input and much appreciated.