MSDP question re full at 96% vs. high water mark at 98%
When does full disk processing take place? At 96% or 98% ? And doesn't this all imply that a high water mark is probably best set to something like 90% (max)or probably (85%) so that clenup can occur before it gets full. If so, then why is teh default 98% Page 68 of the NetBackup v7.5 Deduplication Guide: http://www.symantec.com/business/support/index?page=content&id=DOC5187 ...says this: About deduplication storage capacity The maximum deduplication storage capacity is 64 TBs. NetBackup reserves 4 percent of the storage space for the deduplication database and transaction logs. Therefore, a storage full condition is triggered at a 96 percent threshold. For performance optimization, Symantec recommends that you use a separate disk, volume, partition, or spindle for the deduplication database. If you use separate storage for the deduplication database, NetBackup still uses the 96 percent threshold to protect the data storage from any possible overload. If your storage requirements exceed the capacity of a media server deduplication node, do one of the following: - Use more than one media server deduplication node. - Use a PureDisk storage pool as the storage destination. A PureDisk storage pool provides larger storage capacity; PureDisk also provides global deduplication. See “About the deduplication storage destination” on page 22. Only one deduplication storage path can exist on a media server. You cannot add another storage path to increase capacity beyond 64 TBs. ...but says this on page 82: High water mark The High water mark setting is a threshold that invokes the following actions: - The High water mark indicates that the PureDiskVolume is full. When the PureDiskVolume reaches the High water mark, NetBackup fails any backup jobs that are assigned to the storage unit. NetBackup also does not assign new jobs to a storage unit in which the disk pool is full. NetBackup also fails backup jobs if the PureDiskVolume does not contain enough storage for its estimated space requirement. - NetBackup begins image cleanup when the PureDiskVolume reaches the High water mark; image cleanup expires the images that are no longer valid. NetBackup again assigns jobs to the storage unit when image cleanup reduces the PureDiskVolume capacity to less than the High water mark. The default is 98%.2.1KViews0likes1CommentMSDP encryption (ServerOptions=agent_crypt) (or should it be =encrypt)
Hi Forum, Page 30 of the NetBackup Deduplication Guide v7.5 says that... by default MSDP encryption is disabled by default, but they it is recommended by Symantec. Page 70 says that to enable encryption that we need to add "agent_crypt" to "ServerOptions=" in the ContentRouter.cfg file. But looking at the comments in the file: ; [no]agent_crypt : always disable/enable client-side encryption; ; [no]encrypt : always disable/enable encryption; ...indicates that using "agent_crypt" instructs the client-side deduplication agent to encrypt data. At our site we are not implementing client side deduplication so it woudl seem to me that setting :agent_crypt" won't have any effect. My questions are: 1) Is "agent_crypt" really the option to use if what we are trying to achieve is encryption of the post-dedupe blocks on teh MSDP data storage local to teh MSDP media server? 2) What does the "ServerOptions=encrypt" option do, and how is it different to "agent_crypt" ? 3) If we can determine which option really does enable post-dedupe encryption - then does anyone know what the CPU overhead is ? 4) Are there any particular models of CPU (SPARC or Intel or AMD) that implement the encryption/decryption in their hardware instruction sets - i.e. are there any CPUs that are much better suited for use with MSDP encryption ? Thanks, Dave.Solved1.8KViews1like4CommentsBackups on MSDP are slow (Slower than Tape)
Hi, I have an environment of Netbackup 7.5.0.4. The environment details are as: Master Server: IBM AIX 6.1, Netbackup 7.5.0.4 Media Server 1 (For AIX systems): IBM AIX 6.1, Netbackup 7.5.0.4 We have and MSDP pool on our media server of 20TB. The filesystem used for this MSDP pool is symantec. (vxfs) with bsize of 8192. The memory on the system is 120GB and it is an IBM Lpar of power7 with 5 CPUs. When i run backups on MSDP they are slower than the backups taken directly to tape. Considering the system memory and CPU, i dont think its a resources issue. It might be that netbackup needs some tuning to use these resources. I need help on tuning the netbackup MSDP for faster backups. I checked the value of MaxCacheSize in the file "/storage/pdc/etc/puredisk/contentrouter.cfg" and it is at 75% "MaxCacheSize=75%". Any help will be appreciated. Regards, Mohsin Mansoor1.7KViews0likes3CommentsMSDP Always busy
I am trying to do some upgrades to the firmware and drivers on a server containing a MSDP. Being new to NetBackup I recently took a different pool down, most likely related to shuting the server down while the pool was still processing. After going through that once I would rather be safe than sorry. I was given the command crcontrol --processqueueinfo however even hours after all of my SLP's that dup to this pool have been disabled it is still busy. Is there a way to manually (and safely) freeze and commit all changes so that I can bring the pool down?Solved1.5KViews0likes3CommentsReceiving 129 error codes even though disk is <50% full
Running Netbackup 7.1 We are receiving 129 messages even though our disk storage unit has 1.15TB out of 1.99TB free. The storage unit had reached the high watermark a couple of days ago, and another admin doubled its size.1.4KViews0likes7CommentsAny recommendations for volume manager and file system type for MSDP on Linux...
Hi Forum, I've had a quick search through the DeDupe Admin Guide for v7.5 and I couldn't find any recommendations for volume manager or file system type for the MSDP database and/or data spaces. I guess an appliances uses VxVM and VxFS - but what else might be suitable if we were to build our own Linux based MSDP media server. The local server disks will re RAID-1, and the SAN LUNs will be: - MSDP DB on one x 2 TB LUN from 3PAR - MDDP data on four x 16 TB LUNs from 3PAR (i.e. 4 x PG of RAID-6 6D-2P) I guess my question really relates to the MSDP data space - I was thinking of a simple logical volume of the four LUNs concat together and an ext4 file system on that logical volume. Or might I be better off in carving the MSDP data storage as a concat 2 x LUNs (i.e. 2 x PG of RAID-6 14D-2P)? And I assume a sector cluster/blocking factor of 64 KB is appropriate for ext4, just as it is for NTFS. Anyone have any advice, or willing to share what they did and whether they ripped anything up and started again?1.3KViews0likes2CommentsNTFS cluster blocking factor for MSDP database and MSDP data volumes?
Hi Forum - I've read elsewhere that is is recommended to format the NFTS volumes that will be used to house the MSDP database and MSDP data with a cluster size of 64 KB (i.e. 128 traditional 512 byte sectors). However if if look at a slightly populated MSDP server, I see most files are less than 64 KB. Does anyone have an opinion on this? Top folders with files... F:\MSDP_Data\history\dataobjects 12 F:\MSDP_Data\history\errors 12 F:\MSDP_Data\history\retention 12 F:\MSDP_Data\history\segments 12 F:\MSDP_Data\history\tasks 12 F:\MSDP_Data\history\tlogs 12 F:\MSDP_Data\log\pddb 43 F:\MSDP_Data\queue 83 F:\MSDP_Data\data 26,205 F:\MSDP_Data\processed 103,610 Total = 130119 Table of file sizes... = 0 75 > 0 29,708 > 4 28,285 > 8 22,436 > 16 12,058 > 32 4,585 > 64 18,802 > 1,024 879 > 10,240 836 > 102,400 220 > 204,800 12,118 > 409,600 108 > 1,024,000 9 Total = 1301191.1KViews1like4CommentsNetbackup Appliances 5230 with PureDisk: How many streams?
Hi all, We recently migrated to Netbackup Appliances running Netbackup 7.6.0.1 (Appliance version 2.6.0.1 ) We are running 2 appliances per site, each site is its own NBU domain (We use AIR to replicate). Each appliance is configured with a 70TB PureDisk volume. We are quite new to PureDisk that is running on these systems, but at this moment they are limited to 80 streams maximum in the diskpool object (Which seems pretty low to me) At the moment we are running out of resources due to this maximum that has been set. What is the maximum streamcount a 5230 Appliance PureDisk can safely handle? Note that we are using AIR to replicate all our images, but replication is being done during the day, not during backup times... Any advice is greatly appreciated! Thanks!1KViews1like2CommentsCheck Size of a Image
Is there any way to check the size of an image in an MSDP? I need to replicate a subset of the images on one MSDP to another and am trying to put a timeline together. Also if there is a way to figure out the size of that image after it is rehydrated that would be awesome as well. I need to send these images to tape and am again trying to plan things out a little better. Thanks,1KViews0likes2CommentsNBU7 Deduplication & Lotus Notes Agent
Anybody else checked out the perforamnce of Lotus Notes agent backups using a NBU7 Deduplicating Media Server? What sort of Dedup rates are you getting with mail databases? What I have seen on HP rebadged Sepatons hasn't been that impressive for mail databse servers. Lotus Notes database that contian non-mail files dedup well. Its only the personal mail files thatseen to be a problem.987Views0likes5Comments