low speed when backup many small files

Question

Environment
netbackup 7.1 ,os : Redhat 2.6
Hello All
We have one policy with standart type which is backing up file system,
It&nbsp; starts appr. 60 MB/s.&nbsp; when the backup process reach to the path which are located many small files the speed decreasing till 2 MB/s.
How&nbsp; to solve this issue??
With BR,
Turgunbek

marianne · Accepted Answer

I agree with Nicolai - quite normal...
How long does it take to run 'ls -lR' against this filesystem?
	NBU (bpbkar) needs to do the same in addition to reading each file in order to backup it up.
The alternative is to see if FlashBackup is an option.
	Compatibility Guide over here:&nbsp;http://www.symantec.com/docs/TECH126901
Or else multi-streaming as per Nicolai's suggestion:
NEW_STREAM
	/big-volume1/folder1
	/big-volume1/folder2
	NEW_STREAM
	/big-volume1/folder3
	/big-volume1/folder4
	NEW_STREAM
	/big-volume1/folder5
	...etc

nicolai · Answer

This is quite normal.

Clean up the files if possible.
	Improve disk speed (fragmentation, kernel inode (some systems), disk cache etc etc
	If it durable - accept it as it is.

Else deploy backup via multiple data streams
e.g: /data/data*

nicolai · Answer

You can also run bpbkar by hand to see how fast possible data can be read:
time /usr/openv/netbackup/bin/bpbkar &nbsp;-nocont -nofileinfo -nokeepalives /directory_to_read &nbsp;&gt; /dev/null 2&gt; /tmp/file.out
This command read data from file system just like a normal backup, but the data is not transferred to media server but discarded.&nbsp;
&nbsp;

turguns · Answer

Thank you Marianne and Nicolai..
The netbackup version is 6.0 on&nbsp; client side.
So Fashbackup will not work((..
Stream also not a variant. Because of VTL.
blind alley (((

marianne · Answer

The netbackup version is 6.0 on&nbsp; client side.

Is this telling us about the client what I think??
	6.0 because of old, slow, 32-bit OS and hardware???
By the way... FlashBackup has been supported on Linux for many versions back - depending on Volume Manager/File System.
	You should really try to get this client updated to at least NBU 6.5.6.

Stream also not a variant. Because of VTL.

Multi-streaming is no problem with VTL.
	As long as multiplexing on the STU is disabled to ensure that each stream backs up to a different virtual drive.

turguns · Answer

hardware is old but strong)).. E2900 sun server with 65GB RAM and 8 CPU..populated 3 CPU MEM board
So why solaris 9? Because of application requirement on it.
My friends which are they tried (3 years ago ) to install netbackup 7 version was unsuccessful. So they told me this system is compatible only with 6 version.
&nbsp;

Forum Discussion

low speed when backup many small files

11 Replies

Related Content

Restore of many small files on ntfs, improve speed ?

Slow backup speed

Backup exec 21.2 Upgrade from 21.1 Speed Issue

Backup Speed Calculations

backup speed

Recent Discussions

"failed, status 6" error after increasing datastore (LUN) capacity

command: bperror

MS-SharePoint policy restore error (2804) .

How to restore a backup

How to configure RBAC