Forum Discussion

H_Sharma's avatar
H_Sharma
Level 6
10 years ago

Multiple Small Files

Hello Experts,

We have one solaris 11 servers. It has many small files it has taken more than 12 hours to take the backup on tape and still running. Drives are free and no issue with the drives. Speed we could see on the policy it shows1 mbps that is rather slow.

These server has many small log files i believe thats why its taking time. So somebody has suggessted to TAR these all files and then this would become one file and backup would be fast.So pls let me know to troubleshoot this slow client issue and can we consider this tar option as solution.

 

Thanks,

7.6
Backup and Recovery
Basics
Best Practice
NetBackup
Solaris
  • Michael_G_Ander's avatar
    Michael_G_Ander
    10 years ago

    Flash-backup or accelerator is usually the answer to backup of many small files

    Fragmentation causes slower backups, so defragmentation can help with the speed

    suggest you do a bpbkar -nocont to measure how fast you can read the file system

  • Marianne's avatar
    Marianne
    Level 6
    10 years ago

    I am surprised to see that you have free space on any internal system disk on a Solaris system (/dev/rdsk/c1t0d0s6)? 100% sure there is not a mounted filesystem on that partition?

    You also seem to have / in the backup selection? 

    WRN - / is not frozen  

    I don't thing system partitions such as / can be used for FlashBackup. It is not possible to freeze/quiesce OS partitions.
    Hopefully the 'lots of small files' are not on the root partition - most definitely NOT good system design...

    You also need to have the raw partition specified in Backup Selection - not mountpoint.

    Remember to create bpfis log folder on the client.

  • H_Sharma's avatar
    H_Sharma
    Level 6
    10 years ago

    Hi Marianne,

    Solaris team had given me 1 gb size from raw partition that was /dev/rdsk/c1t0d0s6 i dont know whether anything needs to be done on the same.

    I just pasted that path on the server properties as cache file size.

    I didnot get that.

    "You also need to have the raw partition specified in Backup Selection"

    In my backup selection there is only the path of the directory that needs to be backed up.

    Pls help.

  • Marianne's avatar
    Marianne
    Level 6
    10 years ago

    Seems you have missed some steps in Snapshot Client Admin Guide (link in a previous post).

    FlashBackup is covered in Chapter 4.

    You need to add the raw partition in Backup Selection.
    See step 11 on page 83 and have a look at the Solaris examples.

    The raw partition needs to be where the multiple files reside - NOT root (/) filesystem or a folder name.

    Use 'df -h' to find device/partition name for your filesystem.

    You can also confirm with 'df -h' and 'prtvtoc /dev/rdsk/c1t0d0s2' that s6 on c1d0 is not in use by anything else.

  • H_Sharma's avatar
    H_Sharma
    Level 6
    10 years ago

    You mean to say if i need to take the backup of below path...

    i.e /usr/openv/tar1

    In backup selection i will define the 2 paths.

    1:- /usr/openv/tar1

    2:-/dev/rdsk/c1t0d0s6 (Cache file size)

  • Marianne's avatar
    Marianne
    Level 6
    10 years ago

    No. You need to go through Policy config in Snapshot Client manual again.

    The backup selection needs to be the raw device on which /usr/openv/tar1 exists - actually the 'multiple small files', NOT the tar-file.
    This needs to be a separate filesystem - NOT the NBU /usr/openv folder or filesystem.

    Please provide output of 'df -h' on the client.
    If the 'multiple small files' reside on a system disk (such as root (/) or /usr)     then FlashBackup is not for you.

    /dev/rdsk/c1t0d0s6 seems to be your cache device that needs to specified in Host Properties AFTER you have double-checked that this partition is not used by anything else on the client.

    Also check  “Cache device requirements” on page 121 of the manual.

  • Marianne's avatar
    Marianne
    Level 6
    10 years ago

    I believe Michael has answered your initial query about ways to backup millions of small files.

    I have marked his post as Solution.

    For issues with configuration of FlashBackup policy, please start a new discussion.