DIsk Space is Full--

[Abhi31]

Hi ,

Basic Disk space is full , getting Error 129,

we delete some images manually and run the cleanup job , but still space is not free .

Can any body tell me how to reclaim the free space .

Netbackup Version 6.5

Solaris 8..

[RamNagalla]

did you see the image clean up jobs Netbackup console? does it successfull?

when you say deleted manaully, did you deleted the images using netbackup GUI or bpexpdate command?

[GulzarShaikhAUS]

Can you post the jobs details of the failed job as well as the cleanup job details.

[Marianne]

I think Image Cleanup job was introduced in 7.x. We need to know more about this config. Since NBU has been out of support since 2012, my assumption is that this environment has been in place for more than 3 years. Has Basic disk been used as backup destination all along? Do you have tape where disk backup is staged to? Without staging disk based backups will only be expired and removed when retention level expiration date was reached. Lots of backups with lengthy retention levels and no tape to stage to, you will sooner or later run out of space.

[Abhi31]

Please find failed job details

04/16/2015 19:08:57 - requesting resource Disk_Storage_XXXXX_backup
04/16/2015 19:08:57 - requesting resource XXXX.NBU_CLIENT.MAXJOBS.zharv000-bk
04/16/2015 19:08:57 - requesting resource XXXXX.NBU_POLICY.MAXJOBS.zharv000_SEG014_NT
04/16/2015 19:09:01 - awaiting resource Disk_Storage_XXXXXX_backup. Waiting for resources.
          Reason: Storage unit concurrent jobs throttled, Media server: XXXXX,
          Robot Type(Number): NONE(N/A), Media ID: N/A, Drive Name: N/A,
          Volume Pool: OFFSITE, Storage Unit: Disk_Storage_XXXXX_backup, Drive Scan Host: N/A,
          Disk Pool: Disk_Storage_XXXXXX_backup, Disk Volume: Internal_16
04/16/2015 19:18:53 - Error nbjm (pid=1898) NBU status: 129, EMM status: Insufficient disk space or High Water Mark would be exceeded
04/16/2015 19:28:53 - job 1100022 was restarted as job 1100022
Disk storage unit is full (129).

Yes i have see the image clean up job on GUI console after manually delelting images.

And i have deleted images using netbackup GUI.

This is the cleanup job once i delete the images .

04/17/2015 17:12:17 - Info nbdelete (pid=14912) deleting expired images. Media Server: XXXXX Media: /incremental_backup
04/17/2015 17:12:18 - started process bpdm (pid=1809)
04/17/2015 17:12:19 - Info bpdm (pid=1809) initial volume /incremental_backup: Kbytes total capacity: 1824522240, used space: 1526137244, free space: 298384996
04/17/2015 17:12:27 - Info bpdm (pid=1809) Removed 4 Kbytes
04/17/2015 17:12:28 - Info bpdm (pid=1809) ending volume /incremental_backup: Kbytes total capacity: 1824522240, used space: 1526137240, free space: 298385000
the requested operation was successfully completed (0).

This is the cleanup job , after running the command bpimage -cleanup -allclients.

04/17/2015 17:40:00 - Info bpdbm (pid=15037) processing client XXXX
04/17/2015 17:40:00 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:00 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:00 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX
04/17/2015 17:40:01 - Info bpdbm (pid=15037) processing client XXXXX

04/17/2015 17:40:06 - Info bpdbm (pid=15037) deleted 1 expired records, compressed 1, tir removed 0, deleted 0 expired copies
the requested operation was successfully completed (0)

[GulzarShaikhAUS]

Thanks for posting the job details. Now we would require bpdm with verbosty 5.

bpdm - Disk manager.

[ontherocks]

You have deleted some images from basic disk storage unit, but fragments of backup images are still there and not released the space.

nbdelete - remove deleted fragments from disk volumes

run below command to release/reclaim the space :

nbdelete -allvolumes

[Marianne]

Okay, so you expired the images using the GUI, right? Not 'deleted'? You have not answered my question about how this has been working all along. What is retention level of backup images on disk? Do you have tape where disk backup is staged to?

[ontherocks · Accepted solution]

Hi Abhi31,

Have you tried running the command suggested to reclaim the space?

run below command to release/reclaim the space :

nbdelete -allvolumes

[Abhi31]

Hi All ,

Sorry for delay ..

Marianne ,

There is no staged of disk backup and retention is 14 days . But disk is  always full in 10 days .

Yes we are planning to increase disk space . But until disk space increase we need to  maintain 10 days backup.

One more thing i notices  , next day after running all clean up the space is reclaim .

And what is different between bpimage -cleanup  and nbdelete.

[jim_dalton]

Sol 8 must be well out of support also. Do yourself and your company a favour!

[Marianne]

Space for 10 days but retention level is 14 days.... So, you can see where the problem is, right?

Add disk space or get tape to duplicate to.

Do whatever is needed to meet your company's recovery and retention needs.

And. ... UPGRADE!