cancel
Showing results for 
Search instead for 
Did you mean: 

Jobs waiting on Tapes, Library Full.

pmc214
Level 5

needing a little help.

Ran into issue today and yesterday........ i have NBU 7.6.1.2 and LTO4, 120 tape library which is full. As you can see from Tape Summary Report i only have 4 active tapes. my backup jobs are waiting on tapes. 

What is the best senerio for remedy this? Buy 10 new tapes, add to library (I only have 1 pool) remove which tapes? that are full? I have limited exposure to NBU, thanks for any assistance.

 *******************************************************************************
MEDIA SUMMARY FOR SERVER GROUP UNRESTRICTED_SHARING_GROUP ON 4/4/2017 2:26:17 PM
*******************************************************************************
ACTIVE FULL SUSPENDED FROZEN IMPORTED WORM BE_MEDIA ENCRYPTED
0 0 0  0 0  0 0  0
*******************************************************************************
MEDIA SUMMARY FOR SERVER Thoth ON 4/4/2017 2:26:17 PM
*******************************************************************************
ACTIVE FULL SUSPENDED FROZEN IMPORTED WORM BE_MEDIA ENCRYPTED
0 0 0  0 0  0 0  0
*******************************************************************************
MEDIA SUMMARY FOR SERVER xxxxx ON 4/4/2017 2:26:17 PM
*******************************************************************************
ACTIVE FULL SUSPENDED FROZEN IMPORTED WORM BE_MEDIA ENCRYPTED
4 79 0  6 0  0 0  0
Number of NON-ACTIVE media that:
6 - are currently EXPIRED
093767 expired 04/30/2015 00:14 (FROZEN)
093736 expired 12/16/2015 22:00 (FROZEN)
095418 expired 11/16/2015 04:00 (FROZEN)
094591 expired 11/11/2015 19:14 (FROZEN)
093738 expired 03/05/2016 22:01 (FROZEN)
093754 expired 04/27/2016 11:18 (FROZEN)
29 - will expire within 1 week
40126L expires 04/04/2017 16:36
40124L expires 04/04/2017 17:00
340109 expires 04/04/2017 18:03
340064 expires 04/05/2017 01:18
454346 expires 04/04/2017 22:00
093749 expires 04/05/2017 22:07
503421 expires 04/05/2017 08:30
093739 expires 04/06/2017 17:00
503429 expires 04/06/2017 03:31
454349 expires 04/05/2017 23:30
340102 expires 04/06/2017 16:10
093750 expires 04/06/2017 18:00
093753 expires 04/06/2017 18:00
093788 expires 04/08/2017 22:00
503428 expires 04/07/2017 19:20
503420 expires 04/08/2017 16:43
461784 expires 04/06/2017 22:00
461783 expires 04/06/2017 22:00
454348 expires 04/07/2017 22:00
454341 expires 04/08/2017 22:00
40122L expires 04/06/2017 18:00
094597 expires 04/06/2017 18:00
093789 expires 04/11/2017 00:07
503426 expires 04/10/2017 18:00
503425 expires 04/10/2017 20:31
461788 expires 04/10/2017 21:25
461781 expires 04/09/2017 18:00
340119 expires 04/09/2017 22:00
503427 expires 04/11/2017 10:00
28 - will expire between 1 and 2 weeks
093771 expires 04/11/2017 18:03
093748 expires 04/14/2017 16:43
503422 expires 04/11/2017 21:20
461780 expires 04/13/2017 22:00
40127L expires 04/13/2017 02:25
40125L expires 04/12/2017 22:46
095422 expires 04/11/2017 20:00
094593 expires 04/13/2017 05:07
093787 expires 04/13/2017 05:07
093784 expires 04/13/2017 19:22
093746 expires 04/14/2017 17:00
093743 expires 04/15/2017 17:00
454347 expires 04/14/2017 17:00
340112 expires 04/14/2017 19:42
340104 expires 04/14/2017 17:00
340100 expires 04/14/2017 22:00
094590 expires 04/14/2017 17:00
093766 expires 04/15/2017 17:00
093769 expires 04/15/2017 22:00
461786 expires 04/15/2017 22:00
340118 expires 04/15/2017 22:00
340106 expires 04/15/2017 22:00
093772 expires 04/15/2017 17:00
093770 expires 04/15/2017 22:00
095424 expires 04/18/2017 05:53
340114 expires 04/16/2017 22:45
340113 expires 04/16/2017 22:00
340108 expires 04/16/2017 20:00
7 - will expire between 2 and 3 weeks
093741 expires 04/24/2017 17:00
093735 expires 04/24/2017 17:00
094592 expires 04/24/2017 17:00
093745 expires 04/24/2017 17:00
093786 expires 04/24/2017 17:00
461787 expires 04/24/2017 17:00
503423 expires 04/24/2017 17:00
15 - will expire between 3 weeks and 1 month
093773 expires 04/27/2017 17:00
093783 expires 04/28/2017 02:02
503424 expires 04/27/2017 17:00
40129L expires 04/27/2017 17:00
093785 expires 04/27/2017 17:00
094595 expires 04/28/2017 02:02
340067 expires 04/28/2017 02:02
340068 expires 04/28/2017 02:02
340071 expires 04/28/2017 02:02
340107 expires 04/28/2017 02:02
340115 expires 04/28/2017 02:02
40120L expires 04/28/2017 02:02
454342 expires 04/28/2017 02:02
454343 expires 04/28/2017 02:02
461789 expires 04/28/2017 02:02
Number of ACTIVE media that, as of now:
2 - will expire within 1 week
461785 expires 04/10/2017 18:00
094594 expires 04/10/2017 18:20
1 - will expire between 1 and 2 weeks
093756 expires 04/18/2017 00:06
1 - will expire between 1 month and 2 months
093757 expires 05/09/2017 08:00
Summary by retention level of ALL media
Level   # Media        Megabytes
0         4          3589726.9
1        51         63677650.1
3        33         30800684.4
6         1           722924.5

16 REPLIES 16

quebek
Moderator
Moderator
   VIP    Certified

first things first:

unfreeze these 6 frozen tapes - ie bpmedia -unfreeze -m media_ID

this could help for a short while, then we would need to see outputs from:

vmpool -listall -U

tpconfig -d

vmoprcmd

bpstulist -U

sclind
Moderator
Moderator
   VIP   

It looks like you use about 4-5 tapes a day.  Buying 10 more may not help much.  LTO4 tapes are not very expensive; I would buy more than that.

Do tapes go offsite for a while?  If so perhaps have them held offsite a bit longer so you have some open slots in the library.

 

the ones froze are bad, i need to remove them from library. We do not have Vault. Tapes stay in library. if i need to remove tapes? - which ones?

~~~~~~~

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

C:\Program Files\Veritas\Volmgr\bin>vmpool -listall
===================================================================
pool number:  0
pool name:    None
description:  the None pool
max partially full:    0
================================================================================

pool number:  1
pool name:    NetBackup
description:  the NetBackup pool
max partially full:    0
================================================================================

pool number:  2
pool name:    DataStore
description:  the DataStore pool
max partially full:    0
================================================================================

pool number:  3
pool name:    CatalogBackup
description:  NetBackup Catalog Backup pool
max partially full:    0
================================================================================

pool number:  4
pool name:    Scratch
description:  Scratch Pool
max partially full:    0
================================================================================


C:\Program Files\Veritas\Volmgr\bin>

~~~~~~~~~~~~~~~~~~~~~~


C:\Program Files\Veritas\Volmgr\bin>tpconfig -d
Id  DriveName           Type   Residence
      SCSI coordinates/Path                                            Status
****************************************************************************
0   IBM.ULTRIUM-TD4.000  hcart  TLD(0)  DRIVE=5
      {3,0,1,0}                                                        UP
1   IBM.ULTRIUM-TD4.001  hcart  TLD(0)  DRIVE=6
      {3,0,3,0}                                                        UP
2   IBM.ULTRIUM-TD4.002  hcart  TLD(0)  DRIVE=1
      {3,0,2,0}                                                        UP
3   IBM.ULTRIUM-TD4.003  hcart  TLD(0)  DRIVE=2
      {3,0,5,0}                                                        UP
4   IBM.ULTRIUM-TD4.004  hcart  TLD(0)  DRIVE=3
      {3,0,4,0}                                                        UP
5   IBM.ULTRIUM-TD4.005  hcart  TLD(0)  DRIVE=4
      {3,0,0,0}                                                        UP

Currently defined robotics are:
  TLD(0)     SCSI coordinates = {3,0,2,1}

EMM Server = horus


C:\Program Files\Veritas\Volmgr\bin>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

C:\Program Files\Veritas\Volmgr\bin>vmoprcmd

                           HOST STATUS
Host Name                                  Version   Host Status
=========================================  =======   ===========
horus                                      761200    ACTIVE
Thoth                                      700000    OFFLINE

                                PENDING REQUESTS


                                    <NONE>

                                  DRIVE STATUS

Drive Name               Label   Ready  RecMID  ExtMID  Wr.Enbl.  Type
    Host                       DrivePath                            Status
=============================================================================
IBM.ULTRIUM-TD4.000      No      No                     No        hcart
    horus                      {3,0,1,0}                            TLD

IBM.ULTRIUM-TD4.001      No      No                     No        hcart
    horus                      {3,0,3,0}                            TLD

IBM.ULTRIUM-TD4.002      No      No                     No        hcart
    horus                      {3,0,2,0}                            TLD

IBM.ULTRIUM-TD4.003      No      No                     No        hcart
    horus                      {3,0,5,0}                            TLD

IBM.ULTRIUM-TD4.004      No      No                     No        hcart
    horus                      {3,0,4,0}                            TLD

IBM.ULTRIUM-TD4.005      No      No                     No        hcart
    horus                      {3,0,0,0}                            TLD

C:\Program Files\Veritas\Volmgr\bin>

~~~~~~~~~~~~~~~~~~~~~~

C:\Program Files\Veritas\NetBackup\bin\admincmd>bpstulist -U

Label:                horus-hcart-robot-tld-1
Storage Unit Type:    Media Manager
Host Connection:      xxxxx
Number of Drives:     6
On Demand Only:       no
Max MPX/drive:        3
Density:              hcart - 1/2 Inch Cartridge
Robot Type/Number:    TLD / 0
Max Fragment Size:    1048576 MB

Label:                horus-hcart
Storage Unit Type:    Media Manager
Host Connection:      xxxxx
Number of Drives:     6
On Demand Only:       no
Max MPX/drive:        1
Density:              hcart - 1/2 Inch Cartridge
Robot Type:           (not robotic)
Max Fragment Size:    1048576 MB

Label:                horus-hcart-robot-tld-0
Storage Unit Type:    Media Manager
Host Connection:      xxxxx
Number of Drives:     6
On Demand Only:       no
Max MPX/drive:        6
Density:              hcart - 1/2 Inch Cartridge
Robot Type/Number:    TLD / 0
Max Fragment Size:    1048576 MB

C:\Program Files\Veritas\NetBackup\bin\admincmd>

 

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
You have 4 Active tapes, 79 Full and 6 Frozen tapes.
29 tapes will expire over the next couple of days.

Use Media Summary report, Media written report and available_media script on a daily basis to keep track of amount of tapes used on a daily basis, when media will come available and what is currently available.

In addtion to everything already said, just because you don't have Vault doesn't mean that you can't manually eject tapes and either rack them or send them offsite, or .....

You just need to have good procedures in place to document and track whatever you do with them.

Once you have ejected some and done "something" with them, after you've replaced them in the library with others a rightclick on Media will allow you to run a manual inventory which will update NetBackup with which tapes are inside and which tapes are outside the library.

quebek
Moderator
Moderator
   VIP    Certified

Hey

I would have ejected the tapes which are below these two

7 - will expire between 2 and 3 weeks
15 - will expire between 3 weeks and 1 month

So this will give you 22 slots available + those 6 from frozen tapes so in total 28 slots... I would go an order 2x20pack LTOx for your enviroment. Tapes are not so expensive now a days and it is better to have more then less - you will never know if you do not have to run some extra backups for some business needs...

Also storing tapes in a library is not the best option... No DR capability...

In regards of your STUs - I would have set smaller this Max Fragment Size:    1 048 576 MB

Imagine you have a small file to be restored which is located in 1 048 572 MB - you need to read the whole fragment in order to restore it... If let's say your Max Fragment Size would be 81920 MB then tape would be positioned on frag 12 and 65536 - 4 = so 65523 MB instead of 1 048 572 MB - which will be a huge time saving...

 

mph999
Level 6
Employee Accredited

No no no ... never eer just 'unfreeze' tapes unless you know for sure they are not bad or damaged in some way.

It's not massively common, but I have seen it several times now where damaged tapes have been put back through the drives which in turm damaged the drives causing massive issues.

mph999
Level 6
Employee Accredited

Also storing tapes in a library is not the best option... No DR capability...

>> Depends where the library is, if the library is remote from the clients then no issue ...  ;0)

I would argue that in fact, the safest plae for the tapes is in the library.  Protected from environmental issues, correct temperature, correct humidity and not been thrown about which causes issues if they are no packed correctly for transport.

"you need to read the whole fragment in order to restore it.."  

>>As long as you are not using mpx, then frag size shoud be irrelvant these days as we have fast block positioning.  NBU knows where the files are and so can position the tape directly to the file.

the library is at an alternate site. i have always had spots to put more tapes, just recently filled the library....well i can remove the frozen "bad" tapes and also a few extra cleaning tapes.

So should i put new tapes in the scratch pool then? always just added new tapes to netbackup pool.

Will the tapes i remove still show up in the Tape Summary report or will i have to track that myself?

Thanks you.

I have 24 new tapes now. I pulled 3 cleaning tapes out of the library to make space and put in 3 new tapes. As noted before the frozen tapes are already out of the library so i have no more open slots for any new tapes. I will need to remove tapes, i do not have Vault.

Can someone help me understand how i am supposed to remove and track these tapes? If i remove 21 of the Non-Active Media with the farthest out expiration date (4-28, etc) do i put them in another pool, or do i do an inventory and they just fall off......then once 4-28 rolls around do i put them back in and take out 21 other tapes with th e farthest out expiration date?

I am having a hard time understanding how to manually do this. I have never had to rotate tapes or keep track of it.  

sclind
Moderator
Moderator
   VIP   

What you want to do is really up to you.  We eject tapes used in the last 24 hours and send them offsite for 8 days.  You could just set them aside elsewhere until they get closer to expiring. That way your library would just contain scratch tapes (or tapes close to expiring) plus the tapes currently being written on.

You dont need to make any changes to the tapes removed.  Netbackup will know they are not in the library.

mph999
Level 6
Employee Accredited

NBU will know where they are, providing you 'eject' them through the GUI and remove them from the CAP/ MAP. They will goto the --- volume group, which means 'non-robotic'.

If however, you just open the main door of the library, NBU would not know the tapes had been removed, and you would have to run an inventory to get NBU back in sync with the library.

Marianne
Moderator
Moderator
Partner    VIP    Accredited Certified
I think @mph999 meant
"They will goto the --- volume group"

Tape_Archived
Moderator
Moderator
   VIP   

Please review if compression is enabled at the H/W level (OS level and not under NetBackup). If not please check your OS document to enable it, that may give you some relief.

This is clear math of understanding how much you are going to backup to tape and how many LTO4 (Provides 800 GB and 1.6 TB with h/w compression) you need. Pleae note down all your information and do your capacity requirment and inturn you should be able to figure out the number of tapes you will need. I would think atleast 6 months ahead about your Tape capacity requirment. 

mph999
Level 6
Employee Accredited

Opps, I did indeed, thank you Mariane ....  :0)

i remove tapes from library and load tape in their place, then run inventory on robot. i keep track on a spreadsheet when to put original back in.... make room by pulling out more according to tape summary, the farthest out non-active ready to expire.