NBU 7.1.0.2 - Import Images after cleanup catalog

[MartinVi]

Hi all,

we have to do a cleanup of our catalog due to a hardware migration tasks. Therefore we cleanup the nbu catalog with the command:

 bpexpdate -backupid $i -copy 1 -d 0 -force 

Now we run Phase I of the import and could see in the log that he will recreate the image informations:

 root@rozrhbckb01 :~ # tail -20 /usr/openv/netbackup/logs/user_ops/vim/logs/jbpImport1-20111215093856.log
11:08:16 INF - Recreating copy 1, fragment 1 information for image.

11:08:16 INF - Recreating image information for client rozrhwinp01, policy solaris_b01, and schedule Inc, done on 12/10/2011 18:00:01.
11:08:16 INF - Recreating copy 1, fragment TIR 1 information for image.
11:08:17 INF - Recreating copy 1, fragment 1 information for image.

11:08:17 INF - Recreating image information for client rozrhwint01, policy solaris_b01, and schedule Inc, done on 11/21/2011 18:00:21.
11:08:17 INF - Recreating copy 1, fragment TIR 1 information for image.
11:08:17 INF - Recreating copy 1, fragment 1 information for image.

11:08:17 INF - Recreating image information for client rozrhwint01, policy solaris_b01, and schedule Inc, done on 11/26/2011 18:00:00.
11:08:17 INF - Recreating copy 1, fragment TIR 1 information for image.
11:08:17 INF - Recreating copy 1, fragment 1 information for image.

11:08:18 INF - Recreating image information for client rozrhwint01, policy solaris_b01, and schedule Full, done on 12/04/2011 18:00:00.
11:08:18 INF - Recreating copy 1, fragment TIR 1 information for image.
11:08:18 INF - Recreating copy 1, fragment 1 information for image.

11:08:18 INF - Creation of database information for import of path /backup01 complete.

root@rozrhbckb01 :~ # 

Run Phase I:

Logfile output, see above.

But when i try to run Phase II i see not all images:

I see only 8 images instead of 15000 images?

Can someone explain me if i did something wrong?

Regards, Martin

[Mark_Solutions]

Martin

Do you have 15000 files in the location or 15000 images?

Each image could be made up of many different fragments.

How many images with different names do you see?

[MartinVi]

Hi Marc,

i see in my list which i have created such entries:

 rozrhwint01_1323018000  Sun Dec 04 18:00:00 CET 2011    solaris_b01     Full    rozrhbckb01     /backup01       1       Yes
rozrhwint01_1322326800  Sat Nov 26 18:00:00 CET 2011    solaris_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhwint01_1321894821  Mon Nov 21 18:00:21 CET 2011    solaris_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhwinp01_1323536401  Sat Dec 10 18:00:01 CET 2011    solaris_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhwinp01_1322499716  Mon Nov 28 18:01:56 CET 2011    solaris_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhwinp01_1321549250  Thu Nov 17 18:00:50 CET 2011    solaris_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhwinp01_1321117203  Sat Nov 12 18:00:03 CET 2011    solaris_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhvwc2n2_1323378105  Thu Dec 08 22:01:45 CET 2011    windows_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhvwc2n2_1322687085  Wed Nov 30 22:04:45 CET 2011    windows_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhvwc2n2_1322514052  Mon Nov 28 22:00:52 CET 2011    windows_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhvwc2n2_1322082187  Wed Nov 23 22:03:07 CET 2011    windows_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhvwc2n2_1321909309  Mon Nov 21 22:01:49 CET 2011    windows_b01     Inc     rozrhbckb01     /backup01       1       Yes
rozrhvwc2n2_1321650052  Fri Nov 18 22:00:52 CET 2011    windows_b01     Full    rozrhbckb01     /backup01       1       Yes
 

The whole file contain about 15000 entries. So from my view each line is a image. But i only see 8 entries instead of this 15000. And in the log of Phase I i could see all the files too. But i'm not able to import it. 

THX for your help ...

[MartinVi]

Can i do the import Phase to via Command Line while Phase I is run via GUI?

Regards, Martin

[J_H_Is_gone]

either blank out the media server in your search or change ti to bckp01 - it looks to me like a lot of them were by a different media server - if you leave that field blank it will get the info for all media servers.

[Mark_Solutions]

you can just run bpimport with no other switches to see what that does for you

[MartinVi]

Hi Mark,

thanks for the hint but it doesn't work. i have no idea what could be wrong?

What else can i check or try?

Regards, Martin

[Mark_Solutions]

Martin

I know it will be large but can you post the phase 1 import log for me to look at

[MartinVi]

Hi Mark,

thanks for your help. You will find the files in the attachment. The first one is the Phase I and the second one Phase II. I hope you could find anything ...

Regards, Martin

[Mark_Solutions]

Martin

Thanks for that - it does look like it is running the phase 1 against images OK.

So lets have a look at just one image to start with:

16:44:05 INF - Found existing image information for client ROZRHPAD03, policy windows_b01, and schedule Full, done on 10/28/2011 22:52:20.

16:44:05 INF - Recreating copy 1, fragment TIR 1 information for image.

16:44:05 INF - Recreating copy 1, fragment 1 information for image.

Based on the time and date the image name for this one should be ROZRHPAD03_1319842340

Take a look in /backup01 and tell me which files start with this name, what their full names are and how large they are - then take a look in your catalog section - netbackup\db\images\rozrhpado3\131900000\ (i am guessing here) and see what files exist in that and its sub directories - i may need to see some of there contents but lets see what is there first

[MartinVi]

Hi Mark,

thanks for your help. In the backup01 directory i couldn't find the mentioned image with ROZRHPAD03_1319842340. I attach a list with the files which i can see according to this name also the size. Also a file with the image db on the master server.

Regards, Martin

[Mark_Solutions]

OK Thanks - I was close, it was ROZRHPAD03_1319835140 i was after which has these components:

-rw-------   1 root     root        7.3G Oct 29 03:18 ROZRHPAD03_1319835140_C1_F1.1319835140.img
-rw-------   1 root     root        1.0K Oct 29 03:18 ROZRHPAD03_1319835140_C1_F1.1319835140.info
-rw-------   1 root     root         512 Oct 28 22:52 ROZRHPAD03_1319835140_C1_HDR.1319835140.img
-rw-------   1 root     root        1.0K Oct 28 22:52 ROZRHPAD03_1319835140_C1_HDR.1319835140.info
-rw-------   1 root     root        4.7M Oct 29 03:18 ROZRHPAD03_1319835140_C1_TIR.1319835140.img
-rw-------   1 root     root        1.0K Oct 29 03:18 ROZRHPAD03_1319835140_C1_TIR.1319835140.info

Can you take a look under the /usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp directory to see what is there please

What files there are and if small post them or their contents on here.

[MartinVi]

Hi Mark,

thanks for the help again ...

Here the content of the directory:

 root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp # ls -la
total 7
drwxr-xr-x   2 root     root           3 Dec 22 11:02 .
drwxr-xr-x   4 root     root          12 Dec 28 11:37 ..
-rw-r--r--   1 root     root           0 Dec 22 11:02 .lck
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp # more .lck
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp #
 

Happy new year to all of you ...

Regards, Martin

[Mark_Solutions]

Martin - Happy New Year to you!

I the abscense of anything in the temp directorycould you run the Import search from the Catalog again but this time without specifying any parameters apart from the date range (early as you like) - select disk if this brings back no results but leave as much as possible saying "Any"

Once other thing - have you actually set up /backup01 as a Storage Unit?

Let me know the results - only thing is that the original Phase 1 imports you did may have expired by now, hence the lack of anything in the /tmp directory.

[MartinVi]

Hi Mark,

thanks for your fast response. Yes we have setup /backup01 as Storage Unit again. I'm just starting the import phase I.

I will let you know the result if it has finished.

Update:

When i run the import phase with Media Server = All and Path = All i get the following message:

 INF - Found no images matching the selection criteria that were ready for phase 2 import. 

The same output when i specifiy the path /backup01 only.

Regards, Martin

[Mark_Solutions]

Martin

As i suspected the original Phase 1's have expired, hence nothing in the temp directory under the images section.

Re-run a Phase 1 against the storage unit to see what you get.

[Marianne]

Suggestion:

Create NOexpire touchfile to prevent image expiration until you have managed to complete imports.

http://www.symantec.com/docs/TECH136153

Just REMEMBER to delete it once imports are done!

[mph999]

Phase 1 imports have a 'retention' time of 1 week ....

Thanks,

Martin

[MartinVi]

Hi,

i have re-run Phase I and see now the following in the tmp directory:

 root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp # ls -la
total 10
drwxr-xr-x   2 root     root           4 Jan  5 16:40 .
drwxr-xr-x   3 root     root           3 Jan  5 16:40 ..
-rw-r--r--   1 root     root           0 Jan  9 07:54 .lck
-rw-r--r--   1 root     root         899 Jan  5 16:40 windows_b01_1319835140_FULL
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp #
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp #
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp #
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp # more windows_b01_1319835140_FULL
PROTOCOL_VERSION 9
START_TIME 0
END_TIME 0
SNAP_TIME 1319832069
KBYTES 0
NUM_FRAGMENTS 0
COPIES 0
VERSION 8
CLIENT_TYPE 13
RETENTION_LEVEL 4
SCHEDULE_TYPE 0
COMPRESSION 0
ENCRYPTION 0
FILES_FILE_COMPRESSED 0
MPX 0
TIR_INFO 1
TIR_EXPIRATION 0
PRIMARY_COPY 0
IMAGE_TYPE 1
ELAPSED 0
EXPIRATION 1326382854
NUM_FILES 0
EXTENDED_SECURITY_INFO 0
REQUEST_PID 0
IND_FILE_RESTORE_FROM_RAW 0
IMAGE_DUMP_LEVEL 0
FILE_SYSTEM_ONLY 0
PREV_BLOCK_INCR_TIME 0
BLOCK_INCR_FULL_TIME 0
STREAM_NUMBER 2
CATARC 0
BACKUP_COPY 0
BACKUP_STATUS 0
JOB_ID 0
NUM_RESUMES 0
RESUME_EXPIRATION 0
PFI_TYPE 0
IMAGE_ATTRIBUTE 0
SS_COMPLETED 0
NUM_DR_MEDIAS 0
BACKUP_ID ROZRHPAD03_1319835140
CREATOR root
SCHED_LABEL Full
FILES_FILE windows_b01_1319835140_FULL.f
HISTO_INFO -1 -1 -1 -1 -1 -1 -1 -1 -1 -1
ESTIMATED_KBYTES 0
VM_TYPE 0
IS_SYNTHETIC 0
RUN_TIME 1319835140
LAST_BIRTHTIME 1319835140
CLIENT_CHARSET 0
SLP_VERSION 0
BMR_INFO 0
root@rozrhbckb01 :/usr/openv/netbackup/db/images/ROZRHPAD03/1319000000/tmp #
 

When i try to tun the import Phase II, on the GUI, to find the backup image(s) available for Phase 2 import i get the error message:

 INF - unexpected return value from db_IMAGEreceive: allocation failed 10 

Regards, Martin

[Marianne]

Old TN that should still be relevant: http://www.symantec.com/docs/TECH19038

bpdbm has a timeout of 10 minutes.

Create DBMto touchfile to increase timeout.