05-01-2013 07:49 AM
Environment
Primary Site:
NBU Master/Media Server 7.5.0.3 (32bit)
OS = Windows 2003 SP2 (32bit)
Tape Drive = Standalone Tape Drive
Secondary Site:
NBU Media Server 7.5.0.3 (32bit)
OS = Windows 2003 SP2 (32bit)
Tape Drive = Standalone Tape Drive
(Primary Site and Secondary Site are connected via VPN)
Query
I have taken a backup on Tape Cartridge from Primary Site Master/Media Server. Send this Tape Cartridge to Secondary Site. Insert the Tape Cartridge in to the Media Server of Secondary Site. I open Backup Archive and Restore of Media Server at Secondary Site, select few backup images and hit restore on the Media Server at Secondary Site(Just to check restore and its very tiny backup images). After hit restore I can see the below situation:
Master/Media Server of Primary Site:
5/1/2013 7:36:25 PM - begin Restore
5/1/2013 7:36:30 PM - 1 images required
5/1/2013 7:36:31 PM - media A00013 required
5/1/2013 7:36:31 PM - restoring image 192.168.1.102_1356932098
5/1/2013 7:36:37 PM - Info bpbrm(pid=2856) fileserver-me.XXXXXXXX.com is the host to restore to
5/1/2013 7:36:37 PM - Info bpbrm(pid=2856) telling media manager to start restore on client
5/1/2013 7:36:43 PM - requesting resource A00013
5/1/2013 7:36:43 PM - awaiting resource A00013 A pending request has been generated for this resource request.
Operator action may be required. Pending Action: No action.,
Media ID: A00013, Barcode: --------, Density: 4mm, Access Mode: Read,
Action Drive Name: N/A, Action Media Server: N/A, Robot Number: N/A, Robot Type: NONE,
Volume Group: ---, Action Acs: N/A, Action Lsm: N/A
5/1/2013 7:36:44 PM - Info bpbrm(pid=5748) fileserver-me.XXXXXXXX.com is the host to restore to
5/1/2013 7:36:44 PM - connecting
5/1/2013 7:36:49 PM - Info bpbrm(pid=5748) start tar32 on client
5/1/2013 7:36:53 PM - Info tar32(pid=2520) Restore started.
5/1/2013 7:36:53 PM - connected; connect time: 00:00:09
5/1/2013 7:37:43 PM - awaiting resource A00013 A pending request has been generated for this resource request.
Operator action may be required. Pending Action: No action.,
Media ID: A00013, Barcode: --------, Density: 4mm, Access Mode: Read,
Action Drive Name: N/A, Action Media Server: N/A, Robot Number: N/A, Robot Type: NONE,
Volume Group: ---, Action Acs: N/A, Action Lsm: N/A
Media Server of Secondary Site:
Solved! Go to Solution.
05-01-2013 09:25 AM
This is because the media was written by the master server or media server at the primary site, when you have moved the tapes to secondary site media server and trying the restore it is still wainting to restore the data from the media server that has written the data on the tape.
To resolve this issue either change the media ownership of this tape to secondary site media server or use the media host override options in the master server properties.
Edit: bpmedia -movedb -m media_id -newserver newservername or FORCE_RESTORE_MEDIA_SERVER entry forces restores to go to a specific server, regardless of where the files were backed up.
05-01-2013 09:25 AM
This is because the media was written by the master server or media server at the primary site, when you have moved the tapes to secondary site media server and trying the restore it is still wainting to restore the data from the media server that has written the data on the tape.
To resolve this issue either change the media ownership of this tape to secondary site media server or use the media host override options in the master server properties.
Edit: bpmedia -movedb -m media_id -newserver newservername or FORCE_RESTORE_MEDIA_SERVER entry forces restores to go to a specific server, regardless of where the files were backed up.
05-01-2013 10:52 PM
Tape media server is not active, Media Server: fileserver-me.XXXXXX.com,
Have you managed to use this Media server up to now for backups at remote site?
Please post output of the following commands on the master server:
nbemmcmd -listhosts -verbose
nbemmcmd -getemmserver
PS: your original issues has actually been resolved by sazz - this is a different issue.
05-01-2013 11:01 PM
Marianne is right seems media server is not active
05-01-2013 11:02 PM
use the media host override options in the master server properties.
I add the MasterServer/MediaServer name in Orignal Backup attribute and add the name of Media Server under Restore Server attribute. (under General Server =>Media Host Override) but now face the below status
Activity Monitor
5/2/2013 10:29:47 AM - begin Restore
5/2/2013 10:29:53 AM - 1 images required
5/2/2013 10:29:53 AM - media A00013 required
5/2/2013 10:29:59 AM - restoring image 192.168.1.102_1356932098
5/2/2013 10:30:00 AM - Info bpbrm(pid=1872) fileserver-me.XXXXXX.com is the host to restore to
5/2/2013 10:30:03 AM - Info bpbrm(pid=1872) telling media manager to start restore on client
5/2/2013 10:30:05 AM - Info bpbrm(pid=1476) fileserver-me.XXXXXX.com is the host to restore to
5/2/2013 10:30:05 AM - connecting
5/2/2013 10:30:05 AM - Info bpbrm(pid=1476) start tar32 on client
5/2/2013 10:30:08 AM - requesting resource A00013
5/2/2013 10:30:08 AM - awaiting resource A00013 Reason: Tape media server is not active, Media Server: fileserver-me.XXXXXX.com,
Robot Number: NONE, Robot Type: NONE, Media ID: N/A, Drive Name: N/A,
Volume Pool: N/A, Storage Unit: N/A, Drive Scan Host: N/A
5/2/2013 10:30:09 AM - Info tar32(pid=3848) Restore started.
5/2/2013 10:30:09 AM - connected; connect time: 00:00:04
(Restart the Netbackup Service "BPDOWN/BPUP")
========================================================
I also ran the command from command prompt as below
C:\Program Files\VERITAS\NetBackup\bin\Admincmd>bpmedia.exe -movedb -m A00013 -n
ewserver fileserver-me
Activity Monitor
5/2/2013 10:55:11 AM - begin Restore
5/2/2013 10:55:17 AM - 1 images required
5/2/2013 10:55:17 AM - media A00013 required
5/2/2013 10:55:23 AM - restoring image 192.168.1.102_1356932098
5/2/2013 10:55:24 AM - Info bpbrm(pid=1804) fileserver-me.XXXXX.com is the host to restore to
5/2/2013 10:55:24 AM - Info bpbrm(pid=1804) telling media manager to start restore on client
5/2/2013 10:55:26 AM - Info bpbrm(pid=3388) fileserver-me.XXXXX.com is the host to restore to
5/2/2013 10:55:26 AM - connecting
5/2/2013 10:55:26 AM - Info bpbrm(pid=3388) start tar32 on client
5/2/2013 10:55:28 AM - requesting resource A00013
5/2/2013 10:55:28 AM - awaiting resource A00013 Reason: Tape media server is not active, Media Server: fileserver-me.XXXXX.com,
Robot Number: NONE, Robot Type: NONE, Media ID: N/A, Drive Name: N/A,
Volume Pool: N/A, Storage Unit: N/A, Drive Scan Host: N/A
5/2/2013 10:55:30 AM - Info tar32(pid=3560) Restore started.
5/2/2013 10:55:30 AM - connected; connect time: 00:00:04
(Restart the Netbackup Service "BPDOWN/BPUP")
05-01-2013 11:08 PM
(Leave tpsbkp2/Dont take tpsbkp2 in your consideration please)
C:\Program Files\VERITAS\NetBackup\bin\Admincmd>nbemmcmd -listhosts -verbose
NBEMMCMD, Version: 7.5.0.3
The following hosts were found:
tpsbkp
MachineName = "tpsbkp"
FQName = "tpsbkp.XXXXX.com"
MachineDescription = ""
MachineNbuType = server (6)
tpsbkp
ClusterName = ""
MachineName = "tpsbkp"
FQName = "tpsbkp.XXXXX.com"
GlobalDriveSeed = "VEND:#.:PROD:#.:IDX"
LocalDriveSeed = ""
MachineDescription = ""
MachineFlags = 0xb7
MachineNbuType = master (3)
MachineState = active for tape and disk jobs (14)
NetBackupVersion = 7.5.0.3 (750300)
OperatingSystem = windows (11)
ScanAbility = 5
tpsbkp2.XXXXX.com
ClusterName = ""
MachineName = "tpsbkp2.XXXXX.com"
FQName = "tpsbkp2.XXXXX.com"
LocalDriveSeed = ""
MachineDescription = ""
MachineFlags = 0xb7
MachineNbuType = media (1)
MachineState = not reachable by master (4)
MasterServerName = "tpsbkp"
NetBackupVersion = 7.1.0.0 (710000)
OperatingSystem = windows (11)
ScanAbility = 5
192.168.1.230
MachineName = "192.168.1.230"
FQName = "192.168.1.230"
MachineDescription = ""
MachineNbuType = virtual_machine (10)
fileserver-me.XXXXX.com
ClusterName = ""
MachineName = "fileserver-me.XXXXX.com"
FQName = "fileserver-me.XXXXX.com"
LocalDriveSeed = ""
MachineDescription = ""
MachineFlags = 0xb7
MachineNbuType = media (1)
MachineState = active for disk jobs (12)
MasterServerName = "tpsbkp"
NetBackupVersion = 7.5.0.0 (750000)
OperatingSystem = windows (11)
ScanAbility = 5
Command completed successfully.
C:\Program Files\VERITAS\NetBackup\bin\Admincmd>
==========================================================
C:\Program Files\VERITAS\NetBackup\bin\Admincmd>nbemmcmd -getemmserver
NBEMMCMD, Version: 7.5.0.3
These hosts were found in this domain: fileserver-me.XXXXX.com, tpsbkp, tpsb
kp2.XXXXX.com
Checking with the host "fileserver-me.XXXXX.com"...
Checking with the host "tpsbkp"...
Checking with the host "tpsbkp2.XXXXX.com"...
Server Type Host Version Host Name EMM Server
MEDIA 7.5 fileserver-me.XXXXX.com tpsbkp
MASTER 7.5 tpsbkp tpsbkp
<unknown> UNKNOWN RELEASE (-2)tpsbkp2.XXXXX.com <unknown>
*Failed to get the configuration for the host "tpsbkp2.XXXXX.com". client ho
stname could not be found(48)
One or more hosts had mismatched EMM Servers.
There were problems getting information on one or more hosts.
The consistency check either failed or was incomplete.
Command did not complete successfully.
C:\Program Files\VERITAS\NetBackup\bin\Admincmd>
=================================================
05-01-2013 11:10 PM
Ahh OK. You mean its Licensing issue ?
05-02-2013 12:27 AM
tpsbkp
MachineState = active for tape and disk jobs (14)
fileserver-me.XXXXX.com
MachineState = active for disk jobs (12)
Licensing on fileserver-me allows it to be used for disk jobs only.
Ensure this media server functions normally as a media server for tape backups before you try restores.
05-02-2013 12:35 AM
Ensure this media server functions normally as a media server for tape backups before you try restores.
What I understand you are suggesting me to verify the Tape Drive license.
Correct ?
(WIll verify that the license is entered correctly)
05-02-2013 12:49 AM
Correct.
Compare licenses on media server with licenses on master.
My understanding is that standalone tape drives do not need library based tape drive license.
You can possibly try to force it as follows:
nbemmcmd -updatehost -machinename <media-server> -machinestateop set_tape_active -machinetype media -masterserver <master>
05-02-2013 01:58 AM
.. Why you are so intelligent :)
Thanks
05-02-2013 04:43 AM
This is problem number 3 all in the same discussion!!!
Have you checked the 'view status' tab in the BAR gui?
Please share contents.
Check the following logs to troubleshoot:
On media server: bpbrm and bptm
On destination client: bpcd and tar
*** EDIT ***
I notice that you have edited your previous post in the meantime with new restore attempt details.
The error message is quite clear - drive needs cleaning.
Please ensure that all required log folders exist - see above.
05-02-2013 04:47 AM
I feel there is also something which I am missing. Searching the problem too
Restore Activity Monitor
5/2/2013 4:05:58 PM - begin Restore
5/2/2013 4:06:04 PM - Info bpbrm(pid=1856) fileserver-me.XXXXX.com is the host to restore to
5/2/2013 4:06:05 PM - 1 images required
5/2/2013 4:06:05 PM - media A00013 required
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:05 PM - Info bpbrm(pid=1856) telling media manager to start restore on client
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:06 PM - Info bpbrm(pid=3796) fileserver-me.XXXXX.com is the host to restore to
5/2/2013 4:06:06 PM - connecting
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:06 PM - Info bpbrm(pid=3796) start tar32 on client
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:10 PM - Info tar32(pid=840) Restore started.
5/2/2013 4:06:10 PM - connected; connect time: 00:00:04
5/2/2013 4:06:11 PM - restoring image 192.168.1.102_1356932098
5/2/2013 4:06:13 PM - Info bptm(pid=2764) Waiting for mount of media id A00013 (copy 1) on server fileserver-me.XXXXX.com.
5/2/2013 4:06:13 PM - started process bptm (2764)
5/2/2013 4:06:13 PM - mounting A00013
5/2/2013 4:06:13 PM - Info bptm(pid=2764) INF - Waiting for mount of media id A00013 on server fileserver-me.XXXXX.com for reading.
5/2/2013 4:06:16 PM - requesting resource A00013
5/2/2013 4:06:16 PM - granted resource A00013
5/2/2013 4:06:16 PM - granted resource SEAGATE.DATDAT72-000.001
5/2/2013 4:06:24 PM - mounted; mount time: 00:00:11
5/2/2013 4:06:24 PM - Info bptm(pid=2764) A00013
5/2/2013 4:06:25 PM - Info bptm(pid=2764) INF - Waiting for positioning of media id A00013 on server fileserver-me.XXXXX.com for reading.
5/2/2013 4:06:25 PM - positioning A00013 to file 1
5/2/2013 4:06:25 PM - positioned A00013; position time: 00:00:00
5/2/2013 4:08:07 PM - begin reading
5/2/2013 4:08:09 PM - Info tar32(pid=840) done. status: 0
5/2/2013 4:08:09 PM - Info bpbrm(pid=1856) child done, status 5
5/2/2013 4:08:09 PM - Info bpbrm(pid=1856) sending message to media manager: STOP RESTORE 192.168.1.102_1356932098
5/2/2013 4:08:32 PM - Info bpbrm(pid=1856) media manager for backup id 192.168.1.102_1356932098 exited with status 150: termination requested by administrator
5/2/2013 4:08:33 PM - restored image 192.168.1.102_1356932098 - (the restore failed to recover the requested files(5)); restore time 00:02:22
5/2/2013 4:08:40 PM - Warning bprd(pid=6056) Restore must be resumed prior to first image expiration on INFINITY
5/2/2013 4:08:46 PM - end Restore; elapsed time: 00:02:48
Restore error(2850)
=================================
=================================
Restore Activity Monitor
5/2/2013 4:20:37 PM - begin Restore
5/2/2013 4:20:43 PM - 1 images required
5/2/2013 4:20:43 PM - media A00013 required
5/2/2013 4:20:50 PM - restoring image tech-server1_1356955091
5/2/2013 4:21:02 PM - Info bpbrm(pid=1264) fileserver-me.XXXXX.com is the host to restore to
5/2/2013 4:21:02 PM - Info bpbrm(pid=1264) telling media manager to start restore on client
5/2/2013 4:21:03 PM - Info bpbrm(pid=2304) fileserver-me.XXXXX.com is the host to restore to
5/2/2013 4:21:03 PM - connecting
5/2/2013 4:21:04 PM - Info bpbrm(pid=2304) start tar32 on client
5/2/2013 4:21:07 PM - requesting resource A00013
5/2/2013 4:21:07 PM - granted resource A00013
5/2/2013 4:21:07 PM - granted resource SEAGATE.DATDAT72-000.001
5/2/2013 4:21:08 PM - Info tar32(pid=2016) Restore started.
5/2/2013 4:21:08 PM - connected; connect time: 00:00:05
5/2/2013 4:21:19 PM - mounted
5/2/2013 4:21:19 PM - Info bptm(pid=2212) A00013
5/2/2013 4:21:19 PM - Info bptm(pid=2212) INF - Waiting for positioning of media id A00013 on server fileserver-me.XXXXX.com for reading.
5/2/2013 4:21:19 PM - positioning A00013 to file 7
5/2/2013 4:22:47 PM - positioned A00013; position time: 00:01:28
5/2/2013 4:23:30 PM - begin reading
5/2/2013 4:43:40 PM - restored image tech-server1_1356955091 - (media read error(85)); restore time 00:22:50
5/2/2013 4:43:42 PM - Error bptm(pid=2212) cannot read image from media id A00013, drive index 0, err = 23
5/2/2013 4:43:43 PM - Warning bptm(pid=2212) TapeAlert Code: 0x03, Type: Warning, Flag: HARD ERROR, from drive SEAGATE.DATDAT72-000.001 (index 0), Media Id A00013
5/2/2013 4:43:43 PM - Error bptm(pid=2212) TapeAlert Code: 0x05, Type: Critical, Flag: READ FAILURE, from drive SEAGATE.DATDAT72-000.001 (index 0), Media Id A00013
5/2/2013 4:43:43 PM - Error bptm(pid=2212) TapeAlert Code: 0x14, Type: Critical, Flag: CLEAN NOW, from drive SEAGATE.DATDAT72-000.001 (index 0), Media Id A00013
5/2/2013 4:43:47 PM - Info bpbrm(pid=1264) child done, status 13
5/2/2013 4:43:47 PM - Info bpbrm(pid=1264) sending message to media manager: STOP RESTORE tech-server1_1356955091
5/2/2013 4:43:52 PM - Warning bprd(pid=5520) Restore must be resumed prior to first image expiration on INFINITY
5/2/2013 4:43:58 PM - end Restore; elapsed time: 00:23:21
Restore error(2850)
05-02-2013 05:59 AM
I have a dynamic DNS environment but I also manually add the Master Server name in the host file of Media Server. and also add the entry of Media Server in to the Master Server host file. After that I feel that the problem is resolved which I asked above. But what I feel that I restored some very small file which too a long time but restored.
================
Question: As per my environment:
One Master/Media Server is at Primary Site and one Media Server is at Secondary Site. Both Sites(Primary and Secondary are connected via VPN). The link is around 8mb.
I dont think that my connectivity between Primary and Secondary could be the reason of slow restore
05-02-2013 06:01 AM
Critical, Flag: CLEAN NOW
seems pretty obvious
05-02-2013 06:45 AM
@Marianne Logs attached
05-02-2013 06:56 AM
Have you cleaned the tape drive yet?
05-02-2013 07:15 AM
Seems the logs were collected while restore is in progress and files are actually getting restored.
See bottom of tar and bpbrm logs.
05-02-2013 07:17 AM
Some very little files(in kb size) were restored but some 1GB files are taking an hour and keep going but dont completing the restore
05-02-2013 07:23 AM
I saw the Drive Status but could not see any status message "Need Cleaning" from GUI.
Although I ran the below command:
tpclean -M DRIVE_NAME
=====================================
=====================================
=====================================
I also tried to clean but receive below.