NBU VMware policy restore error (2820)

[Hendrik_Bezuide]

I am trying to do a restore on one of our VM servers, I am getting this error when I am trying to do restore

11/25/2015 21:41:23 - begin Restore
11/25/2015 21:41:23 - restoring from image PrasaBNK2.metroho.mrail.co.za_1448045195
11/25/2015 21:41:23 - requesting resource @aaaa9
11/25/2015 21:41:23 - granted resource  MediaID=@aaaa9;DiskVolume=NBU_Store;DiskPool=prasagppbck06_hp_disk_pool;Path=NBU_Store;StorageServer=prasagppd2d01.prasa.com;MediaServer=prasagppbck06.prasa.com
11/25/2015 21:41:24 - Info bprd (pid=6292) Restoring from copy 1 of image created 11/20/15 20:46:35 from policy PRASA_VMWARE_05
11/25/2015 21:41:25 - Info bprd.sfr (pid=6292) Restoring to vCenter server PRAGPPVCT01, ESX host 172.22.60.20, Datacenter /PRASA GPP, Folder /PRASA GPP/vm/PRODUCTION/Microsoft with 2003 Server/Other/, Display Name PRASAGPPBNK01, Resource Pool/vApp /PRASA GPP/host/PRASACLUSTER/Resources, Datastore/Datastore Cluster PRA-PRD-DS17
11/25/2015 21:41:27 - Info bpdm (pid=1660) started
11/25/2015 21:41:27 - started process bpdm (pid=1660)
11/25/2015 21:41:28 - Info bpdm (pid=1660) reading backup image
11/25/2015 21:41:28 - Info bpdm (pid=1660) requesting nbjm for media
11/25/2015 21:41:28 - Info bpdm (pid=1660) using 512 data buffers
11/25/2015 21:41:28 - Info bpdm (pid=1660) spawning a child process
11/25/2015 21:41:28 - Info bpbrm (pid=1660) child pid: 11164
11/25/2015 21:41:28 - Info bpdm (pid=11164) started
11/25/2015 21:41:28 - started process bpdm (pid=11164)
11/25/2015 21:41:31 - begin reading
11/25/2015 21:41:57 - requesting resource @aaaa9
11/25/2015 21:41:57 - granted resource  MediaID=@aaaa9;DiskVolume=NBU_Store;DiskPool=prasagppbck06_hp_disk_pool;Path=NBU_Store;StorageServer=prasagppd2d01.prasa.com;MediaServer=prasagppbck01.prasa.com
11/25/2015 21:41:59 - Info bpbrm (pid=6304) prasagppbck06 is the host to restore to
11/25/2015 21:41:59 - Info bpbrm (pid=6304) reading file list for client
11/25/2015 21:42:02 - connecting
11/25/2015 21:42:02 - Info bpbrm (pid=6304) starting bptm
11/25/2015 21:42:08 - Info tar32 (pid=4384) Restore started
11/25/2015 21:42:08 - connected; connect time: 0:00:00
11/25/2015 21:42:08 - Info bptm (pid=7260) start
11/25/2015 21:42:08 - started process bptm (pid=7260)
11/25/2015 21:42:09 - Info bptm (pid=7260) reading backup image
11/25/2015 21:42:09 - Info bptm (pid=7260) using 512 data buffers
11/25/2015 21:42:09 - Info bptm (pid=7260) spawning a child process
11/25/2015 21:42:09 - Info bptm (pid=7260) child pid: 4460
11/25/2015 21:42:09 - Info bptm (pid=4460) start
11/25/2015 21:42:09 - started process bptm (pid=4460)
11/25/2015 21:42:16 - begin reading
11/25/2015 21:42:16 - Critical bptm (pid=7260) sts_read_image failed: error 2060022 software error
11/25/2015 21:42:16 - Critical bptm (pid=7260) image read failed: error 2060022: software error
11/25/2015 21:42:16 - Error bptm (pid=7260) cannot read image from disk, Invalid argument
11/25/2015 21:42:17 - Info bptm (pid=7260) EXITING with status 85 <----------
11/25/2015 21:42:17 - Info tar32 (pid=4384) done. status 0
11/25/2015 21:42:19 - Info tar32 (pid=4384) done. status: 0
11/25/2015 21:42:19 - Info tar32 (pid=4384) done. status: 85: media read error
11/25/2015 21:42:19 - Error bpbrm (pid=6304) client restore EXIT STATUS 85: media read error
11/25/2015 21:43:26 - restored from image PrasaBNK2.metroho.mrail.co.za_1448045195; restore time: 0:02:03
11/25/2015 21:43:26 - end Restore; elapsed time 0:02:03
11/25/2015 21:44:25 - end reading; read time: 0:02:09
11/25/2015 21:44:26 - Info bpdm (pid=1660) completed reading backup image
NBU VMware policy restore error  (2820)

[Hendrik_Bezuide]

Running 7.6.0.3
 

[Marianne]

What type of disk storage are you using? There is a problem reading from disk: " 11/25/2015 21:42:16 - Critical bptm (pid=7260) sts_read_image failed: error 2060022 software error 11/25/2015 21:42:16 - Critical bptm (pid=7260) image read failed: error 2060022: software error 11/25/2015 21:42:16 - Error bptm (pid=7260) cannot read image from disk, Invalid argument"

[Hendrik_Bezuide]

Marianne

I do not know if you are talking about this

Basicdisk

hp_spareonecatalyst

[Ramesh111]

Hi Hendrik,

                Try to restore any small file from same backup image to any alternate server and check. If it's disk storage issue means, restore will fail. If restore gets success means issue with some other things.

[Marianne]

You will know which disk you use for Vmware backups. I suggest that you log a call with HP. If the backup was duplicated to tape, you may want to promote copy 2 to primary. But.... if there is a problem reading from disk, the duplication was probably unsuccessful as well. . .

[pats_729]

In addition to what Marianne suggested, try to run bpverify for restoring image. From the job status, it is trying to restore image PrasaBNK2.metroho.mrail.co.za_1448045195.

Run command 

bpverify -backupid PrasaBNK2.metroho.mrail.co.za_1448045195

If verify fails, something bad happend to this image and a call must be logged with Storage Vendor.

[Marianne]

After many years (almost 17) of working with NetBackup and hardware vendors, I have learned that most hardware vendors will point the finger back at the backup software.
We normally need to prove that there is a harware error before they will investigate.

Please ensure that bptm and bpdm log folders exist on the media server before you attempt another restore or image verify.
Increase logging level to 3 if you want to have a look yourself (or share with us as attachments).
Increase logging level to 5 if you want to log a Support call with Veritas.

[Hendrik_Bezuide]

I did do a restore on a other client, and it worked with out problem

[Marianne]

This restore failed with disk read error.

Nothing to do with particular VM, but with this particular image on the disk storage.

Was the backup duplicated to a tape?
Was the duplication successful?

Please try the helpful suggestions above:
Try to restore a single file from the backup.
Try to verify the image.

Please ensure that log folders exist before you do any of the above.

[Hendrik_Bezuide]

SP.NBU

Id id run bpverify and it was sucessfull

D:\Program Files\Veritas\NetBackup\bin\admincmd>bpverify -backupid PrasaBNK2.met
roho.mrail.co.za_1448045195
Verify started 11/26/15 09:35:45
INF - Verifying policy PRASA_VMWARE_05, schedule WEEKLY (PrasaBNK2.metroho.mrail
.co.za_1448045195), path "@aaaa9", created 11/20/2015 20:46:35.
INF - Verify of policy PRASA_VMWARE_05, schedule WEEKLY (PrasaBNK2.metroho.mrail
.co.za_1448045195) was successful.

INF - Status = successfully verified 1 of 1 images.

[Hendrik_Bezuide]

Marianne

No not yet to tape, still on disk

[Marianne]

The successful verify is a good sign. 

The media id indicates that this is Advanced disk (probably with OST plugin?).

Please retry the restore but double-check that log folders exist before you retry the restore.

PS:
I see that you tried the restore last night at 21:42. 
There is a chance that the HP Appliance was so busy with backups that it had problems with reading for restore.
The logs on the Appliance may help.

[Hendrik_Bezuide]

Ok Sorted out.

Thank you all for helping me with this

The person that fixed the server yesterday, did not tell me that they did a snapshot to an older version of the server, so they have override the one that has all the folders in.

I did change the host file to see the master and media server, and then I could restore the files that was needed.   

How do I close this error on this form

I just look I can do vm restore to media server, but cannot to client itself

11/26/2015 10:22:16 - granted resource  MediaID=@aaaa9;DiskVolume=NBU_Store;DiskPool=prasagppbck06_hp_disk_pool;Path=NBU_Store;StorageServer=prasagppd2d01.prasa.com;MediaServer=prasagppbck01.prasa.com
11/26/2015 10:24:27 - Info bpbrm (pid=1168) connect failed STATUS (18) CONNECT_FAILED
11/26/2015 10:24:27 - Info bpbrm (pid=1168)     status: FAILED, (42) CONNECT_REFUSED; system: (10061) No connection could be made because the target machine actively refused it. ; FROM 0.0.0.0 TO PrasaBNK2.metroho.mrail.co.za 172.22.6.67 bpcd VIA pbx
11/26/2015 10:24:27 - Info bpbrm (pid=1168)     status: FAILED, (42) CONNECT_REFUSED; system: (10061) No connection could be made because the target machine actively refused it. ; FROM 0.0.0.0 TO PrasaBNK2.metroho.mrail.co.za 172.22.6.67 bpcd VIA vnetd
11/26/2015 10:24:27 - Info bpbrm (pid=1168)     status: FAILED, (42) CONNECT_REFUSED; system: (10060) Connection timed out.; FROM 0.0.0.0 TO PrasaBNK2.metroho.mrail.co.za 172.22.6.67 bpcd
11/26/2015 10:24:27 - Error bpbrm (pid=1168) Cannot connect to PrasaBNK2.metroho.mrail.co.za

[Hendrik_Bezuide]

I can make a restore to my media server, and just copy the files over, but I cannot restore to client istelf now.

11/26/2015 10:22:16 - granted resource  MediaID=@aaaa9;DiskVolume=NBU_Store;DiskPool=prasagppbck06_hp_disk_pool;Path=NBU_Store;StorageServer=prasagppd2d01.prasa.com;MediaServer=prasagppbck01.prasa.com
11/26/2015 10:24:27 - Info bpbrm (pid=1168) connect failed STATUS (18) CONNECT_FAILED
11/26/2015 10:24:27 - Info bpbrm (pid=1168)     status: FAILED, (42) CONNECT_REFUSED; system: (10061) No connection could be made because the target machine actively refused it. ; FROM 0.0.0.0 TO PrasaBNK2.metroho.mrail.co.za 172.22.6.67 bpcd VIA pbx
11/26/2015 10:24:27 - Info bpbrm (pid=1168)     status: FAILED, (42) CONNECT_REFUSED; system: (10061) No connection could be made because the target machine actively refused it. ; FROM 0.0.0.0 TO PrasaBNK2.metroho.mrail.co.za 172.22.6.67 bpcd VIA vnetd
11/26/2015 10:24:27 - Info bpbrm (pid=1168)     status: FAILED, (42) CONNECT_REFUSED; system: (10060) Connection timed out.; FROM 0.0.0.0 TO PrasaBNK2.metroho.mrail.co.za 172.22.6.67 bpcd
11/26/2015 10:24:27 - Error bpbrm (pid=1168) Cannot connect to PrasaBNK2.metroho.mrail.co.za

[Marianne]

Please see my post below.