02-10-2016 01:25 PM
Hi,
I got a request to setup 40 vmware backup, as VMware backup in our enviornment are set via querry all the backups are added in rotation via query.
Now the problem is out of 40, i am backup failure issue with 12 VMware server (EC 156) rest are completing successfully. need your expert advice in troubleshooting.
Error Log :-
02/07/2016 03:45:58 - Critical bpbrm (pid=19223) from client serv234: cannot open /usr/openv/netbackup/online_util/fi_cntl/bpfis.fim.serv234_1454834485.1.0
02/07/2016 03:45:59 - Info bpfis (pid=19227) done. status: 1542
02/07/2016 03:45:59 - end Parent Job; elapsed time 0:04:34
02/07/2016 03:45:59 - Info bpfis (pid=0) done. status: 1542: An existing snapshot is no longer valid and cannot be mounted for subsequent operations
02/07/2016 03:46:55 - end writing
Operation Status: 156
02/07/2016 03:46:55 - begin Application Snapshot: Stop On Error
Operation Status: 0
02/07/2016 03:46:55 - end Application Snapshot: Stop On Error; elapsed time 0:00:00
02/07/2016 03:46:55 - begin Application Snapshot: Cleanup Resources
02/07/2016 03:46:55 - requesting resource nbu1a.VMware.snapshot.vCenter.serv234
02/07/2016 03:46:55 - granted resource nbu1a.VMware.snapshot.vCenter.serv234
Operation Status: 0
02/07/2016 03:46:55 - end Application Snapshot: Cleanup Resources; elapsed time 0:00:00
02/07/2016 03:46:55 - begin Application Snapshot: Delete Snapshot
02/07/2016 03:46:56 - started process bpbrm (pid=19223)
02/07/2016 03:46:56 - end writing
Operation Status: 1542
02/07/2016 03:46:56 - end Application Snapshot: Delete Snapshot; elapsed time 0:00:01
Operation Status: 156
snapshot error encountered (156)
02-10-2016 01:54 PM
02-10-2016 01:58 PM
Refer below link, it might help you
02-10-2016 02:04 PM
If there exists old snapshots, that are not been deleted. Delete older ones and try.
02-11-2016 12:03 AM
See this TN :
NetBackup for VMware status 156
http://www.veritas.com/docs/000068085
02-11-2016 06:16 AM
If you have already isolated the 12 servers
check what happens if you run backups manually..if this works then problem is something else
if it does not then it is specific to that vm ..could be vmtools,if Windows box then VSS issue... and few other things which you can certainly verify form the technotes provided...
If still the issue persistes enable the bpfis and bpvmutil logs at verbosity on Vmware backup host to looks for errors..
02-11-2016 11:01 AM
Have you verified that you can log onto the servers that are failing? I occasionally have servers start erroring with 156, and it turns out the server is pingable and shows online but you can't log into it. After a reboot it fixes the problem.
02-11-2016 11:53 AM
Get your VMware admin to do snapshots of the problematic VMs with quiesce file system, if that fails you probably have an issue inside the VM. Especially if snapshots without quiesce file system works.