03-24-2014 09:47 AM
Faulting application name: bpbkar32.exe, version: 7.500.713.1123, time stamp: 0x5291767f
Faulting module name: vixDiskLib.dll, version: 4.0.0.5024, time stamp: 0x513736a0
Exception code: 0xc0000005
Fault offset: 0x0000000000033a51
Faulting process id: 0x18e4
Faulting application start time: 0x01cf4634e45e8375
Faulting application path: C:\Program Files\Veritas\NetBackup\bin\bpbkar32.exe
Faulting module path: C:\Program Files\Common Files\VERITAS\VxMS\Shared\VDDK\bin\vixDiskLib.dll
Report Id: 6492a41e-b228-11e3-a53d-001517917d08
Any suggestions? Thanks!
03-24-2014 10:39 AM
Hello
bpbkar is used at the client level for backup and restore functions. I would like to get more information. Is this a VMware Backup? vixDiskLib.dll is a Vmware component and is crashing bpbkar. I would like to get the bpbkar log for the client. See where and what it stopped on.
03-24-2014 11:12 AM
Hello SymTerry,
This is 100% vmware environment..
I've attached the log for the day the error occured 7 times..
Is this the hotbackup failing as the client = the master server? I'm confused...
I have set the log level to 1 and waiting for backups to kick off this afternoon and tonight to see if I can collect more info too.
Thanks!
03-25-2014 11:26 AM
Wanted to update thread......
This morning I looked at the Windows Application log and did not see the bpbkar32.exe errors.... Backups started and seemed to end when the window closed....
Nothing changed afaik.... Odd, but will keep looking....
03-25-2014 03:53 PM
Interesting. I didn't see anything in the log I could pinpoint to this.
If you continue to see the bpbkar process crashing, it might be best to open a case with support at well. This could be a bug.
Support tracks these kind of issues and would need to capture a dump file and nbsu output for a backline escalation to our engineering team.
03-27-2014 09:29 PM
@ kp-
If you can, please export the server's OS Event Application and System logs to '.txt' files, then attach them to this thread, so we can see if there are any trends.
Otherwise, if this reoccurs, you might want to make sure full crash dumps are enabled, per this technote:
How to gather crash dumps for NetBackup processes on Windows Vista / Server 2008 and Windows 7 / Server 2008 R2 - TECH128146
Lastly, if the bpbkar crash dumps have stopped completely...
Note: Per the SORT for NetBackup website, make sure you have applied the required patches...
03-28-2014 11:16 AM
SymJD
Thanks for the reply.
None of the updates were applicable to my server as I tried to install. *sigh* No updates were installed for a few weeks, and these updates you mentioned are not already installed afaik.. unless they got installed with SP1.
I attached the Application log... I was using custom filters and saved the log with the filters applied so you should only see the "Critical" "Error" and "Warning" messages...
I have not seen this error since the 22nd... Maybe this weekend I might see it as the're an extended backup windows... Will update the thread when I know more!
Thanks again!
04-01-2014 04:50 PM
The error seems to similar to issue described in this TN (although TN is old - NBU 7.0.1):
http://www.symantec.com/docs/TECH153334
Ensure you have all the logs mentioned in the TN. If you see the error again, please log a Support call and submit logs.
04-03-2014 09:16 PM
Might be helpful to enable VxMS logs next time if you see that, as vixDiskLib.* is related to that.
http://www.symantec.com/docs/TECH72862
VxMS logs can get very big when enabled, remember to disable it once done.
04-04-2014 07:15 AM
@kp-,
You're welcome for the reply. If you don't have those installed, I would recommend getting them installed as they are required. You should be able to check which Microsoft hotfixes are installed by running this command:
C:\Windows\System32>systeminfo 2>&1
You said this hasn't happened since the 22nd but you would watch out for it and report any updates.
1. Has bpbkar continued to fault, or have you found anything related that could be causing this?
As SymTerry mentioned, the fault seems to be VMware related and it's a client side log for NetBackup so it would seem that you are also using this combined master/media server as a VMware backup host.
Master/Media Server Name: (unknown) > OS: Windows Server 2008 R2 Standard SP1 (x64) > NB: 7.5.0.7 - Is this also a VMware backup host? - What type of backup is running when bpbkar faults?
As for the application log, the filtered information is nice but it doesn't let us see what else might be going on around the same time. Additionally, the bpbkar log that you uploaded (032114.log) is from 03/21/2014 and you mentioned the there were errors but there are no faulting messages from bpbkar32.exe on the 21st to match.
Error 3/22/2014 1:36:34 AM Application Error 1000 (100) "Faulting application name: bpbkar32.exe, version: 7.500.713.1123, time stamp: 0x5291767f Faulting module name: vixDiskLib.dll, version: 4.0.0.5024, time stamp: 0x513736a0 Exception code: 0xc0000005 Fault offset: 0x0000000000033a51 Faulting process id: 0x17c4 Faulting application start time: 0x01cf45a85512b13f Faulting application path: C:\Program Files\Veritas\NetBackup\bin\bpbkar32.exe Faulting module path: C:\Program Files\Common Files\VERITAS\VxMS\Shared\VDDK\bin\vixDiskLib.dll Report Id: 1295204e-b19d-11e3-a53d-001517917d08" Error 3/20/2014 10:00:56 PM Application Error 1000 (100) "Faulting application name: bpbkar32.exe, version: 7.500.713.1123, time stamp: 0x5291767f Faulting module name: vixDiskLib.dll, version: 4.0.0.5024, time stamp: 0x513736a0 Exception code: 0xc0000005 Fault offset: 0x0000000000033a51 Faulting process id: 0x18c4 Faulting application start time: 0x01cf44c024f1f838 Faulting application path: C:\Program Files\Veritas\NetBackup\bin\bpbkar32.exe Faulting module path: C:\Program Files\Common Files\VERITAS\VxMS\Shared\VDDK\bin\vixDiskLib.dll Report Id: c8c8adea-b0b5-11e3-a53d-001517917d08"
With that being said...
2. What errors were you seeing and where were you seeing them?
3. Is this happening during a specific backup job? (catalog backup, vmware backup, etc)
On top of that, you mentioned McAfee and in the application logs you received a VSS error.
Error 3/19/2014 9:56:28 AM VSS 8194 None "Volume Shadow Copy Service error: Unexpected error querying for the IVssWriterCallback interface. hr = 0x80070005, Access is denied. . This is often caused by incorrect security settings in either the writer or requestor process. Operation: Gathering Writer Data Context: Writer Class Id: {e8132975-6f93-4464-a53e-1050253ae220} Writer Name: System Writer Writer Instance ID: {ae324443-baa4-492c-b5d2-b29d1fdca486}"
4. Have you tried disabling, or uninstalling, McAfee and just use Microsoft's software, and trying to reproduce the issue, or monitor to see if it faults again?
5. Please look into the vssadmin commands and report your findings.
C:\Windows\System32>vssadmin list writers C:\Windows\System32>vssadmin list providers C:\Windows\System32>vssadmin list shadows
On a site note, you also received a fault from bpfis back on the 10th, but I didn't see any other bpfis faults afterwards. I'll note it here below for reference:
Error 3/10/2014 7:35:07 PM Application Error 1000 (100) "Faulting application name: bpfis.exe, version: 7.500.713.1123, time stamp: 0x529176c6 Faulting module name: libfi_VMware.dll, version: 7.500.713.1123, time stamp: 0x5291763c Exception code: 0xc0000005 Fault offset: 0x000000000001a0f0 Faulting process id: 0xb9c Faulting application start time: 0x01cf3cd22ffea56d Faulting application path: C:\Program Files\Veritas\NetBackup\bin\bpfis.exe Faulting module path: C:\Program Files\Veritas\NetBackup\bin\libfi_VMware.dll Report Id: c205f403-a8c5-11e3-a5c5-001517917d08"
Otherwise, I look forward to your answers and updates! =)