01-05-2015 05:47 AM
Hello All,
I`m BJ. And I`m a system admin in Korea.
Today, my Oracle DBMS crashed by Backupexec Bedscomn.dll. when Archive backing up.
I`m not sure about How it crashed. Maybe when disconnect channel?
Anyway I got a process dump by DebugDiag when ORACLE.EXE crashed.
I wonder how can I fix it or get bedscomn.dll SYMBOL image.
I attached winDBG result below. Please check it what happened.
- beremote file version = 13.0.5204.125
- Oracle 11g R2
- Win2k8 R2
Microsoft (R) Windows Debugger Version 6.2.9200.20512 AMD64 Copyright (c) Microsoft Corporation. All rights reserved. Loading Dump File [D:\dump\ORACLE__PID__4536__Date__01_05_2015__Time_04_06_38PM__8__Second_Chance_Exception_C0000374.dmp] User Mini Dump File with Full Memory: Only application data is available Comment: 'Dump created by DbgHost. Second_Chance_Exception_C0000374' Symbol search path is: SRV* c:\websymbols*http://msdl.microsoft.com/download/symbols Executable search path is: Windows 7 Version 7601 (Service Pack 1) MP (16 procs) Free x64 Product: Server, suite: Enterprise TerminalServer SingleUserTS Built by: 6.1.7601.17965 (win7sp1_gdr.121004-0333) Machine Name: Debug session time: Mon Jan 5 16:06:38.000 2015 (UTC + 9:00) System Uptime: 50 days 12:18:11.822 Process Uptime: 17 days 2:59:44.000 ................................................................ Loading unloaded module list ................................................................ This dump file has an exception of interest stored in it. The stored exception information can be accessed via .ecxr. (11b8.2f70): Unknown exception - code c0000374 (first/second chance not available) ntdll!RtlReportCriticalFailure+0x62: 00000000`77934102 eb00 jmp ntdll!RtlReportCriticalFailure+0x64 (00000000`77934104) 0:261> 0:261> 0:261> !analyze -v ******************************************************************************* * * * Exception Analysis * * * ******************************************************************************* *** ERROR: Symbol file could not be found. Defaulted to export symbols for bedscomn.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for VXBSA.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for beorasbt.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for orageneric10.dll - *** WARNING: Unable to verify checksum for oracle.exe *** ERROR: Symbol file could not be found. Defaulted to export symbols for oracle.exe - *** ERROR: Symbol file could not be found. Defaulted to export symbols for orapls10.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for oracommon10.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for orantcp10.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for oran10.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for orauts.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for oraclient10.dll - *** ERROR: Symbol file could not be found. Defaulted to export symbols for oranbeq10.dll - FAULTING_IP: ntdll!RtlReportCriticalFailure+62 00000000`77934102 eb00 jmp ntdll!RtlReportCriticalFailure+0x64 (00000000`77934104) EXCEPTION_RECORD: ffffffffffffffff -- (.exr 0xffffffffffffffff) ExceptionAddress: 0000000077934102 (ntdll!RtlReportCriticalFailure+0x0000000000000062) ExceptionCode: c0000374 ExceptionFlags: 00000001 NumberParameters: 1 Parameter[0]: 00000000779ab4b0 PROCESS_NAME: oracle.exe ERROR_CODE: (NTSTATUS) 0xc0000374 - <Unable to get error code text> EXCEPTION_CODE: (NTSTATUS) 0xc0000374 - <Unable to get error code text> EXCEPTION_PARAMETER1: 00000000779ab4b0 NTGLOBALFLAG: 0 APPLICATION_VERIFIER_FLAGS: 0 APP: oracle.exe LAST_CONTROL_TRANSFER: from 0000000077934746 to 0000000077934102 FAULTING_THREAD: ffffffffffffffff BUGCHECK_STR: APPLICATION_FAULT_STATUS_HEAP_CORRUPTION_AFTER_CALL PRIMARY_PROBLEM_CLASS: STATUS_HEAP_CORRUPTION_AFTER_CALL DEFAULT_BUCKET_ID: STATUS_HEAP_CORRUPTION_AFTER_CALL STACK_TEXT: 00000000`779ab518 00000000`778ddc47 ntdll! ?? ::FNODOBFM::`string'+0x10c7c 00000000`779ab520 00000000`77671a4a kernel32!HeapFree+0xa 00000000`779ab528 00000000`75486dfb msvcr80!free+0x1b 00000000`779ab530 00000000`7bdcc7fb bedscomn!FS_CloseFileSys+0x9b 00000000`779ab538 00000000`7bdb1e74 bedscomn!FS_DetachDLE+0xc4 00000000`779ab540 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab548 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab550 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab558 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab560 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab568 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab570 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab578 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab580 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab588 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab590 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab598 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5a0 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5a8 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5b0 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5b8 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5c0 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5c8 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5d0 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5d8 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5e0 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5e8 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5f0 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab5f8 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab600 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab608 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc 00000000`779ab610 00000000`7bdb1e6c bedscomn!FS_DetachDLE+0xbc FOLLOWUP_IP: bedscomn!FS_CloseFileSys+9b 00000000`7bdcc7fb 488b8b28010000 mov rcx,qword ptr [rbx+128h] SYMBOL_STACK_INDEX: 3 SYMBOL_NAME: bedscomn!FS_CloseFileSys+9b FOLLOWUP_NAME: MachineOwner MODULE_NAME: bedscomn IMAGE_NAME: bedscomn.dll DEBUG_FLR_IMAGE_TIMESTAMP: 4f4f914a STACK_COMMAND: !heap ; dps 779ab518 ; kb FAILURE_BUCKET_ID: STATUS_HEAP_CORRUPTION_AFTER_CALL_c0000374_bedscomn.dll!FS_CloseFileSys BUCKET_ID: X64_APPLICATION_FAULT_STATUS_HEAP_CORRUPTION_AFTER_CALL_bedscomn!FS_CloseFileSys+9b WATSON_STAGEONE_URL: Followup: MachineOwner
Thanks for read it.
01-05-2015 08:28 PM
Refer to the below article if your Oracle is in a clustured environment.
http://www.symantec.com/docs/TECH211796
01-05-2015 08:45 PM
Would recommend to log a support case for us to analyse the crash dump.
01-05-2015 08:58 PM
Thank for your reply~. AmoIB.
This is a stand alone Oracle DBMS.
Well....