[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference turris::digital_unix

Title:DIGITAL UNIX(FORMERLY KNOWN AS DEC OSF/1)
Notice:Welcome to the Digital UNIX Conference
Moderator:SMURF::DENHAM
Created:Thu Mar 16 1995
Last Modified:Fri Jun 06 1997
Last Successful Update:Fri Jun 06 1997
Number of topics:10068
Total number of notes:35879

8633.0. "crash data analysis" by HYDRA::LNARAYAN () Wed Jan 29 1997 10:12

    Hi
    
    This is a crash data file, relating to a system crash at a Partner
    site, Have anyone seen such a crash before? Can someone identify the
    cause for the crash? 
    
    Thanks In Advance
    Lakshminarayan

#
# Crash Data Collection (Version 1.4)
#
_crash_data_collection_time: Tue Jan 28 15:31:38 EST 1997
_current_directory: /
_crash_kernel: /var/adm/crash/vmunix.4
_crash_core: /var/adm/crash/vmcore.4
_crash_arch: alpha
_crash_os: Digital UNIX
_host_version: Digital UNIX V4.0B  (Rev. 564); Thu Jan  9 16:41:19 EST 1997 
_crash_version: Digital UNIX V4.0B  (Rev. 564); Thu Jan  9 16:41:19 EST 1997 

thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
_crashtime:  struct {
    tv_sec = 854483275
    tv_usec = 814853
} 
_boottime:  struct {
    tv_sec = 854408101
    tv_usec = 60946
} 
_config:  struct {
    sysname = "OSF1"
    nodename = "AlphaStation500"
    release = "V4.0"
    version = "564"
    machine = "alpha"
} 
_cpu:  38 
_system_string:  0xffffffffff800768 = "Digital AlphaStation 500/333" 
_ncpus:  1 
_avail_cpus:  1 
_partial_dump:  1 
_physmem(MBytes):  63 
_panic_string:  0xfffffc0000681d30 = "kernel memory fault" 
_paniccpu:  0 
_panic_thread:  0xfffffc0002ddb080 
_preserved_message_buffer_begin: 
struct {
    msg_magic = 0x63061
    msg_bufx = 0x85a
    msg_bufr = 0x65c
    msg_bufc = "Alpha boot: available memory from 0xf88000 to 0x3f16000
Digital UNIX V4.0B  (Rev. 564); Thu Jan  9 16:41:19 EST 1997 
physical memory = 64.00 megabytes.
available memory = 48.25 megabytes.
using 237 buffers containing 1.85 megabytes of memory
Firmware revision: 6.3
PALcode: OSF version 1.21
Digital AlphaStation 500/333
Mem_size = 64872448, consmem = 273
pci0 at nexus
tu0: DECchip 21040-AA: Revision: 2.4
tu0 at pci0 slot 6
tu0: DEC TULIP Ethernet Interface, hardware address: 00-00-F8-22-0E-35
tu0: console mode: selecting 10BaseT (UTP) port: half duplex
tga0 at pci0 slot 8
tga0: depth 8, map size 2MB, 1280x1024
tga0: ZLXp2-E, Revision: 34
isp0 at pci0 slot 9
isp0: QLOGIC ISP1020A
cam_logger: CAM_ERROR packet
cam_logger: bus 0 
isp_probe
NVRAM parameters invalid, using driver Fast10 defaults
isp0: Firmware revision 2.10 (loaded by console)
Testing of physical memory complete (0 pages bad).
scsi0 at isp0 slot 0
rz0 at scsi0 target 0 lun 0 (LID=0) (DEC     RZ28D    (C) DEC 0008) (Wide16)
rz4 at scsi0 target 4 lun 0 (LID=1) (DEC     RRD45   (C) DEC  0436)
eisa0 at pci0
ace0 at eisa0
ace1 at eisa0
lp0 at eisa0
fdi0 at eisa0
fd0 at fdi0 unit 0
gpc0 at eisa0
lvm0: configured.
lvm1: configured.
kernel console: tga0
dli: configured
ATM Subsystem configured with 1 restart threads
ATM UNI 3.x signalling: configured
ATM IP interface: configured
SuperLAT. Copyright 1994 Meridian Technology Corp. All rights reserved.
<3>SCSI logical disk 1: using ULTRIX partition info found on disk.
<3>SCSI logical disk 1: using ULTRIX partition info found on disk.
<3>/: file system full
<3>/: file system full
<3>/: file system full

trap: invalid memory ifetch access from kernel mode

    faulting virtual address:     0x0000000000002000
    pc of faulting instruction:   0x0000000000002000
    ra contents at time of fault: 0xfffffc000051665c
    sp contents at time of fault: 0xffffffff83833640

panic (cpu 0): kernel memory fault
syncing disks... done
device string for dump = SCSI 0 9 0 0 0 0 0.
DUMP.prom: dev SCSI 0 9 0 0 0 0 0, block 131072
device string for dump = SCSI 0 9 0 0 0 0 0.
DUMP.prom: dev SCSI 0 9 0 0 0 0 0, block 131072
"
} 
_preserved_message_buffer_end: 
_kernel_process_status_begin: 
  PID	COMM
00000	kernel idle
00001	init
00003	kloadsrv
00020	update
00093	syslogd
00095	binlogd
00256	portmap
00258	nfsiod
01328	windu_registryd
01329	windu_clientd
00313	sendmail
00364	os_mibs
00369	inetd
00371	snmpd
00404	cron
00432	lpd
01458	hyperhelp
00462	dtlogin
00470	getty
00471	Xdec
00472	dtlogin
00495	dtsession
00544	ttsession
00545	rpc.ttdbserverd
00553	dtwm
00554	sh
00555	xterm
00556	xterm
00557	xterm
00558	xemacs-19.14
00559	dxconsole
00560	tcsh
00561	tcsh
00562	tcsh
01683	gqladmin
01685	ladebug
_kernel_process_status_end: 
_current_pid:  1683 
_current_tid:  0xfffffc0002ddb080 
_proc_thread_list_begin: 
thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
thread 0xfffffc0002ddb600 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0002ddbb80 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0002ddb8c0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
_proc_thread_list_end: 

warning: Files compiled -g3: parameter values probably wrong
_dump_begin: 
>  0 boot(0x0, 0xfffffc0002ddb080, 0x2c0000002c, 0x36, 0x1) 
["../../../../src/kernel/arch/alpha/machdep.c":2466, 0xfffffc0000501ca8]

   1 panic(s = 0xfffffc0000681d30 = "kernel memory fault") 
["../../../../src/kernel/bsd/subr_prf.c":791, 0xfffffc000027af3c]
pcpu = (nil)
i = 7057392
mycpu = 0
spl = 0

   2 trap() ["../../../../src/kernel/arch/alpha/trap.c":1512, 
0xfffffc0000509b48]
t = 0xfffffc0000681c38
pcb = 0xffffffff83833a38
task = 0xfffffc00036ca000
p = 0xfffffc00036ca220
syst = struct {
    tv_sec = 56235968
    tv_usec = -1024
}
nofault_save = 0
exc_type = 18446744073709551615
exc_code = 18446744071620998720
exc_subcode = 0
s = -1
gen_sig = 57450496
stime_enter = struct {
    seconds = 1
    microseconds = -4398041494684
}
stime_exit = struct {
    seconds = -4398013123776
    microseconds = 4
}
utime = struct {
    seconds = 0
    microseconds = -4398007517168
}
stime_enter_valid = 18446739675719276480
ast = 57450496
cursig = 57450496
instfault_types = {
    [0] 0xfffffc00006acdd0 = "bpt"
    [1] 0xfffffc00006acdd8 = "bugchk"
    [2] 0xfffffc00006acde0 = "gentrap"
    [3] 0xfffffc00006acde8 = "fen"
    [4] 0xfffffc00006acdf0 = "opdec"
    [5] 0xfffffc00006acdf8 = "5"
    [6] 0xfffffc00006ace00 = "6"
    [7] 0xfffffc00006ace08 = "7"
}
result = 0
sta = struct {
    trap_a0 = 76989690
    trap_a1 = 18446739675664318720
    trap_a2 = 18446744071620361988
}
uframe = {
    [0] -4398044067116
    [1] -4398041953512
    [2] -4398045232896
    [3] 2
    [4] -4398044068392
    [5] 1
    [6] 0
    [7] 1004155618353481
    [8] -4398045232896
    [9] 1
    [10] -4397989058832
    [11] 76989680
    [12] 21474836480
    [13] -4398045231584
    [14] 1004155618353481
    [15] -2088553224
    [16] -4398041278328
    [17] -4398041141888
    [18] -4397990945024
    [19] 616284160
    [20] -1
    [21] -4398041479068
    [22] -4398004746944
    [23] 616284160
    [24] -4398018956576
    [25] -4398000638528
    [26] 0
    [27] -4398004746880
    [28] 5
    [29] -17179267336
    [30] -8606711216
    [31] -8598339576
    [32] 616292352
}
sta = struct {
    trap_a0 = 18446739675719276480
    trap_a1 = 18446739675667598176
    trap_a2 = 1
}
sta = struct {
    trap_a0 = 18446744071620361832
    trap_a1 = 0
    trap_a2 = 7333016
}
siginfo = struct {
    si_signo = 8388608
    si_errno = -1024
    si_code = 2784352
    si_kflags = -1024
    _sifields = union {
        _sigproc = struct {
            _pid = 7032616
            _pinfo = union {
                _kill = struct {
                    _uid = 4294966272
                    _pidgen = 33341488
                }
                _sigchld = struct {
                    _status = -1024
                    _utime = 33341488
                    _stime = -1024
                }
                _sigtimer = struct {
                    _timer1 = 4294966272
                    _timer2 = 33341488
                }
            }
            _sigrt = struct {
                _sigval = union {
                    sival_int = 1
                    sival_ptr = 0x1
                }
            }
        }
        _sigfault = struct {
            _addr = 0xfffffc00006b4f28 = ""
        }
        _sigpoll = struct {
            _band = -4398039478488
            _fd = 33341488
        }
        _siganon = struct {
            _siganon = union {
                sival_int = 7032616
                sival_ptr = 0xfffffc00006b4f28
            }
        }
    }
}
signal = 157936
ux_code = 7153856
inst = union {
    word = 57450496
    byte = ""
    common = struct {
        57450496
        opcode = 0
    }
    m_format = struct {
        memory_displacement = 40960
        rb = 12
        ra = 27
        opcode = 0
    }
    b_format = struct {
        branch_displacement = 827392
        ra = 27
        opcode = 0
    }
    o_format = struct {
        rc = 0
        function = 0
        form = 0
        5
        rb = 12
        ra = 27
        opcode = 0
    }
    l_format = struct {
        rc = 0
        function = 0
        form = 0
        literal = 101
        ra = 27
        opcode = 0
    }
    f_format = struct {
        fc = 0
        function = 1280
        fb = 12
        fa = 27
        opcode = 0
    }
    pal_format = struct {
        function = 57450496
        opcode = 0
    }
    j_format = struct {
        hint = 8192
        function = 2
        rb = 12
        ra = 27
        opcode = 0
    }
}

   3 _XentMM(0x0, 0x2000, 0xfffffc00006aaff0, 0xfffffc0000732c78, 0x0) 
["../../../../src/kernel/arch/alpha/locore.s":1424, 0xfffffc00004fdc54]

_dump_end: 
_kernel_thread_list_begin: 
thread 0xfffffc0001fd62c0 stopped at   [thread_run:2469 ,0xfffffc00002a8e08]	 
Source not available
thread 0xfffffc0001fd6580 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd6840 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd6b00 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd6dc0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd7080 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd7340 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd7600 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd78c0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0001fd7b80 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107c000 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107c2c0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107c580 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107c840 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107cb00 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107cdc0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107d340 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107d600 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107d8c0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000107db80 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0002530000 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc00025302c0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0002530580 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc0002530840 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189c2c0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189c580 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189c840 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189cb00 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189cdc0 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189d080 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
thread 0xfffffc000189d340 stopped at   [thread_block:2097 ,0xfffffc00002a8640]	 
Source not available
_kernel_thread_list_end: 
_savedefp:  (nil) 
_kernel_memory_fault_data_begin:  
struct {
    fault_va = 0x2000
    fault_pc = 0x2000
    fault_ra = 0xfffffc000051665c
    fault_sp = 0xffffffff83833640
    access = 0xffffffffffffffff
    status = 0x0
    cpunum = 0x0
    count = 0x1
    pcb = 0xffffffff83833a38
    thread = 0xfffffc0002ddb080
    task = 0xfffffc00036ca000
    proc = 0xfffffc00036ca220
} 
_kernel_memory_fault_data_end:  
_uptime: 20.88 hours

thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
paniccpu: 0x0 
machine_slot[paniccpu]: struct {
    is_cpu = 0x1
    cpu_type = 0xf
    cpu_subtype = 0xf
    running = 0x1
    cpu_ticks = {
        [0] 0x50e12
        [1] 0xf
        [2] 0x2f0ca
        [3] 0x488cc2b
        [4] 0x6042d
    }
    clock_freq = 0x400
    error_restart = 0x0
    cpu_panicstr = 0xfffffc0000681d30 = "kernel memory fault"
    cpu_panic_thread = 0xfffffc0002ddb080
} 
tset machine_slot[paniccpu].cpu_panic_thread: 
Begin Trace for machine_slot[paniccpu].cpu_panic_thread: 
thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
>  0 boot(0x0, 0xfffffc0002ddb080, 0x2c0000002c, 0x36, 0x1) 
["../../../../src/kernel/arch/alpha/machdep.c":2466, 0xfffffc0000501ca8]
   1 panic(s = 0xfffffc0000681d30 = "kernel memory fault") 
["../../../../src/kernel/bsd/subr_prf.c":791, 0xfffffc000027af3c]
   2 trap() ["../../../../src/kernel/arch/alpha/trap.c":1512, 
0xfffffc0000509b48]
   3 _XentMM(0x0, 0x2000, 0xfffffc00006aaff0, 0xfffffc0000732c78, 0x0) 
["../../../../src/kernel/arch/alpha/locore.s":1424, 0xfffffc00004fdc54]
End Trace for machine_slot[paniccpu].cpu_panic_thread: 

thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
"cpu_data" is not an array
thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
_stack_trace[0]_begin: 
>  0 boot(0x0, 0xfffffc0002ddb080, 0x2c0000002c, 0x36, 0x1) 
["../../../../src/kernel/arch/alpha/machdep.c":2466, 0xfffffc0000501ca8]
   1 panic(s = 0xfffffc0000681d30 = "kernel memory fault") 
["../../../../src/kernel/bsd/subr_prf.c":791, 0xfffffc000027af3c]
   2 trap() ["../../../../src/kernel/arch/alpha/trap.c":1512, 
0xfffffc0000509b48]
   3 _XentMM(0x0, 0x2000, 0xfffffc00006aaff0, 0xfffffc0000732c78, 0x0) 
["../../../../src/kernel/arch/alpha/locore.s":1424, 0xfffffc00004fdc54]
_stack_trace[0]_end: 

thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
_kdbx_sum_start:
Hostname : AlphaStation500
cpu: Digital AlphaStation 500/333	avail: 1
Boot-time:	Mon Jan 27 18:35:01 1997
Time:	Tue Jan 28 15:27:55 1997
Kernel : OSF1 release V4.0 version 564 (alpha)
_kdbx_sum_end:
_kdbx_swap_start:

       Swap device name              Size       In Use       Free
--------------------------------  ----------  ----------  ----------
/dev/rz0b                            500000k      40584k     459416k
                                      62500p       5073p      57427p
--------------------------------  ----------  ----------  ----------
Total swap partitions:    1          500000k      40584k     459416k
                                      62500p       5073p      57427p
_kdbx_swap_end:
_kdbx_proc_start:
Addr        PID   PPID  PGRP  UID   NICE SIGCATCH P_SIG    Event       Flags
=========== ===== ===== ===== ===== ==== ======== ======== =========== 
============
k0x01fd2ca0     0     0     0     0    0 00000000 00000000        NULL in sys
k0x01e88ca0     1     0     1     0    0 307a62ff 00000000        NULL in 
contign pagv
k0x01b90220     3     1     3     0    0 00004000 00000000        NULL in pagv
k0x01b91720    20     1    20     0    0 00002000 00000000        NULL in pagv
k0x01798ca0    93     1    93     0    0 60086001 00000000        NULL in pagv
k0x01799720    95     1    95     0    0 00004001 00000000        NULL in pagv
k0x01498ca0   256     1   256     0    0 00080628 00000000        NULL in pagv
k0x01498220   258     1   258     0    0 00000000 00000000        NULL in pagv
k0x03350220  1328     1  1300   215    0 60005efa 00000000        NULL in pagv 
ctty
k0x032d6220  1329     1  1300   215    0 00001ef8 00000000        NULL in pagv 
ctty
k0x01798220   313     1     0     0    0 00086000 00000000        NULL in pagv
k0x01688ca0   364     1   364     0    0 00004002 00000000        NULL in pagv
k0x01689720   369     1   369     0    0 40082001 00000000        NULL in pagv
k0x01688220   371     1   371     0    0 20004002 00000000        NULL in pagv
k0x022b8ca0   404     1   404     0    0 00002000 00000000        NULL in pagv
k0x022b9720   432     1   432     0    0 00084007 00000000        NULL in pagv
k0x032db720  1458   561  1458   215    0 00080000 00000000        NULL in pagv 
ctty
k0x022b8220   462     1   462     0    0 20084003 00000000        NULL in pagv
k0x01e89720   470     1   470     0    0 00000000 00000000        NULL in pagv 
ctty
k0x01499720   471   462   471     0   -2 00004003 00000000        NULL in pagv
k0x01b90ca0   472   462   472     0    0 20004002 00000000        NULL in pagv
k0x03351720   495   472   495   215    0 00084000 00000000        NULL in pagv
k0x01391720   544     1   495   215    0 60085003 00000000        NULL in pagv
k0x01390ca0   545   369   545     0    0 60081000 00000000        NULL in pagv
k0x01390220   553   495   553   215    0 00084e8f 00000000        NULL in pagv
k0x03350ca0   554   495   495   215    0 00000000 00000000        NULL in pagv
k0x02fb1720   555   495   555   215    0 00085006 00000000        NULL in pagv
k0x02fb0ca0   556   495   556   215    0 00085006 00000000        NULL in pagv
k0x02fb0220   557   495   557   215    0 00085006 00000000        NULL in pagv
k0x01944220   558   495   558   215    0 6f887eff 00002000        NULL in pagv
k0x01944ca0   559   554   495   215    0 00000000 00000000        NULL in pagv
k0x01945720   560   556   560   215    0 09882003 00000000        NULL in pagv 
ctty
k0x032da220   561   557   561   215    0 09882003 00000000        NULL in pagv 
ctty
k0x032daca0   562   555   562   215    0 09882003 00000000        NULL in pagv 
ctty
k0x036ca220  1683  1685  1685   215    0 00001ef8 00000000        NULL in pagv 
ctty
_kdbx_proc_end:

thread 0xfffffc0002ddb080 stopped at  [boot:2466 ,0xfffffc0000501ca8]	 Source 
not available
Audit subsystem disabled

No audit data to be saved
#
_crash_data_collection_finished:




T.RTitleUserPersonal
Name
DateLines
8633.1CSC64::BLAYLOCKIf at first you doubt,doubt again.Wed Jan 29 1997 17:4631

You can send the crash-data file to the canasta server
for initial analysis

    "To request a diagnosis, send mail whose content is one of the
    above files and whose subject looks like:

    DIAGNOSE [<platform>] [CASE_ID=<case_id>] [CUSTOMER_ID=<customer_id>]"

to the mail address [email protected]

From the data in the note, you may be able to find out
the culpret from this information:

trap: invalid memory ifetch access from kernel mode

    faulting virtual address:     0x0000000000002000
    pc of faulting instruction:   0x0000000000002000
    ra contents at time of fault: 0xfffffc000051665c
    sp contents at time of fault: 0xffffffff83833640

Using the ra, map that address as an instruction

	# kdbx -k vmunix.0 vmcore.0
	(kdbx) 0xfffffc000051665c?20i	# Get the instruction stream prior
	(kdbx) 0xffffffff83833640/20X	# Contents of the stack

Since this appears to be a 4.0B system you will probably want
to QAR/IPMT the problem.