[Search for users]
[Overall Top Noters]
[List of all Conferences]
[Download this site]
| Title: | + OpenVMS Clusters - The best clusters in the world! + |
| Notice: | This conference is COMPANY CONFIDENTIAL. See #1.3 |
| Moderator: | PROXY::MOORE |
|
| Created: | Fri Aug 26 1988 |
| Last Modified: | Fri Jun 06 1997 |
| Last Successful Update: | Fri Jun 06 1997 |
| Number of topics: | 5320 |
| Total number of notes: | 23384 |
5270.0. "INCONSTATE crash @VAXCLUSTER_CACHE" by CSC32::REIGELMAN () Fri Mar 28 1997 00:18
Is the following a known issue. This footprint has been seem several time and
once told to apply VAXSYS14_061. Also see stars article titled.
VAX INCONSTATE VAXCLUSTER_CACHE+... MOVB #34,17(R5) troubleshooting
******************************* ENTRY 1242. *******************************
ERROR SEQUENCE 19144. LOGGED ON: SID 17000201
DATE/TIME 27-MAR-1997 17:28:38.24 SYS_TYPE 01110201
SYSTEM UPTIME: 46 DAYS 04:49:50
SCS NODE: HNE VAX/VMS V6.1
FATAL BUGCHECK KA7AA-AA CPU FW REV# 1. CONSOLE FW REV# 1.1
INCONSTATE, Inconsistent I/O data base
PROCESS NAME PCF
PROCESS ID 0122027D
ERROR PC 89BCEC5E
ERROR PSL 00080009
C-BIT
N-BIT
INTERRUPT PRIORITY LEVEL = 08.
PREVIOUS MODE = KERNEL
CURRENT MODE = KERNEL
FIRST PART DONE CLEAR
STACK POINTERS
KSP 7FF116F8 ESP 7FFE9800 SSP 7FFECA44 USP 7FDF9310 ISP 89BC7DF8
GENERAL REGISTERS
R0 00002124 R1 000000C8 R2 019D00BB R3 94635A00 R4 89BCEBF5
R5 93B9CD00 R6 903C6200 R7 7FF11D20 R8 7FF11AB8 R9 7FF11ACC
R10 7FF11AB8 R11 7FF11AC4 AP 7FF11844 FP 7FF11808 SP 7FF11780
SYSTEM REGISTERS
P0BR B572B400
P0 PTE BASE (VIRT ADDRS)
P0LR 00019DAF
TOTAL P0 PAGES
P1BR B5059000
P1 PTE BASE (VIRT ADDRS)
P1LR 001FEFB6
TOTAL NON-EXISTENT P1 PAGES
SBR 1F1A7600
SYSTEM PTE BASE (PHYS ADDRS)
SLR 00376280
TOTAL PAGES "SYSTEM" VIRT MEM
PCBB 71AACC20
PCB BASE (PHYS ADDRS)
SCBB 1F178800
SCB BASE (PHYS ADDRS)
ASTLVL 00000001
EXECUTIVE MODE AST PENDING
SISR 00000000
INTERRUPT REQUEST ACTIVE = 0.
ICCS 00000000
SDA> exam/inst 89BCEC5E
VAXCLUSTER_CACHE+0445E: MOVB #34,0B(R5)
SDA> exam/inst 89BCEC5E-20;20
VAXCLUSTER_CACHE+0443E: CMPW #244C,R0
VAXCLUSTER_CACHE+04443: BEQL VAXCLUSTER_CACHE+0445E
VAXCLUSTER_CACHE+04445: CMPW #2454,R0
VAXCLUSTER_CACHE+0444A: BEQL VAXCLUSTER_CACHE+0445E
VAXCLUSTER_CACHE+0444C: CMPW #2044,R0
VAXCLUSTER_CACHE+04451: BEQL VAXCLUSTER_CACHE+0445E
VAXCLUSTER_CACHE+04453: CMPW #0084,R0
VAXCLUSTER_CACHE+04458: BEQL VAXCLUSTER_CACHE+0445E
VAXCLUSTER_CACHE+0445A: BUGW #019C <<< Declare crash
VAXCLUSTER_CACHE+0445E: MOVB #34,0B(R5)
SDA> eval/cond 00002124 <<< unexpected service status !!!
%SYSTEM-F-IVLOCKID, invalid lock ID
R5 is a CFCB
**** Fatal BUG CHECK, version = V6.1 INCONSTATE, Inconsistent I/O data base
Crash CPU: 01 Primary CPU: 00
Active/available CPU masks: 0000000F/0000000F
Current process = PCFS_SERVER
Register dump
R0 = 00002124
R1 = 000000C8
R2 = 019D00BB
R3 = 94635A00
R4 = 89BCEBF5
R5 = 93B9CD00
R6 = 903C6200
R7 = 7FF11D20
R8 = 7FF11AB8
R9 = 7FF11ACC
R10= 7FF11AB8
R11= 7FF11AC4
AP = 7FF11844
FP = 7FF11808
SP = 7FF11780
PC = 89BCEC5E
PSL= 00080009
Kernel/interrupt/boot stack
7FF11788 89BCE338
7FF1178C 00002124
7FF11790 000000C8
7FF11794 019D00BB
7FF11798 94635A00
7FF1179C 89BCEBF5
7FF117A0 93B9CD00
7FF117A4 903C6200
7FF117A8 7FF11D20
7FF117AC 7FF11AB8
7FF117B0 7FF11ACC
7FF117B4 7FF11AB8
7FF117B8 7FF11AC4
7FF117BC 89BCEBF1
7FF117C0 93B9CD00
7FF117C4 89BCEB1C
7FF117C8 933D2180
7FF117CC 000000C8
7FF117D0 00000000
7FF117D4 94635A00
7FF117D8 7FF11AC8
7FF117DC 93B9CD00
7FF117E0 903C6200
7FF117E4 7FF11D20
7FF117E8 7FF11AB8
7FF117EC 7FF11ACC
7FF117F0 7FF11AB8
7FF117F4 7FF11AC4
7FF117F8 89BCDE22
7FF117FC 93B9CD00
7FF11800 00000008
7FF11804 89BCD03B
7FF11808 00000000
7FF1180C 2FFC0000
7FF11810 7FF11894
7FF11814 7FF1185C
7FF11818 7FF24D83
7FF1181C 00000000
7FF11820 94635A00
7FF11824 7FF11AC8
7FF11828 7FF11A3C
7FF1182C 903C6200
7FF11830 7FF11D20
7FF11834 7FF11AB8
7FF11838 7FF11ACC
7FF1183C 7FF11AB8
7FF11840 7FF11AC4
7FF11844 00000005
7FF11848 94635A00
7FF1184C 933D2180
7FF11850 7FF11AB8
7FF11854 7FF15D38
7FF11858 7FF15DA9
7FF1185C 00000000
7FF11860 2BFC0000
7FF11864 7FF11950
7FF11868 7FF11918
7FF1186C 7FF24A82
7FF11870 00000000
7FF11874 7FF11D20
7FF11878 00000001
7FF1187C 00000000
7FF11880 903C6200
7FF11884 7FF11D20
Exec stack
Process privileges
B56C8600 FFF7FFFF
B56C8604 FFFFFFFF
Image name = DSA6:[SYS5.SYSCOMMON.][SYSEXE]PCFS_SERVER.EXE;3
Loaded images
[SYSMSG]SYSMSG.EXE 89AA7E00 89AE6E00
[SYS$LDR]SYSLDR_DYN.EXE 89D44E00 89D46E00
[SYS$LDR]DDIF$RMS_EXTENSION.EXE 89D47400 89D48600
[SYS$LDR]RECOVERY_UNIT_SERVICES.EXE 89D48800 89D49000
[SYS$LDR]RMS.EXE 89AE7200 89B12200
VBSS.EXE 89BC8600 89BCA200
VAXCLUSTER_CACHE.EXE 89BCA800 89BCF200
SYS$NETWORK_SERVICES.EXE 89BCF800 89BCFA00
SYS$UTC_SERVICES.EXE 89BD0000 89BD0E00
SYS$TRANSACTION_SERVICES.EXE 89BD1400 89BDD400
SYS$IPC_SERVICES.EXE 89BDD800 89BEFE00
CPULOA.EXE 89BF0000 89BF4E00
LMF$GROUP_TABLE.EXE 89BF7200 89BF8A00
SYSLICENSE.EXE 89BF8E00 89BFAC00
SNAPSHOT_SERVICES.EXE 89BFB200 89BFBE00
SYSGETSYI.EXE 89BFC400 89BFDC00
SYSDEVICE.EXE 89BFE000 89C00800
MESSAGE_ROUTINES.EXE 89C00E00 89C06C00
EXCEPTION.EXE 89C17200 89C20800
LOGICAL_NAMES.EXE 89C21000 89C23400
SECURITY.EXE 89C23E00 89C2D800
LOCKING.EXE 89C2E200 89C34A00
PAGE_MANAGEMENT.EXE 89C35400 89C3F000
WORKING_SET_MANAGEMENT.EXE 89C7FE00 89C85800
IMAGE_MANAGEMENT.EXE 89C86200 89C89600
EVENT_FLAGS_AND_ASTS.EXE 89C89C00 89C8B800
IO_ROUTINES.EXE 89C8C200 89C97600
PROCESS_MANAGEMENT.EXE 89C98A00 89CA4200
ERRORLOG.EXE 89D37200 89D37C00
PRIMITIVE_IO.EXE 89D38200 89D39400
SYSTEM_SYNCHRONIZATION_SPC.EXE 89D39800 89D3DC00
SYSTEM_PRIMITIVES_MIN.EXE 89D3E200 89D41E00
**** Starting memory dump....
**** Total memory too big for SDA, attempting subset dump
Header and error log buffers dumped...
SPT & GPT dumped...
System space dumped...
Global pages dumped...
PCFS_SERVER dumped...
AUDIT_SERVER dumped...
NETACP dumped...
REMACP dumped...
_FTA378: dumped...
IPCACP dumped...
CONFIGURE dumped...
SCHED_REMOTE dumped...
DECW$TE_CAA2 dumped...
CACHE_SERVER dumped...
CLUSTER_SERVER dumped...
OPCOM dumped...
JOB_CONTROL dumped...
QUEUE_MANAGER dumped...
SHADOW_SERVER dumped...
SECURITY_SERVER dumped...
SMISERVER dumped...
TP_SERVER dumped...
MONITOR_SERVER dumped...
EVL dumped...
RAID$SERVER dumped...
ACMS115SP001000 dumped...
MULTINET_SERVER dumped...
_RTA6: dumped...
ACMS01EXC11A000 dumped...
NFS_SERVER dumped...
SMTP_SYMBIONT dumped...
NFS_SERVERIO_1 dumped...
LATACP dumped...
RDMS_MONITOR dumped...
BATCH_2085 dumped...
MRLOGGER dumped...
MR$T_N_1 dumped...
MRG$GATEWAY dumped...
MRLISTEN_33170 dumped...
FG5_1 dumped...
SYMBIONT_2 dumped...
SERVER_0139 dumped...
ACMS118SP005000 dumped...
EPC$REGISTRAR dumped...
ACMS115SP003001 dumped...
DCSC$CHL_RCV_01 dumped...
ACMS01TSC001000 dumped...
ACMS_SWL dumped...
ACMS01ACC001000 dumped...
ACMS01ATL001000 dumped...
ACMS01CP001000 dumped...
ACMS11ASP005000 dumped...
BATCH_1368 dumped...
M68_1 dumped...
ACMS117SP001000 dumped...
SNARJE$SERVER dumped...
SNARJE$MPX dumped...
SERVER_014F dumped...
RPC$SWL dumped...
ACMS119SP001000 dumped...
SNAEVL dumped...
ACMS01QTI001000 dumped...
ACMS118SP001000 dumped...
D14 dumped...
HITMAN dumped...
CarbonCopy dumped...
RTMON dumped...
F35 dumped...
ACMS119SP006001 dumped...
ACMS115SP002000 dumped...
BATCH_6535 dumped...
NBNS dumped...
ACMS116SP009000 dumped...
BATCH_7783 dumped...
NETBIOS dumped...
_NTY3333: dumped...
FAL_33025 dumped...
COOL_COPY dumped...
ACMS116SP008001 dumped...
ACMS01EXC118000 dumped...
ACMS118SP003000 dumped...
<Rexec_PNM> dumped...
BATCH_5009 dumped...
LP4 dumped...
BATCH_1830 dumped...
_NTY3332: dumped...
ACMS116SP001000 dumped...
DECW$FD dumped...
ACMS115SP004002 dumped...
ACMS116SP002001 dumped...
ACMS115SP006003 dumped...
ACMS116SP010001 dumped...
ACMS116SP006001 dumped...
BATCH_4942 dumped...
ACMS01EXC119000 dumped...
ACMS118SP006001 dumped...
FAL_33195 dumped...
SERVER_0138 dumped...
_NTY3402: dumped...
ACMS01EXC117000 dumped...
VUE$OPER_PRD_2 dumped...
ACMS116SP007000 dumped...
DCSC$SUPERVISOR dumped...
SLS$TAPMGRDB dumped...
ACMS116SP004001 dumped...
OPER_PRD dumped...
_RTA1: dumped...
SERVER_013E dumped...
ACMS11ASP003000 dumped...
ACMS119SP012002 dumped...
_RTA3: dumped...
_LTA8975: dumped...
ACMS01EXC115000 dumped...
OPERATOR dumped...
_NTY3334: dumped...
ACMS116SP003000 dumped...
GRT dumped...
ACMS11ASP001000 dumped...
BATCH_973 dumped...
ACMS117SP004000 dumped...
LP4_1 dumped...
BATCH_6968 dumped...
CM_DVSC00000001 dumped...
PSDC$DC_SERVER dumped...
F54 dumped...
ACMS115SP005002 dumped...
ATR_Daemon dumped...
ACMS119SP007002 dumped...
ACMS01EXC116000 dumped...
FAL_32770 dumped...
SLS$OPCOM dumped...
BATCH_4371 dumped...
NSCHED dumped...
ACMS117SP003000 dumped...
VUE$OPER_PRD_3 dumped...
FAL_32940 dumped...
ACMS119SP004000 dumped...
SCHED#_1963 dumped...
ACMS119SP005004 dumped...
ERRFMT dumped...
ACMS11ASP004000 dumped...
Control Master dumped...
SWL_Daemon dumped...
FG5 dumped...
_LTA8332: dumped...
HNSEC dumped...
_FTA377: dumped...
SERVER_0137 dumped...
_FTA379: dumped...
WKK dumped...
JSK dumped...
_RTA2: dumped...
ACMS11ASP002000 dumped...
SERVER_013F dumped...
ACMS116SP005000 dumped...
M68 dumped...
ACMS119SP013002 dumped...
ACMS119SP002000 dumped...
ATTN_MANAGER dumped...
ACMS118SP002001 dumped...
ACMS118SP004001 dumped...
S43 dumped...
ACMS119SP003003 dumped...
DECW$SESSION dumped...
BATCH_4881 dumped...
SLS$TAPMGRRQ dumped...
DCSC$CHL_XMT_01 dumped...
**** Memory dump complete....
**** to shadow set member, unit ... 1190
Here is the MACRO that we are crashing in from the VBN_CACHE module.
1116 ; This MACRO assumes that R0 has an error code, i.e., BLBS R0 has failed
1117 ; previous to invoking this MACRO
1118 ; It also assume that R5 contains the CFCB address
1119
1120 .MACRO CFCB_CHKLK, ?L1
1121 CMPW #SS$_WRONGSTATE, R0 ; Multiple Actions
1122 BEQL L1
1123 CMPW #SS$_INSFMEM, R0 ; Memory problem
1124 BEQL L1 ; Yes
1125 CMPW #SS$_INSFLPGS, R0 ; Memory problem
1126 BEQL L1 ; Yes
1127 CMPW #SS$_INSFRPGS, R0 ; Memory problem
1128 BEQL L1 ; Yes
1129 CMPW #SS$_INSFSPTS, R0 ; Memory problem
1130 BEQL L1 ; Yes
1131 CMPW #SS$_DEVOFFLINE, R0 ; Lock Manager in Transition
1132 BEQL L1 ; Yes
1133 BUG_CHECK INCONSTATE, FATAL
1134 L1:
1135 MOVB #SPL$C_SCS, CFCB$B_SUBTYPE(R5)
1136 FORK_WAIT ; Try Later
1137 MOVB #DYN$C_VCC_CFCB, CFCB$B_SUBTYPE(R5)
1138 .ENDM
1139
| T.R | Title | User | Personal
Name | Date | Lines |
|---|
| 5270.1 | | JARETH::NORWICH | | Fri Mar 28 1997 10:55 | 4 |
|
How can I get to the dump.
Phil
|
| 5270.2 | Tried CANASTA? | XDELTA::HOFFMAN | Steve, OpenVMS Engineering | Mon Mar 31 1997 15:39 | 6 |
| :Is the following a known issue.
Send the CLUE footprint to CANASTA -- see VMSNOTES 233.* for info.
If CANASTA recognizes it, you'll get information back. If not,
then this crash can/will be added to the CANASTA database for any
folks that might encounter this crash in the future...
|
| 5270.3 | more information | CSC32::REIGELMAN | | Thu Apr 03 1997 02:19 | 174 |
| reply .1
I gave Ronnie Millar the dial-in informastion to look at the
dump. If there are any question please contact me at 592-4446
14:00 00:00 mst.
also I found what look like the backward link for the hashtable
is corrupted.
forwarded this to Ronnie Millar
try to format the CFCB that was in R5, couldn't so I dumped.
\ ; Format of CFCB from STARS article titled "INCONSTATE Crash at
\ ; VAXCLUSTER_CACHE+0BF6"
\ ;
\ CFCB$W_SIZE = 8 !
\ CFCB$B_TYPE = 10 (A) !
\ CFCB$B_SUBTYPE = 11 (B) !
\ CFCB$L_HASHTABLE = 48 (30) !
\ CFCB$L_STATUS = 52 (34) !
\ CFCB$V_NOLOCK = 3 !
\ CFCB$V_LIMBO = 9 !
\ CFCB$L_VREAD = 56 (38) !
\ CFCB$L_READHIT = 60 (3C) !
\ CFCB$L_VWRITE = 64 (40) !
\ CFCB$L_BLOCKCNT = 76 (4C) !
\ CFCB$L_CLCNT = 80 (50) !
\ CFCB$L_HIVBN = 92 (5C) !
\ CFCB$L_FCB = 96 (60) !
\ CFCB$W_OCNT = 102 (66) !
\ CFCB$B_DISABLE = 104 (68) !
\ CFCB$Q_FREE_CLP = 108 (6C) !
\ CFCB$L_TIME = 116 (74) !
\ CFCB$Q_LIMBO = 120 (78) !
\ CFCB$L_CVCB = 132 (80) !
SDA> exam 93B9CD00;80
00000000 206F00C0 00000000 00000000 ........�.o .... 93B9CD00
013D0131 00000001 00000000 00000000 ............1.=. 93B9CD10
00000000 00000000 00000000 00000000 ................ 93B9CD20
0000000B 0000001F 00000810 9231C700 .�1............. 93B9CD30
^^^^
|---hash table
00000000 00000000 00000000 00000000 ................ 93B9CD40
00000001 00000000 00000000 00000000 ................ 93B9CD50
93B9CD6C 00000000 00030000 94635A00 .Zc.........l. 93B9CD60
^^^^
|---FCB
00000000 00000000 00000000 93B9CD6C l............. 93B9CD70
there is a linkage back to CFCB
SDA> format 94635A00
94635A00 FCB$L_FCBFL 94986A00
94635A04 FCB$L_FCBBL 945F1440
94635A08 FCB$W_SIZE 0130
94635A0A FCB$B_TYPE 07
94635A0B FCB$B_ACCLKMODE 04
94635A0C FCB$L_EXFCB 00000000
94635A10 FCB$L_WLFL 94635A10
94635A14 FCB$L_WLBL 94635A10
94635A18 FCB$W_REFCNT 0000
94635A1A FCB$W_ACNT 0000
94635A1C FCB$W_WCNT 0001
94635A1E FCB$W_LCNT 0000
94635A20 FCB$W_TCNT 0000
94635A22 FCB$W_STATUS 0000
94635A24 FCB$W_FID 0606
FCB$W_FID_DIRNUM
FCB$W_FID_NUM
94635A26 FCB$L_FID_RECNUM 0006
FCB$W_FID_SEQ
94635A28 FCB$B_FID_RVN 00
FCB$W_FID_RVN
94635A29 FCB$B_FID_NMX 00
94635A2A FCB$W_SEGN 0000
94635A2C FCB$L_STVBN 00000001
94635A30 FCB$L_STLBN 00000000
94635A34 FCB$L_HDLBN 000F492A
94635A38 FCB$L_FILESIZE 00000003
94635A3C FCB$L_EFBLK 00000001
94635A40 FCB$W_VERSIONS 0000
94635A42 FCB$L_DIRINDX 0000
94635A44 0000
94635A46 FCB$W_DIRSEQ 0000
94635A48 FCB$L_ACCLKID 01EF0001
94635A4C FCB$L_LOCKBASIS 00000606
94635A50 FCB$L_NUMEXTENTS 00000000
FCB$L_TRUNCVBN
94635A54 FCB$L_CACHELKID 00000000
94635A58 FCB$L_HIGHWATER 00000004
94635A5C FCB$L_NEWHIGHWATER 00000004
94635A60 FCB$W_HWM_UPDATE 0000
94635A62 FCB$W_HWM_ERASE 0000
94635A64 FCB$W_HWM_PARTIAL 0000
94635A66 FCB$W_REVISION 0001
94635A68 FCB$L_HWM_WAITFL 94635A68
FCB$L_LIMBOFL
FCB$Q_HWMQHD
FCB$Q_LIMBOQHD
94635A6C FCB$L_HWM_WAITBL 94635A68
FCB$L_LIMBOBL
94635A70 FCB$L_FILEOWNER 07E30053
FCB$W_UICMEMBER
FCB$W_UICGROUP
94635A74 0000FFFF
94635A78 0449007C
94635A7C 00000000
94635A80 FCB$Q_ACMODE FFFFFFFF PDT$C_PE_MFQ_THRESHOLD
94635A84 FFFFFFFF PDT$C_PE_MFQ_THRESHOLD
94635A88 FCB$L_SYS_PROT FFFFFFE0 CDRP$Q_NT_PRVMSK
FCB$W_FILEPROT
94635A8C FCB$L_OWN_PROT FFFFFFE0 CDRP$Q_NT_PRVMSK
94635A90 FCB$L_GRP_PROT FFFFFFFF PDT$C_PE_MFQ_THRESHOLD
94635A94 FCB$L_WOR_PROT FFFFFFFF PDT$C_PE_MFQ_THRESHOLD
94635A98 FCB$L_ACLFL 90694EC0
94635A9C FCB$L_ACLBL 90694EC0
94635AA0 00000000
94635AA4 00000000
94635AA8 00000000
94635AAC 00000000
94635AB0 00000000
94635AB4 00000000
94635AB8 00000000
94635ABC 00000000
94635AC0 00000000
94635AC4 00000000
94635AC8 00000000
94635ACC 00000000
94635AD0 8FD54920
94635AD4 00000000
94635AD8 00000000
94635ADC 00000000
94635AE0 00000000
94635AE4 00000000
94635AE8 00000000
94635AEC 00000000
94635AF0 00000000
94635AF4 00000000
94635AF8 00000000
94635AFC 00000000
94635B00 00000000
94635B04 00000000
94635B08 00000000
94635B0C 00000000
94635B10 00000000
94635B14 00000000
94635B18 FCB$L_ORB 94635A70
94635B1C FCB$L_CFCB 93B9CD00 <--- link back to CFCB
94635B20 FCB$L_DIRLCKID 00000000
94635B24 FCB$L_PRIMFCB 00000000
FCB$C_LENGTH
hastable won't format out
SDA> format 9231C700
%SDA-E-NOSYMBOLS, no "HT" symbols found to format this block
SDA> exam 9231C700;50
9231C70C 036F0040 00040204 FFFB32C0 �2�[email protected]..�1. 9231C700
9231C71C 9231C714 9231C714 9231C70C .�1..�1..�1..�1. 9231C710
0001007B 9231C724 9231C724 9231C71C .�1.$�1.$�1.{... 9231C720
00000000 00000000 0000D000 0000FFC0 �.............. 9231C730
89C31F96 34510038 A4678210 92341180 ..4...g8.Q4..�. 9231C740
backlink looks wrong tried to valid it.
SDA> val que/sel 9231C700
Error comparing backward link to previous structure address (9231C700)
Error occurred in queue element at address 922CF9C0, after tracing 0
elements
|