[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference csc32::consolemanager

Title:POLYCENTER Console Manager
Notice:Kits, Scans, Docs on CSC32:: as PCM$KITS:,PCM$DOCS:, PCM$SCANS:
Moderator:CSC32::BUTTERWORTH
Created:Thu Aug 06 1992
Last Modified:Fri Jun 06 1997
Last Successful Update:Fri Jun 06 1997
Number of topics:1541
Total number of notes:6564

1070.0. "Console Ctrl HUNG in LEF" by 29633::LIND (Jim Lind; 592-4099 CX03-1/N14 CNMC-West) Tue Oct 31 1995 14:04

    ISSUE:  Console Ctrl Processes hung in LEF

    ENVIRONMENT:  VMS V6.1; PCM V1.6-110
    		  VAX 6620 w/DEMNA, 128 MB
    		  221 Configured Systems

    PROBLEM DESCRIPTION:

    We have to restart the PCM system about twice a week due to problems 
    with one or more of the Console Ctrl processes being hung in the LEF
    state:

    SYMPTOM:

    Perform CONSOLE CONNECT or CONSOLE MONITOR.  The screen is blanked
    and then it hangs.  No ASCII output of any kind will take place 
    to the screen.  You cannot Ctrl-C, Ctrl-Y, Ctrl-E or Ctrl-A out
    of this situation.  You must terminate your process/screen.

    There seems to be a relationship of the likelihood of a process
    getting hung to the amount of console traffic being logged by 
    that process.

    HOW TO VERIFY/ANALYZE PROBLEM:

    Use SHOW SYSTEM and look for a "Console Ctrl nn" process that is 
    in LEF.  Perform SHOW SYSTEM again and see if the same process is still
    in LEF.  (Note, the Console Ctrl processes will go in and out of 
    LEF as they perform their normal tasks, but will STAY in LEF when
    HUNG.)

    Note PID of Console Ctrl process. Use ANALYZE /SYSTEM, then SET PROCESS
    /INDEX=pid and then SHO PROCESS /CHANNEL using SDA.

    Note that many (or all) of the LTA channels and several of the MBA
    devices are "busy".

    This process is hung, and console connect or monitor on any of 
    these devices are no longer possible.

    WORKAROUND:

    You must execute a CONSOLE SHUTDOWN, but it will not complete, as
    I/O will not complete (rundown) on the hung Console Ctrl process(es).
    You also cannot perform a shutdown if the ARCHIVE process is hung
    waiting on a Console Ctrl process to complete I/O.

    Stop /ID on the hung process.  The CONSOLE system may finish
    shutting down.

    Now, use MCR LATCP to look for LTA channels that are NOT deleted by
    entering SHOW PORT.  Stop those port displaying a syntax of
    "terminal server name/port name" manually with LATCP.

    Restart the CONSOLE MANAGER.

    THINGS WE HAVE TRIED:

    We have specified as little as THREE devices per Console Ctrl process
    to minimize the effect of this problem.  It does not seem to help
    much, just that fewer devices are affected by any single hung Console
    Ctrl process.

    This problem has existed since the release of V1.6 of PCM, even when
    monitoring less that 200 consoles.

    The easiest thing to do is reboot the system.

    ARCHIVE WILL HANG when this LEF problem exists on one or more
    of the Console Ctrl processes.  This can result in FILLING UP
    the CONSOLE$LOGFILES area, as any automatic (scheduled) ARCHIVE
    process will not complete and the log disk can become full.  This
    has caused the entire system to fail if not attended to manually.

    Jim Lind
    CXO3 Production Center
    CX3PCM Console Manager
T.RTitleUserPersonal
Name
DateLines
1070.1Console Ctrl Hang in LEF - SOLUTION52621::LASERThu Nov 02 1995 11:315
It is a bug and we fixed it You can find the solution at :
PCMSVR::PCM$DISK:[LASER.CFS30762]NSI_111.BCK

Laser Rotshtein
PCM - Support manager
1070.2re: .1 NSI_111 does not fix the problem49430::BRUTTINArmand Bruttin MCS GenevaFri Nov 03 1995 05:35711
Laser,

Console Ctrl Processes hung in LEF event after installing
PCMSVR::PCM$DISK:[LASER.CFS30762]NSI_111.BCK
The Customer has crashed the system to get a dumpfile.

This can may be help you to fix the problem.
As soon as possible I will post a pointer to the dump file.

---------

The Console Ctrl process has 2 channel busy on LTA devices
( LTA5148 and LTA5158 ). The process seems to be waiting for
synchronous IO completion on device LTA5148.

Effectively there are 2 QIOs on the device LTA5148


--------------------------------------------------------------------------------
				I/O request queue
				-----------------

STATE    IRP      PID   MODE CHAN  FUNC    WCB     EFN    AST     IOSB    STATUS

 C   80EBED40  0009001A  U   02C0  0000  00000000  57  000176F8  00241B58  8203
 *   ********
	nop bufio,func,termio

 P   80EC9040  0009001A  U   02C0  0080  00000000  57  00000000  00241B58  8203
 *   ********
	nop bufio,func,termio

-------------------------------------------------------------------------------


As fare I can understand the pending QIO will never been finish until the
current one will be terminated.

Armand Bruttin


Output from the crash dump
**************************

Current process summary
-----------------------
 Extended Indx Process name    Username    State   Pri   PCB      PHD    Wkset
-- PID -- ---- --------------- ----------- ------- --- -------- -------- ------
 00000081 0001 SWAPPER                      HIB     16 80C3A2F8 80C3A000      0
 00000085 0005 IPCACP          SYSTEM       HIB     10 80DE1D80 813D6000     20
 00000086 0006 ERRFMT          SYSTEM       HIB      8 80DE19C0 81402000     59
 00000087 0007 OPCOM           SYSTEM       HIB      8 80D9F000 8142E000     44
 00000088 0008 AUDIT_SERVER    AUDIT$SERVER HIB     10 80DA0280 8145A000    115
 00000089 0009 JOB_CONTROL     SYSTEM       HIB     10 80DA0CC0 81486000     45
 0000008A 000A QUEUE_MANAGER   SYSTEM       HIB      8 80DE8640 814B2000    161
 0000008B 000B SECURITY_SERVER SYSTEM       HIB     10 80DEA4C0 814DE000    146
 0000008C 000C NETACP          DECNET       HIB     10 80D9DB40 8137E000     70
 0000008D 000D EVL             DECNET       HIB      6 80DFAC00 8150A000     45
 0000008E 000E REMACP          SYSTEM       HIB     11 80DFAE80 81536000     22
 0000008F 000F LATACP          SYSTEM       HIB     14 80E12240 81562000     46
 00000090 0010 SMISERVER       SYSTEM       HIB      9 80E13340 8158E000    154
 00000091 0011 SYMBIONT_1      SYSTEM       HIB      4 80E1CD40 815BA000     30
 00000092 0012 SYMBIONT_2      SYSTEM       HIB      6 80E1E840 815E6000     51
 00000094 0014 PSDC$DC_SERVER  SYSTEM       HIB     15 80E26540 8163E000    163
 00000095 0015 SYMBIONT_3      SYSTEM       HIB      6 80E27180 8166A000     51
 00001C98 0018 Console Daemon  SYSTEM       HIB      6 80E1C140 816C2000    159
 00001C99 0019 Console Notify  SYSTEM       HIB      6 80EC1940 81612000    162
 0000049A 001A Console Ctrl 01 SYSTEM       LEF      6 80E55D40 8171A000    319
 00002B1B 001B Console Ctrl 02 SYSTEM       HIB      6 80E5A300 81772000    113
 0000009F 001F DECW$SERVER_0   SYSTEM       HIB      8 80E61400 817F6000    579
 0000362A 002A BAUME           BAUME        HIB      9 80EBC980 816EE000    167
 000034AC 002C Multi-Line  001 SYSTEM       LEF     10 80EB9DC0 81746000    455
 00002FAD 002D Multi-Line  002 SYSTEM       LEF     10 80ECC700 817CA000    476
 000011BB 003B SNS$WATCHDOG    BPOLY1       HIB      6 80E9B980 813AA000    167
 000010BC 003C SNS$CONS_2735   BPOLY1       HIB      5 80E4F840 81696000    309
 0000363E 003E DECW$LOGINOUT   <login>      LEF      4 80EE7B80 818A6000    280
 0000123F 003F SNS$AR_2735     BPOLY1       LEF      2 80EC16C0 8184E000     73
 00003640 0040 SYSTEM          SYSTEM       CUR      6 80EEB500 8179E000     69

SDA> set proc/ind=001A
SDA> sh proc

Process index: 001A   Name: Console Ctrl 01   Extended PID: 0000049A
--------------------------------------------------------------------
Process status:        00141001  RES,WAKEPEN,PHDRES,LOGIN
Required capabilities: 0000000C  QUORUM,RUN

PCB address              80E55D40    JIB address              80EC7140
PHD address              8171A000    Swapfile disk address    00000000
Master internal PID      0009001A    Subprocess count                0
Internal PID             0009001A    Creator internal PID     00000000
Extended PID             0000049A    Creator extended PID     00000000
State                       LEF      Termination mailbox          256E
                         ********
Previous CPU Id          00000000    Current CPU Id           00000000
Previous ASNSEQ  00000000000000A5    Previous ASN     000000000000002C
Current priority                6    # of threads     0000000000000000
Initial process priority        4    Delete pending count         0
Base priority                   4    AST's active                 NONE
UIC                [00001,000004]    AST's remaining              1004
Mutex count                     0    Buffered I/O count/limit     1004/1024
Waiting EF cluster              1    Direct I/O count/limit       1024/1024
			*********
Abs time of last event   083C4EE5    BUFIO byte count/limit     550262/551670
Event flag wait mask     FDFFFFFF    # open files allowed left    1007
                        *********


SDA> sh proc/chan
Process index: 001A   Name: Console Ctrl 01   Extended PID: 0000049A
--------------------------------------------------------------------


                            Process active channels
                            -----------------------

Channel	 Window		  Status	Device/file accessed
-------	 ------		  ------	--------------------
  0010	00000000	          	DKA200:
  0020	80DE9B40	          	DKA300:(4492,118,0) (section file)
  0030	80DBE780	          	DKA300:(390,2,0) (section file)
  0040	80DC5C00	          	DKA300:(3309,83,0) (section file)
  0050	80E6F580	          	DKA300:(3202,167,0)
  0060	80EC8B40	          	DKA300:(2087,51,0)
  0070	80DC6E40	          	DKA300:(1740,2,0) (section file)
  0080	80DCA100	          	DKA300:(3884,11,0) (section file)
  0090	80DC9FC0	          	DKA300:(4673,61,0) (section file)
  00A0	80DC5500	          	DKA300:(1723,2,0) (section file)
  00B0	80DCAEC0	          	DKA300:(3408,4,0) (section file)
  00C0	80DCAA80	          	DKA300:(1631,2,0) (section file)
  00D0	80DCA640	          	DKA300:(1575,2,0) (section file)
  00E0	00000000	          	DKA300:
  00F0	00000000	     Busy 	MBA9594:
  0100	00000000	          	MBA9595:
  0110	00000000	          	MBA9596:
  0120	00000000	          	MBA9599:
  0130	00000000	          	LTA5139:
  0140	00000000	          	MBA9255:
  0150	00000000	          	MBA9255:
  0170	00000000	     Busy 	MBA9604:
  0180	00000000	          	LTA5141:
  01C0	00000000	     Busy 	MBA9606:
  01D0	00000000	          	LTA5143:
  0210	00000000	     Busy 	MBA9610:
  0220	00000000	          	LTA5145:
  0230	80E77980	          	DKA200:(1553,2834,0)
  0240	80EC2D40	          	DKA200:(1554,9,0)
  0250	80E825C0	          	DKA200:(1555,12,0)
  0260	00000000	     Busy 	MBA9612:
  0270	00000000	          	LTA5147:
  0280	00000000	          	MBA9255:
  0290	00000000	          	MBA9255:
  02B0	00000000	     Busy 	MBA9614:
  02C0	00000000	     Busy 	LTA5148:
  02D0	80E86E40	          	DKA200:(1439,8,0)
  02E0	80E51540	          	DKA200:(1440,8,0)
  02F0	80EB9A40	          	DKA200:(1441,8,0)
  0300	00000000	     Busy 	MBA9615:
  0310	00000000	          	LTA5149:
  0320	00000000	          	MBA9255:
  0330	00000000	          	MBA9255:
  0340	00000000	          	MBA9255:
  0350	00000000	     Busy 	MBA9616:
  0360	00000000	          	LTA5150:
  0370	80E62F00	          	DKA200:(1757,11,0)
  0380	80EB92C0	          	DKA200:(1821,9,0)
  0390	80E76D80	          	DKA200:(2519,13,0)
  03A0	00000000	     Busy 	MBA9617:
  03B0	00000000	          	LTA5151:
  03C0	00000000	          	MBA9255:
  03D0	00000000	          	MBA9255:
  03E0	00000000	          	MBA9255:
  03F0	00000000	     Busy 	MBA9618:
  0400	00000000	          	LTA5152:
  0410	00000000	          	MBA9255:
  0440	00000000	     Busy 	MBA9619:
  0450	00000000	          	LTA5153:
  0490	00000000	     Busy 	MBA9620:
  04A0	00000000	          	LTA5154:
  04E0	00000000	     Busy 	MBA9621:
  04F0	00000000	          	LTA5155:
  0530	00000000	     Busy 	MBA9622:
  0540	00000000	          	LTA5156:
  0550	80E94B40	          	DKA200:(2560,10,0)
  0560	80EC8900	          	DKA200:(2561,10,0)
  0570	80E8FFC0	          	DKA200:(2562,10,0)
  0580	00000000	     Busy 	MBA9623:
  0590	00000000	          	LTA5157:
  05A0	80EBF100	          	DKA200:(2563,293,0)
  05B0	80E8CD40	          	DKA200:(2564,10,0)
  05C0	80E8F900	          	DKA200:(2565,8,0)
  05D0	00000000	     Busy 	MBA9624:
  05E0	00000000	     Busy 	LTA5158:
  0620	00000000	     Busy 	MBA9625:

SDA> sh dev lta5148

I/O data structures
-------------------
LTA5148                                 Unknown           UCB address:  80EF01C0

Device status:   00000110 online,bsy
Characteristics: 0C040007 rec,ccl,trm,avl,idv,odv
                 00000200 nnm

Owner UIC [000001,000004]   Operation count       3290   ORB address    80EC7A40
      PID        0009001A   Error count              0   DDB address    80E11C00
Class/Type          42/00   Reference count          1   DDT address    80C853A0
Def. buf. size         80   BOFF              00000080   CRB address    80E11D80
DEVDEPEND        180A01B2   Byte count        00000001   IRP address    80EBED40
DEVDEPND2        00040080   SVAPTE            80EE3B80   Fork PC        80C5F020
DEVDEPND3        00000000   DEVSTS            00000000   I/O wait queue 80EC9040
FLCK index             3A                                                       
DLCK address     80C2B500                                                       

I/O data structures
-------------------
				I/O request queue
				-----------------

STATE    IRP      PID   MODE CHAN  FUNC    WCB     EFN    AST     IOSB    STATUS

 C   80EBED40  0009001A  U   02C0  0000  00000000  57  000176F8  00241B58  8203
     ********
	nop bufio,func,termio

 P   80EC9040  0009001A  U   02C0  0080  00000000  57  00000000  00241B58  8203
     ********
	nop bufio,func,termio


SDA> f 80EBED40  ***************

80EBED40   IRP$L_IOQFL                     80EFA3C0	
80EBED44   IRP$L_IOQBL                     80ECC730	
80EBED48   IRP$W_SIZE                          0178	 
80EBED4A   IRP$B_TYPE                        0A	 
80EBED4B   IRP$B_RMOD                      43	 
80EBED4C   IRP$L_PID                       0009001A	 
80EBED50   IRP$L_AST                       000176F8	 
           IRP$L_SHD_IOFL                  
           IRP$Q_PARAM_0                   
80EBED54   IRP$L_ASTPRM                    00241B00	 
           IRP$L_HRB                       
           IRP$L_SHAD                      
80EBED58   IRP$L_OBOFF                     00000000	 
           IRP$Q_PARAM_1                   
80EBED5C   IRP$L_ABOFF                     00000000	 
80EBED60   IRP$L_KAST                      00000000	 
           IRP$L_MIRP                      
           IRP$L_WIND                      
80EBED64   IRP$L_UCB                       80EF01C0	UCB
80EBED68   IRP$B_EFN                             39	 
80EBED69   IRP$B_PRI                           3B	 
80EBED6A   IRP$B_CLN_INDX                    00	 
80EBED6B   IRP$B_WLG_FLAGS                 00	 
80EBED6C   IRP$L_CLN_WLE                   00241B58	 
           IRP$L_IOSB                      
80EBED70   IRP$L_CHAN                      000002C0	 
80EBED74   IRP$L_EXTEND                    73797320	 
80EBED78   IRP$L_STS                       00008203	 
           IRP$Q_STATUS                    
80EBED7C   IRP$L_STS2                      00000000	 
80EBED80   IRP$L_SVAPTE                    80EE3B80	
80EBED84   IRP$L_BCNT                      00000001	 
80EBED88   IRP$L_BOFF                      00000080	 
80EBED8C   IRP$PS_KPB                      80EE5080	
80EBED90   IRP$L_IOST1                     00000000	 
           IRP$L_MEDIA                     
80EBED94   IRP$B_CARCON                          FF	 
           IRP$L_IOST2                     
           IRP$L_TT_TERM                   
           IRP$W_SHD_COPY_TYPE             
           IRP$W_SHD_VUN                   
80EBED95                                       FF	 
80EBED96   IRP$W_SHD_DEV_TYPE              FFFF	 
           IRP$W_SHD_MSCP_DISK_MODIFIER    
80EBED98   IRP$L_ABCNT                     00010000	 
           IRP$Q_NT_PRVMSK                 
           IRP$Q_STATION                   
           IRP$Q_TT_STATE                  
80EBED9C   IRP$L_OBCNT                     01000000	 
80EBEDA0   IRP$L_FUNC                      00000000	 
80EBEDA4   IRP$L_SEGVBN                    00000001	 
80EBEDA8   IRP$L_DIAGBUF                   0000FFFF	 
           IRP$L_SCB_BUF                   
           IRP$W_TT_PRMPT                  
80EBEDAC   IRP$L_DCD_SRC_UCB               00E4773F	 
           IRP$L_SEQNUM                    
80EBEDB0   IRP$L_ARB                       80E55E40	ARB
80EBEDB4   IRP$B_CPY_MODE                        4D	 
           IRP$L_KEYDESC                   
           IRP$L_WLE_PTR                   
80EBEDB5                                   6D6853	 
80EBEDB8   IRP$L_QIO_P1                    00241C20	 
80EBEDBC   IRP$L_QIO_P2                    00000001	 
80EBEDC0   IRP$L_QIO_P3                    00000000	 
80EBEDC4   IRP$L_QIO_P4                    7EE7B528	 
80EBEDC8   IRP$L_QIO_P5                    00000000	 
80EBEDCC   IRP$L_QIO_P6                    00000000	 
80EBEDD0   IRP$PS_FDT_CONTEXT              00000000	 
80EBEDD4   IRP$PS_CCB                      7FF84560	
80EBEDD8   IRP$L_FQFL                      80E55D68	PCB+00028
80EBEDDC   IRP$L_FQBL                      80E55D68	PCB+00028
80EBEDE0   IRP$W_CDRPSIZE                      0000	 
80EBEDE2   IRP$B_CD_TYPE                     02	 
80EBEDE3   IRP$B_FLCK                      20	 
80EBEDE4   IRP$L_FPC                       0009001A	 
80EBEDE8   IRP$Q_FR3                       82BB05B8	CONTINUE_THREAD
80EBEDEC                                   7EF76444	 
80EBEDF0   IRP$Q_FR4                       203A206D	 
80EBEDF4                                   4D444142	 
80EBEDF8   IRP$L_SAVD_RTN                  80C36FA8	EXE$QXQPPKT
80EBEDFC   IRP$L_MSG_BUF                   430A0D4B	 
80EBEE00   IRP$L_RSPID                     6D68534D	 
80EBEE04   IRP$L_CDT                       6553203A	 
80EBEE08   IRP$Q_RES_WAIT_STATE            79732074	 
80EBEE0C                                   6D657473	 
80EBEE10   IRP$L_SCS_STALL_DATA            63726120	 
80EBEE14   IRP$L_RWCPTR                    65766968	 
80EBEE18   IRP$L_BD_ADDR                   616C6620	 
80EBEE1C   IRP$L_LBUFH_AD                  4B5B1B67	 
80EBEE20   IRP$B_SHD_PIO_CNT                     0D	 
           IRP$L_ERASE_VBN                 
           IRP$L_LBOFF                     
           IRP$T_LBUFHNDL                  ".Attempting c"
80EBEE21   IRP$B_SHD_PIO_ACT                   0A	 
80EBEE22   IRP$B_SHD_PIO_FLAGS               41	 
80EBEE23   IRP$B_SHD_PIO_ERRCNT            74	 
80EBEE24   IRP$B_SHD_PIO_ERRINDEX                74	 
           IRP$L_CDRPFL                    
           IRP$L_RBUFH_AD                  
80EBEE25   IRP$B_SHD_PIO_ERRSEV                65	 
80EBEE26                                   706D	 
80EBEE28   IRP$L_RBOFF                     676E6974	 
           IRP$Q_SHD_LOCK_FR0              
80EBEE2C   IRP$L_UBARSRCE                  6E6F6320	 
           IRP$L_XCT_LEN                   
80EBEE30   IRP$L_DUTUFLAGS                 7463656E	 
           IRP$Q_SHD_LOCK_FR1              
80EBEE34   IRP$W_DUTUCNTR                      7420	 
80EBEE36   IRP$W_ENDMSGSIZ                 206F	 
80EBEE38   IRP$Q_SHD_LOCK_FR2              746E6F43	 
80EBEE3C                                   6C6C6F72	 
80EBEE40   IRP$Q_SHD_LOCK_FR4              66207265	 
80EBEE44                                   6820726F	 
80EBEE48   IRP$Q_SHD_LOCK_FR5              2074736F	 
80EBEE4C                                   4441423C	 
80EBEE50   IRP$L_SHD_LOCK_FPC              3E34494D	 
80EBEE54   IRP$L_SHD_PIO_ERROR             0D4B5B1B	 
80EBEE58   IRP$L_SHD_PIO_LNK               6E6F430A	 
80EBEE5C   IRP$L_SHDSPC                    7463656E	 
80EBEE60   IRP$L_SHD_CONTROL_IRP           3207001C	 
80EBEE64   IRP$L_SHD_TEMP                  72000008	 
80EBEE68   IRP$Q_SHD_SAVED_R1              69615720	 
80EBEE6C                                   676E6974	 
80EBEE70   IRP$Q_SHD_SAVED_R2              80C04A30	EXE$GQ_RIGHTSLIST
80EBEE74                                   00000000	 
80EBEE78   IRP$Q_SHD_SAVED_R4              00000000	 
80EBEE7C                                   00000000	 
80EBEE80   IRP$L_SHD_SVD_CNT_IRP           80EBFDC0	
80EBEE84   IRP$L_SHD_SAVED_STATUS          00000040	 
80EBEE88   IRP$L_SHD_WLG_MODE_FPC          00100001	 
80EBEE8C   IRP$L_SHD_PERLKID               00040028	 
80EBEE90   IRP$L_SHD_EXPEL_TIMER           7FF84404	
80EBEE94   IRP$L_SHD_EXPEL_FLAGS           00000025	 
80EBEE98   IRP$L_SHD_EXPEL_MASK            00000000	 
80EBEE9C   IRP$Q_SHD_RESERV_Q8             0000001E	 
80EBEEA0                                   00000000	 
80EBEEA4   IRP$Q_SHD_RESERV_Q9             00000017	 
80EBEEA8                                   00000000	 
80EBEEAC   IRP$Q_SHD_RESERV_Q10            00000010	 
80EBEEB0                                   00000000	 
80EBEEB4   IRP$B_SHD_FLAGS                       00	 
80EBEEB5                                   000000	 
           IRP$C_LENGTH                    


SDA> f 80EC9040    ************************

80EC9040   IRP$L_IOQFL                     80EF022C	UCB+0006C
80EC9044   IRP$L_IOQBL                     80EF022C	UCB+0006C
80EC9048   IRP$W_SIZE                          0178	 
80EC904A   IRP$B_TYPE                        0A	 
80EC904B   IRP$B_RMOD                      03	 
80EC904C   IRP$L_PID                       0009001A	 
80EC9050   IRP$L_AST                       00000000	 
           IRP$L_SHD_IOFL                  
           IRP$Q_PARAM_0                   
80EC9054   IRP$L_ASTPRM                    00000000	 
           IRP$L_HRB                       
           IRP$L_SHAD                      
80EC9058   IRP$L_OBOFF                     00000600	 
           IRP$Q_PARAM_1                   
80EC905C   IRP$L_ABOFF                     00000000	 
80EC9060   IRP$L_KAST                      00000000	 
           IRP$L_MIRP                      
           IRP$L_WIND                      
80EC9064   IRP$L_UCB                       80EF01C0	UCB
80EC9068   IRP$B_EFN                             39	 
80EC9069   IRP$B_PRI                           3B	 
80EC906A   IRP$B_CLN_INDX                    00	 
80EC906B   IRP$B_WLG_FLAGS                 00	 
80EC906C   IRP$L_CLN_WLE                   00241B58	 
           IRP$L_IOSB                      
80EC9070   IRP$L_CHAN                      000002C0	 
80EC9074   IRP$L_EXTEND                    00000019	 
80EC9078   IRP$L_STS                       00008203	 
           IRP$Q_STATUS                    
80EC907C   IRP$L_STS2                      00000000	 
80EC9080   IRP$L_SVAPTE                    80EDD140	
80EC9084   IRP$L_BCNT                      00000400	 
80EC9088   IRP$L_BOFF                      00000480	 
80EC908C   IRP$PS_KPB                      80EE5080	
80EC9090   IRP$L_IOST1                     7EE7B5A8	 
           IRP$L_MEDIA                     
80EC9094   IRP$B_CARCON                          FF	 
           IRP$L_IOST2                     
           IRP$L_TT_TERM                   
           IRP$W_SHD_COPY_TYPE             
           IRP$W_SHD_VUN                   
80EC9095                                       FF	 
80EC9096   IRP$W_SHD_DEV_TYPE              FFFF	 
           IRP$W_SHD_MSCP_DISK_MODIFIER    
80EC9098   IRP$L_ABCNT                     00010000	 
           IRP$Q_NT_PRVMSK                 
           IRP$Q_STATION                   
           IRP$Q_TT_STATE                  
80EC909C   IRP$L_OBCNT                     01000000	 
80EC90A0   IRP$L_FUNC                      00000080	 
80EC90A4   IRP$L_SEGVBN                    00000B48	 
80EC90A8   IRP$L_DIAGBUF                   0000FFFF	 
           IRP$L_SCB_BUF                   
           IRP$W_TT_PRMPT                  
80EC90AC   IRP$L_DCD_SRC_UCB               00E47740	 
           IRP$L_SEQNUM                    
80EC90B0   IRP$L_ARB                       80E55E40	ARB
80EC90B4   IRP$B_CPY_MODE                        00	 
           IRP$L_KEYDESC                   
           IRP$L_WLE_PTR                   
80EC90B5                                   000000	 
80EC90B8   IRP$L_QIO_P1                    00241C20	 
80EC90BC   IRP$L_QIO_P2                    00000400	 
80EC90C0   IRP$L_QIO_P3                    00000000	 
80EC90C4   IRP$L_QIO_P4                    7EE7B5A8	 
80EC90C8   IRP$L_QIO_P5                    00000000	 
80EC90CC   IRP$L_QIO_P6                    00000000	 
80EC90D0   IRP$PS_FDT_CONTEXT              00000000	 
80EC90D4   IRP$PS_CCB                      7FF84560	
80EC90D8   IRP$L_FQFL                      80E55D68	PCB+00028
80EC90DC   IRP$L_FQBL                      80E55D68	PCB+00028
80EC90E0   IRP$W_CDRPSIZE                      0000	 
80EC90E2   IRP$B_CD_TYPE                     02	 
80EC90E3   IRP$B_FLCK                      20	 
80EC90E4   IRP$L_FPC                       0009001A	 
80EC90E8   IRP$Q_FR3                       82BB05B8	CONTINUE_THREAD
80EC90EC                                   7EF76444	 
80EC90F0   IRP$Q_FR4                       00000000	 
80EC90F4                                   00000000	 
80EC90F8   IRP$L_SAVD_RTN                  80C36FA8	EXE$QXQPPKT
80EC90FC   IRP$L_MSG_BUF                   00AA0000	 
80EC9100   IRP$L_RSPID                     53850004	 
80EC9104   IRP$L_CDT                       00220360	 
80EC9108   IRP$Q_RES_WAIT_STATE            0000020D	 
80EC910C                                   000400AA	 
80EC9110   IRP$L_SCS_STALL_DATA            DA035385	
80EC9114   IRP$L_RWCPTR                    00000005	 
80EC9118   IRP$L_BD_ADDR                   00000000	 
80EC911C   IRP$L_LBUFH_AD                  00AA0000	 
80EC9120   IRP$B_SHD_PIO_CNT                     04	 
           IRP$L_ERASE_VBN                 
           IRP$L_LBOFF                     
           IRP$T_LBUFHNDL                  ".^S."
80EC9121   IRP$B_SHD_PIO_ACT                   00	 
80EC9122   IRP$B_SHD_PIO_FLAGS               5E	 
80EC9123   IRP$B_SHD_PIO_ERRCNT            53	 
80EC9124   IRP$B_SHD_PIO_ERRINDEX                0F	 
           IRP$L_CDRPFL                    
           IRP$L_RBUFH_AD                  
80EC9125   IRP$B_SHD_PIO_ERRSEV                00	 
80EC9126                                   0200	 
80EC9128   IRP$L_RBOFF                     0000AAAA	 
           IRP$Q_SHD_LOCK_FR0              
80EC912C   IRP$L_UBARSRCE                  00000000	 
           IRP$L_XCT_LEN                   
80EC9130   IRP$L_DUTUFLAGS                 00000000	 
           IRP$Q_SHD_LOCK_FR1              
80EC9134   IRP$W_DUTUCNTR                      0000	 
80EC9136   IRP$W_ENDMSGSIZ                 0000	 
80EC9138   IRP$Q_SHD_LOCK_FR2              00000000	 
80EC913C                                   00000000	 
80EC9140   IRP$Q_SHD_LOCK_FR4              80EC92C0	
80EC9144                                   000000C0	 
80EC9148   IRP$Q_SHD_LOCK_FR5              001300C0	 
80EC914C                                   00000000	 
80EC9150   IRP$L_SHD_LOCK_FPC              00000000	 
80EC9154   IRP$L_SHD_PIO_ERROR             030000AB	 
80EC9158   IRP$L_SHD_PIO_LNK               06000070	 
80EC915C   IRP$L_SHDSPC                    06000070	 
80EC9160   IRP$L_SHD_CONTROL_IRP           00FEFFF0	 
80EC9164   IRP$L_SHD_TEMP                  1F010104	 
80EC9168   IRP$Q_SHD_SAVED_R1              000000FD	 
80EC916C                                   00000002	 
80EC9170   IRP$Q_SHD_SAVED_R2              25010003	 
80EC9174                                   0027EB0C	 
80EC9178   IRP$Q_SHD_SAVED_R4              0000F160	 
80EC917C                                   01C104CE	 
80EC9180   IRP$L_SHD_SVD_CNT_IRP           00000000	 
80EC9184   IRP$L_SHD_SAVED_STATUS          00000000	 
80EC9188   IRP$L_SHD_WLG_MODE_FPC          00000000	 
80EC918C   IRP$L_SHD_PERLKID               00000000	 
80EC9190   IRP$L_SHD_EXPEL_TIMER           00010000	 
80EC9194   IRP$L_SHD_EXPEL_FLAGS           00000001	 
80EC9198   IRP$L_SHD_EXPEL_MASK            80E93840	
80EC919C   IRP$Q_SHD_RESERV_Q8             000091BC	 
80EC91A0                                   80D9D0C0	
80EC91A4   IRP$Q_SHD_RESERV_Q9             0000D7C0	 
80EC91A8                                   000000A0	 
80EC91AC   IRP$Q_SHD_RESERV_Q10            00000000	 
80EC91B0                                   00000000	 
80EC91B4   IRP$B_SHD_FLAGS                       C4	 
80EC91B5                                   80D9D7	 
           IRP$C_LENGTH                    








SDA> sh dev lta5158

I/O data structures
-------------------
LTA5158                                 Unknown           UCB address:  80ECBA40

Device status:   00000110 online,bsy
Characteristics: 0C040007 rec,ccl,trm,avl,idv,odv
                 00000200 nnm

Owner UIC [000001,000004]   Operation count        605   ORB address    80E1B9C0
      PID        0009001A   Error count              0   DDB address    80E11C00
Class/Type          42/00   Reference count          1   DDT address    80C853A0
Def. buf. size         80   BOFF              00000080   CRB address    80E11D80
DEVDEPEND        180A01B2   Byte count        00000001   IRP address    80ECD440
DEVDEPND2        00040080   SVAPTE            80EA7480   Fork PC        80C5F020
DEVDEPND3        00000000   DEVSTS            00000000   I/O wait queue 80ECBAAC
FLCK index             3A                                                       
DLCK address     80C2B500                                                       


I/O data structures
-------------------
				I/O request queue
				-----------------

STATE    IRP      PID   MODE CHAN  FUNC    WCB     EFN    AST     IOSB    STATUS

 C   80ECD440  0009001A  U   05E0  0000  00000000  47  000176F8  00301B18  8203
     ********
	nop bufio,func,termio


SDA> f 80ECD440            ***************************

80ECD440   IRP$L_IOQFL                     80EBEBC0	
80ECD444   IRP$L_IOQBL                     80E55D60	PCB+00020
80ECD448   IRP$W_SIZE                          0178	 
80ECD44A   IRP$B_TYPE                        0A	 
80ECD44B   IRP$B_RMOD                      43	 
80ECD44C   IRP$L_PID                       0009001A	 
80ECD450   IRP$L_AST                       000176F8	 
           IRP$L_SHD_IOFL                  
           IRP$Q_PARAM_0                   
80ECD454   IRP$L_ASTPRM                    00301AC0	 
           IRP$L_HRB                       
           IRP$L_SHAD                      
80ECD458   IRP$L_OBOFF                     00000000	 
           IRP$Q_PARAM_1                   
80ECD45C   IRP$L_ABOFF                     00000000	 
80ECD460   IRP$L_KAST                      00000000	 
           IRP$L_MIRP                      
           IRP$L_WIND                      
80ECD464   IRP$L_UCB                       80ECBA40	UCB
80ECD468   IRP$B_EFN                             2F	 
80ECD469   IRP$B_PRI                           3B	 
80ECD46A   IRP$B_CLN_INDX                    00	 
80ECD46B   IRP$B_WLG_FLAGS                 00	 
80ECD46C   IRP$L_CLN_WLE                   00301B18	 
           IRP$L_IOSB                      
80ECD470   IRP$L_CHAN                      000005E0	 
80ECD474   IRP$L_EXTEND                    80ED7B58	
80ECD478   IRP$L_STS                       00008203	 
           IRP$Q_STATUS                    
80ECD47C   IRP$L_STS2                      00000000	 
80ECD480   IRP$L_SVAPTE                    80EA7480	
80ECD484   IRP$L_BCNT                      00000001	 
80ECD488   IRP$L_BOFF                      00000080	 
80ECD48C   IRP$PS_KPB                      80EA36C0	
80ECD490   IRP$L_IOST1                     00000000	 
           IRP$L_MEDIA                     
80ECD494   IRP$B_CARCON                          FF	 
           IRP$L_IOST2                     
           IRP$L_TT_TERM                   
           IRP$W_SHD_COPY_TYPE             
           IRP$W_SHD_VUN                   
80ECD495                                       FF	 
80ECD496   IRP$W_SHD_DEV_TYPE              FFFF	 
           IRP$W_SHD_MSCP_DISK_MODIFIER    
80ECD498   IRP$L_ABCNT                     00010000	 
           IRP$Q_NT_PRVMSK                 
           IRP$Q_STATION                   
           IRP$Q_TT_STATE                  
80ECD49C   IRP$L_OBCNT                     01000000	 
80ECD4A0   IRP$L_FUNC                      00000000	 
80ECD4A4   IRP$L_SEGVBN                    00000FAC	 
80ECD4A8   IRP$L_DIAGBUF                   0000FFFF	 
           IRP$L_SCB_BUF                   
           IRP$W_TT_PRMPT                  
80ECD4AC   IRP$L_DCD_SRC_UCB               00E41308	 
           IRP$L_SEQNUM                    
80ECD4B0   IRP$L_ARB                       80E55E40	ARB
80ECD4B4   IRP$B_CPY_MODE                        60	 
           IRP$L_KEYDESC                   
           IRP$L_WLE_PTR                   
80ECD4B5                                   002903	 
80ECD4B8   IRP$L_QIO_P1                    00301BF0	 
80ECD4BC   IRP$L_QIO_P2                    00000001	 
80ECD4C0   IRP$L_QIO_P3                    00000000	 
80ECD4C4   IRP$L_QIO_P4                    7EE7B788	 
80ECD4C8   IRP$L_QIO_P5                    00000000	 
80ECD4CC   IRP$L_QIO_P6                    00000000	 
80ECD4D0   IRP$PS_FDT_CONTEXT              00000000	 
80ECD4D4   IRP$PS_CCB                      7FF84BA0	
80ECD4D8   IRP$L_FQFL                      80E55D68	PCB+00028
80ECD4DC   IRP$L_FQBL                      80E55D68	PCB+00028
80ECD4E0   IRP$W_CDRPSIZE                      0000	 
80ECD4E2   IRP$B_CD_TYPE                     02	 
80ECD4E3   IRP$B_FLCK                      20	 
80ECD4E4   IRP$L_FPC                       0009001A	 
80ECD4E8   IRP$Q_FR3                       82BB05B8	CONTINUE_THREAD
80ECD4EC                                   7EF76444	 
80ECD4F0   IRP$Q_FR4                       00000001	 
80ECD4F4                                   01030000	 
80ECD4F8   IRP$L_SAVD_RTN                  F7040C3E	
80ECD4FC   IRP$L_MSG_BUF                   09FFFFFF	 
80ECD500   IRP$L_RSPID                     4F504206	 
80ECD504   IRP$L_CDT                       0731594C	 
80ECD508   IRP$Q_RES_WAIT_STATE            41424E21	 
80ECD50C                                   4645445F	 
80ECD510   IRP$L_SCS_STALL_DATA            5F454E49	 
80ECD514   IRP$L_RWCPTR                    4B454557	 
80ECD518   IRP$L_BD_ADDR                   4F50427C	 
80ECD51C   IRP$L_LBUFH_AD                  2431594C	 
80ECD520   IRP$B_SHD_PIO_CNT                     53	 
           IRP$L_ERASE_VBN                 
           IRP$L_LBOFF                     
           IRP$T_LBUFHNDL                  
80ECD521   IRP$B_SHD_PIO_ACT                   59	 
80ECD522   IRP$B_SHD_PIO_FLAGS               53	 
80ECD523   IRP$B_SHD_PIO_ERRCNT            7C	 
80ECD524   IRP$B_SHD_PIO_ERRINDEX                53	 
           IRP$L_CDRPFL                    
           IRP$L_RBUFH_AD                  
80ECD525   IRP$B_SHD_PIO_ERRSEV                59	 
80ECD526                                   5453	 
80ECD528   IRP$L_RBOFF                     04044D45	 
           IRP$Q_SHD_LOCK_FR0              
80ECD52C   IRP$L_UBARSRCE                  0DF080CB	 
           IRP$L_XCT_LEN                   
80ECD530   IRP$L_DUTUFLAGS                 33204B01	 
           IRP$Q_SHD_LOCK_FR1              
80ECD534   IRP$W_DUTUCNTR                      4E2D	 
80ECD536   IRP$W_ENDMSGSIZ                 564F	 
80ECD538   IRP$Q_SHD_LOCK_FR2              3A383020	 
80ECD53C                                   42203230	 
80ECD540   IRP$Q_SHD_LOCK_FR4              594C4F50	 
80ECD544                                   61422031	 
80ECD548   IRP$Q_SHD_LOCK_FR5              20686374	 
80ECD54C                                   5F41424E	 
80ECD550   IRP$L_SHD_LOCK_FPC              49464544	 
80ECD554   IRP$L_SHD_PIO_ERROR             575F454E	 
80ECD558   IRP$L_SHD_PIO_LNK               204B4545	 
80ECD55C   IRP$L_SHDSPC                    71206E69	 
80ECD560   IRP$L_SHD_CONTROL_IRP           65756575	 
80ECD564   IRP$L_SHD_TEMP                  4F504220	 
80ECD568   IRP$Q_SHD_SAVED_R1              2431594C	 
80ECD56C                                   20535953	 
80ECD570   IRP$Q_SHD_SAVED_R2              65735528	 
80ECD574                                   59532072	 
80ECD578   IRP$Q_SHD_SAVED_R4              4D455453	 
80ECD57C                                   0E200029	 
80ECD580   IRP$L_SHD_SVD_CNT_IRP           00000021	 
80ECD584   IRP$L_SHD_SAVED_STATUS          00000000	 
80ECD588   IRP$L_SHD_WLG_MODE_FPC          00000000	 
80ECD58C   IRP$L_SHD_PERLKID               00000000	 
80ECD590   IRP$L_SHD_EXPEL_TIMER           00000000	 
80ECD594   IRP$L_SHD_EXPEL_FLAGS           00000000	 
80ECD598   IRP$L_SHD_EXPEL_MASK            00000000	 
80ECD59C   IRP$Q_SHD_RESERV_Q8             00000000	 
80ECD5A0                                   00000000	 
80ECD5A4   IRP$Q_SHD_RESERV_Q9             00000000	 
80ECD5A8                                   00000000	 
80ECD5AC   IRP$Q_SHD_RESERV_Q10            00000000	 
80ECD5B0                                   00000000	 
80ECD5B4   IRP$B_SHD_FLAGS                       00	 
80ECD5B5                                   000000	 
           IRP$C_LENGTH                    

    
1070.352621::TANIASun Nov 05 1995 04:538
	Hi!

    From the first you need perform PCM shutdown, check ports of LATservers 
  with LATCP and  delete them. 

		Murod.

1070.429067::BUTTERWORTHGun Control is a steady hand.Mon Nov 06 1995 10:148
    Do you have the dump online yet? I would like to see it. Your's is a 
    different problem than that fixed in the patch kit. It really shouldn't
    have two reads on the port like that due to the way the code posts
    reads on the port. I have a feeling we lost connection and that didn't
    get detected for some reason.
    
    Regards,
      Dan
1070.5re .4 Crash dump on AXPMCS (48.959)49575::NEUWEILERSystem Support GenevaMon Nov 06 1995 11:2617
    Dan,
    
    Crash dump availale on AXPMCS::SYS$PUBLIC:BPOLY1_DUMP.DMP
    
    dir/sec axpmcs::sys$public:BPOLY1_DUMP.DMP
    
    Directory AXPMCS::W11:[PUBLIC]
    
    BPOLY1_DUMP.DMP;2               [400,400]           (RWED,RWED,RE,RWE)
    
    Total of 1 file.
    
    Thanks,
    
    Armand
    
    
1070.6Problem Seems to have Improved/Fixed29633::LINDJim Lind; 592-4099 CX03-1/N14 CNMC-WestWed Nov 08 1995 17:4114
    Installed patch on CX3PCM (see note .0) bring us to V1.6-111.
    
    After 5 days and one complete archive, problem seems to have
    been solved.
    
    Still early to know for sure, but we now use one controller for 
    16 systems (supported configuration), with 223 systems on PCM
    and all is well (so far).
    
    Thanks to Dan Butterworth in the CSC for his help in installing
    the patch at the CXO3 production factility.
    
    Jim Lind
    Datacenter Manager
1070.729067::BUTTERWORTHGun Control is a steady hand.Thu Nov 09 1995 15:455
    Armand, 
       I have your dump and i'll be looking at it ASAP - it took a whole
    day to copy it.
    
    Dan
1070.829067::BUTTERWORTHGun Control is a steady hand.Mon Nov 13 1995 14:3614
    To all who have installed NSI_111.BCK:
    
    At least two bugs in the IPC code have been fixed by that kit. I
    suspect at least one of the remaining LEF hangs is due to insufficient
    channels. I would like everyone that is still having an LEF problem,
    particularely when you do an ARCHIVE, check the CHANNELCNT SYSGEN
    parameter. The default is 127 and this might not be sufficient when you
    have at least one controller that is manageing 16 systems. I would like
    everyone to set channelcnt to 500. This will have very little impact
    on memory usage. Do this for both VAX and Alpha platforms.
    
    Regards,
      Dan
    imapact on memory usage.
1070.9Hung in a AXP system52663::CHAMEROYFri Nov 17 1995 02:538
Hi,

	I have the same problem in a AXP system .
	Have you a .bck for AXP system to resolve this HUNG ?

	Regards,

	renaud
1070.1052621::MURODMon Nov 20 1995 01:2612
	Hi, Renaud.

    File NSI_111.BCK  have the solution .
  The file resides on PCMSVR::PCM$DISK:[LASER._111] for ALPHA.

	Note: pay attention NSI_111.BCK include the README.TXT file.

    For users that control LAT - connections with PCM and encountered on
  monitor hangs problem, we advise perform PCM shutdown, check ports of their
  LATservers with LATCP and delete them.

		Murod.
1070.1152336::STRATMANPeter Stratman @VBOTue Nov 21 1995 13:158
    RE .8
    >particularely when you do an ARCHIVE, check the CHANNELCNT SYSGEN
    >parameter. The default is 127 and this might not be sufficient when you

    fwiw, the channelcnt default on AXP 6.2 is 256...

    Peter.