[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference turris::digital_unix

Title:DIGITAL UNIX(FORMERLY KNOWN AS DEC OSF/1)
Notice:Welcome to the Digital UNIX Conference
Moderator:SMURF::DENHAM
Created:Thu Mar 16 1995
Last Modified:Fri Jun 06 1997
Last Successful Update:Fri Jun 06 1997
Number of topics:10068
Total number of notes:35879

8857.0. "?vmunix: malloc failed: size = 768??" by GREGOR::OPP () Mon Feb 17 1997 16:31

    
        I'm testing an Alpha PC164LX system running Digital UNIX V4.0B with
     a DE500, twisted-pair, Fast Ethernet adapter installed.  During an IP
     network stress test, the console displays messages of the form

        MAXFLI vmunix: malloc failed: bucket size=768, # of failures=100
        MAXFLI vmunix: malloc failed: bucket size=768, # of failures=200
        MAXFLI vmunix: malloc failed: bucket size=768, # of failures=300

     This seems to occur at the same time that a burst of 512-byte packets 
     is being sent via the Fast Ethernet port.  If the tests are allowed to
     run for a sufficient time (less than four hours), the system fails by
     hanging.  

        Are there any system parameters I can adjust to avoid this memory
     allocation failure?  Using the settings in sysconfigtab.lite seems to
     decrease the time to failure, especially if tcp_sendspace and tcp_
     recvspace are increased to 65,536 at the same time.  Any recommenda-
     tions would be appreciated.  

     Greg

     References:  Topics 6483 & 8290: malloc failures
                  Topic 8679: dual-rail Ethernet configuration


     Attachment:  Messages log for a typical system boot --> test --> hang
                  sequence of events.

        
Feb 13 10:23:35 MAXFLI vmunix: Alpha boot: available memory from 0xd90000 to 0x3f50000
Feb 13 10:23:35 MAXFLI vmunix: Digital UNIX V4.0B  (Rev. 564); Fri Feb  7 11:43:20 EST 1997 
Feb 13 10:23:35 MAXFLI vmunix: physical memory = 64.00 megabytes.
Feb 13 10:23:35 MAXFLI vmunix: available memory = 50.29 megabytes.
Feb 13 10:23:35 MAXFLI vmunix: using 237 buffers containing 1.85 megabytes of memory
Feb 13 10:23:35 MAXFLI vmunix: Digital AlphaPC 164/LX 466 MHz system
Feb 13 10:23:35 MAXFLI vmunix: Firmware revision: 4.7
Feb 13 10:23:36 MAXFLI vmunix: Digital UNIX PALcode version 1.21
Feb 13 10:23:36 MAXFLI vmunix: Module 1095:646 not in pci option table, can't configure it
Feb 13 10:23:36 MAXFLI vmunix: pci0 at nexus
Feb 13 10:23:36 MAXFLI vmunix: tu0: DECchip 21140-AA: Revision: 2.0
Feb 13 10:23:36 MAXFLI vmunix: tu0: auto negotiation capable device: National DP83840
Feb 13 10:23:36 MAXFLI vmunix: tu0 at pci0 slot 5
Feb 13 10:23:36 MAXFLI vmunix: tu0: DEC Fast Ethernet Interface, hardware address: 00-00-F8-03-03-0B
Feb 13 10:23:36 MAXFLI vmunix: tu0: auto negotiation off: selecting 100BaseTX (UTP) port: half duplex
Feb 13 10:23:36 MAXFLI vmunix: trio0 at pci0 slot 6
Feb 13 10:23:36 MAXFLI vmunix: trio0: S3 Trio64 (SVGA) - Plug N' Play - 2.0 Mb
Feb 13 10:23:36 MAXFLI vmunix: pci1000 at pci0 slot 7
Feb 13 10:23:36 MAXFLI vmunix: tu1: DECchip 21040-AA: Revision: 2.4
Feb 13 10:23:36 MAXFLI vmunix: tu1 at pci1000 slot 0
Feb 13 10:23:36 MAXFLI vmunix: tu1: DEC TULIP Ethernet Interface, hardware address: 00-00-F8-20-6A-EE
Feb 13 10:23:36 MAXFLI vmunix: tu1: console mode: selecting 10Base2 (BNC) port
Feb 13 10:23:36 MAXFLI vmunix: isp0 at pci1000 slot 1
Feb 13 10:23:36 MAXFLI vmunix: isp0: QLOGIC ISP1020A
Feb 13 10:23:37 MAXFLI vmunix: isp0: Firmware revision 2.10 (loaded by console)
Feb 13 10:23:37 MAXFLI vmunix: scsi0 at isp0 slot 0
Feb 13 10:23:37 MAXFLI vmunix: rz0 at scsi0 target 0 lun 0 (LID=0) (SEAGATE ST34371W         0338) (Wide16)
Feb 13 10:23:37 MAXFLI vmunix: rz1 at scsi0 target 1 lun 0 (LID=1) (SEAGATE ST32155W         0528) (Wide16)
Feb 13 10:23:37 MAXFLI vmunix: rz5 at scsi0 target 5 lun 0 (LID=2) (SONY    CD-ROM CDU-76S   1.2d)
Feb 13 10:23:37 MAXFLI vmunix: isa0 at pci0
Feb 13 10:23:37 MAXFLI vmunix: gpc0 at isa0
Feb 13 10:23:37 MAXFLI vmunix: ace0 at isa0
Feb 13 10:23:37 MAXFLI vmunix: ace1 at isa0
Feb 13 10:23:37 MAXFLI vmunix: lp0 at isa0
Feb 13 10:23:37 MAXFLI vmunix: fdi0 at isa0
Feb 13 10:23:37 MAXFLI vmunix: fd0 at fdi0 unit 0
Feb 13 10:23:37 MAXFLI vmunix: lvm0: configured.
Feb 13 10:23:37 MAXFLI vmunix: lvm1: configured.
Feb 13 10:23:37 MAXFLI vmunix: kernel console: trio0
Feb 13 10:23:37 MAXFLI vmunix: dli: configured
Feb 13 10:23:38 MAXFLI vmunix: ADVFS: using 566 buffers containing 4.42 megabytes of memory
Feb 13 10:23:39 MAXFLI vmunix: Node ID is 00-00-f8-03-03-0b (from device tu0)
Feb 13 10:23:39 MAXFLI vmunix: dna_netman: configured
Feb 13 10:23:41 MAXFLI vmunix: Node UID is 2330f680-85b5-11d0-be03-0000f803030b
Feb 13 10:23:42 MAXFLI vmunix: dna_dli: configured
Feb 13 10:23:43 MAXFLI vmunix: dna_base: configured
Feb 13 10:23:49 MAXFLI vmunix: dna_xti: configured
Feb 13 10:24:02 MAXFLI vmunix: SCSI logical disk 2: using ULTRIX partition info found on disk.
Feb 13 10:24:02 MAXFLI vmunix: SCSI logical disk 2: using ULTRIX partition info found on disk.
Feb 13 10:24:05 MAXFLI vmunix: SuperLAT. Copyright 1994 Meridian Technology Corp. All rights reserved.


Feb 13 12:17:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=100
Feb 13 12:17:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=200
Feb 13 12:39:16 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=300
Feb 13 12:39:17 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=400
Feb 13 12:51:16 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=500
Feb 13 12:51:18 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=600
Feb 13 12:51:18 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=700
Feb 13 12:51:18 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=800
Feb 13 12:51:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=900
Feb 13 12:51:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1000
Feb 13 12:51:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1100
Feb 13 12:51:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1200
Feb 13 12:51:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1300
Feb 13 12:51:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1400
Feb 13 12:51:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1500
Feb 13 12:51:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1600
Feb 13 12:51:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1700
Feb 13 12:51:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1800
Feb 13 12:51:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=1900
Feb 13 12:51:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2000
Feb 13 12:51:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2100
Feb 13 12:51:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2200
Feb 13 13:17:50 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2300
Feb 13 13:17:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2400
Feb 13 13:17:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2500
Feb 13 13:20:53 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2600
Feb 13 13:20:54 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2700
Feb 13 13:20:54 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2800
Feb 13 13:28:49 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=2900
Feb 13 13:28:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3000
Feb 13 13:28:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3100
Feb 13 13:28:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3200
Feb 13 13:28:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3300
Feb 13 13:28:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3400
Feb 13 13:28:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3500
Feb 13 13:45:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3600
Feb 13 13:45:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3700
Feb 13 13:45:22 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3800
Feb 13 13:45:22 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=3900
Feb 13 13:45:22 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4000
Feb 13 13:45:23 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4100
Feb 13 13:45:23 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4200
Feb 13 13:45:23 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4300
Feb 13 13:45:23 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4400
Feb 13 13:45:23 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4500
Feb 13 13:48:03 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4600
Feb 13 13:48:03 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4700
Feb 13 13:48:04 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4800
Feb 13 13:48:04 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=4900
Feb 13 13:48:04 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5000
Feb 13 13:48:05 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5100
Feb 13 13:48:05 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5200
Feb 13 13:48:05 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5300
Feb 13 13:48:11 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5400
Feb 13 13:56:26 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5500
Feb 13 13:56:27 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5600
Feb 13 13:56:27 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5700
Feb 13 13:56:27 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5800
Feb 13 13:56:27 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=5900
Feb 13 13:56:27 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6000
Feb 13 13:56:27 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6100
Feb 13 14:04:11 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6200
Feb 13 14:04:13 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6300
Feb 13 14:04:13 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6400
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6500
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6600
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6700
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6800
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=6900
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7000
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7100
Feb 13 14:04:14 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7200
Feb 13 14:04:15 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7300
Feb 13 14:05:44 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7400
Feb 13 14:05:45 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7500
Feb 13 14:19:48 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7600
Feb 13 14:19:50 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7700
Feb 13 14:19:50 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7800
Feb 13 14:19:50 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=7900
Feb 13 14:19:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8000
Feb 13 14:19:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8100
Feb 13 14:19:51 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8200
Feb 13 14:19:52 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8300
Feb 13 14:19:52 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8400
Feb 13 14:19:52 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8500
Feb 13 14:19:52 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8600
Feb 13 14:19:53 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8700
Feb 13 14:19:53 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8800
Feb 13 14:19:53 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=8900
Feb 13 14:19:53 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9000
Feb 13 14:19:53 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9100
Feb 13 14:19:54 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9200
Feb 13 14:19:54 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9300
Feb 13 14:19:54 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9400
Feb 13 14:19:55 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9500
Feb 13 14:19:55 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9600
Feb 13 14:27:16 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9700
Feb 13 14:27:17 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9800
Feb 13 14:27:18 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=9900
Feb 13 14:27:18 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10000
Feb 13 14:27:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10100
Feb 13 14:27:19 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10200
Feb 13 14:27:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10300
Feb 13 14:27:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10400
Feb 13 14:27:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10500
Feb 13 14:27:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10600
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10700
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10800
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=10900
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11000
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11100
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11200
Feb 13 14:27:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11300
Feb 13 14:27:22 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11400
Feb 13 14:27:22 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11500
Feb 13 14:27:22 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11600
Feb 13 14:33:09 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11700
Feb 13 14:33:10 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11800
Feb 13 14:33:10 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=11900
Feb 13 14:33:11 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12000
Feb 13 14:33:11 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12100
Feb 13 14:33:35 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12200
Feb 13 14:33:36 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12300
Feb 13 14:33:36 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12400
Feb 13 14:33:36 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12500
Feb 13 14:33:37 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12600
Feb 13 14:33:37 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12700
Feb 13 14:33:37 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12800
Feb 13 14:39:52 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=12900
Feb 13 14:44:41 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13000
Feb 13 14:44:42 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13100
Feb 13 14:44:42 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13200
Feb 13 14:44:43 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13300
Feb 13 14:44:43 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13400
Feb 13 14:44:43 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13500
Feb 13 14:44:44 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13600
Feb 13 14:44:44 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13700
Feb 13 14:45:18 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13800
Feb 13 14:45:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=13900
Feb 13 14:45:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14000
Feb 13 14:45:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14100
Feb 13 14:45:20 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14200
Feb 13 14:45:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14300
Feb 13 14:45:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14400
Feb 13 14:45:21 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14500
Feb 13 14:51:48 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14600
Feb 13 14:51:49 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14700
Feb 13 14:51:49 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14800
Feb 13 14:51:50 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=14900
Feb 13 14:51:50 MAXFLI vmunix: malloc failed: bucket size=768, # of failures=15000
T.RTitleUserPersonal
Name
DateLines
8857.1NETRIX::"[email protected]"Shashi MangalatTue Feb 18 1997 19:0712
The malloc failures typically indicates low memory.  Run vmstat to
see if the free count is < 10.  Also run "vmstat -M" a few times
to see if any bucket is growing (might indicate a leak).

If the system has enough memory then this would mean the system
is not able to handle the peak load.  There is no easy way to change
the defaults.  On a 64Meg system malloc reserves ~32pages for its
use.  You can try increasing this by dbx'ing the kernel and setting
kmemreserve to a larger value.

--shashi
[Posted by WWW Notes gateway]
8857.2Bucket 15 data & observationsGREGOR::OPPWed Feb 19 1997 15:581037
    
    	Attached is the data regarding memory buckets as collected by
    a home-grown command procedure called monitor_unix_system.cmd.  It
    shows that the usage of bucket #15, size 768 bytes, is highly vari-
    able, depending upon what the test programs are doing.  From past
    observations, it appears to be the execution of the command:
    
    	ping -f -c 3072 -s 512 -p 0123456789ABCDEF $remote_node
    
    that is causing the malloc failures.  
    
    	All of the attached data is with kmemreserve = 32, which is the
    default value.  I intend to try doubling the value to 64 and repeating
    the system test.
    
    Greg 
    
    
    ------------ Data, selected from monitor_unix_system.log -------------
    
! Four file_patterns test processes are already running by the time this 
! sample is taken.  kmemreserve was at the default value of 32.


At Wed Feb 19 10:54:18 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9542            1210          152672
    1            32          1262            1810           40384
    2            64          1039             241           66496
    3            96          3119             281          299424
    4           128           987             357          126336
    5           160          1811             229          289760
    6           192           251              43           48192
    7           256           652             788          166912
    8           320           539              36          172480
    9           384             8              13            3072
   10           448             2              16             896
   11           512           893             179          457216
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           146              19          102784
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            93               9          249984
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3813408 bytes
Total free memory in buckets = 1086304 bytes
***************
At Wed Feb 19 11:02:29 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9542            1210          152672
    1            32          1265            1807           40480
    2            64          1034             246           66176
    3            96          3119             281          299424
    4           128           987             357          126336
    5           160          1811             229          289760
    6           192           251              43           48192
    7           256           654             722          167424
    8           320           538              37          172160
    9           384             8              13            3072
   10           448             2              16             896
   11           512           893             179          457216
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           146              19          102784
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            93               9          249984
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3813376 bytes
Total free memory in buckets = 1069952 bytes
***************
At Wed Feb 19 11:10:33 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9542            1210          152672
    1            32          1265            1807           40480
    2            64          1031             249           65984
    3            96          3115             285          299040
    4           128           986             358          126208
    5           160          1811             229          289760
    6           192           251              43           48192
    7           256           653             659          167168
    8           320           540              35          172800
    9           384             8              13            3072
   10           448             2              16             896
   11           512           894             178          457728
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           146              19          102784
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             9               7            9216
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            93               9          249984
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3814592 bytes
Total free memory in buckets = 1052352 bytes

! ip_ping_target.cmd test to PERKED via Fast Ethernet started at 11:13

***************
At Wed Feb 19 11:18:08 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9588            1164          153408
    1            32          1276            1796           40832
    2            64          1032             248           66048
    3            96          3155             245          302880
    4           128           997             347          127616
    5           160          1834             206          293440
    6           192           253              41           48576
    7           256           644             924          164864
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768            11              69            8448
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            38              10           77824
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3833824 bytes
Total free memory in buckets = 1098656 bytes
***************
At Wed Feb 19 11:24:30 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9588            1164          153408
    1            32          1276            1796           40832
    2            64          1032             248           66048
    3            96          3165             235          303840
    4           128          1002             342          128256
    5           160          1835             205          293600
    6           192           253              41           48576
    7           256           687            1265          175872
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           150              15          105600
   15           768            31              49           23808
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            38              10           77824
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3862848 bytes
Total free memory in buckets = 1167936 bytes
***************
At Wed Feb 19 11:30:33 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9575            1177          153200
    1            32          1273            1799           40736
    2            64          1033             247           66112
    3            96          3149             251          302304
    4           128           995             349          127360
    5           160          1834             206          293440
    6           192           253              41           48576
    7           256           641            1279          164096
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3827760 bytes
Total free memory in buckets = 1194832 bytes
***************
At Wed Feb 19 11:36:50 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9577            1175          153232
    1            32          1274            1798           40768
    2            64          1032             248           66048
    3            96          3161             239          303456
    4           128           996             348          127488
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           665            1479          170240
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3834192 bytes
Total free memory in buckets = 1245744 bytes
***************
At Wed Feb 19 11:42:44 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9578            1174          153248
    1            32          1272            1800           40704
    2            64          1031             249           65984
    3            96          3150             250          302400
    4           128           995             349          127360
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           643            1533          164608
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            54               5          442368
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3851840 bytes
Total free memory in buckets = 1236288 bytes
***************
At Wed Feb 19 11:49:03 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9578            1174          153248
    1            32          1275            1797           40800
    2            64          1032             248           66048
    3            96          3162             238          303552
    4           128           999             345          127872
    5           160          1836             204          293760
    6           192           253              41           48576
    7           256           660            1356          168960
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           149              16          104896
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3834944 bytes
Total free memory in buckets = 1212224 bytes
***************
At Wed Feb 19 11:55:59 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9591            1161          153456
    1            32          1276            1796           40832
    2            64          1030             250           65920
    3            96          3153             247          302688
    4           128           996             348          127488
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           645            1403          165120
    8           320           542              33          173440
    9           384             9              12            3456
   10           448             2              16             896
   11           512           897             175          459264
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             9               7            9216
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3831472 bytes
Total free memory in buckets = 1223888 bytes
***************
At Wed Feb 19 12:02:37 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9591            1161          153456
    1            32          1281            1791           40992
    2            64          1041             239           66624
    3            96          3164             236          303744
    4           128           999             345          127872
    5           160          1835             205          293600
    6           192           253              41           48576
    7           256          2250              22          576000
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           149              16          104896
   15           768          1601               9         1229568  ! <---
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            40               8           81920
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 5472944 bytes
Total free memory in buckets = 814800 bytes
***************
At Wed Feb 19 12:09:01 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9578            1174          153248
    1            32          1277            1795           40864
    2            64          1031             249           65984
    3            96          3150             250          302400
    4           128           995             349          127360
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           642            1630          164352
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3827168 bytes
Total free memory in buckets = 1285536 bytes
***************
At Wed Feb 19 12:15:25 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9591            1161          153456
    1            32          1277            1795           40864
    2            64          1032             248           66048
    3            96          3156             244          302976
    4           128           998             346          127744
    5           160          1834             206          293440
    6           192           253              41           48576
    7           256           643            1565          164608
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3830288 bytes
Total free memory in buckets = 1266032 bytes
***************
At Wed Feb 19 12:22:38 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9592            1160          153472
    1            32          1273            1799           40736
    2            64          1040             240           66560
    3            96          3164             236          303744
    4           128           996             348          127488
    5           160          1832             208          293120
    6           192           253              41           48576
    7           256           678            1626          173568
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768            19              61           14592
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            38              10           77824
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3849568 bytes
Total free memory in buckets = 1271328 bytes
***************
At Wed Feb 19 12:29:02 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9592            1160          153472
    1            32          1276            1796           40832
    2            64          1031             249           65984
    3            96          3166             234          303936
    4           128           997             347          127616
    5           160          1832             208          293120
    6           192           253              41           48576
    7           256          1572             572          402432
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768           917               3          704256 ! <---
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 4765888 bytes
Total free memory in buckets = 959168 bytes
***************
At Wed Feb 19 12:35:14 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9579            1173          153264
    1            32          1276            1796           40832
    2            64          1031             249           65984
    3            96          3160             240          303360
    4           128           992             352          126976
    5           160          1832             208          293120
    6           192           253              41           48576
    7           256           658            1486          168448
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           147              18          103488
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3831792 bytes
Total free memory in buckets = 1248144 bytes
***************
At Wed Feb 19 12:41:42 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9593            1159          153488
    1            32          1274            1798           40768
    2            64          1033             247           66112
    3            96          3168             232          304128
    4           128           997             347          127616
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           669            1443          171264
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           210             147          241920
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            38              10           77824
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3839536 bytes
Total free memory in buckets = 1232208 bytes
***************
At Wed Feb 19 12:47:41 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9592            1160          153472
    1            32          1276            1796           40832
    2            64          1032             248           66048
    3            96          3155             245          302880
    4           128           994             350          127232
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           642            1342          164352
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           147              18          103488
   15           768            10              70            7680
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3827840 bytes
Total free memory in buckets = 1211136 bytes
***************
At Wed Feb 19 12:53:48 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9579            1173          153264
    1            32          1277            1795           40864
    2            64          1038             242           66432
    3            96          3161             239          303456
    4           128           993             351          127104
    5           160          1829             211          292640
    6           192           253              41           48576
    7           256           662            1482          169472
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           147              18          103488
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3831376 bytes
Total free memory in buckets = 1248560 bytes
***************
At Wed Feb 19 13:00:25 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9593            1159          153488
    1            32          1278            1794           40896
    2            64          1032             248           66048
    3            96          3165             235          303840
    4           128           993             351          127104
    5           160          1832             208          293120
    6           192           253              41           48576
    7           256           668            1348          171008
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           147              18          103488
   15           768            17              63           13056
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            38              10           77824
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3842992 bytes
Total free memory in buckets = 1204176 bytes
***************
At Wed Feb 19 13:06:41 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9592            1160          153472
    1            32          1279            1793           40928
    2            64          1029             251           65856
    3            96          3156             244          302976
    4           128           997             347          127616
    5           160          1831             209          292960
    6           192           253              41           48576
    7           256           651            1397          166656
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768            11              69            8448
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3832000 bytes
Total free memory in buckets = 1223360 bytes
***************
At Wed Feb 19 13:12:49 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9579            1173          153264
    1            32          1276            1796           40832
    2            64          1031             249           65984
    3            96          3160             240          303360
    4           128           997             347          127616
    5           160          1832             208          293120
    6           192           253              41           48576
    7           256           658            1582          168448
    8           320           539              36          172480
    9           384             9              12            3456
   10           448             2              16             896
   11           512           895             177          458240
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           148              17          104192
   15           768             9              71            6912
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3831472 bytes
Total free memory in buckets = 1273040 bytes
***************
At Wed Feb 19 13:19:05 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9593            1159          153488
    1            32          1278            1794           40896
    2            64          1039             241           66496
    3            96          3166             234          303936
    4           128           994             350          127232
    5           160          1832             208          293120
    6           192           253              41           48576
    7           256           663            1545          169728
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           147              18          103488
   15           768            11              69            8448
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3835728 bytes
Total free memory in buckets = 1260592 bytes
***************
At Wed Feb 19 13:25:11 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9593            1159          153488
    1            32          1275            1797           40800
    2            64          1035             245           66240
    3            96          3162             238          303552
    4           128           993             351          127104
    5           160          1829             211          292640
    6           192           253              41           48576
    7           256           997            1435          255232
    8           320           541              34          173120
    9           384             9              12            3456
   10           448             2              16             896
   11           512           896             176          458752
   12           576            28              14           16128
   13           640            10               2            6400
   14           704           147              18          103488
   15           768           348               2          267264 ! <---
   16           896             8              10            7168
   17          1024             8               8            8192
   18          1152           209             148          240768
   19          1344            23               1           30912
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 4178704 bytes
Total free memory in buckets = 1182320 bytes

! System hangs at 13:27:27 EST just after completing a "ping -f -s 256
! -c 4096".  Next network command is "ping -f -s 512 -c 3072".
8857.3Happens also in A1000 + dU4.0BNETRIX::&quot;[email protected]&quot;Jarkko HietaniemiThu Feb 20 1997 06:4630
I really do hope I were doing testing and having these hangs.

Now it is the customer that is the guinea-pig: and it is their
main NFS server that hangs about 1-3 times daily :-(

A1000: 4.0B: latest FW (CD 3.8): 128 MB: in internal SCSI
system disk + 3 x Seagate, behind PCI-RAID 9 x RZ29B (4 GB?). 
Has ATM that is in light use.

Hangs each day with console full of

malloc failed: bucket size=256, # of failures=21300
malloc failed: bucket size=256, # of failures=21400
malloc failed: bucket size=256, # of failures=21500
malloc failed: bucket size=256, # of failures=21600
malloc failed: bucket size=256, # of failures=21700
...

Hitting the halt button always seems to give a corrupt
crash dump (or, at least, a crash dump in which I find
little information). What is The Correct Way To Get
A Crash Dump of the current situation in an A1000?

-- 
Jarkko Hietaniemi Digital/Finland MCS/OSS DTN 879-4738
[email protected]   +358-(0)9-434 4738



[Posted by WWW Notes gateway]
8857.4It would be nice to have a list of which subsystem does allocation of size N...NETRIX::&quot;[email protected]&quot;Jarkko HietaniemiThu Feb 20 1997 09:275
(M)allocations of sizes 768 and 256 fail, no other good leads.

Okay, which subsystems do allocations of those sizes?

[Posted by WWW Notes gateway]
8857.5Doubling kmemreserve has negative effectGREGOR::OPPThu Feb 20 1997 10:48320
    RE: .4  
    
    	In my testing, the 768-byte bucket appears to be most heavily
    used by TCP/IP packets.  An edited log from a recent test implementing
    the suggestion in .1 is attached.  
    
    Greg
    
! During this test, kmemreserve was assigned a value of 64.  The default
! during previous tests was 32.  Additions to the log file are denoted 
! by leading exclamation marks.
!
! Doubling the value of kmemreserve has the *apparent* effect of reducing
! the time to failure from 2.2 to 0.7 hours.  

At Wed Feb 19 16:11:45 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9130             598          146080
    1            32          1562            1510           49984
    2            64          1111             169           71104
    3            96          2751              54          264096
    4           128           951             265          121728
    5           160          1818             120          290880
    6           192           234              18           44928
    7           256           400              80          102400
    8           320           530              20          169600
    9           384            10              11            3840
   10           448             2              16             896
   11           512           937               7          479744
   12           576            28              14           16128
   13           640             8               4            5120
   14           704           135               8           95040
   15           768            10              20            7680
   16           896             9               9            8064
   17          1024             9               7            9216
   18          1152           206              60          237312
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            39               9           79872
   22          2688            75               0          201600
   23          4096             8               2           32768
   24          8192            50               1          409600
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3670080 bytes
Total free memory in buckets = 499232 bytes
***************

! At 16:12, ip_ping_target to 16.127.168.129 via Fast Ethernet started
! At 16:14, four file_patterns jobs, one each to partitions /max1a, /max1g
!   /advfs_0, and /advfs_1 are started via 'at' commands.


At Wed Feb 19 16:17:07 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9762             478          156192
    1            32          1276            1796           40832
    2            64          1056             224           67584
    3            96          3268             132          313728
    4           128          1032             312          132096
    5           160          1937             154          309920
    6           192           253              41           48576
    7           256           619             757          158464
    8           320           545              30          174400
    9           384            11              10            4224
   10           448             2              16             896
   11           512           941               3          481792
   12           576            28              14           16128
   13           640             9               3            5760
   14           704           154              11          108416
   15           768            12              78            9216
   16           896             9               9            8064
   17          1024             9               7            9216
   18          1152           220             186          253440
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            41               7           83968
   22          2688            97               5          260736
   23          4096             8               2           32768
   24          8192            51               5          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3916608 bytes
Total free memory in buckets = 940704 bytes
***************
At Wed Feb 19 16:23:27 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9903             849          158448
    1            32          1291            1781           41312
    2            64          1036             244           66304
    3            96          3269             131          313824
    4           128          1031             313          131968
    5           160          1887             204          301920
    6           192           253              41           48576
    7           256          2698              22          690688
    8           320           546              29          174720
    9           384            11              10            4224
   10           448             2              16             896
   11           512           940               4          481280
   12           576            28              14           16128
   13           640             9               3            5760
   14           704           154              11          108416
   15           768          2024               6         1554432 ! <---
   16           896             9               9            8064
   17          1024            10               6           10240
   18          1152           212             194          244224
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            39               9           79872
   22          2688            97               5          260736
   23          4096             8               2           32768
   24          8192            51               7          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 5974992 bytes
Total free memory in buckets = 740880 bytes
***************
At Wed Feb 19 16:30:13 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9925             827          158800
    1            32          1289            1783           41248
    2            64          1043             237           66752
    3            96          3278             122          314688
    4           128          1037             307          132736
    5           160          1891             200          302560
    6           192           253              41           48576
    7           256           709            1595          181504
    8           320           546              29          174720
    9           384            11              10            4224
   10           448             2              16             896
   11           512           932              12          477184
   12           576            28              14           16128
   13           640             9               3            5760
   14           704           156               9          109824
   15           768            16              74           12288
   16           896             9               9            8064
   17          1024            10               6           10240
   18          1152           210             196          241920
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            40               8           81920
   22          2688            97               5          260736
   23          4096             8               2           32768
   24          8192            51               7          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3923728 bytes
Total free memory in buckets = 1195728 bytes
***************
At Wed Feb 19 16:36:24 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9929             823          158864
    1            32          1287            1785           41184
    2            64          1034             246           66176
    3            96          3272             128          314112
    4           128          1032             312          132096
    5           160          1884             207          301440
    6           192           253              41           48576
    7           256          1000            1240          256000
    8           320           546              29          174720
    9           384            11              10            4224
   10           448             2              16             896
   11           512           900              44          460800
   12           576            28              14           16128
   13           640             9               3            5760
   14           704           154              11          108416
   15           768           348               2          267264 ! <---
   16           896             9               9            8064
   17          1024            10               6           10240
   18          1152           210             196          241920
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            40               8           81920
   22          2688            97               5          260736
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 4232496 bytes
Total free memory in buckets = 1078448 bytes
***************
At Wed Feb 19 16:43:33 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9930             822          158880
    1            32          1289            1783           41248
    2            64          1036             244           66304
    3            96          3279             121          314784
    4           128          1032             312          132096
    5           160          1887             204          301920
    6           192           253              41           48576
    7           256           679            1433          173824
    8           320           546              29          174720
    9           384            11              10            4224
   10           448             2              16             896
   11           512           900              44          460800
   12           576            28              14           16128
   13           640             9               3            5760
   14           704           154              11          108416
   15           768            12              78            9216
   16           896             9               9            8064
   17          1024            10               6           10240
   18          1152           210             196          241920
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            39               9           79872
   22          2688            97               5          260736
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3891584 bytes
Total free memory in buckets = 1186912 bytes
***************
At Wed Feb 19 16:49:44 EST 1997 the memory usage by buckets was read: 
 

Memory usage by bucket:

bucket#  element_size  elements_in_use  elements_free  bytes_in_use
    0            16          9678            1074          154848
    1            32          1276            1796           40832
    2            64          1022             258           65408
    3            96          3137             263          301152
    4           128           993             351          127104
    5           160          1818             273          290880
    6           192           251              43           48192
    7           256           653            1459          167168
    8           320           542              33          173440
    9           384             9              12            3456
   10           448             2              16             896
   11           512           898              46          459776
   12           576            28              14           16128
   13           640             9               3            5760
   14           704           146              19          102784
   15           768            11              69            8448
   16           896             8              10            7168
   17          1024            11               5           11264
   18          1152           210             196          241920
   19          1344            22               2           29568
   20          1600             4               6            6400
   21          2048            37              11           75776
   22          2688            95               7          255360
   23          4096             8               2           32768
   24          8192            51               8          417792
   25         12288            20               8          245760
   26         16384             3               4           49152
   27         32768             5               0          163840
   28         65536             3               0          196608
   29        131072             1               0          131072
   30        262144             0               0               0
   31        524288             0               0               0

Total memory being used from buckets = 3830720 bytes
Total free memory in buckets = 1240096 bytes

! System hangs during the transmission of a 3K packet burst of 512-byte 
! packets at 16:54.  The last console message reads:
!
!    malloc failed: bucket size = 768  number of failures = 1800

8857.6Submitted as "OSF" QAR 51659GREGOR::OPPThu Feb 20 1997 14:3159
QAR # St Sev Pub Cat Maintainer   Component  T Entered-by   Date in     
Answer
----- -- --- --- --- ------------ ---------- - ------------ ----------- 
------
51659 OP  H  No      QAR$ASSIGNER            M QAR_INTERNAL 20-FEB-1997
<no abstract available>

Site name:        4YK DIGITAL SEMICONDUCTOR
Product/Version:  DEC OSF/1  PTB04564           CPU type:  all
Op Syst/Version:  DEC OSF/1  PTB04564

QAR 51659  Version PTB04564  20-FEB-1997 14:13:47.1

-- Submitted by --                      -- DIGITAL contact --
GREG OPP
4YK DIGITAL SEMICONDUCTOR SYSTEM INTEGRA
RICKS::OPP

DTN 225-6392, HLO 2-3/D11

Attachments: DS APC164 QAR RAPPER               Customer severity: H
Reproducible at will: Y

CPU        Memory     System device
all        0          0

     Problem Summary

        An Alpha PC164LX system with 64 MB of main memory has demonstrated
     reproducible system "hang" failures while running "ip_ping_target.cmd"
     via a point-to-point 100 Mbit/sec Ethernet to a remote Alpha PC164LX
     system, which is running Windows NT V4.0 SP2.  Several experiments
     have been performed during which Digital UNIX system parameters were
     adjusted.  While settings to reduce the time to failure have been
     found, parameter settings that avoid the system hang have yet to be
     determined.  Therefore, this problem is being submitted to the Digital
     UNIX internal QAR system.


     Contents

        1. Problem summary and � DS APC164 QAR Rapper (1 page)
        2. APC164 QAR 029 (14 pages)
        3. ip_ping_target.cmd Bourne Shell script (2 pages)
        4. file_patterns_untix.csh C Shell script (7 pages)
        5. List of software installed on MAXFLI per 'setld' (5 pages)
        6. System configuration as reported by SRM console (3 pages)

     Reference

        Additional information regarding this problem can be found in topic
     8857 of the Digital_UNIX Notes conference.  Since it is Easynet-acces-
     sible, it is not included within the wrapper.

     Greg Opp                                           February 20, 1997
     Digital Semiconductor
     [email protected]

     [ items 2-6 deleted to save Notes file space]
8857.7NETRIX::&quot;[email protected]&quot;Shashi MangalatFri Feb 21 1997 16:4215
It doesn't look like there is a leak.  There is an increase in malloc memory
usage but there should be plenty left for other things.

The malloc failures reported are allocation failures where the caller cannot
wait for memory.  It depends on the kernel component what it does in this
case.
It may be in a position to specify blocking allocation at a later point or it
might just fail the request.

A vmstat output would have helped to see if the system was low in memory. 
Also,
forced crash at the time of hang would help too.

-s-hashi
[Posted by WWW Notes gateway]
8857.8I've got plenty of dataGREGOR::OPPSat Feb 22 1997 17:4949
       I have plenty of data collected from vmstat.  If you'd like to 
    review, I'll try to find a publicly accessible location to post it.
    A listing of the log files from MAXFLI, which contain vmstat, netstat,
    and process information is attached below.
    
       Alpha PC's do NOT have a mechanism for forcing a crash dump. 
    The console does not respond to CTRL-P and there is no halt switch.
    Thus, it's not possible without hardware modifications to set the
    interrupt level to maximum and the PC to an illegal address to 
    force a crash.  If UNIX provides an alternative method, I'd be glad
    to try it.  
    
    Regards,
    
    Greg
    
    Attached Listing:
    
    -r--r--r--   1 systest  system     79231 Feb  7 11:06
    	monitor_MAXFLI_hangs_07feb97.log
    -r--r--r--   1 systest  system    764659 Feb 12 16:41
    	monitor_MAXFLI_hangs_12feb97.log
    -r--r--r--   1 systest  system    366771 Feb 13 14:52
    	monitor_MAXFLI_hangs_13feb97.log
    -r--r--r--   1 systest  system    657343 Feb 14 19:28
    	monitor_MAXFLI_hangs_14feb97.log
    -r--r--r--   1 systest  system     72800 Feb 15 21:48
    	monitor_MAXFLI_hangs_15feb97.log
    -r--r--r--   1 systest  system     25555 Feb 16 20:58
    	monitor_MAXFLI_hangs_16feb97.log
    -r--r--r--   1 systest  system    513911 Feb 17 12:26
    	monitor_MAXFLI_hangs_17feb97_1.log
    -r--r--r--   1 systest  system    126582 Feb 17 14:53
    	monitor_MAXFLI_hangs_17feb97_2.log
    -r--r--r--   1 systest  system   1981695 Feb 18 05:30
    	monitor_MAXFLI_hangs_18feb97_1.log
    -r--r--r--   1 systest  system    787009 Feb 18 14:40
    	monitor_MAXFLI_hangs_18feb97_2.log
    -r--r--r--   1 systest  system    251869 Feb 18 17:00
    	monitor_MAXFLI_hangs_18feb97_3.log
    -r--r--r--   1 systest  system    819421 Feb 19 13:26
    	monitor_MAXFLI_hangs_19feb97_1.log
    -r--r--r--   1 systest  system    128314 Feb 19 16:50
    	monitor_MAXFLI_hangs_19feb97_2.log
    -r--r--r--   1 systest  system    299443 Feb 20 09:19
    	monitor_MAXFLI_hangs_20feb97_1.log
    -r--r--r--   1 systest  system    273890 Feb 20 16:50
    	monitor_MAXFLI_hangs_20feb97_2.log
    
8857.9vm usage logs & procedure which gen'd themGREGOR::OPPWed Feb 26 1997 14:2592
    	The log files generated by the attached command procedure are
    available for review at KAFFEE::UNIX_TEST$PUB:*.LOG.  Not all of 
    the log files contain virtual memory bucket usage memory as the
    edit history indicates.  I hope this information is helpful in 
    determining the cause of this reproducible system hang failure.
    
    Greg
    
    ----------------------- Attached command procedure ---------------------
    
#!/bin/sh
# monitor_unix_system.cmd  -  UNIX Bourne Shell script to periodically
#          sample and display some system performance measurements
#          using available Bourne Shell commands, cryptic though they
#          may be.  
#
# Edit History:
#
# 07-FEB-1997	GLO	Initial version.  Copied from monitory_my_system.cmd
#                       and modified based upon UNIX experience gained in
#                       the past year or so.
# 13-FEB-1997	GLO	Add dbx -k command to acquire more virtual memory
#                       and UBC information.
# 19-FEB-1997   GLO     Add vmstat -M command to acquire yet another per-
#                       spective on memory usage
#
#!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
#
pass_cnt=0                  # use a pass count limit to start
#
until 
   { test `expr $pass_cnt` -ge 2284 ;}    # 5 mins per pass ~= 190 hours
do
   {
   echo " "                 # blank line for spacing
   echo "At `date` the following process-related information was read: "
   echo " "
   ps aux                   # display all processes
   echo " "                 # blank line for spacing
#
   echo "At `date` the following system & user summary information was read: "
   echo " "
   w -l                     # display summary of current system activity
   echo " "                 # blank line for spacing
#
   echo "At `date` the following memory statistics were read: "
   echo " "
   vmstat -s                # memory statistics
   echo " "                 # blank line for spacing
#
   echo "At `date` the memory usage by buckets was read: "
   echo " "
   vmstat -M                # memory usage by buckets
   echo " "                 # blank line for spacing
#
   echo " "
   echo "At `date` the following memory parameters were read "
   echo "using dbx -k /vmunix /dev/mem: "
   echo " "
   dbx -k /vmunix /dev/mem < vm_ubc_perfsum.lst
   echo " "
#
   echo "At `date` the following I/O performance information was read: "
   echo " "
   iostat                   # I/O statistics    
   echo " "                 # blank line for spacing
#
   echo "At `date` the following swap space information was read: "
   echo " "
   swapon -s                # swap space allocated, in-use, & free
   echo " "
   echo "At `date` the following network information was displayed:  "
   echo " "
   netstat -s
   echo " "
#
   echo "Beginning my nap at `date` "
   echo " "
   sleep 295                # hibernate for 4 minutes 55 seconds    
   pass_cnt=`expr $pass_cnt + 1`            ;
   }
#                 Don't forget the semicolon^
done
exit   


# vm_ubc_perfsum.lst
#
print vm_perfsum 
# yes			# only needed if executed interactively
quit!
#