| Title: | VMSTUNING |
| Notice: | Welcome to VMSTUNING |
| Moderator: | EVMS::HALLYB |
| Created: | Sat Feb 15 1986 |
| Last Modified: | Wed May 14 1997 |
| Last Successful Update: | Fri Jun 06 1997 |
| Number of topics: | 1539 |
| Total number of notes: | 7984 |
I'd like to run a 1GB batch job (or larger!) on a Turbolaser, an AlphaServer 8400 Model 5/350 with 8GB of physical memory, running Alpha/VMS VERSION V6.2-1H3. However the system manager sets things, I seem to be stuck around 700MB. What parameters do we need to look at? Thanks, -Michael Here are the SYSGEN parameters for this system: Parameters in use: Active Parameter Name Current Default Min. Max. Unit Dynamic -------------- ------- ------- ------- ------- ---- ------- PFCDEFAULT 64 64 0 2032 Pagelets D internal value 4 4 0 127 Pages D GBLSECTIONS 2000 250 80 3276 Sections GBLPAGES 20000000 30720 10240 -1 Pagelets internal value 1250000 1920 640 -1 Pages GBLPAGFIL 1024 128 32 -1 Pages MAXPROCESSCNT 1815 32 12 8192 Processes SMP_CPUS -1 -1 0 -1 CPU bitmas MULTIPROCESSING 3 3 0 4 Coded-valu VECTOR_PROC 1 1 0 3 Coded-valu SMP_SANITY_CNT 300 300 1 -1 10ms. SMP_SPINWAIT 100000 100000 1 8388607 10 usec. SMP_LNGSPINWAIT 3000000 3000000 1 8388607 10 usec. PROCSECTCNT 64 32 5 1024 Sections MINWSCNT 20 20 10 -1 Pure-numbe PAGFILCNT 4 4 4 63 Files SWPFILCNT 2 2 0 63 Files SYSMWCNT 37602 2048 512 65536 Pagelets internal value 2351 128 32 4096 Pages KSTACKPAGES 1 1 1 768 Pages BALSETCNT 670 30 8 8192 Slots WSMAX 1048576 4096 1024 1048576 Pagelets internal value 65536 256 64 65536 Pages NPAGEDYN 39657472 1048576 163840 -1 Bytes NPAGEVIR 158638080 8388608 163840 -1 Bytes PAGEDYN 12361728 212992 65536 -1 Bytes VIRTUALPAGECNT 4194304 65536 2048 4194304 Pagelets internal value 262144 4096 128 -262144 Pages QUANTUM 20 20 2 32767 10Ms D MPW_WRTCLUSTER 64 64 16 512 Pages MPW_HILIMIT 65535 512 64 65535 Pages MPW_LOLIMIT 2010 16 0 65535 Pages MPW_IOLIMIT 4 4 1 127 I/O MPW_THRESH 4020 16 0 65536 Pages D MPW_WAITLIMIT 65535 576 64 65535 Pages D MPW_LOWAITLIMIT 65279 448 56 65535 Pages D FILE_CACHE 10 10 0 100 Percent PFRATL 0 0 0 -1 Flts/10Sec D PFRATH 8 8 0 -1 Flts/10Sec D WSINC 2400 2400 0 -1 Pagelets D internal value 150 150 0 -1 Pages D WSDEC 4000 4000 0 -1 Pagelets D internal value 250 250 0 -1 Pages D AWSMIN 512 512 0 -1 Pagelets D internal value 32 32 0 -1 Pages D AWSTIME 20 20 1 -1 10Ms D SWPOUTPGCNT 512 512 0 -1 Pagelets D internal value 32 32 0 -1 Pages D LONGWAIT 30 30 0 65535 Seconds D DORMANTWAIT 2 2 0 65535 Seconds D TIMVCFAIL 1600 1600 100 65535 10Ms D ERRORLOGBUFFERS 18 4 2 64 Buffers DUMPSTYLE 1 0 0 -1 Bitmask USERD1 0 0 0 -1 D USERD2 0 0 0 -1 D USER3 0 0 0 -1 USER4 0 0 0 -1 EXTRACPU 1000 1000 0 -1 10Ms D MAXSYSGROUP 7 8 1 32768 UIC Group D MVTIMEOUT 900 3600 1 64000 Seconds D TAPE_MVTIMEOUT 600 600 1 64000 Seconds D MAXBUF 8192 8192 4096 64000 Bytes D DEFMBXBUFQUO 1056 1056 256 64000 Bytes D DEFMBXMXMSG 256 256 64 64000 Bytes D FREELIM 690 32 16 -1 Pages FREEGOAL 2680 200 16 -1 Pages D GROWLIM 690 63 0 -1 Pages D BORROWLIM 690 300 0 -1 Pages D XFMAXRATE 236 236 0 255 Special D LAMAPREGS 0 0 0 255 Mapregs CLISYMTBL 512 512 48 1024 Pagelets D LOCKIDTBL 3840 1792 1792 4194304 Entries LOCKIDTBL_MAX 65535 65535 1792 4194304 Entries RESHASHTBL 4096 64 1 65535 Entries DEADLOCK_WAIT 10 10 0 -1 Seconds D SCSBUFFCNT 512 50 0 32767 Entries SCSCONNCNT 204 40 2 32767 Entries SCSRESPCNT 300 300 0 32767 Entries SCSMAXDG 576 576 28 985 Bytes SCSMAXMSG 132 132 52 985 Bytes SCSFLOWCUSH 1 1 0 16 Credits D SCSSYSTEMID 30186 0 -1 -1 Pure-numbe SCSSYSTEMIDH 0 0 -1 -1 Pure-numbe SCSNODE "CMOS8 " " " " " "ZZZZ" Ascii PRCPOLINTERVAL 30 30 1 32767 Seconds D PASTIMOUT 5 5 1 99 Seconds D PASTDGBUF 16 4 1 16 Buffers PANUMPOLL 16 16 1 223 Ports D PAMAXPORT 32 32 0 223 Port-numbe D PAPOLLINTERVAL 5 5 1 32767 Seconds D PAPOOLINTERVAL 15 15 1 32767 Seconds D PASANITY 1 1 0 1 Boolean D PANOPOLL 0 0 0 1 Boolean D TIMEPROMPTWAIT 65535 -1 0 -1 uFortnight UDABURSTRATE 0 0 0 31 Longwords LNMSHASHTBL 1024 512 128 8192 Entries LNMPHASHTBL 512 512 128 8192 Entries BUGREBOOT 1 1 0 1 Boolean D CRDENABLE 1 1 0 1 Boolean DUMPBUG 1 1 0 1 Boolean BUGCHECKFATAL 0 0 0 1 Boolean D ACP_MULTIPLE 0 0 0 1 Boolean D SETTIME 0 0 0 1 Boolean ACP_SHARE 1 1 0 1 Boolean UAFALTERNATE 0 0 0 1 Boolean SAVEDUMP 1 0 0 1 Boolean CLASS_PROT 0 0 0 1 Boolean D LGI_BRK_TERM 0 1 0 1 Boolean D LGI_BRK_DISUSER 0 0 0 1 Boolean D LOAD_PWD_POLICY 0 0 0 1 Boolean D ACP_XQP_RES 1 1 0 1 Boolean ACP_REBLDSYSD 1 1 0 1 Boolean MOUNTMSG 0 0 0 1 Boolean D DISMOUMSG 0 0 0 1 Boolean D TTY_SCANDELTA 10000000 10000000 100000 -1 100Ns TTY_DIALTYPE 0 0 0 255 Bit-Encode TTY_SPEED 15 15 1 17 Special TTY_RSPEED 0 0 0 17 Special TTY_PARITY 24 24 0 255 Special TTY_BUF 80 80 0 511 Characters TTY_DEFCHAR 402657952 402657952 0 -1 Bit-Encode TTY_DEFCHAR2 135170 4098 0 -1 Bit-Encode TTY_TYPAHDSZ 78 78 1 32767 Bytes TTY_ALTYPAHD 200 200 1 32767 Bytes TTY_ALTALARM 64 64 0 -1 Bytes TTY_DMASIZE 64 64 0 -1 Bytes D TTY_CLASSNAME "TT" "TT" "AA" "ZZ" Ascii TTY_SILOTIME 8 8 0 255 Ms TTY_TIMEOUT 900 900 0 -1 Seconds D TTY_AUTOCHAR 7 7 0 255 Character D RMS_DFMBC 16 16 1 127 Blocks D RMS_DFMBFSDK 0 0 0 127 Blocks D RMS_DFMBFSMT 0 0 0 127 Blocks D RMS_DFMBFSUR 0 0 0 127 Buffers D RMS_DFMBFREL 0 0 0 127 Buffers D RMS_DFMBFIDX 0 0 0 127 Buffers D RMS_DFMBFHSH 0 0 0 127 Buffers D RMS_PROLOGUE 0 0 0 3 Prolog-Lvl D RMS_EXTEND_SIZE 0 0 0 65535 Blocks D RMS_FILEPROT 64000 64000 0 65535 Prot-mask RMS_GBLBUFQUO 1024 1024 0 32767 Gbl bufs D RMS_DFNBC 8 8 1 127 Blocks D PQL_DASTLM 24 24 -1 -1 Ast D PQL_MASTLM 100 4 -1 -1 Ast D PQL_DBIOLM 32 32 -1 -1 I/O D PQL_MBIOLM 100 4 -1 -1 I/O D PQL_DBYTLM 65536 65536 -1 -1 Bytes D PQL_MBYTLM 100000 1024 -1 -1 Bytes D PQL_DCPULM 0 0 -1 -1 10Ms D PQL_MCPULM 0 0 -1 -1 10Ms D PQL_DDIOLM 32 32 -1 -1 I/O D PQL_MDIOLM 100 4 -1 -1 I/O D PQL_DFILLM 128 128 -1 -1 Files D PQL_MFILLM 100 2 -1 -1 Files D PQL_DPGFLQUOTA 65536 65536 -1 -1 Pagelets D internal value 4096 4096 0 -1 Pages D PQL_MPGFLQUOTA 32768 2048 -1 -1 Pagelets D internal value 2048 128 128 -1 Pages D PQL_DPRCLM 32 32 -1 -1 Processes D PQL_MPRCLM 10 0 -1 -1 Processes D PQL_DTQELM 16 16 -1 -1 Timers D PQL_MTQELM 0 0 -1 -1 Timers D PQL_DWSDEFAULT 5440 1024 -1 -1 Pagelets internal value 340 64 0 -1 Pages PQL_MWSDEFAULT 5440 512 -1 -1 Pagelets internal value 340 32 32 -1 Pages PQL_DWSQUOTA 10880 2048 -1 -1 Pagelets D internal value 680 128 0 -1 Pages D PQL_MWSQUOTA 10880 1024 -1 -1 Pagelets D internal value 680 64 64 -1 Pages D PQL_DWSEXTENT 1048576 16384 -1 -1 Pagelets D internal value 65536 1024 0 -1 Pages D PQL_MWSEXTENT 1048576 2048 -1 -1 Pagelets D internal value 65536 128 128 -1 Pages D PQL_DENQLM 64 64 -1 -1 Locks D PQL_MENQLM 300 4 -1 -1 Locks D PQL_DJTQUOTA 4096 4096 -1 -1 Bytes D PQL_MJTQUOTA 0 0 -1 -1 Bytes D ACP_MAPCACHE 335 9 2 -1 Blocks D ACP_HDRCACHE 1340 36 8 -1 Blocks D ACP_DIRCACHE 1340 22 4 -1 Blocks D ACP_DINDXCACHE 335 26 2 -1 Blocks D ACP_WORKSET 0 0 0 -1 Pagelets D ACP_FIDCACHE 64 64 0 -1 File-Ids D ACP_EXTCACHE 64 64 0 -1 Extents D ACP_EXTLIMIT 100 100 0 1000 Percent/10 D ACP_QUOCACHE 1815 64 0 2337 Users D ACP_SYSACC 8 8 0 -1 Directorie D ACP_MAXREAD 32 32 1 64 Blocks D ACP_WINDOW 7 7 1 -1 Pointers D ACP_WRITEBACK 1 1 0 1 Boolean D ACP_DATACHECK 2 2 0 3 Bit-mask D ACP_BASEPRIO 8 8 4 31 Priority D ACP_SWAPFLGS 14 15 0 15 Bit-mask D DEFPRI 4 4 1 31 Priority D IJOBLIM 64 64 1 8192 Jobs D BJOBLIM 16 16 0 1024 Jobs D NJOBLIM 100 16 0 1024 Jobs D RJOBLIM 100 16 0 65535 Jobs D DEFQUEPRI 100 100 0 255 Priority D MAXQUEPRI 100 100 0 255 Priority D LGI_PWD_TMO 30 30 0 255 Seconds D LGI_RETRY_LIM 3 3 0 255 Tries D LGI_RETRY_TMO 20 20 2 255 Seconds D LGI_BRK_LIM 5 5 1 255 Failures D LGI_BRK_TMO 3600 300 0 5184000 Seconds D LGI_HID_TIM 86400 300 01261440000 Seconds D VAXCLUSTER 2 1 0 2 Coded-valu EXPECTED_VOTES 2 1 1 127 Votes VOTES 1 1 0 127 Votes RECNXINTERVAL 120 20 1 32767 Seconds D DISK_QUORUM " " " " " " "ZZZZ" Ascii QDSKVOTES 1 1 0 127 Votes QDSKINTERVAL 10 10 1 32767 Seconds ALLOCLASS 1 0 0 255 Pure-numbe LOCKDIRWT 0 0 0 255 Pure-numbe NISCS_CONV_BOOT 0 0 0 1 Boolean NISCS_LOAD_PEA0 1 0 0 1 Boolean NISCS_PORT_SERV 0 0 0 3 Bit-encode MSCP_LOAD 1 0 0 16384 Coded-valu TMSCP_LOAD 0 0 0 3 Coded-valu MSCP_SERVE_ALL 1 0 0 2 Coded-valu TMSCP_SERVE_ALL 0 0 0 3 Coded-valu MSCP_BUFFER 128 128 16 -1 Coded-valu MSCP_CREDITS 8 8 2 128 Coded-valu TAILORED 0 0 0 1 Boolean STARTUP_P1 " " " " " " "zzzz" Ascii STARTUP_P2 " " " " " " "zzzz" Ascii STARTUP_P3 " " " " " " "zzzz" Ascii STARTUP_P4 " " " " " " "zzzz" Ascii STARTUP_P5 " " " " " " "zzzz" Ascii STARTUP_P6 " " " " " " "zzzz" Ascii STARTUP_P7 " " " " " " "zzzz" Ascii STARTUP_P8 " " " " " " "zzzz" Ascii MMG_CTLFLAGS 3 3 0 -1 Bit-mask D WINDOW_SYSTEM 1 0 0 2 Pure-numbe D ERLBUFFERPAGES 4 4 2 32 Pagelets TAPE_ALLOCLASS 0 0 0 255 Pure-numbe VECTOR_MARGIN 100 100 1 -1 Pure-numbe D SHADOWING 2 0 0 3 Coded-valu SHADOW_SYS_DISK 1 0 0 -1 Bit_Code D SHADOW_SYS_UNIT 1 0 0 9999 Unit SHADOW_MAX_COPY 1 4 0 42 Threads D LGI_CALLOUTS 0 0 0 255 Count D NET_CALLOUTS 0 0 0 255 Count D IEEE_ADDRESS 0 0 -1 -1 Pure-numbe D IEEE_ADDRESSH 0 0 -1 -1 Pure-numbe D SHADOW_MBR_TMO 20 20 1 65535 Seconds D ZERO_LIST_HI 4096 16 0 65535 Pages D GH_EXEC_CODE 512 512 0 2048 Pages GH_EXEC_DATA 104 128 0 2048 Pages GH_RES_CODE 1536 512 0 2048 Pages GH_RES_DATA 0 0 0 2048 Pages GH_RSRVPGCNT 2048 0 0 2048 Pages NISCS_MAX_PKTSZ 1498 1498 1080 8192 Bytes NISCS_LAN_OVRHD 18 18 0 256 Bytes SECURITY_POLICY 7 7 0 -1 Bit-mask WLKSYSDSK 0 0 0 1 Boolean DBGTK_SCRATCH 1 1 0 10 Pages IMGREG_PAGES 2000 600 0 10000 Pages SHADOW_SYS_TMO 20 20 1 65535 Seconds D SHADOW_SYS_WAIT 256 256 1 65535 Seconds D SHADOW_REMOVE_1 " " " " " " "ZZZZ" Ascii SHADOW_REMOVE_2 " " " " " " "ZZZZ" Ascii SYSTEM_CHECK 0 0 0 1 Coded-valu DR_UNIT_BASE 0 0 0 9900
| T.R | Title | User | Personal Name | Date | Lines |
|---|---|---|---|---|---|
| 1536.1 | please supply more information | OSOV03::KAGEYAMA | Trust, but Verify | Thu Apr 10 1997 05:08 | 15 |
> -< How do I run a 1GB batch job? >- What do your mean by the 1GB batch job? 1GB of virtual memory? 1GB of working set size? >However the system manager sets things, I seem to be stuck around >700MB. Are there any log files? If it runs interactively, is it OK? - Kazunori | |||||
| 1536.2 | More information | GAAS::TSUK | Michael Tsuk | Thu Apr 10 1997 12:15 | 30 |
> What do your mean by the 1GB batch job? > 1GB of virtual memory? > 1GB of working set size? 1GB of physical memory, preferably. The program really bogs down if it starts paging. > Are there any log files? Here is one: $ SET noVERIFY Allocated 1048576 (100000) bytes at 54008. [stuff removed] Allocated 679477248 (28800000) bytes at 2D834008. Allocated 680525824 (28900000) bytes at 2D954008. Allocated 681574400 (28A00000) bytes at 0. TSUK job terminated at 9-APR-1997 14:41:49.66 Accounting information: Buffered I/O count: 84 Peak working set size: 15232 Direct I/O count: 106 Peak page file size: 1535136 Page faults: 1196 Mounted volumes: 0 Charged CPU time: 0 00:00:00.21 Elapsed time: 0 00:00:03.17 > If it runs interactively, is it OK? No, it stops at exactly the same place. -Michael | |||||
| 1536.3 | BSS::JILSON | WFH in the Chemung River Valley | Thu Apr 10 1997 13:58 | 1 | |
What is the PGFLQUO for your username? | |||||
| 1536.4 | From show process /all | GAAS::TSUK | Michael Tsuk | Thu Apr 10 1997 15:26 | 3 |
> What is the PGFLQUO for your username? Paging file quota: 1487360 | |||||
| 1536.5 | BSS::JILSON | WFH in the Chemung River Valley | Thu Apr 10 1997 15:41 | 5 | |
From the peak pagefile size and your pagefile quota, PGFLQUO is probably your limiting factor. Increase it up to VIRTUALPAGECNT and try again but watch the system pagefile utilizations. Jilly | |||||
| 1536.6 | Better, but not perfect | GAAS::TSUK | Michael Tsuk | Thu Apr 10 1997 16:09 | 21 |
Better, but not perfect. My batch job is running now, but here's the
state:
OpenVMS V6.2-1H3 on node CMOS8 10-APR-1997 15:06:26.32 Uptime 3 07:19:22
AlphaServer 8400 Model 5/350
Pid Process Name State Pri I/O CPU Page flts Pages
51E00902 BATCH_490 CUR 5 4 1070 0 00:22:15.83 11777594 65536 B
[TSUK] 524288Kb
Lots of page faults, and I'm stuck at 65536 pages (a suspicious number).
The queue is set up as follows:
Batch queue CMOS8$SPECIAL, busy, on CMOS8::
/BASE_PRIORITY=4 /NOENABLE_GENERIC /JOB_LIMIT=1 /OWNER=[SYSTEM]
/PROTECTION=(S:M,O:D,G:R,W:RS) /WSDEFAULT=2000000 /WSEXTENT=3000000
/WSQUOTA=2000000
What do I need to do to reduce the page faulting?
-Michael
| |||||
| 1536.7 | ZIMBRA::BERNARDO | Dave Bernardo, VMS Engineering | Thu Apr 10 1997 18:46 | 6 | |
You can't...
You need to increase WSMAX but it's already at the maximum for V6.2.
If you upgrade to V7.1, the max has been increased to 524288 pages.
d.
| |||||