T.R | Title | User | Personal Name | Date | Lines |
---|
5309.1 | see MCC-TOOLS, note 21 | MCDOUG::doug | Dead or Canadian? | Wed Jul 07 1993 09:39 | 9 |
| At first glance, 48 Mb sounds like it might be a little on the skimpy
side...
See note 21.* in NOTED::MCC-TOOLS for a system planner tool.
Then you can plug in your own numbers and draw your own conclusions.
/doug
|
5309.2 | 4000/60 48mb is too small | TOOK::R_SPENCE | Nets don't fail me now... | Wed Jul 07 1993 11:20 | 22 |
| As you have specified it, the 4000/60 is going to be much too small.
First, memory is way to little. 48mb is the minimum permitted by the
SPD. You are doing lots more than minimum.
Second, I would reccomend that you craft the domains and alarm rules
so that you can have some wildcard rules if possible. What I read was
that you wanted to have 400-600 rules running. I would work to get
the number down below 100.
Third, 8-10 batch jobs seems excessive. Each will have an instance of
DECmcc running (more memory - 16mb per instance isn't unreasonable).
Use domains and the fact that an entity can be in more than one domain
to help you here. For each of the users, create a
"historical-recording" domain (will need unique names of course) and
start ONE background batch job for each. Then, include in these domains
all the entities that you need to do historical recording on.
Given the load you plan I would provide lots of memory and if possible,
I would use a 4000/90 instead.
s/rob
|
5309.3 | more info please | TRKWSH::COMFORT | Here beside the rising tide | Thu Jul 08 1993 16:48 | 17 |
|
re .-1
In what ways will using wild card alarms (I presume polling type rules)
reduce processing overhead? In the case of DECnet Phase IV, wouldn't
the number of NML connections be the same?
We have demontrated that a 4060 w/ 400 alarm rules, displaying 3-4
iconic maps, using A1mail and message router in 104 megs of memory is
an unusable system. After reducing the number of rules to 300, the
system becomes borderline useful. The customer is looking a 4090's as
a solution.
Additional input is greatly appreciated.
Dave
|
5309.4 | One thread per rule | TOOK::R_SPENCE | Nets don't fail me now... | Thu Jul 08 1993 17:41 | 13 |
| Each "rule" requires it's own thread to execute within. So, one
wildcard rule for 100 entities is one thread and the memory
requirements for one thread. 100 rules is 100 threads...
I would certainly agree with you that the VS4000/60 is not sufficient
for the described load.
Did you do any performance measurments on the system? What did you
run out of? Memory, CPU, I/O? Depending on the rate that the rules
execute you could have run out of CPU but I would expect memory to
have been close to used up also.
s/rob
|
5309.5 | | TOOK::MCPHERSON | Dead or Canadian? | Thu Jul 08 1993 18:10 | 23 |
|
If you don't use wildcarded alarm rules, each rule creates its own set of
threads and resources. If you can use a wildcarded alarm rule, the Alarms FM
*serializes* the requests, so only ONE set of threads has to be created.
If you *don't* use wildcarded alarm rules wherever you can, then you're burning
up resources. Figure *nominally* 64kbytes per alarm rule for CMA thread
overhead:
64k x 300 alarm rules comes to about 19 Mbytes of memory.
Absolute *best* case would be if you could replace 100% of the 300 alarms with
a single wildcarded rule. You'd essentially buy back 19 Mbyes of system
memory.
Of courese, if the alarm FM has to call other FMs/AMs to do the work, these MMs
in turn create threads and consume additional resources.
With the little information that I have to work on, I *personally* would expect
that you'd get *memory* bound before CPU bound, if you were able to use alarm
rule wildcarding.
/doug
|
5309.6 | Stack space for the AM does not count (really) | TOOK::LYONS | Ahh, but fortunately, I have the key to escape reality. | Thu Jul 08 1993 20:17 | 18 |
| re: .-1
Doug, remember that the memory used for stack and CMA thread management
in the AM's and FM's during rule evaluation is allocated and released
on the fly, so only those rules that were currently evaluating would
allocate FM/AM stack space. It is still true that EACH rule will use
the 64KB of memory, so your numbers on 19Meg of memory are right on.
Using a thread to store the context of a rule is very expensive, but
that design was done back when threads were much, much cheaper. Moving
to CMA cost MCC quite a bit in terms of performance. Wildcard rules
will save much (but not all) of that memory. The reason it wont save
all of it is that the alarms package will still need to keep some state
information about each entity it is looking at, but that memory amount
is small compared to the 64K per stack/context.
drl
|
5309.7 | I stand corrected. | TOOK::MCPHERSON | Dead or Canadian? | Fri Jul 09 1993 09:33 | 3 |
| OK.
So best case, he'd only buy back *18* Mb of memory.
/doug
|
5309.8 | re .-last few | TRKWSH::COMFORT | Here beside the rising tide | Fri Jul 09 1993 10:51 | 22 |
|
In reference to the resource limits/consumption question in .4, both
memory and cpu are at a premium. When the 350 to 400 rules were
running, the cpu was the problem, running at ~ 90-95% as seen by VMS
monitor with DETMCC running continually over 80%. The memory
consumption, though a factor, has remained pretty much the same. Just
for informations' sake, the "background" task running the alarms
(DETMCC) is running about 53000 pages and each map runs approx 20000
pages with the current system setup. Out of 212922 total pages, there
are 8000 - 9000 free.
After offloading 100 or so alarms and exporting to another system
(about 300 alarms active now), cpu util doesn't get much above ~75% with
DETMCC taking up to ~60%.
Sounds like it is definitely worth seeing if some of these rules can be
restructured.
Thanks,
Dave
|