[Search for users]
[Overall Top Noters]
[List of all Conferences]
[Download this site]
Title: | DECmcc user notes file. Does not replace IPMT. |
Notice: | Use IPMT for problems. Newsletter location in note 6187 |
Moderator: | TAEC::BEROUD |
|
Created: | Mon Aug 21 1989 |
Last Modified: | Wed Jun 04 1997 |
Last Successful Update: | Fri Jun 06 1997 |
Number of topics: | 6497 |
Total number of notes: | 27359 |
5502.0. "problem with exporting" by TROOA::GREENALL () Wed Aug 18 1993 18:03
I am having a problem with running the canned reports with DECmcc 1.3,
and have narrowed the problem down to what I believe to be either a
bug, or a misunderstanding on my part on how exporting data works.
Basically, the reports I am running are showing up blank because the
time_stamps of the records being exported to the RDB file are being
messed up.
I have decided that I will run the reports by first RECORDING data with
the historian at 15 minute intervals. I will then export this data as
needed to the RDB file, and then run the report.
Here is an example of the problem I am seeing.
I have started recording on the object node4 tror01 circuit syn-0.
Here is the output of a
show record node4 tror01 circuit syn-0 part=*, -
in domain .tro.s.mcc.record.
I realize now that recording Initial Attributes can't work for the
router, so that is the reason for the failure, and It will be turned
off. It still shouldn't affect the export though..
Node4 tror01 Circuit syn-0
AT 18-AUG-1993 16:22:37
Recording parameters for the partition "Identifiers" :
Recording state = ACTIVE,
State since = 15-AUG-1993 22:39:50.43,
Polling period = 1 00:00:00.00,
Begin time = 15-AUG-1993 22:38:59.13,
End time = 25-MAY-2012 00:00:00.00,
Keep age = 0 14:00:00.00,
Request time = 15-AUG-1993 22:38:59.13,
Requested by = "SYSTEM",
Time of last successful poll = "18-AUG-1993 11:17:26.07",
Number of successful polls = 11,
Time of last failed poll = "NONE",
Last poll failure reason = "N/A",
Number of failed polls = 0,
Last historical expiration time = "18-AUG-1993 11:17:26.07",
Time of last expiration failure = "NONE",
Last expiration failure reason = "N/A",
Number of expiration failures = 0
Node4 tror01 Circuit syn-0
AT 18-AUG-1993 16:22:45
Recording parameters for the partition "Status" :
Recording state = ACTIVE,
State since = 15-AUG-1993 22:39:57.08,
Polling period = 0 00:15:00.00,
Begin time = 15-AUG-1993 22:38:59.13,
End time = 25-MAY-2012 00:00:00.00,
Keep age = 0 14:00:00.00,
Request time = 15-AUG-1993 22:38:59.13,
Requested by = "SYSTEM",
Time of last successful poll = "18-AUG-1993 16:17:56.98",
Number of successful polls = 180,
Time of last failed poll = "NONE",
Last poll failure reason = "N/A",
Number of failed polls = 0,
Last historical expiration time = "18-AUG-1993 16:17:56.98",
Time of last expiration failure = "NONE",
Last expiration failure reason = "N/A",
Number of expiration failures = 0
Node4 tror01 Circuit syn-0
AT 18-AUG-1993 16:22:46
Recording parameters for the partition "Counters" :
Recording state = ACTIVE,
State since = 15-AUG-1993 22:40:05.75,
Polling period = 0 00:15:00.00,
Begin time = 15-AUG-1993 22:38:59.13,
End time = 25-MAY-2012 00:00:00.00,
Keep age = 0 14:00:00.00,
Request time = 15-AUG-1993 22:38:59.13,
Requested by = "SYSTEM",
Time of last successful poll = "18-AUG-1993 16:18:25.76",
Number of successful polls = 180,
Time of last failed poll = "NONE",
Last poll failure reason = "N/A",
Number of failed polls = 0,
Last historical expiration time = "18-AUG-1993 16:18:25.76",
Time of last expiration failure = "NONE",
Last expiration failure reason = "N/A",
Number of expiration failures = 0
Node4 tror01 Circuit syn-0
AT 18-AUG-1993 16:22:47
Recording parameters for the partition "Characteristics" :
Recording state = ACTIVE,
State since = 15-AUG-1993 22:40:11.95,
Polling period = 1 00:00:00.00,
Begin time = 15-AUG-1993 22:38:59.13,
End time = 25-MAY-2012 00:00:00.00,
Keep age = 0 14:00:00.00,
Request time = 15-AUG-1993 22:38:59.13,
Requested by = "SYSTEM",
Time of last successful poll = "18-AUG-1993 11:18:55.21",
Number of successful polls = 11,
Time of last failed poll = "NONE",
Last poll failure reason = "N/A",
Number of failed polls = 0,
Last historical expiration time = "18-AUG-1993 11:18:55.21",
Time of last expiration failure = "NONE",
Last expiration failure reason = "N/A",
Number of expiration failures = 0
Node4 tror01 Circuit syn-0
AT 18-AUG-1993 16:22:49
Recording parameters for the partition "References" :
Recording state = ACTIVE,
State since = 15-AUG-1993 22:40:22.07,
Polling period = 1 00:00:00.00,
Begin time = 15-AUG-1993 22:38:59.13,
End time = 25-MAY-2012 00:00:00.00,
Keep age = 0 14:00:00.00,
Request time = 15-AUG-1993 22:38:59.13,
Requested by = "SYSTEM",
Time of last successful poll = "NONE",
Number of successful polls = 0,
Time of last failed poll = "18-AUG-1993 11:19:24.94",
Last poll failure reason = "Entity is not registered",
Number of failed polls = 11,
Last historical expiration time = "NONE",
Time of last expiration failure = "NONE",
Last expiration failure reason = "N/A",
Number of expiration failures = 0
Node4 tror01 Circuit syn-0
AT 18-AUG-1993 16:22:50
Recording parameters for the partition "Initial Attributes" :
Recording state = ACTIVE,
State since = 15-AUG-1993 22:40:31.75,
Polling period = 1 00:00:00.00,
Begin time = 15-AUG-1993 22:38:59.13,
End time = 25-MAY-2012 00:00:00.00,
Keep age = 0 14:00:00.00,
Request time = 15-AUG-1993 22:38:59.13,
Requested by = "SYSTEM",
Time of last successful poll = "NONE",
Number of successful polls = 0,
Time of last failed poll = "18-AUG-1993 11:19:55.24",
Last poll failure reason = "MCC specialized exception code : 330",
Number of failed polls = 11,
Last historical expiration time = "NONE",
Time of last expiration failure = "NONE",
Last expiration failure reason = "N/A",
Number of expiration failures = 0
I then export this data to the rdb file with the command
$ manage/enter
export node4 tror01 circuit syn-0 export target=disk$data1:[reports]reports.rdb, -
export period = 00:15:00 , -
begin time = 12:00:00 , -
end time = 15:00:00 , -
in domain .tro.s.mcc.record
!
exit
This is what I then get in the resultant RDB file.
mcr sql$
sql> select node4, timestamp from mcc_node4_circuit;
NODE4 TIME_STAMP
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
57.56 18-AUG-1993 11:17:26.07
13 rows selected
Now I see why I am getting 0 length reports. The timestamps do not
fall within the range of data that I am recording (remember, I exported
between the times 12:00 and 15:00). Where is Export getting this timestamp?
Is this a bug in mcc, or a misunderstanding on my part on how export works.
Richard
T.R | Title | User | Personal Name | Date | Lines |
---|
5502.1 | just misunderstanding ... | SISE::SAM | | Mon Aug 23 1993 15:38 | 29 |
|
Richard,
You did everything correctly except one thing: you did not record
enough information to calculate past time statistics. As you know record
operation allows to record every partition but statistics. So when Exporter
is asked to perform a past time export it tries to calculate statistics
on the fly from historical data. Node4 partitions do not provide all
information needed for Performance Analyzer (PA) in order to calculate
statistics. As far as I remember you also need to record line characteristics
and circuit counters (?). Probably the best thing is to look at Performance
Analyzer Use manual. In this manual you can find a chapter which lists
everything what you need to record.
Now about "time_stamp" field in the exported table. This field is
not used by the report package. Under different circumstances this field can
have different meaning. But in each table you can find "time_<partition_name>"
field for each partition (for example, "time_counters"). This information
together with status ("mcc_cvr_<partition>) gives you real time stamp and
status of the original reqiest. As far as I remember Historical Data Use
manual has a description of the data base table structure.
Sam
|
5502.2 | one more try | TROOA::GREENALL | | Wed Aug 25 1993 17:40 | 10 |
|
Whoops,
sorry, but I guess I missed it in my note. Yes, I did record line
statistics.. I recorded line, node, and circuit statistics for the
node, and still I got no data.
Anyways, I will try yet again to get mcc working properly, and will
report back. Maybe I missed it.
|
5502.3 | | TOOK::MINTZ | Erik Mintz | Wed Aug 25 1993 17:55 | 6 |
| No, please check Sam's note again. You can not record statistics at all.
You must record the raw data required by the statistical calculations.
Then when you try to review (or export) statistical data, it is
re-computed from the historical raw data.
-- Erik
|
5502.4 | partial success (but more problems) | TROOA::GREENALL | | Mon Aug 30 1993 19:35 | 74 |
|
Ok, I have partial success here. I am able to run reports on exported
data, and the data is valid.
I still don't see anything different this time, then what I did last
time. (when I said recording statistics in .2, I shouldn't have used
the word statistics, I was using statistics as a general term for
characteristics, counters, etc..)
Anyways, the data is being recorded, and the "time_stamp" column is now
incrementing properly. (again, don't ask me why it is now, when it
didn't in .0. I'm using the same commands).
I am now getting plaged by errors of the following time when I try to
export data (again, only sometimes, and only on some items.) Note that
TROR01 CIRCUIT SYN-0 is a registered object, and I am executing this
command at approx 16:00 hrs.
MCC> EXPORT NODE4 TROR01 CIRCUIT SYN-0 -
_MCC> EXPORT TARGET=DISK$DATA1:[REPORTS]REPORTS.RDB, -
_MCC> EXPORT PERIOD=00:15:00, -
_MCC> BEGIN TIME=TODAY, -
_MCC> END TIME=NOW, -
_MCC> IN DOMAIN .TRO.S.MCC.RECORD
The requested operation cannot be completed
MCC Routine Error = %MCC-S-NORMAL, normal successful completion,
Entity Existence Info = Entity Existence Cannot Be Determined
But here is the silly thing. It did export some data, as is shown by
the SQL command below
NODE4 TIME_STAMP
57.56 29-AUG-1993 23:40:33.74
57.56 30-AUG-1993 00:10:41.07
57.56 30-AUG-1993 00:10:41.07
57.56 30-AUG-1993 00:40:33.96
57.56 30-AUG-1993 00:50:38.05
57.56 30-AUG-1993 01:10:40.87
57.56 30-AUG-1993 01:20:36.74
57.56 30-AUG-1993 01:40:48.41
57.56 30-AUG-1993 01:50:39.88
57.56 30-AUG-1993 02:10:41.04
57.56 30-AUG-1993 02:20:45.05
57.56 30-AUG-1993 02:40:39.85
57.56 30-AUG-1993 02:40:39.85
57.56 30-AUG-1993 03:10:42.14
57.56 30-AUG-1993 03:20:38.07
57.56 30-AUG-1993 03:40:37.37
57.56 30-AUG-1993 03:50:41.52
57.56 30-AUG-1993 04:10:40.90
57.56 30-AUG-1993 04:20:46.48
57.56 30-AUG-1993 04:40:44.98
57.56 30-AUG-1993 04:50:39.48
57.56 30-AUG-1993 05:10:49.15
57.56 30-AUG-1993 05:20:38.75
57.56 30-AUG-1993 05:20:38.75
57.56 30-AUG-1993 05:20:38.75
57.56 30-AUG-1993 05:20:38.75
57.56 30-AUG-1993 06:20:37.36
57.56 30-AUG-1993 06:20:37.36
28 rows selected
So, the question I ask is, why did it export some of the data, and then
crap out with this error, when It was able to determine the existance
before it died? Please don't tell me that the code keeps checking, and
checking, and checking in dns every single time! Is this why exporting
from the historian is so slow?
BTW, again I'm using mcc1.3 and VMS 5.5-2, using DNS.
|
5502.5 | yet more exporting problems | TROOA::GREENALL | | Mon Aug 30 1993 20:07 | 158 |
|
ok folks, now I'm really getting upset with MCC (-:
here are two instances of the same line of code, with just a slight
change, causing a syntax error. I point out, that it's the exact same
piece of code in the DCL procedure both times. Here is a cut and paste
of the two commands.
Note that these are cut and pasted directly from the log of the
command procedure. The only difference is the Nodename
$ manage/enterprise -
export node4 KAOR03 -
export target disk$data1:[reports]reports.rdb, -
export period=00:15:00, -
begin time = 30-aug-1993 00:00:00.00, -
end time = now, -
in domain .tro.s.mcc.record
DECmcc (V1.3.0)
Node4 DEC:.kao.kaor03
AT 30-AUG-1993 17:28:27
Exporting completed
---
$ manage/enterprise -
export node4 KAOR04 -
export target disk$data1:[reports]reports.rdb, -
export period=00:15:00, -
begin time = 30-aug-1993 00:00:00.00, -
end time = now, -
in domain .tro.s.mcc.record
DECmcc (V1.3.0)
%MCC-I-NOPARCMD, .TRO.S.MCC.RECORD
^
%MCC-I-SYNTAXERR, Syntax error -- unable to interpret remainder of line
%MCC-S-NORMAL, normal successful completion
------
I can't find any reason to this. There is no discernable difference between
the two commands. This command is in a simple subroutine where p1 is
the node to export.
Here is the simple command procedure that I wrote that will automatically
export the data from my historian to the rdb file. It first uses SQL
to look into the database, to find out where the last export crapped out
(or ended), and continues where it left off. I wrote this to help work
around the problem described in the previous reply.
$ SET NOON
$ SET VERIFY
$! router TROR01
$! This procedure should be called periodically to export
$! node4 data to the rdb file disk$data1:[reports]reports.rdb
$! The procedure looks into the rdb database using SQL to determine
$! when the last export completed. It then exports from that time
$! to the present time using an interval of 15 minutes.
$
$ set default disk$data1:[reports]
$
$ call export TROR01
$ call export TROR02
$ call export KAOR02
$ call export KAOR03
$ call export KAOR04
$ call export CTHR01
$ call export OTOR01
$ call export MQOR01
$ call export WNOR01
$ call export EMOR01
$ call export VAOR01
$ call export CGOR01
$
$ exit
$
$ export:
$ subroutine
$
$! p1 - name of the entity to export
$
$! first to get the maximum date from the sql database
$! for the node p1
$
$ filename = "select.tmp"
$ quote :="'"
$
$! write the sql to find the maximum date
$!
$ open/write file$ 'filename'
$ say := write file$
$ say "$ mcr sql$
$ say " attach ",quote,"alias d filename disk$data1:[reports]reports.rdb",quote,";"
$ say " select max(time_stamp) from d.mcc_node4 where
$ say " name containing ",quote,p1,quote,";"
$ say "$ exit"
$ close file$
$
$! execute the file created
$! note that verify must be off so that the contents of the file
$! is known. this file must be parsed later.
$!
$ v=f$verify(0)
$ @select.tmp/out=select.tmp_out
$ v=f$verify(1)
$!
$! see if a row was selected
$!
$ search select.tmp_out "1 row selected"/output=nl:
$!
$! one row was selected, so hopefully this was a date
$!
$ if $severity=1
$ then
$!
$! get date from the file
$!
$ open/read file$ select.tmp_out
$ read file$ line
$ read file$ line
$ startdate == f$edit(line,"trim")
$ close file$
$ write sys$output startdate
$!
$! there were no records for this node in the rdb database
$! so assign a startdate manually
$!
$ if startdate .eqs. "NULL"
$ then
$ startdate == "30-aug-1993 00:00:00.00"
$ endif
$
$! execute the export
$ manage/enterprise -
export node4 'p1' -
export target disk$data1:[reports]reports.rdb, -
export period=00:15:00, -
begin time = 'startdate', -
end time = now, -
in domain .tro.s.mcc.record
$ else
$!
$! nothing was selected. Something is messed up so save
$! the output, and quit
$!
$ copy select.tmp_out select.tmp_bad
$ endif
$
$ delete select.tmp;*
$ delete select.tmp_out;*
$
$ endsubroutine
|