[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference azur::mcc

Title:DECmcc user notes file. Does not replace IPMT.
Notice:Use IPMT for problems. Newsletter location in note 6187
Moderator:TAEC::BEROUD
Created:Mon Aug 21 1989
Last Modified:Wed Jun 04 1997
Last Successful Update:Fri Jun 06 1997
Number of topics:6497
Total number of notes:27359

5502.0. "problem with exporting" by TROOA::GREENALL () Wed Aug 18 1993 18:03

    
    
    I am having a problem with running the canned reports with DECmcc 1.3,
    and have narrowed the problem down to what I believe to be either a
    bug, or a misunderstanding on my part on how exporting data works.
    
    Basically, the reports I am running are showing up blank because the
    time_stamps of the records being exported to the RDB file are being
    messed up.
    
    I have decided that I will run the reports by first RECORDING data with
    the historian at 15 minute intervals.  I will then export this data as
    needed to the RDB file, and then run the report.
    
    Here is an example of the problem I am seeing.
    
    I have started recording on the object node4 tror01 circuit syn-0. 
    Here is the output of a 
    
    	show record node4 tror01 circuit syn-0 part=*,  -
    		in domain .tro.s.mcc.record.
    
    I realize now that recording Initial Attributes can't work for the
    router, so that is the reason for the failure, and It will be turned
    off.  It still shouldn't affect the export though..
    
    

Node4 tror01 Circuit syn-0 
AT 18-AUG-1993 16:22:37 

Recording parameters for the partition "Identifiers" :
                        Recording state = ACTIVE,
                            State since = 15-AUG-1993 22:39:50.43,
                         Polling period = 1 00:00:00.00,
                             Begin time = 15-AUG-1993 22:38:59.13,
                               End time = 25-MAY-2012 00:00:00.00,
                               Keep age = 0 14:00:00.00,
                           Request time = 15-AUG-1993 22:38:59.13,
                           Requested by = "SYSTEM",
           Time of last successful poll = "18-AUG-1993 11:17:26.07",
             Number of successful polls = 11,
               Time of last failed poll = "NONE",
               Last poll failure reason = "N/A",
                 Number of failed polls = 0,
        Last historical expiration time = "18-AUG-1993 11:17:26.07",
        Time of last expiration failure = "NONE",
         Last expiration failure reason = "N/A",
          Number of expiration failures = 0

Node4 tror01 Circuit syn-0 
AT 18-AUG-1993 16:22:45 

Recording parameters for the partition "Status" :
                        Recording state = ACTIVE,
                            State since = 15-AUG-1993 22:39:57.08,
                         Polling period = 0 00:15:00.00,
                             Begin time = 15-AUG-1993 22:38:59.13,
                               End time = 25-MAY-2012 00:00:00.00,
                               Keep age = 0 14:00:00.00,
                           Request time = 15-AUG-1993 22:38:59.13,
                           Requested by = "SYSTEM",
           Time of last successful poll = "18-AUG-1993 16:17:56.98",
             Number of successful polls = 180,
               Time of last failed poll = "NONE",
               Last poll failure reason = "N/A",
                 Number of failed polls = 0,
        Last historical expiration time = "18-AUG-1993 16:17:56.98",
        Time of last expiration failure = "NONE",
         Last expiration failure reason = "N/A",
          Number of expiration failures = 0

Node4 tror01 Circuit syn-0 
AT 18-AUG-1993 16:22:46 

Recording parameters for the partition "Counters" :
                        Recording state = ACTIVE,
                            State since = 15-AUG-1993 22:40:05.75,
                         Polling period = 0 00:15:00.00,
                             Begin time = 15-AUG-1993 22:38:59.13,
                               End time = 25-MAY-2012 00:00:00.00,
                               Keep age = 0 14:00:00.00,
                           Request time = 15-AUG-1993 22:38:59.13,
                           Requested by = "SYSTEM",
           Time of last successful poll = "18-AUG-1993 16:18:25.76",
             Number of successful polls = 180,
               Time of last failed poll = "NONE",
               Last poll failure reason = "N/A",
                 Number of failed polls = 0,
        Last historical expiration time = "18-AUG-1993 16:18:25.76",
        Time of last expiration failure = "NONE",
         Last expiration failure reason = "N/A",
          Number of expiration failures = 0

Node4 tror01 Circuit syn-0 
AT 18-AUG-1993 16:22:47 

Recording parameters for the partition "Characteristics" :
                        Recording state = ACTIVE,
                            State since = 15-AUG-1993 22:40:11.95,
                         Polling period = 1 00:00:00.00,
                             Begin time = 15-AUG-1993 22:38:59.13,
                               End time = 25-MAY-2012 00:00:00.00,
                               Keep age = 0 14:00:00.00,
                           Request time = 15-AUG-1993 22:38:59.13,
                           Requested by = "SYSTEM",
           Time of last successful poll = "18-AUG-1993 11:18:55.21",
             Number of successful polls = 11,
               Time of last failed poll = "NONE",
               Last poll failure reason = "N/A",
                 Number of failed polls = 0,
        Last historical expiration time = "18-AUG-1993 11:18:55.21",
        Time of last expiration failure = "NONE",
         Last expiration failure reason = "N/A",
          Number of expiration failures = 0

Node4 tror01 Circuit syn-0 
AT 18-AUG-1993 16:22:49 

Recording parameters for the partition "References" :
                        Recording state = ACTIVE,
                            State since = 15-AUG-1993 22:40:22.07,
                         Polling period = 1 00:00:00.00,
                             Begin time = 15-AUG-1993 22:38:59.13,
                               End time = 25-MAY-2012 00:00:00.00,
                               Keep age = 0 14:00:00.00,
                           Request time = 15-AUG-1993 22:38:59.13,
                           Requested by = "SYSTEM",
           Time of last successful poll = "NONE",
             Number of successful polls = 0,
               Time of last failed poll = "18-AUG-1993 11:19:24.94",
               Last poll failure reason = "Entity is not registered",
                 Number of failed polls = 11,
        Last historical expiration time = "NONE",
        Time of last expiration failure = "NONE",
         Last expiration failure reason = "N/A",
          Number of expiration failures = 0

Node4 tror01 Circuit syn-0 
AT 18-AUG-1993 16:22:50 

Recording parameters for the partition "Initial Attributes" :
                        Recording state = ACTIVE,
                            State since = 15-AUG-1993 22:40:31.75,
                         Polling period = 1 00:00:00.00,
                             Begin time = 15-AUG-1993 22:38:59.13,
                               End time = 25-MAY-2012 00:00:00.00,
                               Keep age = 0 14:00:00.00,
                           Request time = 15-AUG-1993 22:38:59.13,
                           Requested by = "SYSTEM",
           Time of last successful poll = "NONE",
             Number of successful polls = 0,
               Time of last failed poll = "18-AUG-1993 11:19:55.24",
               Last poll failure reason = "MCC specialized exception code : 330",
                 Number of failed polls = 11,
        Last historical expiration time = "NONE",
        Time of last expiration failure = "NONE",
         Last expiration failure reason = "N/A",
          Number of expiration failures = 0



I then export this data to the rdb file with the command
$ manage/enter
	export node4 tror01 circuit syn-0 export target=disk$data1:[reports]reports.rdb,	-
	export period = 00:15:00 ,					-
	begin time = 12:00:00 ,				-
	end time = 15:00:00 ,				-
	in domain .tro.s.mcc.record
!
exit

This is what I then get in the resultant RDB file.

mcr sql$
sql> select node4, timestamp from mcc_node4_circuit;

 NODE4      TIME_STAMP                
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
 57.56      18-AUG-1993 11:17:26.07   
13 rows selected

	Now I see why I am getting 0 length reports.  The timestamps do not
fall within the range of data that I am recording (remember, I exported
between the times 12:00 and 15:00).  Where is Export getting this timestamp?  
Is this a bug in mcc, or a misunderstanding on my part on how export works.

Richard

    
T.RTitleUserPersonal
Name
DateLines
5502.1just misunderstanding ...SISE::SAMMon Aug 23 1993 15:3829
    
	Richard,

	You did everything correctly except one thing: you did not record 
  enough information to calculate past time statistics. As you know record
  operation allows to record every partition but statistics. So when Exporter
  is asked to perform a past time export it tries to calculate statistics
  on the fly from historical data. Node4 partitions do not provide all
  information needed for Performance Analyzer (PA) in order to calculate 
  statistics. As far as I remember you also need to record line characteristics
  and circuit counters (?). Probably the best thing is to look at Performance
  Analyzer Use manual. In this manual you can find a chapter which lists
  everything what you need to record. 

	Now about "time_stamp" field in the exported table. This field is 
  not used by the report package. Under different circumstances this field can
  have different meaning. But  in each table you can find "time_<partition_name>"
  field for each partition (for example, "time_counters"). This information
  together with status ("mcc_cvr_<partition>) gives you real time stamp and
  status of the original reqiest. As far as I remember Historical Data Use
  manual has a description of the data base table structure.

	Sam
  
 

    

    
5502.2one more tryTROOA::GREENALLWed Aug 25 1993 17:4010
    
    Whoops, 
    
    	sorry, but I guess I missed it in my note. Yes, I did record line
    statistics.. I recorded line, node, and circuit statistics for the
    node, and still I got no data.
    
    	Anyways, I will try yet again to get mcc working properly, and will
    report back.  Maybe I missed it.
    
5502.3TOOK::MINTZErik MintzWed Aug 25 1993 17:556
No, please check Sam's note again.  You can not record statistics at all.
You must record the raw data required by the statistical calculations.
Then when you try to review (or export) statistical data, it is
re-computed from the historical raw data.

-- Erik
5502.4partial success (but more problems)TROOA::GREENALLMon Aug 30 1993 19:3574
    
    Ok, I have partial success here. I am able to run reports on exported
    data, and the data is valid.
    
    I still don't see anything different this time, then what I did last
    time. (when I said recording statistics in .2, I shouldn't have used
    the word statistics, I was using statistics as a general term for
    characteristics, counters, etc..)
    
    Anyways, the data is being recorded, and the "time_stamp" column is now
    incrementing properly. (again, don't ask me why it is now, when it
    didn't in .0. I'm using the same commands).
    
    I am now getting plaged by errors of the following time when I try to
    export data (again, only sometimes, and only on some items.) Note that
    TROR01 CIRCUIT SYN-0 is a registered object, and I am executing this
    command at approx 16:00 hrs.
    
    MCC> EXPORT NODE4 TROR01 CIRCUIT SYN-0 -
    _MCC> EXPORT TARGET=DISK$DATA1:[REPORTS]REPORTS.RDB, -
    _MCC> EXPORT PERIOD=00:15:00, -
    _MCC> BEGIN TIME=TODAY, -
    _MCC> END TIME=NOW, -
    _MCC> IN DOMAIN .TRO.S.MCC.RECORD
    
    
    The requested operation cannot be completed
           MCC Routine Error = %MCC-S-NORMAL, normal successful completion,
           Entity Existence Info = Entity Existence Cannot Be Determined
    
    
    But here is the silly thing. It did export some data, as is shown by
    the SQL command below
    
    NODE4      TIME_STAMP
     57.56      29-AUG-1993 23:40:33.74
     57.56      30-AUG-1993 00:10:41.07
     57.56      30-AUG-1993 00:10:41.07
     57.56      30-AUG-1993 00:40:33.96
     57.56      30-AUG-1993 00:50:38.05
     57.56      30-AUG-1993 01:10:40.87
     57.56      30-AUG-1993 01:20:36.74
     57.56      30-AUG-1993 01:40:48.41
     57.56      30-AUG-1993 01:50:39.88
     57.56      30-AUG-1993 02:10:41.04
     57.56      30-AUG-1993 02:20:45.05
     57.56      30-AUG-1993 02:40:39.85
     57.56      30-AUG-1993 02:40:39.85
     57.56      30-AUG-1993 03:10:42.14
     57.56      30-AUG-1993 03:20:38.07
     57.56      30-AUG-1993 03:40:37.37
     57.56      30-AUG-1993 03:50:41.52
     57.56      30-AUG-1993 04:10:40.90
     57.56      30-AUG-1993 04:20:46.48
     57.56      30-AUG-1993 04:40:44.98
     57.56      30-AUG-1993 04:50:39.48
     57.56      30-AUG-1993 05:10:49.15
     57.56      30-AUG-1993 05:20:38.75
     57.56      30-AUG-1993 05:20:38.75
     57.56      30-AUG-1993 05:20:38.75
     57.56      30-AUG-1993 05:20:38.75
     57.56      30-AUG-1993 06:20:37.36
     57.56      30-AUG-1993 06:20:37.36
    28 rows selected
    
    
    
    So, the question I ask is, why did it export some of the data, and then
    crap out with this error, when It was able to determine the existance
    before it died?  Please don't tell me that the code keeps checking, and
    checking, and checking in dns every single time!  Is this why exporting 
    from the historian is so slow?
                                
    BTW, again I'm using mcc1.3 and VMS 5.5-2, using DNS.
5502.5yet more exporting problemsTROOA::GREENALLMon Aug 30 1993 20:07158
    
    ok folks, now I'm really getting upset with MCC (-:
    
    here are two instances of the same line of code, with just a slight
    change, causing a syntax error.  I point out, that it's the exact same
    piece of code in the DCL procedure both times.  Here is a cut and paste
    of the two commands.
    
    	Note that these are cut and pasted directly from the log of the 
    command procedure.  The only difference is the Nodename
    
    $               manage/enterprise -
                            export node4 KAOR03  -
                            export target disk$data1:[reports]reports.rdb, -
                             export period=00:15:00, -
                                    begin time = 30-aug-1993 00:00:00.00, -
                                    end time = now, -
                                    in domain .tro.s.mcc.record
    DECmcc (V1.3.0)
    
    
    Node4 DEC:.kao.kaor03
    AT 30-AUG-1993 17:28:27
    
    Exporting completed
    
    
---
    $               manage/enterprise -
                            export node4 KAOR04  -
                            export target disk$data1:[reports]reports.rdb, -
                            export period=00:15:00, -
                                    begin time = 30-aug-1993 00:00:00.00, -
                                    end time = now, -
                                    in domain .tro.s.mcc.record
    DECmcc (V1.3.0)
    
    %MCC-I-NOPARCMD, .TRO.S.MCC.RECORD
                     ^
    %MCC-I-SYNTAXERR, Syntax error -- unable to interpret remainder of line
    %MCC-S-NORMAL, normal successful completion
    
    ------
    I can't find any reason to this. There is no discernable difference between
    the two commands.   This command is in a simple subroutine where p1 is
    the node to export.
    
    Here is the simple command procedure that I wrote that will automatically
    export the data from my historian to the rdb file. It first uses SQL
    to look into the database, to find out where the last export crapped out 
    (or ended), and continues where it left off. I wrote this to help work 
    around the problem described in the previous reply. 
    
$ SET NOON
$ SET VERIFY
$! router TROR01
$!	This procedure should be called periodically to export 
$!	node4 data to the rdb file disk$data1:[reports]reports.rdb
$!	The procedure looks into the rdb database using SQL to determine
$!	when the last export completed.  It then exports from that time
$! 	to the present time using an interval of 15 minutes.
$
$ set default disk$data1:[reports]
$
$ call export TROR01
$ call export TROR02
$ call export KAOR02
$ call export KAOR03
$ call export KAOR04
$ call export CTHR01
$ call export OTOR01
$ call export MQOR01
$ call export WNOR01
$ call export EMOR01
$ call export VAOR01
$ call export CGOR01
$
$ exit
$
$ export:
$	subroutine
$
$!	p1 - name of the entity to export
$
$! first to get the maximum date from the sql database
$! for the node p1
$
$	filename = "select.tmp"
$	quote :="'"
$
$! write the sql to find the maximum date
$!
$	open/write file$ 'filename'
$ 	say := write file$
$	say "$ mcr sql$                                             
$	say "	attach ",quote,"alias d filename disk$data1:[reports]reports.rdb",quote,";"
$	say "	select max(time_stamp) from d.mcc_node4 where
$	say "		name containing ",quote,p1,quote,";"
$	say "$ exit"
$	close file$
$
$! execute the file created
$! note that verify must be off so that the contents of the file
$! is known. this file must be parsed later.
$!
$	v=f$verify(0)
$	@select.tmp/out=select.tmp_out
$	v=f$verify(1)
$!
$! see if a row was selected
$!
$	search select.tmp_out "1 row selected"/output=nl:
$!
$! one row was selected, so hopefully this was a date
$!
$	if $severity=1 
$	then
$!
$!		get date from the file
$!
$		open/read file$ select.tmp_out
$		read file$ line
$		read file$ line
$		startdate == f$edit(line,"trim")
$		close file$
$		write sys$output startdate
$!
$!		there were no records for this node in the rdb database
$!		so assign a startdate manually
$!
$		if startdate .eqs. "NULL"
$		then
$			startdate == "30-aug-1993 00:00:00.00"
$		endif
$
$!		execute the export
$		manage/enterprise -
			export node4 'p1'  -
			export target disk$data1:[reports]reports.rdb, -
			export period=00:15:00, -
				begin time = 'startdate', -
				end time = now, -
				in domain .tro.s.mcc.record
$	else
$!
$!		nothing was selected. Something is messed up so save 
$!		the output, and quit
$!
$		copy select.tmp_out select.tmp_bad
$	endif
$
$	delete select.tmp;*
$	delete select.tmp_out;*						
$
$ endsubroutine