[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference ulysse::rdb_vms_competition

Title:DEC Rdb against the World
Moderator:HERON::GODFRIND
Created:Fri Jun 12 1987
Last Modified:Thu Feb 23 1995
Last Successful Update:Fri Jun 06 1997
Number of topics:1348
Total number of notes:5438

1142.0. "Difference between TPC-B 1.0 and 1.1?" by VAOU02::JBLAIR () Wed Apr 29 1992 03:43

    Can anyone tell me why the TPC-B benchmark specifies that it was run as
    a V1.0 TPC-B ratehr than a V1.1? I am refering to the VAX 6560 results
    of 193.76. The Oracle rep is telling my customer that we took advantage
    of a loophole by running the V1.0 of the benchmark and that our results
    would be significantly lower had we run the V1.1. I am very new the the
    TPC world so I am unable to comment against this statement. Any help
    greatly appreciated. ( Also, I am sorry if this is already answer here
    somewhere - I searched but couldn't find this info.)
    
    regards,
    jeanne
    
T.RTitleUserPersonal
Name
DateLines
1142.1Specs have changedIJSAPL::OLTHOFHenny Olthof @UTO 838-2021Wed Apr 29 1992 09:299
Jeanne,

Yes, the specs have changed and therefore we withdrew previous TPC-B results.
I cannot beleive that we did the 193.x test with old specs, so I guess the
Oracle rep is trying to confuse the customer. Ask Oracle about thier Rdb test,
which showed 60.1 TPS on the same hardware.

Cheers,
Henny Olthof, TP-DB The Netherlands
1142.2TPC approved release of our V1.0 figuresCOOKIE::OAKEYPicard/Riker '92Wed Apr 29 1992 17:319
�       <<< Note 1142.1 by IJSAPL::OLTHOF "Henny Olthof @UTO 838-2021" >>>
�                            -< Specs have changed >-

Yes, the 193.76 tpsB results were run under V1.0 of the TPC-B benchmark.  

However, Digital did not take advantage of any loophole to submit these 
figures and get them approved by the TP Council.  At the time of submission 
to and release by TPC, V1.0 of the benchmark was what was in effect.  

1142.3If Oracle is misleading customers we need to knowCOOKIE::OAKEYPicard/Riker &#039;92Wed Apr 29 1992 19:228
Re: .0

Refer to note 1095 if you feel that Digital's TPC results are being 
misrepresented by Oracle.  We feel that it is important that Digital's TPC 
results be fairly and accurately represented and we need to know if there 
are instances when other vendors are presenting misleading information.

1142.4ORACLE's Sour GrapesCOOKIE::BERENSONLex mala, lex nullaWed Apr 29 1992 20:1737
There are two versions of TPC-B, V1.0 and V1.1.  The few TPC-B results we
have published are all V1.0 and were published prior to V1.1 taking
effect (April 1).

At one point we withdrew some older TPC-B V1.0 results (for a VAXcluster)
because a clarification by the TPC required that we prove the
clarification impacted our results by less than 5%.  We decided that the
effort to do this wasn't worthwhile because the results were already
obsolete and the cost of re-running the benchmark was high.  This whole
area is irrelevant when discussing the recent 6560 results since that
test fully and completely complies with TPC requirements in every way,
shape, and form.  ORACLE is just whining because we beat them in a
benchmark.  They used every trick in the book to get the TPC to discredit
our results, including forcing us to explain some internal workings of
Rdb that they wanted to claim made it impossible for us to sustain the
tps-rate for 8-hours, but they failed.  The results are fully
conformant.

ORACLE gets identical performance for V1.0 and V1.1.  Our performance for
the benchmark under V1.1 is unknown, except we know its at least as good
as ORACLE's performance.  We see no point in re-running the benchmark since
the TPC considers pre-existing V1.0 results to be perfectly acceptable.
Any future results will have to be done with V1.1, but recall that we are
not very interested in TPC-B.  We believe that both TPC-A and TPC-C are
much more representative of what real customers do.  We only ran the 6560
TPC-B benchmark to debunk ORACLE's completely misleading advertising, and
had to use the same machine they were using.  Further, we see no point in
running another benchmark on a 6560 as it is not a current product
offering.  

Tell your customer that ORACLE is just expressing sour grapes over not
being the TPC-B leader.  They went out on a limb by advertising their own
benchmark results for Rdb and not applying the same level of application
optimization to the effort as if it had been their own product, and they
had their mistakes shoved down their throat.

Hal
1142.5thanksVAOU02::JBLAIRWed Apr 29 1992 20:313
    Thank you, everyone for the clarification.
    
    -jeanne