<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
<title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
Jonah H. Harris wrote:
<blockquote
cite="mid:36e682920812142016x21d31a57q41894aa6b20a0108(at)mail(dot)gmail(dot)com"
type="cite">
<pre wrap="">On Sun, Dec 14, 2008 at 11:05 PM, justin <a class="moz-txt-link-rfc2396E" href="mailto:justin(at)emproshunts(dot)com"><justin(at)emproshunts(dot)com></a> wrote:
</pre>
<blockquote type="cite">
<pre wrap="">I would like to see them even if PostgreSql comes dead last.
</pre>
</blockquote>
<pre wrap=""><!---->
Well, running an official TPC benchmark is an interesting process.
First, you have to have a spec-compliant benchmark kit, which we
don't. Second, you have to work with a hardware vendor, and none of
the vendors are going to work with you if you can't make their
hardware look good; they don't want to come in last even if it's due
to your software. I know, I talked to three of the major hardware
vendors. Lastly, it costs a fair amount of money and time to perform
an audited benchmark, which I don't think the community wants to pay
for.
</pre>
</blockquote>
<br>
Thats a problem with testing. Its not cheap or easy. I do this all
the time with electrical equipment. The company I work for has 20K in
a environmental testing chamber, 55K in power supplies 60K in DMMs
which must be certified to NIST costing another 10K every year. This
is only for the lab and QC.<br>
<br>
So yes i know testing is very expensive but it can be done and should
be done independently of the Hardware/Software manufactures. If not
how are we to know that this hardware/Software is really a production
item. Example of independent lab is Consumer Reports, created to test
products without the manufactures influence over the net result as the
manufactures were hoisting bogus testing reports on the public. <br>
<br>
The more i learn how the tests are run the more suspicious i become its
totally black bagged. The test method must be easy to understand be
realistic to a real model that anyone can run with X time and X money
on hand. Since you have stated that is near impossible to do, i would
say the testing methods need to be rethought. <br>
<br>
Any one can test our product if they went out spend 40K on electrical
lab equipment and has a basic understand of electrical principles.
There is no need to have an understanding of ISO 17025
<a class="moz-txt-link-freetext" href="http://en.wikipedia.org/wiki/ISO_17025">http://en.wikipedia.org/wiki/ISO_17025</a><br>
<br>
<br>
<blockquote
cite="mid:36e682920812142016x21d31a57q41894aa6b20a0108(at)mail(dot)gmail(dot)com"
type="cite">
<pre wrap=""></pre>
<blockquote type="cite">
<pre wrap="">Does that not prove the point Oracle is over price software compared to the
competition.
</pre>
</blockquote>
<pre wrap=""><!---->
That depends on whether you need the performance or not.
</pre>
</blockquote>
That don't make sense???? Its all about cost if the other software is
cheaper per transaction means you can spend the same amount of money as
one would on Oracle on lets say MSSQL then blow by Oracle's performance<br>
<blockquote
cite="mid:36e682920812142016x21d31a57q41894aa6b20a0108(at)mail(dot)gmail(dot)com"
type="cite">
<pre wrap="">
</pre>
<blockquote type="cite">
<pre wrap="">The only way to verify the results is duplicate the test and given these
servers cost from $100K to $10million its unlikely these test are verified
by a 3rd party running independent hardware. From where i come from for
result to be proven someone else must duplicate the results independently
with only instructions given by the original tester.
</pre>
</blockquote>
<pre wrap=""><!---->
Perhaps you should download a full disclosure report of a TPC
benchmark. First of all, they're all audited. Second of all, every
configuration detail is provided for you to be able to run the test
yourself. In fact, if you have a good enough reason to do so (i.e.
looking to buy a good amount of software), both Oracle and Microsoft
will give you copies of their benchmark kits for evaluation purposes</pre>
</blockquote>
<br>
Used to be work under ISO 9000 writing standards and dealing with
Auditors. I know how auditing works and ways to make yourself look
good and in compliance when its completely penciled wiped into shape.
Given no 3rd party does completely independent testing i view it as an
all around joke. <br>
<br>
This is the reason we chose to drop ISO certification as it had nothing
to do about doing the job right <br>
</body>
</html>