Order Entry Results

Our Vendor test has received quite a bit of interest from certain processor vendors; rightfully so, as the workload is quite difficult to recreate.

As you can see from the results below, there are some interesting conclusions that you can draw:
  • The Dual Opteron 875 took the lead by 18% over the fastest Quad Intel. This should come as no surprise as we have seen in the past that the memory bandwidth limitation of the Intel FSB architecture does not allow the quads to really stretch their legs. On the other hand, the Integrated Memory Controller of the Opterons allow them to pull ahead.
  • The additional L3 cache of the Quad Xeon 3.3GHz allows it to outperform the Quad Xeon 3.6GHz by 16%.
  • The Quad Xeon 3.6GHz with the 667MHz FSB is only able to outperform the Dual Xeon 3.6GHz 800MHz FSB by 5%.
  • The dual Xeons are able to outpace the dual 252's by 2%, and the single 875 by 5%. The Xeons success here can be attributed to the additional L2 cache.
  • The Dual Opteron 875 demonstrated nice scalability by servicing 52% more requests in the same period as the single Opteron 875.

Vendor Heavy Workload Test (Reads)

Vendor Heavy Workload Test (Writes)

To give you an idea of the scale of this benchmark, we have graphs of stored procedures calls per second. We decided to focus on Stored Procedures / Second rather than Transactions / Second, as the definition of a Transaction can have a business context or a technical context.

Vendor Heavy Workload Stored Procedures


"Order Entry" Stress Test: Measuring Enterprise Class Performance Data Warehouse Results
Comments Locked

144 Comments

View All Comments

  • Opteron - Monday, June 20, 2005 - link

  • mikeshoup - Wednesday, June 15, 2005 - link

    I think a better option for testing compiling speed would be to pass a -j argument to make when compiling FireFox, and tell it to run as many parallel operations as the processor can take threads. IE: -j2 for a dual core or ht cpu
  • fritz64 - Thursday, May 5, 2005 - link

    I know what I will be getting after fall this year. Those numbers are impresive!
  • jvarszegi - Friday, April 29, 2005 - link

    So they're reproducible, but only in secret. And you knew, as usual, about mistakes you were making, but made them anyway to, um, make a valid comparison to something else that no one can verify. Nicely done. Whatever they're paying you, it's not enough.
  • Ross Whitehead - Thursday, April 28, 2005 - link

    Zebo -

    You are correct you can not reproduce them, but we can and have 10's of times over the last year w/ different hardware. I do not believe that because you cannot reproduce them discounts their validity but it does require you have a small amount of trust in us.

    We have detailed the interaction of the application with the database. With this description you should be able to draw conclusions as to whether it matches the profile of your applications and database servers. Keep in mind, when it comes to performance tuning the most command phrase is "it depends". This means that there are so many variables in a test, that unless all are carefully maintained the results will vary greatly. So, even if you could reproduce it I would not recommend a change to your application hardware until it was validated with your own application as the benchmark.

    The owner of the benchmark is not AMD, or Intel, or anyone remotely related to PC hardware.

    I think if you can get beyond the trust factor there is a lot to gain from the benchmarks and our tests.
  • Reginhild - Thursday, April 28, 2005 - link

    Wow, the new AMD dual cores blow away the "patched together" Intel dual cores!!

    I can't see why anyone would choose the Intel dually over AMD unless all the AMDs are sold out.

    Intel needs to get off their arse and design a true dual core chip instead of just slapping two "unconnected" processors on one chip. The fact that the processors have to communicate with each other by going outside the chip is what killed Intel in all the benchmarks.
  • Zebo - Thursday, April 28, 2005 - link

    Ross,

    How can I reproduce them when they are not available to me?

    From your article:
    " We cannot reveal the identity of the Corporation that provided us with the application because of non-disclosure agreements in place. As a result, we will not go into specifics of the application, but rather provide an overview of its database interaction so that you can grasp the profile of this application, and understand the results of the tests better (and how they relate to your database environment)."

    Then don't include them. Benchmarking tools to which no one else has access is not scientific because it can't be reproduced so that anyone with a similar setup can verify the results.

    I don't even know what they do. How are they imporatant to me? How will this translate to anything real world I need to do? How can I trust the mysterious company? Could be AMD for all I know.
  • MPE - Wednesday, April 27, 2005 - link

    #134

    How can it be the best for the buck ? Unless you are seeing benchmarks from Anand that says so how could come to the conclusion?
    At some tests the 3800+ was the worse performer while the X2 and PD where the best.

    You are extrapolating logic from air.
  • Ross Whitehead - Wednesday, April 27, 2005 - link

    #131

    "no mystery unreproducable benchmarks like Anand's database stuff."

    It is not clear what you mean by this statement. The database benchmarks are 100% reproducable and are real life apps not synthetic or academic calcs.
  • nserra - Wednesday, April 27, 2005 - link

    You are discussion price and it's not correct since intel goes from 2800 to 3200 and amd goes from 3500+ into 4000+ (i'm ignoring amd new model numbers, still based on older).

    I complete disagree the AMD model numbers, the should be = to single core, the should just had the X2.

    The TRUE X2 will be more performer than opteron, by 2% to 5%.

Log in

Don't have an account? Sign up now