Comments on: More Erlang Web Server Benchmarking http://steve.vinoski.net/blog/2011/05/18/more-erlang-web-server-benchmarking/ Ask forgiveness, not permission. Sat, 19 May 2012 14:32:40 +0000 hourly 1 http://wordpress.org/?v=3.5.1 By: steve http://steve.vinoski.net/blog/2011/05/18/more-erlang-web-server-benchmarking/comment-page-1/#comment-1642 steve Thu, 19 May 2011 12:18:10 +0000 http://steve.vinoski.net/blog/?p=832#comment-1642 @DeadZen: I don’t know the answer to that question, as those benchmarks were created before I started using Erlang or Yaws. I don’t know any more details of how they were created or run than what’s described on that page. If you’ve ever heard any of my presentations where I mention these benchmarks, you’ll already know that I tend to classify them as interesting but no longer relevant. You’ll also find that the Yaws website does not refer to these benchmarks, and in fact displays no benchmarks of any kind.

When I first started evaluating Yaws I found that page and tried to recreate the results but on a smaller scale, and I was able to get results that were somewhat similar but definitely not the same. But the important point about that is that rather than just blindly accepting those benchmarks, I ran my own benchmarks that tested the characteristics I sought.

If my past two blog postings have not been enough to convey my opinion of performance benchmarks, then you might want to read this article (pdf) I wrote 8 years ago. That article applied to enterprise middleware, but it’s relevant to this discussion as well.

]]> By: DeadZen http://steve.vinoski.net/blog/2011/05/18/more-erlang-web-server-benchmarking/comment-page-1/#comment-1641 DeadZen Thu, 19 May 2011 11:41:51 +0000 http://steve.vinoski.net/blog/?p=832#comment-1641 http://www.sics.se/~joe/apachevsyaws.html

How many rules were broken?

]]>