My agenda is hibernate success.
Look on the following posts and on the comments there.
http://www.codefutures.com/weblog/andygrove/2007/10/hibernate-conclusions.htmlIn the above post the writer tell about his bad expereince in confronting hibernate team with his own benchmark.
He wrote:
Quote:
However, the real surprise for me was how the performance and scalability compared between the two approaches. I spent a couple of days building a realistic subset of the application I was recommending the technology for and then ran benchmarks against a large database on dedicated test hardware. The results showed that Hibernate didn’t scale at all well compared to Spring JDBC for this application.
I posted some questions to the Hibernate forum to validate the approach I had taken and I received the rather terse and unhelpful reply “This is called 'A useless microbenchmark' and has been addressed a thousand times.” from a member of the Hibernate team. I did some reading of the Hibernate Performance FAQ and found some interesting statements in there, such as "We claim that Hibernate performs well" and "Many people try to benchmark Hibernate. All public benchmarks we have seen so far had (and most still have) serious flaws.". It almost seems like it is taboo to question Hibernate performance. I don't understand this defensive stance since most developers would recognize that there is a trade off between ease of use and performance
This is one of dozen example in the web for failed to discuess hibernate team on benchmarking.
We all wish to hibernate success and performance is a key to success.In order to success hibernate need to prove the small overhead.
hibernate visibility by publish a good and proven benchmark is required.
I have 6 years experience with hibernate.
In most of the time (not all) i recommended for hibernate.
In order to make the recommendation and the decision to chose hibernate easier for company that didn't use hibernate a proven benchmark is required.
My suggestion is to fix the test and not removed them.The test will be used as a performance reference and will be used to make hibernate performance visibility higher and not a taboo as it today.
A benchmark should include lot of cases like:
Simple objects
Complex objects
Bulk
Read
Write
Merge complex graph and more
If you want i am willing to take this task under my responsibility and to create a better performance test, but i need your cooperation with this.
Thank you