Hello there,

I'm kind of new to this ''performance testing''. However, I would like to measure the performance of Hibernate OGM (+MongoDB).
Is there a particular way that is recommended to measure this performance?

I thought of making use of System.currentTimeMillis() before and after using the persist() method.
I'm not quite sure whether that is a handy and fair way of measuring the performance, since it is now measuring the insertion inside MongoDB as well rather than purely Hibernate OGM. So I thought I would check the time in my MongoDB logs and subtract this amount by the System.currentTimeMillis() calculations made before and after the persist() method for instance.

Hi,

Check out this post on SO to learn more about writing micro benchmarks in Java in general: https://stackoverflow.com/questions/504103/how-do-i-write-a-correct-micro-benchmark-in-java.

Then I recommend to take a look at JMH: http://openjdk.java.net/projects/code-tools/jmh/) for writing benchmarks.

We also have a basic set of performance tests based on JMH which may serve as base of inspiration: https://github.com/hibernate/hibernate-ogm/tree/master/performance

Hth,

--Gunnar

Edit:

Nevermind it works! :D Thank you mate!!!!! Now I will try to understand how your tests are actually setup ;)

I had to change 4.1.2-SNAPSHOT to 4.1.1.Final

-----------------------

Don't read this ;)

Thank you for the reply! The tests you provided available on Github really look interesting!

I tried to import the entire project into eclipse. Then I tried to run the Hibernate-OGM-Performancetest (after changing the persistence.xml file to my settings) project by right clicking on the launcher and then ''Java Application''. I got the following error:


This lead me to think that I did not generate any file by Maven. So I right clicked on the project and then clicked on Maven -> Run As -> Maven Generate-Sources.
The following error occured:


Sorry for this ridiculous newbie question. I tried to also launch Maven Install on the hibernate-ogm-parent but got an error regarding a check-style.

Hi,

Best is to run the build once on the command line:



The readme.md in the root dir gives instructions on how to build the code base.

--Gunnar

Thank you mate, it works :)
Thank you for providing some example performance tests as well!

Hello Gunnar,

I'm very sorry for posting an off topic question. I hope you won't mind:

Based on your performance testing using JMH, I figured I want to measure the performance of MongoDB itself and compare this with another NoSQL database (without Hibernate OGM).

If I look at the following code for instance, I assume I will only need to insert the method at line 44/91/124 for instance in a benchmark instead of the entire thing to measure the performance of MongoDB, correct?

https://github.com/hibernate/hibernate-ogm/blob/master/performance/src/main/java/org/hibernate/ogm/perftest/mongodb/nativeapi/NativeApiInsertBenchmark.java

Benchmarks are complex but I think it's faire to keep the structure creation as part of the benchmark. This is part of the overall "persistence" cost.

Sorry for the late reply. Thanks for your comment. Good point.