-->
These old forums are deprecated now and set to read-only. We are waiting for you on our new forums!
More modern, Discourse-based and with GitHub/Google/Twitter authentication built-in.

All times are UTC - 5 hours [ DST ]



Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 1 post ] 
Author Message
 Post subject: Batch Processing Performance
PostPosted: Mon Jun 06, 2005 10:11 am 
Newbie

Joined: Mon Jun 06, 2005 9:53 am
Posts: 1
Hi ,

In one of our applications we are trying to insert more than 2 million records into database. We have to use hibernate and our API to build the objects into database because of the complexity of logic involved in constructing those objects.

Obviously we have to do batch processing because of the volume of inserts to not hit out of memory problem, and we are using JTA for transaction.

Until now I was under impression the performance of this type of application will be faster if we try to reduce the number of commits to database by increasing the batch size, of course keeping memory constraints in mind. So first I used batch size of 1000 and trying the different numbers to get an optimal number. The performance kept on improving as lowered the batch size to commit and was much faster when batch size was 10.

Does anyone have idea why is this behavior? The performance must be better if we reduce the number of calls to database. Instead it is better the other way.

Thanks.


Top
 Profile  
 
Display posts from previous:  Sort by  
Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 1 post ] 

All times are UTC - 5 hours [ DST ]


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
© Copyright 2014, Red Hat Inc. All rights reserved. JBoss and Hibernate are registered trademarks and servicemarks of Red Hat, Inc.