These old forums are deprecated now and set to read-only. We are waiting for you on our new forums!
More modern, Discourse-based and with GitHub/Google/Twitter authentication built-in.

All times are UTC - 5 hours [ DST ]



Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 1 post ] 
Author Message
 Post subject: Efficient storage of 500.000 rows
PostPosted: Wed Oct 07, 2009 7:11 pm 
Newbie

Joined: Mon Aug 10, 2009 7:46 am
Posts: 2
I have written a webcrawler, which produces a high amount of webgraph-nodes consisting of
3 attributes:

ID: int
URI: String
Collection of references to other nodes

I use hibernate to store approx. 500 000 of these objects in my MSSql database.
I use a many to many relationship to model the relations.

I do a

ITransaction TX = SX.BeginTransaction();

here i save all nodes without "save-update" in a loop

TX.commit()

The storeage of the nodes is very slow, i wait 30 min until everything is stored.
What possibilities are there for speed-improvements, any suggestions?

Regards

R4DIUM


Top
 Profile  
 
Display posts from previous:  Sort by  
Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 1 post ] 

All times are UTC - 5 hours [ DST ]


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
© Copyright 2014, Red Hat Inc. All rights reserved. JBoss and Hibernate are registered trademarks and servicemarks of Red Hat, Inc.