I have written a webcrawler, which produces a high amount of webgraph-nodes consisting of 3 attributes:
ID: int URI: String Collection of references to other nodes
I use hibernate to store approx. 500 000 of these objects in my MSSql database. I use a many to many relationship to model the relations.
I do a
ITransaction TX = SX.BeginTransaction();
here i save all nodes without "save-update" in a loop
TX.commit()
The storeage of the nodes is very slow, i wait 30 min until everything is stored. What possibilities are there for speed-improvements, any suggestions?
Regards
R4DIUM
|