-->
These old forums are deprecated now and set to read-only. We are waiting for you on our new forums!
More modern, Discourse-based and with GitHub/Google/Twitter authentication built-in.

All times are UTC - 5 hours [ DST ]



Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 6 posts ] 
Author Message
 Post subject: Hibernate Search Master/Slaves Jgroups
PostPosted: Wed Jul 03, 2013 4:16 am 
Newbie

Joined: Tue Jul 02, 2013 12:19 pm
Posts: 1
I have a setup of Hibernate Search with Jgroups backend, and have 1 master with up to 3 slaves. The index is stored using Infinispan with no filestore (I have a relatively small index). The whole system sits behind a load balancer, and apart from the jgroups master/slave setting, the nodes are identical. If the master node happens to go down, would the search index not be updated until it goes up again?


Top
 Profile  
 
 Post subject: Re: Hibernate Search Master/Slaves Jgroups
PostPosted: Wed Jul 10, 2013 10:45 am 
Hibernate Team
Hibernate Team

Joined: Fri Oct 05, 2007 4:47 pm
Posts: 2536
Location: Third rock from the Sun
hi, yes that's correct. the master is a critical component in this configuration.
If that's a problem I'd suggest to use JMS with a failover mode, or help me to test HSEARCH-882 as soon as I we release the next alpha tag.. this one should take a lot of configuration complexity away and just do "the right thing"

_________________
Sanne
http://in.relation.to/


Top
 Profile  
 
 Post subject: Re: Hibernate Search Master/Slaves Jgroups
PostPosted: Wed Jul 10, 2013 11:42 am 
Beginner
Beginner

Joined: Fri Nov 13, 2009 4:05 pm
Posts: 30
In a master/slave configuration, if you rebuild the index using a MassIndexer that wipes and recreates the index on the master, are the slaves still online and searchable in their full capacity? I'm trying to understand is that the only way to use the MassIndexer on a large scale of records while being able to keep the index completely online for user searches until the MassIndexer can be modified to support update/removal mechanics described in HSEARCH-1032.


Top
 Profile  
 
 Post subject: Re: Hibernate Search Master/Slaves Jgroups
PostPosted: Wed Jul 10, 2013 11:45 am 
Hibernate Team
Hibernate Team

Joined: Fri Oct 05, 2007 4:47 pm
Posts: 2536
Location: Third rock from the Sun
That looks like an improvement we could make. So you expect to run the MassIndexer regularly in production? Shouldn't be needed generally.

_________________
Sanne
http://in.relation.to/


Top
 Profile  
 
 Post subject: Re: Hibernate Search Master/Slaves Jgroups
PostPosted: Fri Jul 12, 2013 9:38 am 
Beginner
Beginner

Joined: Fri Nov 13, 2009 4:05 pm
Posts: 30
sanne.grinovero wrote:
That looks like an improvement we could make. So you expect to run the MassIndexer regularly in production? Shouldn't be needed generally.

If you allow Hibernate to manage the insert/update/deletes from the database, absolutely. But in the cases where the data is managed outside of Hibernate and all Hibernate offers is a database agnostic solution for a web application that has read only access to this information, then the MassIndexer appears to be the only viable way to keep the Lucene indexes aligned with the data in the database.

I have considered moving the TSQL programs from the database into Java-code that leverages Hibernate in the long-term but we have some prior milestones that must be met before that can be made a reality and some research needed to manage Hibernate connected to multiple databases.


Top
 Profile  
 
 Post subject: Re: Hibernate Search Master/Slaves Jgroups
PostPosted: Fri Jul 12, 2013 9:54 am 
Hibernate Team
Hibernate Team

Joined: Fri Oct 05, 2007 4:47 pm
Posts: 2536
Location: Third rock from the Sun
understood. Did you consider using the non-automated approach? We describe the "flush-to-indexed" technique which provides much more control on how the operations are performed:

http://docs.jboss.org/hibernate/search/4.3/reference/en-US/html_single/#search-batchindex-flushtoindexes

It is somewhat slower, but that could be a good thing compared to saturating all your CPUs if you want to serve requests at the same time.

Also you could track or help with https://hibernate.atlassian.net/browse/HSEARCH-1032

I just sent some proposals to the mailing list:
http://lists.jboss.org/pipermail/hibernate-dev/2013-July/010135.html

(possible follow ups: http://search.jboss.org/#!q=%22HSEARCH-1032%22&project=hibernate&mailList=dev )

_________________
Sanne
http://in.relation.to/


Top
 Profile  
 
Display posts from previous:  Sort by  
Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 6 posts ] 

All times are UTC - 5 hours [ DST ]


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
© Copyright 2014, Red Hat Inc. All rights reserved. JBoss and Hibernate are registered trademarks and servicemarks of Red Hat, Inc.