-->
These old forums are deprecated now and set to read-only. We are waiting for you on our new forums!
More modern, Discourse-based and with GitHub/Google/Twitter authentication built-in.

View unanswered posts | View active topics


Board index » Projects » Search, Validator, Shards

All times are UTC - 5 hours [ DST ]


Forum locked This topic is locked, you cannot edit posts or make further replies.  Page 1 of 1
  [ 4 posts ] 
  Previous topic | Next topic 
Author Message
david2011
 Post subject: Master/Slave - Index out of sync errors
PostPosted: Mon Jul 16, 2012 12:24 pm 
Regular
Regular

Joined: Tue May 17, 2011 1:45 am
Posts: 52
Hi,

I am facing this issue continuously. This is how its happening

1. I have two war files, one acting as master , the other as slave
2. Reindexing happens in Master only (manually) twice a day (the index size is small)
3. Both master and slave have a delta index process triggered every 10 mins
4.Refresh interval in Master is set to 30 mins
5. Refresh interval in Slave is set to 5 hrs


The indexes go out of sync after 14-16 hrs.
Top
 Profile  
 
hardy.ferentschik
 Post subject: Re: Master/Slave - Index out of sync errors
PostPosted: Mon Jul 16, 2012 1:20 pm 
Hibernate Team
Hibernate Team

Joined: Thu Apr 05, 2007 5:52 am
Posts: 1689
Location: Sweden
david2011 wrote:
3. Both master and slave have a delta index process triggered every 10 mins

Why do master and slave do an delta index? Can you clarify your setup? Configuration,
indexing code?

david2011 wrote:
The indexes go out of sync after 14-16 hrs.


What the symptoms? Anything in the logs? Any exceptions?

--Hardy
Top
 Profile  
 
david2011
 Post subject: Re: Master/Slave - Index out of sync errors
PostPosted: Mon Jul 16, 2012 7:32 pm 
Regular
Regular

Joined: Tue May 17, 2011 1:45 am
Posts: 52
The delta keeps track of recent changes because there are frequent updates that happen , while reindex is used only as a clean up process. Moreover users will be using the slave to perform searches and I do not want users to get impacted when rindexing is going on.

The symptoms are

Firstly it starts with these messages both in master and slave

HSEARCH000019: Unable to remove previous marker file from source of /indexfolder/default/indexbase-slave/names

And then

Slave throws this error occasionally
unable to synchronize source of /indexfolder/default/indexbase-slave/names: java.io.IOException: Error during file transfer: expected 16777216 bytes, only 0 bytes copied.

After that soon we have index going out of sync
Top
 Profile  
 
hardy.ferentschik
 Post subject: Re: Master/Slave - Index out of sync errors
PostPosted: Tue Jul 17, 2012 4:11 am 
Hibernate Team
Hibernate Team

Joined: Thu Apr 05, 2007 5:52 am
Posts: 1689
Location: Sweden
It looks like the copy operation to sync master and slave directories fails. What type of of shared file system are you using? NFS? Some form of SAN? Is the shared file system working properly?

Can you post the full stacktrace and your master slave configuration?

--Hardy
Top
 Profile  
 
Display posts from previous:  Sort by  
Forum locked This topic is locked, you cannot edit posts or make further replies.  Page 1 of 1
  [ 4 posts ] 

Board index » Projects » Search, Validator, Shards

All times are UTC - 5 hours [ DST ]

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
© Copyright 2014, Red Hat Inc. All rights reserved. JBoss and Hibernate are registered trademarks and servicemarks of Red Hat, Inc.