-->
These old forums are deprecated now and set to read-only. We are waiting for you on our new forums!
More modern, Discourse-based and with GitHub/Google/Twitter authentication built-in.

All times are UTC - 5 hours [ DST ]



Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 4 posts ] 
Author Message
 Post subject: How can I configure sharding for customer data
PostPosted: Wed Nov 17, 2010 8:21 am 
Newbie

Joined: Wed Nov 17, 2010 7:52 am
Posts: 2
In my application, I have configured hibernate search to index my customer data. so, on every insertion into a database, hibernate search will take care of indexing the data with the use of annotations.
now i want to configure a shard for each customer. to configure shards, we need to define the no.of.shards, sharding startegy and sharding properties at the configuration level . but i dont know about the customer details or the number of customer in prior as its been creating at runtime.

how can i configure the shards on my above example?


Top
 Profile  
 
 Post subject: Re: How can I configure sharding for customer data
PostPosted: Wed Nov 17, 2010 11:09 am 
Hibernate Team
Hibernate Team

Joined: Fri Oct 05, 2007 4:47 pm
Posts: 2536
Location: Third rock from the Sun
Hi,
that's not possible yet, sorry
Quote:
http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-472


Can you explain your needs exactly? Why not storing all data in the same index?
You are welcome to help out and join the ongoing discussion on JIRA.

BTW, make sure you use the corretct forum; there's an appropriate area for Search, Validator and Shards.

_________________
Sanne
http://in.relation.to/


Top
 Profile  
 
 Post subject: Re: How can I configure sharding for customer data
PostPosted: Thu Nov 18, 2010 2:09 am 
Newbie

Joined: Wed Nov 17, 2010 7:52 am
Posts: 2
Hi,

sorry for posting in wrong forum.

I have data specific to client and each client having the clientid.

I need to create separate shards for each client dynamically and whenever search or update or create happens I need to find the specific shard using the client id.

if its not supported, is it possible to customise ourselves. in order to customise how to go for it and what are all the changes do i need to do?


Top
 Profile  
 
 Post subject: Re: How can I configure sharding for customer data
PostPosted: Thu Nov 18, 2010 6:29 am 
Hibernate Team
Hibernate Team

Joined: Fri Oct 05, 2007 4:47 pm
Posts: 2536
Location: Third rock from the Sun
Hi, sure any help is always welcome.

before you start coding, I was asking to why? as applying a filter is usually as good, it will result in the same functionality.
The reason is just for performance reasons, as if you don't need to search in multiple shards the query can open a smaller index than the big one, still this performance improvement is noticeable only with extremely large databases, as indexreader's are pooled and optimized anyway;
another reason might be legal requirements, but are you needing that - it's for those cases people is enforced to use a database on a separate machine for each customer - not a common use case.

Anyway, you're welcome to help out implementing it as I'd love to have the feature.

Start with this reading: http://community.jboss.org/wiki/ContributingtoHibernateSearch
Then subscribe to developer's mailing list: http://hibernate.org/community/mailinglists hibernate-dev
And send an email there, just to say hi and that you're interested in contributing it - I and others will send suggestions and directions from there, as these design decisions are better discussed in team and other developers are unlikely to see this thread. You can also discuss it on the JIRA itself, follow the link I sent in previous post.

_________________
Sanne
http://in.relation.to/


Top
 Profile  
 
Display posts from previous:  Sort by  
Forum locked This topic is locked, you cannot edit posts or make further replies.  [ 4 posts ] 

All times are UTC - 5 hours [ DST ]


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
© Copyright 2014, Red Hat Inc. All rights reserved. JBoss and Hibernate are registered trademarks and servicemarks of Red Hat, Inc.