[Hibernate Search] Where the query matches

fabreax · **Posted:** Wed Jul 18, 2007 11:46 am

Hello,

When I make a query, is it possible to know where field matches ?

For example, I make a search : "field1:house AND field2:house" and I have one result. Could I know if field1 contains "house" or field 2 ?

Thank you.

emmanuel · **Posted:** Wed Jul 18, 2007 1:32 pm

I am not aware of a way to do it.

fabreax · **Posted:** Wed Jul 18, 2007 1:41 pm

Hum thank you Emmanuel... and maybe in a future release ?

(Because it's very importante when we did a search to know where the result is ...)

emmanuel · **Posted:** Wed Jul 18, 2007 1:49 pm

Now that I think about it, I guess you could look at Highlights, but I've never used them.

fabreax · **Posted:** Thu Jul 19, 2007 3:55 am

Yeah ! Very interesting to get a small extract (this is the same in Google).

I founded that :

Code:

IndexSearcher searcher = new IndexSearcher("ramDir");
Hits hits = searcher.search(luceneQuery);
Highlighter highlighter = new Highlighter(this, new QueryScorer(query));
for (int i = 0; i < hits.length(); i++)
{
  String text = hits.doc(i).get("field_name");
  TokenStream tokenStream = analyzer.tokenStream("field_name", new StringReader(text));
  // Get 3 best fragments and seperate with a "..."
  String result = highlighter.getBestFragments(tokenStream, text, 3, "...");
  System.out.println(result);
}

But in Hibernate Search, I have "Hit" but "Highlighter" and "QueryScorer" missed because the package "org.apache.lucene.search.highlight" missed.

Could I add it myself ?

emmanuel · **Posted:** Thu Jul 19, 2007 9:39 am

We could think about a nice integration. Do you want to give it a try?

fabreax · **Posted:** Thu Jul 19, 2007 11:00 am

I don't understand (I'm french), what do you want I try ?
To find the org.apache.lucene.search.highlight Lucene files and try to use Highlighter with Hibernate Search ?

emmanuel · **Posted:** Thu Jul 19, 2007 2:07 pm

To propose a patch to have access to the Highlights feature from within Hibernate Search from a fullTextQuery

fabreax · **Posted:** Thu Jul 19, 2007 3:55 pm

Hum, I'm in IT training period, I don't know if I have the required skills and enough time.

Is it complicated ?

emmanuel · **Posted:** Thu Jul 19, 2007 5:13 pm

Dunno, as I told you I haven't looked at Highlights in Lucene yet :)

fabreax · **Posted:** Fri Jul 20, 2007 4:15 am

I made several tests.

I added to my project Lucene class files and org.apache.lucene.search.highlight contribution.

Then I added to a classic HSearch search :

Code:

      try {
         IndexSearcher searcher = new IndexSearcher("/home/fmn/templucene/dao.modele.Entite");
         Hits hits = searcher.search(luceneQuery);
         Highlighter highlighter = new Highlighter(new SimpleHTMLFormatter("<b>","</b>") , new QueryScorer(luceneQuery));

         String fieldName = "documents.pleinTexte";
         for (int i = 0; i < hits.length(); i++) // for each document
         {
                 String fieldText = hits.doc(i).get(fieldName);

                 TokenStream tokenStream = (new StandardAnalyzer()).tokenStream(fieldName, new StringReader(fieldText));
                 // Get 3 best fragments and seperate with a "..."
                 String[] results = highlighter.getBestFragments(tokenStream, fieldText, 3);
                 
                 System.out.println("Result fragments :\n");
                 for(String result : results)
                    System.out.println("... "+result+" ...");
         }
      } catch (IOException e) {
         // TODO
         e.printStackTrace();
      }

The result is for example :

Code:

...  grande   première   formation   Turquie   première   proposition   <b>et</b>   première   victoire   en   grand   prix   le   départ   <b>et</b>   mouvementée   à   la   tête   a   été   pour   physique   <b>et</b>   la ...
...  victime   d'   une   crevaison   sain   <b>et</b>   puis   aussi   mais   dans   le   tour   suivant  ...

Here I want 3 index segments (max) found and I want the matched word in bold. It works very well but I think I made a search again when I use

Code:

Hits hits = searcher.search(luceneQuery);

equivalent to

Code:

luceneQuery = parser.parse(requeteLucene);

fabreax · **Posted:** Tue Jul 24, 2007 7:19 am

Could we insert it in HSearch ?

fabreax · **Posted:** Fri Jul 27, 2007 4:42 am

Am I able to do that easily ?

christian · **Posted:** Fri Jul 27, 2007 5:37 am

I don't see a reason to add your code snippet anywhere in Hibernate Search. In fact, I don't see why we would move the perfectly working Lucene Highlighter API into a Hibernate Search API.

I'm using FullTextQuery of Hibernate Search and the Highlighter on the query result without any problem or desire to simplify it.

fabreax · **Posted:** Fri Jul 27, 2007 7:11 am

In my example, I made a second query (not Hibernate Search Query) here :

Code:

   IndexSearcher[] searchers = new IndexSearcher[2];
   searchers[0] = new IndexSearcher("indexdir1");
   searchers[1] = new IndexSearcher("indexdir2");
   MultiSearcher searcher = new MultiSearcher(searchers);

   Hits hits = searcher.search(luceneQuery); 

Is there a solution to avoid this ?