Indexing causing queries to be fired for non-indexed fields

seemarich · **Joined:** Tue Feb 03, 2009 12:29 pm **Posts:** 49

I'm using these versions of Hibernate jars.
Hibernate Core 3.3.1.GA
Hibernate Annotations 3.4.0 GA
Hibernate EntityManager 3.4.0 GA
Hibernate Search 3.1.0 GA

I'm trying to manually index an entity which has an associated entity marked with the @IndexedEmbedded annotation. Only one field in the associated entity is marked with the @Field annotation for indexing. However, when I try to manually index the main entity, it is firing select queries for all the lazy fetched fields of the associated entity. This is slowing down the indexing process. How can I prevent this from happening?

Thanks,
Seema

hardy.ferentschik · **Posted:** Wed Feb 04, 2009 4:09 am

Hi,

could you provide your entity mapping and an extract of the log file showing the executed sql statements?

--Hardy

seemarich · **Joined:** Tue Feb 03, 2009 12:29 pm **Posts:** 49

hi,

Our entities are very complex, so I created some dummy ones to simulate the issue. The indexed entity is IndexedSaleEventItem which is associated with IndexedInventory which in turn is associated with IndexedPurchaseInformation. When I attempt to index the IndexedSaleEventItem, it fires a query for loading the IndexedInventory which is fine since it has an embedded index. But it also fires a query for IndexedPurchaseInformation which has no indexed fields and is marked as lazy fetched. In my actual entity, there are multiple lazy loaded fields which are causing such multiple queries to be executed making the indexing slow.

The query logs, entities and indexing code are included below.

Code:

@Indexed
@Entity
@Table(name = "ATL_SALE_EVENT_ITEM")
public class IndexedSaleEventItem implements Serializable {

    /**
     * Comment for <code>serialVersionUID</code>.
     */
    private static final long serialVersionUID = -4745509173261900608L;

    /** The Unique Identifier. */
    @DocumentId
    @Id
    @GeneratedValue
    @Column(name = "SALE_EVENT_ITEM_ID")
    private Long id;

    /** The saleEvent.*/
    @ManyToOne(fetch = FetchType.LAZY)
    @JoinColumn(name = "SALE_EVENT_ID")
    private SaleEvent saleEvent;

    /** The inventoryId.*/
    @IndexedEmbedded
    @ManyToOne(fetch = FetchType.LAZY)
    @JoinColumn(name = "INVENTORY_ID")
    private IndexedInventory inventory;

    /** The auctionType. */
    @Column(name = "AUCTION_TYPE")
    private String auctionType;

    @Field(index=Index.TOKENIZED, store=org.hibernate.search.annotations.Store.NO)
    /** The itemDescription. */
    @Column(name = "ITEM_DESCRIPTION")
    private String itemDescription;

// getters and setters

}


@Entity
@Table(name = "ATL_INVENTORY")
public class IndexedInventory extends Trackable implements Serializable {

    /** Comment for serialVersionUID. */
    private static final long serialVersionUID = -440936293775306289L;

    /** The Unique Identifier. */
    @Id
    @GeneratedValue
    @Column(name = "INVENTORY_ID")
    private Long id;

   /** The make of the Inventory. */
    @Field(index=Index.TOKENIZED, store=org.hibernate.search.annotations.Store.NO)
    @Column(name = "MAKE")
    private String make;
  
    @ContainedIn
    @OneToMany(mappedBy="inventory",  fetch = FetchType.LAZY)
    private Collection<IndexedSaleEventItem> saleEventItems;
    
    /** Purcahse Information for the item. */
    @OneToOne(fetch = FetchType.LAZY, mappedBy = "inventory")
    private IndexedPurchaseInformation purchaseInformation;

   // getters and setters
}

@Entity
@Table(name = "ATL_PURCHASE_INFORMATION")
public class IndexedPurchaseInformation extends Trackable implements Serializable {

    /**
     * Comment for <code>serialVersionUID.</code>
     */
    private static final long serialVersionUID = -6535271186496400341L;

    /** The id. */
    @Id
    @GeneratedValue
    @Column(name = "PURCHASE_INFO_ID")
    private Long id;

    /** The amount. */
    @Column(name = "PURCHASE_AMOUNT")
    private Double amount;

    /** The purchaseDate. */
    @Column(name = "PURCHASE_DATE")
    private Date purchaseDate;

    /** The inventory. */
    @OneToOne(cascade = CascadeType.ALL, fetch = FetchType.LAZY)
    @JoinColumn(name = "INVENTORY_ID")
    private IndexedInventory inventory;
    
    // getters and setters

}

// Indexing code

EntityManager em = getAdesaJpaTemplate().getEntityManagerFactory()
            .createEntityManager();
      FullTextEntityManager fullTextEntityManager = Search
            .getFullTextEntityManager(em);

      List entities = em
            .createQuery(
                  "select distinct saleEventItem from IndexedSaleEventItem as saleEventItem " )
            .getResultList();
      System.out.println("Number of entities to be indexed "
            + entities.size());
      long startTIme = System.currentTimeMillis();
      int i = 0;
      for (Object entity : entities) {
         System.out.println("indexing " + i++);
         fullTextEntityManager.index(entity);
         //break;
      }

Thanks,
Seema

sanne.grinovero · **Posted:** Wed Feb 04, 2009 7:56 am

Quote:

@OneToOne(fetch = FetchType.LAZY, mappedBy = "inventory")
private IndexedPurchaseInformation purchaseInformation;

this is not going to be interpreted as "Lazy", as there is one limitation in the use of Lazy loading when the referenced object could be null.

here is a complete explanation, it is not a Search specific problem:
http://www.hibernate.org/162.html

you could change the mapping to either use "constrainted=true" if your business model can support this, or use JOIN FetchType to load the useless data in a more efficient way.