Examples of it.unimi.dsi.mg4j.search.visitor.CounterSetupVisitor

Package it.unimi.dsi.mg4j.search.visitor

Examples of it.unimi.dsi.mg4j.search.visitor.CounterSetupVisitor

it.unimi.dsi.mg4j.search.visitor.CounterSetupVisitor
A visitor using the information collected by a {@link it.unimi.dsi.mg4j.search.visitor.TermCollectionVisitor}to set up term frequencies and counters.
Term {@linkplain #frequency frequencies} and {@linkplain #count counts} are stored in publicly accessible parallel arrays of integers indexed by offsets, as defined by a {@link it.unimi.dsi.mg4j.search.visitor.TermCollectionVisitor} provided at construction time.Additionally, the {@linkplain #indexNumber index number} (a position into the array returned by {@link it.unimi.dsi.mg4j.search.visitor.TermCollectionVisitor#indices()}) and the {@linkplain #offset2Term term} for each offset are available.
When instances of this class perform a visit, they prepare the arrays and fill those contaning {@linkplain #frequency frequencies} and {@linkplain #indexNumber index numbers}. It is up to an instance of {@link it.unimi.dsi.mg4j.search.visitor.CounterCollectionVisitor}(which requires an instance of this class in its constructor) to fill the {@linkplain #count counts} with data related tothe current document.
For a more complete picture, see {@link it.unimi.dsi.mg4j.search.visitor.CounterCollectionVisitor}.

   * @param frequencies the frequencies, or <code>null</code> for Boldi's variant.
   */
  public BM25FScorer( final double k1, final Reference2DoubleMap<Index> b, final StringMap<? extends CharSequence> termMap, final LongList frequencies ) {
    this.termMap = termMap;
    termVisitor = new TermCollectionVisitor();
    setupVisitor = new CounterSetupVisitor( termVisitor );
    counterCollectionVisitor = new CounterCollectionVisitor( setupVisitor );
    this.k1 = k1;
    this.bByIndex = b;
    this.frequencies = frequencies;
    k1Plus1 = k1 + 1;

View Full Code Here

   * @param b the <var>b</var> parameter, specified as a map from indices to values.
   */
  public BM25FScorer( final double k1, final StringMap<? extends CharSequence> termMap, final LongList frequencies, final Object2DoubleMap<String> b ) {
    this.termMap = termMap;
    termVisitor = new TermCollectionVisitor();
    setupVisitor = new CounterSetupVisitor( termVisitor );
    counterCollectionVisitor = new CounterCollectionVisitor( setupVisitor );
    this.k1 = k1;
    this.bByName = b;
    this.frequencies = frequencies;
    k1Plus1 = k1 + 1;

View Full Code Here

  /** The term collection visitor used to estimate counts. */
  private final TermCollectionVisitor termCollectionVisitor;
  
  public CountScorer() {
    termCollectionVisitor = new TermCollectionVisitor();
    counterSetupVisitor = new CounterSetupVisitor( termCollectionVisitor );
    counterCollectionVisitor = new CounterCollectionVisitor( counterSetupVisitor );
  }

View Full Code Here

   * @param k1 the <var>k</var><sub>1</sub> parameter.
   * @param b the <var>b</var> parameter.
   */
  public BM25Scorer( final double k1, final double b ) {
    termVisitor = new TermCollectionVisitor();
    setupVisitor = new CounterSetupVisitor( termVisitor );
    counterCollectionVisitor = new CounterCollectionVisitor( setupVisitor );
    this.k1 = k1;
    this.b = b;
    k1Plus1 = k1 + 1;
  }

View Full Code Here

  /** An array indexed by offsets that caches the inverse document-frequency part of the formula, multiplied by the index weight. */
  private double[] weightedIdfPart;
  
  public TfIdfScorer() {
    termVisitor = new TermCollectionVisitor();
    setupVisitor = new CounterSetupVisitor( termVisitor );
    counterCollectionVisitor = new CounterCollectionVisitor( setupVisitor );
  }

View Full Code Here


  
  public void testCounterSetup() throws Exception {


    TermCollectionVisitor termVisitor = new TermCollectionVisitor();
    CounterSetupVisitor setupVisitor = new CounterSetupVisitor( termVisitor );
    CounterCollectionVisitor counterCollectionVisitor = new CounterCollectionVisitor( setupVisitor );


    it.unimi.dsi.mg4j.query.nodes.Query query = simpleParser.parse( "this" );
    DocumentIteratorBuilderVisitor documentIteratorBuilderVisitor = new DocumentIteratorBuilderVisitor( null, index0, Integer.MAX_VALUE );


    DocumentIterator indexIterator = query.accept( documentIteratorBuilderVisitor );


    indexIterator.nextDocument();


    termVisitor.prepare();
    indexIterator.accept( termVisitor );
    setupVisitor.prepare();
    indexIterator.accept( setupVisitor );


    // assertEquals( 3, indexIterator.frequency() );
    assertEquals( 3, setupVisitor.frequency[ 0 ] );

View Full Code Here

TOP

Related Classes of it.unimi.dsi.mg4j.search.visitor.CounterSetupVisitor

it.unimi.dsi.mg4j.search.score.BM25FScorer

it.unimi.dsi.mg4j.search.score.BM25Scorer

it.unimi.dsi.mg4j.search.score.CountScorer

it.unimi.dsi.mg4j.search.score.ScorerTest

it.unimi.dsi.mg4j.search.score.TfIdfScorer

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.