Examples of org.terrier.indexing.BasicIndexer

org.terrier.indexing.BasicIndexer

BasicIndexer is the default indexer for Terrier. It takes terms from each Document object provided by the collection, and adds terms to temporary Lexicons, and into the DirectFile. The documentIndex is updated to give the pointers into the Direct file. The temporary lexicons are then merged into the main lexicon. Inverted Index construction takes place as a second step.
Properties:

indexing.max.encoded.documentindex.docs - how many docs before the DocumentIndexEncoded is dropped in favour of the DocumentIndex (on disk implementation).
string.use_utf - use the UTF index structures?
See Also: Properties in org.terrier.indexing.Indexer and org.terrier.indexing.BlockIndexer

@author Craig Macdonald & Vassilis Plachouras @see org.terrier.indexing.Indexer @see org.terrier.indexing.BlockIndexer

        ? useSinglePass 
          ? new BlockSinglePassIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX)  
          : new BlockIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX)
        : useSinglePass
          ? new BasicSinglePassIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX)
          : new BasicIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX);
  
      SimpleFileCollection sfc = new SimpleFileCollection(folderList, true);
  
      indexer.index(new Collection[] { sfc });

Examples of org.terrier.indexing.BasicIndexer

Related Classes of org.terrier.indexing.BasicIndexer