Examples of org.terrier.indexing.BlockSinglePassIndexer$DelimFieldTermProcessor

org.terrier.indexing.BlockSinglePassIndexer
This class behaves in a similar fashion to FieldTermProcessor except that this one treats blocks bounded by delimiters instead of fixed-sized blocks. @author Rodrygo Santos @since 2.2

      + (ApplicationSetup.BLOCK_INDEXING ? "(with blocks)" : "") 
      + "...");
    final long beginTimestamp = System.currentTimeMillis();
    BasicSinglePassIndexer _indexer;
    if (ApplicationSetup.BLOCK_INDEXING)
      _indexer = new BlockSinglePassIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX);
    else
      _indexer = new BasicSinglePassIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX);
    _indexer.index(new Collection[] {collectionTREC});
    long endTimestamp = System.currentTimeMillis();
    System.err.println("Finished building the inverted index...");

View Full Code Here

  
      Indexer indexer;
      final boolean useSinglePass = Boolean.parseBoolean(ApplicationSetup.getProperty("desktop.indexing.singlepass", "false"));
      indexer = ApplicationSetup.BLOCK_INDEXING
        ? useSinglePass 
          ? new BlockSinglePassIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX)  
          : new BlockIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX)
        : useSinglePass
          ? new BasicSinglePassIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX)
          : new BasicIndexer(ApplicationSetup.TERRIER_INDEX_PATH, ApplicationSetup.TERRIER_INDEX_PREFIX);

View Full Code Here

TOP

Related Classes of org.terrier.indexing.BlockSinglePassIndexer$DelimFieldTermProcessor

org.terrier.applications.desktop.DesktopTerrier

org.terrier.applications.TRECIndexing

org.terrier.structures.indexing.BlockDocumentPostingList

org.terrier.structures.indexing.BlockFieldDocumentPostingList

org.terrier.structures.indexing.singlepass.BlockFieldMemoryPostings

org.terrier.structures.indexing.singlepass.BlockMemoryPostings

org.terrier.structures.indexing.singlepass.FileRunIteratorFactory

org.terrier.structures.indexing.singlepass.RunsMerger

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.