Examples of org.terrier.structures.indexing.singlepass.hadoop.IDComparator

Package org.terrier.structures.indexing.singlepass.hadoop

Examples of org.terrier.structures.indexing.singlepass.hadoop.IDComparator

org.terrier.structures.indexing.singlepass.hadoop.IDComparator
Compares String objects. It is used to sort the Map ID's for the MapData files loaded during the reduce step. It makes sure that the Map ID's are in order of the documents that they processed. @author richardm @since 3.0

      runData.add(tempHRD);
      runDataIn.close();
    }
    // Sort by splitnum
    Collections.sort(runData);
    Collections.sort(mapTaskIDs, new IDComparator(runData));
    // A list of the index shards
    MapIndexPrefixes = mapTaskIDs.toArray(new String[0]);
    return runData;
  }

View Full Code Here

TOP

Related Classes of org.terrier.structures.indexing.singlepass.hadoop.IDComparator

org.terrier.indexing.hadoop.Hadoop_BasicSinglePassIndexer

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.