Examples of it.unimi.dsi.mg4j.index.cluster.ContiguousDocumentalStrategy

it.unimi.dsi.mg4j.index.cluster.ContiguousDocumentalStrategy
A documental partitioning and clustering strategy that partitions an index into contiguous segments.
To partition an index in contiguous parts, you must provide an array of cutpoints, which define each part. More precisely, given cutpoints c₀,c₂,…,c_k, the global index will be partitioned into k local indices containing the documents from c₀ (included) to c₁ (excluded), from c₁ (included) to c₂ and so on. Note that necessarily c₀=0 and c_k=N, where N is the number of globally indexed documents.
The {@link #properties()} method provides two properties, pointerfrom and pointerto,that contain the first (included) and last (excluded) pointer in the local index. @author Alessandro Arrabito @author Sebastiano Vigna

      clusterProperties.setProperty( IndexCluster.PropertyKeys.BLOOM, false );
      clusterProperties.setProperty( IndexCluster.PropertyKeys.FLAT, true );


      if ( indexingType == IndexingType.STANDARD ) {
        clusterProperties.setProperty( Index.PropertyKeys.INDEXCLASS, DocumentalConcatenatedCluster.class.getName() );
        BinIO.storeObject( new ContiguousDocumentalStrategy( cutPoints.toIntArray() ), basename + CLUSTER_STRATEGY_EXTENSION );
      }
      else {
        clusterProperties.setProperty( Index.PropertyKeys.INDEXCLASS, DocumentalMergedCluster.class.getName() );
        BinIO.storeObject( new IdentityDocumentalStrategy( batch, totDocuments ), basename + CLUSTER_STRATEGY_EXTENSION );
      }

View Full Code Here

      clusterProperties.setProperty( DocumentalCluster.PropertyKeys.BLOOM, false );
      clusterProperties.setProperty( IndexCluster.PropertyKeys.FLAT, false );


      if ( indexingIsStandard ) {
        clusterProperties.setProperty( Index.PropertyKeys.INDEXCLASS, DocumentalConcatenatedCluster.class.getName() );
        BinIO.storeObject( new ContiguousDocumentalStrategy( cutPoints.toIntArray() ), basename + CLUSTER_STRATEGY_EXTENSION );
      }
      else { // Remapped
        clusterProperties.setProperty( Index.PropertyKeys.INDEXCLASS, DocumentalMergedCluster.class.getName() );
        BinIO.storeObject( new IdentityDocumentalStrategy( batch, totDocuments ), basename + CLUSTER_STRATEGY_EXTENSION );
      }

View Full Code Here

TOP

Related Classes of it.unimi.dsi.mg4j.index.cluster.ContiguousDocumentalStrategy

it.unimi.dsi.mg4j.tool.Scan

it.unimi.dsi.mg4j.tool.Scan$PayloadAccumulator

it.unimi.dsi.util.Properties

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.