Examples of com.m6d.filecrush.crush.Bucketer$Bucket

net.noderunner.amazon.s3.Bucket
Arranges files into buckets. Callers must interact with this class in the following order:
1. Invoke {@link #reset(String)}.
2. Invoke {@link #add(FileStatus)} zero or more times.
3. Invoke {@link #createBuckets()}.
4. Go to 1 or throw away instance.
The bucketing algorithm is:
1. Calculate the number of buckets as floor(total bytes / block size). Add one if there is a remainder.
2. Sort the files in order of descending size.
3. Add each file to the bucket that has the least size.
4. Remove any buckets containing one file only


    this.dir = dir;
    this.input = input;
    this.expected = expected;


    this.bucketer = new Bucketer(5, 50, excludeSingleItemBuckets);
  }

View Full Code Here


  private Bucketer bucketer;


  @Before
  public void before() {
    bucketer = new Bucketer(5, 50, true);
  }

View Full Code Here

   }


   private void setBucket(String s)
   {
      if (s != null)
         setBucket(new Bucket(s));
   }

View Full Code Here

   }


   private void setBucket(String s)
   {
      if (s != null)
         setBucket(new Bucket(s));
   }

View Full Code Here

TOP

Related Classes of com.m6d.filecrush.crush.Bucketer$Bucket

com.google.gxp.compiler.alerts.common.BadNodePlacementError

com.m6d.filecrush.crush.BucketerParameterizedTest

com.m6d.filecrush.crush.BucketerTest

org.apache.hadoop.hdfs.server.balancer.Balancer.Source

org.apache.hadoop.hdfs.server.balancer.Balancer.Target

org.elasticsearch.common.bytes.BytesArray

org.elasticsearch.common.text.BytesText

org.elasticsearch.common.text.StringText

org.elasticsearch.common.text.Text

org.elasticsearch.search.aggregations.InternalAggregations

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.