Examples of org.apache.tez.mapreduce.examples.terasort.TeraGen

Package org.apache.tez.mapreduce.examples.terasort

Examples of org.apache.tez.mapreduce.examples.terasort.TeraGen

org.apache.tez.mapreduce.examples.terasort.TeraGen
Generate the official GraySort input data set. The user specifies the number of rows and the output directory and this class runs a map/reduce program to generate the data. The format of the data is:
- (10 bytes key) (constant 2 bytes) (32 bytes rowid) (constant 4 bytes) (48 bytes filler) (constant 4 bytes)
- The rowid is the right justified row id as a hex number.
To run the program: bin/hadoop jar hadoop-*-examples.jar teragen 10000000000 in-dir

  private void runTeraGen(Configuration conf, Path sortInput) 
      throws Exception {
    String[] genArgs = {NUM_ROWS, sortInput.toString()};
    
    // Run TeraGen
    assertEquals(ToolRunner.run(conf, new TeraGen(), genArgs), 0);
  }

View Full Code Here

  private void runTeraGen(Configuration conf, Path sortInput) 
      throws Exception {
    String[] genArgs = {NUM_ROWS, sortInput.toString()};
    
    // Run TeraGen
    assertEquals(ToolRunner.run(conf, new TeraGen(), genArgs), 0);
  }

View Full Code Here

TOP

Related Classes of org.apache.tez.mapreduce.examples.terasort.TeraGen

org.apache.hadoop.conf.Configuration

org.apache.hadoop.fs.Path

org.apache.hadoop.io.LongWritable

org.apache.hadoop.mapreduce.Job

org.apache.tez.mapreduce.examples.terasort.TestTeraSort

java.io.IOException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.