Package com.datasalt.pangool.tuplemr.mapred.lib.input

Examples of com.datasalt.pangool.tuplemr.mapred.lib.input.HCatTupleInputFormat

51
52
53
54
55
56
57
58
59
60
61
    String dbName = args[0];
    String tableName = args[1];
   
    MapOnlyJobBuilder builder = new MapOnlyJobBuilder(conf, "HCatTupleInputFormat Integration Test");
    // input path can't be null in Pangool so we enter anything
    builder.addInput(new Path("anything"), new HCatTupleInputFormat(dbName, tableName, conf), new MapOnlyMapper<ITuple, NullWritable, NullWritable, NullWritable>() {
     
      protected void map(ITuple key, NullWritable value, Context context) throws IOException, InterruptedException {
        System.out.println(key.toString());
      };
    });
View Full Code Here
189
190
191
192
193
194
195
196
197
198
199
      throws IOException {
    if(hadoopConf == null) {
      throw new IllegalArgumentException(
          "Hadoop configuration can't be null - please provide a valid one.");
    }
    HCatTupleInputFormat inputFormat = new HCatTupleInputFormat(dbName, tableName, conf);
    Map<String, String> specificContext = new HashMap<String, String>();
    specificContext.put("mapreduce.lib.hcat.job.info", conf.get("mapreduce.lib.hcat.job.info"));
    specificContext.put("mapreduce.lib.hcatoutput.hive.conf",
        conf.get("mapreduce.lib.hcatoutput.hive.conf"));
    addCustomInputFormatFile(new Path("hive/" + dbName + "/" + this.tableName), inputFormat,
View Full Code Here
TOP

Related Classes of com.datasalt.pangool.tuplemr.mapred.lib.input.HCatTupleInputFormat

  • com.datasalt.pangool.examples.HCatalogIntegrationTest
  • com.datasalt.pangool.io.Schema
  • com.datasalt.pangool.io.Tuple
  • com.splout.db.hadoop.TableBuilder
  • org.apache.hcatalog.data.HCatRecord
  • org.apache.hcatalog.mapreduce.HCatInputFormat
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.