Examples of com.splout.db.hadoop.engine.SQLite4JavaOutputFormat

com.splout.db.hadoop.engine.SQLite4JavaOutputFormat

An OutputFormat that accepts Pangool's Tuples and writes to a sqlite4Java SQLite file. The Tuples that are written to it must conform to a particular schema: having a "_partition" integer field (which will then create a file named "partition".db).

The different schemas that will be given to this OutputFormat are defined in the constructor by providing a {@link TableSpec}. These TableSpec also contains information such as pre-SQL or post-SQL statements but most notably contain a Schema so that a CREATE TABLE can be derived automatically from it. Note that the Schema provided to TableSpec doesn't need to contain a "_partition" field or be nullable.

    }
    
    MapOnlyJobBuilder job = new MapOnlyJobBuilder(conf);
    TableSpec tableSpec = new TableSpec(schema, schema.getFields().get(1));
    
    job.setOutput(new Path(out, "store"), new SploutSQLProxyOutputFormat(new SQLite4JavaOutputFormat(1000000, tableSpec)), ITuple.class,
        NullWritable.class);
    job.addInput(input, new HadoopInputFormat(TextInputFormat.class), new MapOnlyMapper<LongWritable, Text, ITuple, NullWritable>() {


      ITuple metaTuple = new Tuple(schema);

Examples of com.splout.db.hadoop.engine.SQLite4JavaOutputFormat

Related Classes of com.splout.db.hadoop.engine.SQLite4JavaOutputFormat