Examples of CsvOutputFormat

eu.stratosphere.api.java.record.io.CsvOutputFormat
This is an OutputFormat to serialize {@link Record}s to text. The output is structured by record delimiters and field delimiters as common in CSV files. Record delimiter separate records from each other ('\n' is common). Field delimiters separate fields within a record. Record and field delimiters can be configured using the CsvOutputFormat {@link Configuration}. The number of fields to serialize must be configured as well. For each field the type of the {@link Value} must be specified using the{@link CsvOutputFormat#FIELD_TYPE_PARAMETER_PREFIX} config key and an indexrunning from 0 to the number of fields. The position within the {@link Record} can be configured for each field usingthe {@link CsvOutputFormat#RECORD_POSITION_PARAMETER_PREFIX} config key.Either all {@link Record} positions must be configured or none. If none isconfigured, the index of the config key is used. @see Value @see Configuration @see Record
org.apache.flink.api.java.record.io.CsvOutputFormat
This is an OutputFormat to serialize {@link Record}s to text. The output is structured by record delimiters and field delimiters as common in CSV files. Record delimiter separate records from each other ('\n' is common). Field delimiters separate fields within a record. Record and field delimiters can be configured using the CsvOutputFormat {@link Configuration}. The number of fields to serialize must be configured as well. For each field the type of the {@link Value} must be specified using the{@link CsvOutputFormat#FIELD_TYPE_PARAMETER_PREFIX} config key and an indexrunning from 0 to the number of fields. The position within the {@link Record} can be configured for each field usingthe {@link CsvOutputFormat#RECORD_POSITION_PARAMETER_PREFIX} config key.Either all {@link Record} positions must be configured or none. If none isconfigured, the index of the config key is used. @see Value @see Configuration @see Record
org.geoserver.wfs.response.CSVOutputFormat
fc-editor.org/rfc/rfc4180.txt @author Justin Deoliveira, OpenGeo, jdeolive@opengeo.org @author Sebastian Benthall, OpenGeo, seb@opengeo.org @author Andrea Aime, OpenGeo

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

    
    iteration.setNextWorkset(updateComponentId);
    iteration.setSolutionSetDelta(updateComponentId);


    // create DataSinkContract for writing the new cluster positions
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, iteration, "Result");
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(LongValue.class, 0)
      .field(LongValue.class, 1);

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

    String output    = (args.length > 1 ? args[1] : "");


    GenericDataSource<TableInputFormat> source = new GenericDataSource<TableInputFormat>(new MyTableInputFormat(), "HBase Input");
    source.setParameter(TableInputFormat.INPUT_TABLE, "twitter");
    source.setParameter(TableInputFormat.CONFIG_LOCATION, "/etc/hbase/conf/hbase-site.xml");
    FileDataSink out = new FileDataSink(new CsvOutputFormat(), output, source, "HBase String dump");
    CsvOutputFormat.configureRecordFormat(out)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(StringValue.class, 0)
      .field(StringValue.class, 1)

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

      .build();
    ReduceOperator reducer = ReduceOperator.builder(CountWords.class, StringValue.class, 0)
      .input(mapper)
      .name("Count Words")
      .build();
    FileDataSink out = new FileDataSink(new CsvOutputFormat(), output, reducer, "Word Counts");
    CsvOutputFormat.configureRecordFormat(out)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(StringValue.class, 0)
      .field(IntValue.class, 1);

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

      .input2(filterVisits)
      .name("Antijoin DocsVisits")
      .build();


    // Create DataSinkContract for writing the result of the OLAP query
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, antiJoinVisits, "Result");
    result.setDegreeOfParallelism(numSubTasks);
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter('|')
      .lenient(true)

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

        .build();
    
    iteration.setNextPartialSolution(sumReduce);


    @SuppressWarnings("unchecked")
    FileDataSink finalResult = new FileDataSink(new CsvOutputFormat("\n",  " ", StringValue.class), output, iteration, "Output");


    Plan plan = new Plan(finalResult, "Iteration with AllReducer (keyless Reducer)");
    plan.setDefaultParallelism(numSubTasks);
    return plan;
  }

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

    
    iteration.setNextWorkset(minAndUpdate);
    iteration.setSolutionSetDelta(minAndUpdate);


    // create DataSinkContract for writing the new cluster positions
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, iteration, "Result");
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(LongValue.class, 0)
      .field(LongValue.class, 1);

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

      .name("AggCo")
      .build();
    aggCO.setDegreeOfParallelism(numSubtasks);


    // create DataSinkContract for writing the result
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, "Output");
    result.setDegreeOfParallelism(numSubtasks);
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter('|')
      .field(IntValue.class, 0)

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

    }
    
    iteration.setNextWorkset(updateComponentId);


    // sink is the iteration result
    FileDataSink result = new FileDataSink(new CsvOutputFormat("\n", " ", LongValue.class, LongValue.class), output, iteration, "Result");


    // return the PACT plan
    Plan plan = new Plan(result, "Workset Connected Components");
    plan.setDefaultParallelism(numSubTasks);
    return plan;

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

    
    iteration.setNextWorkset(updateComponentId);
    iteration.setSolutionSetDelta(updateComponentId);


    // sink is the iteration result
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, iteration, "Result");
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(LongValue.class, 0)
      .field(LongValue.class, 1);

View Full Code Here

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

    CollectionDataSource source2 = new CollectionDataSource(tmp, "test_collection");


    JoinOperator join = JoinOperator.builder(Join.class, IntValue.class, 0, 0)
      .input1(source).input2(source2).build();


    FileDataSink out = new FileDataSink(new CsvOutputFormat(), output, join, "Collection Join");
    CsvOutputFormat.configureRecordFormat(out)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(StringValue.class, 0)
      .field(IntValue.class, 1);

View Full Code Here

0 1 2 3 4

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.