Package eu.stratosphere.api.java.record.io

Examples of eu.stratosphere.api.java.record.io.CsvOutputFormat$ConfigBuilder

145
146
147
148
149
150
151
152
153
154
155
      .input(joinLiO, partJoin2, partJoin1)
      .name("AggLio")
      .build();

    // create DataSinkContract for writing the result
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, aggLiO, "Output");
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter('|')
      .lenient(true)
      .field(LongValue.class, 0)
View Full Code Here
138
139
140
141
142
143
144
145
146
147
148
    }
   
    iteration.setNextWorkset(updateComponentId);

    // sink is the iteration result
    FileDataSink result = new FileDataSink(new CsvOutputFormat("\n", " ", LongValue.class, LongValue.class), output, iteration, "Result");

    // return the PACT plan
    Plan plan = new Plan(result, "Workset Connected Components");
    plan.setDefaultParallelism(numSubTasks);
    return plan;
View Full Code Here
148
149
150
151
152
153
154
155
156
157
158
    MapOperator mapper = MapOperator.builder(new TokenizeLine()).input(source).name("Tokenize Lines").build();
   
    ReduceOperator reducer = ReduceOperator.builder(CountWords.class, StringValue.class, 0).input(mapper)
        .name("Count Words").build();
   
    FileDataSink out = new FileDataSink(new CsvOutputFormat(), output, reducer, "Word Counts");
   
    CsvOutputFormat.configureRecordFormat(out).recordDelimiter('\n')
        .fieldDelimiter(' ').field(StringValue.class, 0)
        .field(IntValue.class, 1);
View Full Code Here
TOP

Related Classes of eu.stratosphere.api.java.record.io.CsvOutputFormat$ConfigBuilder

  • com.sun.xml.ws.api.databinding.DatabindingConfig
  • eu.stratosphere.addons.hbase.example.HBaseReadExample
  • eu.stratosphere.hadoopcompatibility.example.WordCount
  • eu.stratosphere.test.accumulators.AccumulatorITCase
  • eu.stratosphere.test.accumulators.AccumulatorIterativeITCase
  • eu.stratosphere.test.broadcastvars.BroadcastVarsNepheleITCase
  • eu.stratosphere.test.compiler.examples.WordCountCompilerTest
  • eu.stratosphere.test.compiler.iterations.ConnectedComponentsTest
  • eu.stratosphere.test.distributedCache.DistributedCacheTest
  • eu.stratosphere.test.iterative.CoGroupConnectedComponentsITCase
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.