Examples of GenericDataSink

eu.stratosphere.api.java.record.operators.GenericDataSink
Operator for nodes that act as data sinks, storing the data they receive. The way the data is stored is handled by the {@link OutputFormat}.
org.apache.flink.api.java.record.operators.GenericDataSink
s.apache.org/jira/browse/FLINK-1106">FLINK-1106 for more details. Operator for nodes that act as data sinks, storing the data they receive. The way the data is stored is handled by the {@link OutputFormat}.

Examples of eu.stratosphere.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(DelayingMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Long Cancelling Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(4);
    
    runAndCancelJob(p, 10 * 1000, 20 * 1000);

View Full Code Here

Examples of eu.stratosphere.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(LongCancelTimeMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Long Cancelling Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(4);
    
    runAndCancelJob(p, 10 * 1000, 10 * 1000);

View Full Code Here

Examples of eu.stratosphere.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(new SimpleMatcher(), IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(64);
    
    runAndCancelJob(p, 3000, 20*1000);

View Full Code Here

Examples of eu.stratosphere.api.java.record.operators.GenericDataSink

        .input(source).name("le mapper").build();
    
    ReduceOperator reducer = ReduceOperator.builder(new ConcatenatingReducer(), IntValue.class, 1)
        .input(mapper).name("le reducer").build();
    
    GenericDataSink sink = new GenericDataSink(PrintingOutputFormat.class, reducer);
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(4);
    
    LocalExecutor.execute(p);

View Full Code Here

Examples of org.apache.flink.api.java.record.operators.GenericDataSink

            "org.apache.derby.jdbc.EmbeddedDriver",
            "jdbc:derby:memory:ebookshop",
            "select * from books"),
        "Data Source");


    GenericDataSink sink = new GenericDataSink(new JDBCOutputFormat(), "Data Output");
    JDBCOutputFormat.configureOutputFormat(sink)
        .setDriver("org.apache.derby.jdbc.EmbeddedDriver")
        .setUrl("jdbc:derby:memory:ebookshop")
        .setQuery("insert into newbooks (id,title,author,price,qty) values (?,?,?,?,?)")
        .setClass(IntValue.class)
        .setClass(StringValue.class)
        .setClass(StringValue.class)
        .setClass(FloatValue.class)
        .setClass(IntValue.class);


    sink.addInput(source);
    return new Plan(sink, "JDBC Example Job");
  }

View Full Code Here

Examples of org.apache.flink.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(SimpleMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(DOP);
    
    runAndCancelJob(p, 3000, 10*1000);

View Full Code Here

Examples of org.apache.flink.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(SimpleMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(DOP);
    
    runAndCancelJob(p, 5000, 10*1000);

View Full Code Here

Examples of org.apache.flink.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(StuckInOpenMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Stuc-In-Open Match")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(DOP);
    
    runAndCancelJob(p, 5000);

View Full Code Here

Examples of org.apache.flink.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(SimpleMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Long Cancelling Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(DOP);
    
    runAndCancelJob(p, 30 * 1000, 30 * 1000);

View Full Code Here

Examples of org.apache.flink.api.java.record.operators.GenericDataSink

    JoinOperator matcher = JoinOperator.builder(DelayingMatcher.class, IntValue.class, 0, 0)
      .input1(source1)
      .input2(source2)
      .name("Long Cancelling Sort Join")
      .build();
    GenericDataSink sink = new GenericDataSink(new DiscardingOutputFormat(), matcher, "Sink");
    
    Plan p = new Plan(sink);
    p.setDefaultParallelism(DOP);
    
    runAndCancelJob(p, 10 * 1000, 20 * 1000);

View Full Code Here

0 1 2

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.