Examples of OptimizedPlan

eu.stratosphere.compiler.plan.OptimizedPlan
The optimizer representation of a plan. The optimizer creates this from the user defined PACT job plan. It works on this representation during its optimization. Finally, this plan is translated to a schedule for the nephele runtime system.
org.apache.flink.compiler.plan.OptimizedPlan
The optimizer representation of a plan. The optimizer creates this from the user defined PACT job plan. It works on this representation during its optimization. Finally, this plan is translated to a schedule for the nephele runtime system.

Examples of eu.stratosphere.compiler.plan.OptimizedPlan

              }
            }
          }
        }
      }
      return new OptimizedPlan(this.sources, this.sinks, this.allNodes, jobName, originalPlan);
    }

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

      
      DataSet<Tuple2<Long, Long>> iterEnd = iteration.getWorkset().map(new TestMapper<Tuple2<Long,Long>>());
      iteration.closeWith(iterEnd, iterEnd).print();
      
      Plan p = env.createProgramPlan();
      OptimizedPlan op = compileNoStats(p);
      
      WorksetIterationPlanNode wipn = (WorksetIterationPlanNode) op.getDataSinks().iterator().next().getInput().getSource();
      assertTrue(wipn.getSolutionSetPlanNode().getOutgoingChannels().isEmpty());
      
      NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
      jgg.compileJobGraph(op);
    }

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

  public void testRightSide() {
    try {
      
      Plan plan = getTestPlanRightStatic(PactCompiler.HINT_LOCAL_STRATEGY_HASH_BUILD_SECOND);
      
      OptimizedPlan oPlan = compileNoStats(plan);
  
      OptimizerPlanNodeResolver resolver = getOptimizerPlanNodeResolver(oPlan);
      DualInputPlanNode innerJoin = resolver.getNode("DummyJoiner");
      
      // verify correct join strategy

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

  public void testRightSideCountercheck() {
    try {
      
      Plan plan = getTestPlanRightStatic(PactCompiler.HINT_LOCAL_STRATEGY_HASH_BUILD_FIRST);
      
      OptimizedPlan oPlan = compileNoStats(plan);
  
      OptimizerPlanNodeResolver resolver = getOptimizerPlanNodeResolver(oPlan);
      DualInputPlanNode innerJoin = resolver.getNode("DummyJoiner");
      
      // verify correct join strategy

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

  public void testLeftSide() {
    try {
      
      Plan plan = getTestPlanLeftStatic(PactCompiler.HINT_LOCAL_STRATEGY_HASH_BUILD_FIRST);
      
      OptimizedPlan oPlan = compileNoStats(plan);
  
      OptimizerPlanNodeResolver resolver = getOptimizerPlanNodeResolver(oPlan);
      DualInputPlanNode innerJoin = resolver.getNode("DummyJoiner");
      
      // verify correct join strategy

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

  public void testLeftSideCountercheck() {
    try {
      
      Plan plan = getTestPlanLeftStatic(PactCompiler.HINT_LOCAL_STRATEGY_HASH_BUILD_SECOND);
      
      OptimizedPlan oPlan = compileNoStats(plan);
  
      OptimizerPlanNodeResolver resolver = getOptimizerPlanNodeResolver(oPlan);
      DualInputPlanNode innerJoin = resolver.getNode("DummyJoiner");
      
      // verify correct join strategy

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

          this.setSourceStatistics(s, 100, 100);
        }
      }
      
      
      OptimizedPlan oPlan = compileNoStats(plan);
  
      OptimizerPlanNodeResolver resolver = getOptimizerPlanNodeResolver(oPlan);
      DualInputPlanNode innerJoin = resolver.getNode("DummyJoiner");
      
      // verify correct join strategy

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan


  @Override
  public String getExecutionPlan() throws Exception {
    Plan p = createProgramPlan("unnamed job");
    
    OptimizedPlan op = this.client.getOptimizedPlan(p, getDegreeOfParallelism());
    
    PlanJSONDumpGenerator gen = new PlanJSONDumpGenerator();
    return gen.getOptimizerPlanAsJSON(op);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

    FileDataSink sink = new FileDataSink(new DummyOutputFormat(), OUT_FILE, globalRed);
    
    // return the plan
    Plan plan = new Plan(sink, "Union Property Propagation");
    
    OptimizedPlan oPlan = compileNoStats(plan);
    
    NepheleJobGraphGenerator jobGen = new NepheleJobGraphGenerator();
    
    // Compile plan to verify that no error is thrown
    jobGen.compileJobGraph(oPlan);
    
    oPlan.accept(new Visitor<PlanNode>() {
      
      @Override
      public boolean preVisit(PlanNode visitable) {
        if (visitable instanceof SingleInputPlanNode && visitable.getPactContract() instanceof ReduceOperator) {
          for (Channel inConn : visitable.getInputs()) {

View Full Code Here

Examples of org.apache.flink.compiler.plan.OptimizedPlan

    DataSet<Tuple2<String, Integer>> result = lastUnion.groupBy(0).aggregate(Aggregations.SUM, 1);
    result.writeAsText(OUT_FILE);
  
    // return the plan
    Plan plan = env.createProgramPlan("Test union on new java-api");
    OptimizedPlan oPlan = compileNoStats(plan);
    NepheleJobGraphGenerator jobGen = new NepheleJobGraphGenerator();
    
    // Compile plan to verify that no error is thrown
    jobGen.compileJobGraph(oPlan);
    
    oPlan.accept(new Visitor<PlanNode>() {
      
      @Override
      public boolean preVisit(PlanNode visitable) {
        
        /* Test on the union output connections

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.