Examples of NepheleJobGraphGenerator

eu.stratosphere.compiler.plantranslate.NepheleJobGraphGenerator
This component translates the optimizer's resulting plan a nephele job graph. The translation is a one to one mapping. All decisions are made by the optimizer, this class simply creates nephele data structures and descriptions corresponding to the optimizer's result.
The basic method of operation is a top down traversal over the plan graph. On the way down, tasks are created for the plan nodes, on the way back up, the nodes connect their predecessor.
org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator
This component translates the optimizer's resulting plan a nephele job graph. The translation is a one to one mapping. All decisions are made by the optimizer, this class simply creates nephele data structures and descriptions corresponding to the optimizer's result.
The basic method of operation is a top down traversal over the plan graph. On the way down, tasks are created for the plan nodes, on the way back up, the nodes connect their predecessor.

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    setSourceStatistics(centersSource, 1024*1024, 32f);
    
    OptimizedPlan plan = compileWithStats(p);
    checkPlan(plan);
    
    new NepheleJobGraphGenerator().compileJobGraph(plan);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    Plan p = kmi.getPlan(String.valueOf(DEFAULT_PARALLELISM), IN_FILE, IN_FILE, OUT_FILE, String.valueOf(20));
    
    OptimizedPlan plan = compileNoStats(p);
    checkPlan(plan);
    
    new NepheleJobGraphGenerator().compileJobGraph(plan);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    // optimize and compile plan 
    PactCompiler pc = new PactCompiler(new DataStatistics());
    OptimizedPlan op = pc.compile(plan);
    
    // return job graph of failing job
    NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
    return jgg.compileJobGraph(op);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    // optimize and compile plan
    PactCompiler pc = new PactCompiler(new DataStatistics());
    OptimizedPlan op = pc.compile(plan);


    // return job graph of working job
    NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
    return jgg.compileJobGraph(op);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    plan.setDefaultParallelism(DOP);


    PactCompiler pc = new PactCompiler(new DataStatistics());
    OptimizedPlan op = pc.compile(plan);


    NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
    return jgg.compileJobGraph(op);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

  }


  private JobGraph getJobGraph(final Plan plan) throws Exception {
    final PactCompiler pc = new PactCompiler(new DataStatistics());
    final OptimizedPlan op = pc.compile(plan);
    final NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
    return jgg.compileJobGraph(op);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    Plan plan = new Plan(output);


    PactCompiler pc = new PactCompiler(new DataStatistics());
    OptimizedPlan op = pc.compile(plan);


    NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
    return jgg.compileJobGraph(op);


  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    ShipStrategyType ss2 = deltaMapper.getOutgoingChannels().get(0).getShipStrategy();
    
    assertTrue( (ss1 == ShipStrategyType.FORWARD && ss2 == ShipStrategyType.PARTITION_HASH) ||
          (ss2 == ShipStrategyType.FORWARD && ss1 == ShipStrategyType.PARTITION_HASH) );
    
    new NepheleJobGraphGenerator().compileJobGraph(oPlan);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    // verify solution delta
    assertEquals(2, joinWithSolutionSetNode.getOutgoingChannels().size());
    assertEquals(ShipStrategyType.PARTITION_HASH, joinWithSolutionSetNode.getOutgoingChannels().get(0).getShipStrategy());
    assertEquals(ShipStrategyType.PARTITION_HASH, joinWithSolutionSetNode.getOutgoingChannels().get(1).getShipStrategy());
    
    new NepheleJobGraphGenerator().compileJobGraph(oPlan);
  }

View Full Code Here

Examples of org.apache.flink.compiler.plantranslate.NepheleJobGraphGenerator

    
    // verify solution delta
    assertEquals(1, joinWithSolutionSetNode.getOutgoingChannels().size());
    assertEquals(ShipStrategyType.FORWARD, joinWithSolutionSetNode.getOutgoingChannels().get(0).getShipStrategy());
    
    new NepheleJobGraphGenerator().compileJobGraph(oPlan);
  }

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.