Examples of eu.stratosphere.compiler.PactCompiler$GraphCreatingVisitor

eu.stratosphere.compiler.PactCompiler
This utility class performs the translation from the user specified program to the optimizer plan. It works as a visitor that walks the user's job in a depth-first fashion. During the descend, it creates an optimizer node for each operator, respectively data source or -sink. During the ascend, it connects the nodes to the full graph.
This translator relies on the setInputs method in the nodes. As that method implements the size estimation and the awareness for optimizer hints, the sizes will be properly estimated and the translated plan already respects all optimizer hints.

    if (port < 0) {
      throw new CompilerException("Cannot find port to job manager's RPC service in the global configuration.");
    }


    final InetSocketAddress jobManagerAddress = new InetSocketAddress(address, port);
    this.compiler = new PactCompiler(new DataStatistics(), new DefaultCostEstimator(), jobManagerAddress);
    
    //  Disable Local Execution when using a Client
    ContextEnvironment.disableLocalExecution();
  }

View Full Code Here

        // we use the existing session
        shutDownAtEnd = false;
      }


      try {
        PactCompiler pc = new PactCompiler(new DataStatistics());
        OptimizedPlan op = pc.compile(plan);
        
        NepheleJobGraphGenerator jgg = new NepheleJobGraphGenerator();
        JobGraph jobGraph = jgg.compileJobGraph(op);
        
        JobClient jobClient = this.nephele.getJobClient(jobGraph);

View Full Code Here

        // we use the existing session
        shutDownAtEnd = false;
      }


      try {
        PactCompiler pc = new PactCompiler(new DataStatistics());
        OptimizedPlan op = pc.compile(plan);
        PlanJSONDumpGenerator gen = new PlanJSONDumpGenerator();
    
        return gen.getOptimizerPlanAsJSON(op);
      }
      finally {

View Full Code Here

   */
  public static String optimizerPlanAsJSON(Plan plan) throws Exception {
    LocalExecutor exec = new LocalExecutor();
    try {
      exec.start();
      PactCompiler pc = new PactCompiler(new DataStatistics());
      OptimizedPlan op = pc.compile(plan);
      PlanJSONDumpGenerator gen = new PlanJSONDumpGenerator();


      return gen.getOptimizerPlanAsJSON(op);
    } finally {
      exec.stop();

View Full Code Here

0 1

TOP

Related Classes of eu.stratosphere.compiler.PactCompiler$GraphCreatingVisitor

eu.stratosphere.client.LocalExecutor

eu.stratosphere.client.program.Client

eu.stratosphere.compiler.costs.DefaultCostEstimator

eu.stratosphere.compiler.dag.BinaryUnionNode

eu.stratosphere.compiler.dag.BulkIterationNode

eu.stratosphere.compiler.dag.BulkPartialSolutionNode

eu.stratosphere.compiler.dag.CoGroupNode

eu.stratosphere.compiler.dag.CollectorMapNode

eu.stratosphere.compiler.dag.CrossNode

eu.stratosphere.compiler.dag.DataSinkNode

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.