Examples of org.apache.tez.dag.api.Edge

org.apache.tez.dag.api.Edge
Edge defines the connection between a producer and consumer vertex in the DAG. @link {@link EdgeProperty} defines the relationship between them. The producervertex provides input to the edge and the consumer vertex reads output from the edge.

          CustomPartitionVertex.class.getName());
      desc.setUserPayload(userPayload);
      w.setVertexManagerPlugin(desc);
    }


    return new Edge(v, w, createEdgeProperty(edgeProp));
  }

View Full Code Here

          CustomPartitionVertex.class.getName());
      desc.setUserPayload(userPayload);
      w.setVertexManagerPlugin(desc);
    }


    return new Edge(v, w, createEdgeProperty(edgeProp));
  }

View Full Code Here


    DAG dag = new DAG("OrderedWordCount" + dagIndex);
    for (int i = 0; i < vertices.size(); ++i) {
      dag.addVertex(vertices.get(i));
      if (i != 0) {
        dag.addEdge(new Edge(vertices.get(i-1),
            vertices.get(i), new EdgeProperty(
                DataMovementType.SCATTER_GATHER, DataSourceType.PERSISTED,
                SchedulingType.SEQUENTIAL,
                new OutputDescriptor(
                    OnFileSortedOutput.class.getName()),

View Full Code Here


    dag.addVertex(stage1Vertex);
    dag.addVertex(stage2Vertex);
    dag.addVertex(stage3Vertex);


    Edge edge1 = new Edge(stage1Vertex, stage2Vertex, new EdgeProperty(
        DataMovementType.SCATTER_GATHER, DataSourceType.PERSISTED,
        SchedulingType.SEQUENTIAL, new OutputDescriptor(
        OnFileSortedOutput.class.getName()), new InputDescriptor(
                ShuffledMergedInputLegacy.class.getName())));
    Edge edge2 = new Edge(stage2Vertex, stage3Vertex, new EdgeProperty(
        DataMovementType.SCATTER_GATHER, DataSourceType.PERSISTED,
        SchedulingType.SEQUENTIAL, new OutputDescriptor(
        OnFileSortedOutput.class.getName()), new InputDescriptor(
                ShuffledMergedInputLegacy.class.getName())));

View Full Code Here

0 1 2 3 4

TOP

Related Classes of org.apache.tez.dag.api.Edge

org.apache.hadoop.hive.ql.exec.tez.DagUtils

org.apache.hadoop.hive.ql.exec.tez.TestTezTask

org.apache.hadoop.hive.ql.exec.tez.TezTask

org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder

org.apache.tez.examples.JoinExample

org.apache.tez.examples.JoinValidate

org.apache.tez.mapreduce.client.YARNRunner

org.apache.tez.mapreduce.examples.FilterLinesByWord

org.apache.tez.mapreduce.examples.FilterLinesByWordOneToOne

org.apache.tez.mapreduce.examples.MRRSleepJob

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.