Examples of org.apache.tez.dag.api.EdgeManagerPlugin.routeDataMovementEventToDestination()

Class org.apache.tez.dag.api.EdgeManagerPlugin

Examples of org.apache.tez.dag.api.EdgeManagerPlugin.routeDataMovementEventToDestination()

org.apache.tez.dag.api.EdgeManagerPlugin.routeDataMovementEventToDestination()
Return the routing information to inform consumers about the source task output that is now available. The return map has the routing information. The event will be routed to every destination task index in the key of the map. Every physical input in the value for that task key will receive the input. @param event Data movement event that contains the output information @param sourceTaskIndex Source task that produced the event @param sourceOutputIndex Index of the physical output on the source task that produced the event @param destinationTaskAndInputIndices Map via which the routing information is returned

    DataMovementEvent dmEvent = DataMovementEvent.create(1, ByteBuffer.wrap(new byte[0]));
    // 4 source task outputs - same as original number of partitions
    Assert.assertEquals(4, edgeManager.getNumSourceTaskPhysicalOutputs(0));
    // 4 destination task inputs - 2 source tasks + 2 merged partitions
    Assert.assertEquals(4, edgeManager.getNumDestinationTaskPhysicalInputs(0));
    edgeManager.routeDataMovementEventToDestination(dmEvent, 1, dmEvent.getSourceIndex(), targets);
    Assert.assertEquals(1, targets.size());
    Map.Entry<Integer, List<Integer>> e = targets.entrySet().iterator().next();
    Assert.assertEquals(0, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(3, e.getValue().get(0).intValue());

View Full Code Here

    Assert.assertEquals(0, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(3, e.getValue().get(0).intValue());
    targets.clear();
    dmEvent = DataMovementEvent.create(2, ByteBuffer.wrap(new byte[0]));
    edgeManager.routeDataMovementEventToDestination(dmEvent, 0, dmEvent.getSourceIndex(), targets);
    Assert.assertEquals(1, targets.size());
    e = targets.entrySet().iterator().next();
    Assert.assertEquals(1, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(0, e.getValue().get(0).intValue());

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.