List of routeDataMovementEventToDestination() Examples

Examples of routeDataMovementEventToDestination()

org.apache.tez.dag.api.EdgeManager.routeDataMovementEventToDestination()
Return the routing information to inform consumers about the source task output that is now available. The return Map has the routing information. Key is the destination task physical input index and the value is the list of destination task indices for which the key input index will receive the data movement event. @param event Data movement event @param sourceTaskIndex Source task @param numDestinationTasks Total number of destination tasks @param inputIndicesToTaskIndices Map via which the routing information is returned
org.apache.tez.dag.api.EdgeManagerPlugin.routeDataMovementEventToDestination()
Return the routing information to inform consumers about the source task output that is now available. The return map has the routing information. The event will be routed to every destination task index in the key of the map. Every physical input in the value for that task key will receive the input. @param event Data movement event that contains the output information @param sourceTaskIndex Source task that produced the event @param sourceOutputIndex Index of the physical output on the source task that produced the event @param destinationTaskAndInputIndices Map via which the routing information is returned

Examples of org.apache.tez.dag.api.EdgeManager.routeDataMovementEventToDestination()

    Assert.assertEquals(2, newEdgeManagers.size());
    
    EdgeManager edgeManager = newEdgeManagers.values().iterator().next();
    Map<Integer, List<Integer>> targets = Maps.newHashMap();
    DataMovementEvent dmEvent = new DataMovementEvent(1, new byte[0]);
    edgeManager.routeDataMovementEventToDestination(dmEvent, 1, 2, targets);
    Assert.assertEquals(1, targets.size());
    Map.Entry<Integer, List<Integer>> e = targets.entrySet().iterator().next();
    Assert.assertEquals(3, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(0, e.getValue().get(0).intValue());

View Full Code Here

Examples of org.apache.tez.dag.api.EdgeManager.routeDataMovementEventToDestination()

    Assert.assertEquals(3, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(0, e.getValue().get(0).intValue());
    targets.clear();
    dmEvent = new DataMovementEvent(2, new byte[0]);
    edgeManager.routeDataMovementEventToDestination(dmEvent, 0, 2, targets);
    Assert.assertEquals(1, targets.size());
    e = targets.entrySet().iterator().next();
    Assert.assertEquals(0, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(1, e.getValue().get(0).intValue());

View Full Code Here

Examples of org.apache.tez.dag.api.EdgeManager.routeDataMovementEventToDestination()

    Assert.assertEquals(2, newEdgeManagers.size());
    
    EdgeManager edgeManager = newEdgeManagers.values().iterator().next();
    Map<Integer, List<Integer>> targets = Maps.newHashMap();
    DataMovementEvent dmEvent = new DataMovementEvent(1, new byte[0]);
    edgeManager.routeDataMovementEventToDestination(dmEvent, 1, 2, targets);
    Assert.assertEquals(1, targets.size());
    Map.Entry<Integer, List<Integer>> e = targets.entrySet().iterator().next();
    Assert.assertEquals(3, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(0, e.getValue().get(0).intValue());

View Full Code Here

Examples of org.apache.tez.dag.api.EdgeManager.routeDataMovementEventToDestination()

    Assert.assertEquals(3, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(0, e.getValue().get(0).intValue());
    targets.clear();
    dmEvent = new DataMovementEvent(2, new byte[0]);
    edgeManager.routeDataMovementEventToDestination(dmEvent, 0, 2, targets);
    Assert.assertEquals(1, targets.size());
    e = targets.entrySet().iterator().next();
    Assert.assertEquals(0, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(1, e.getValue().get(0).intValue());

View Full Code Here

Examples of org.apache.tez.dag.api.EdgeManagerPlugin.routeDataMovementEventToDestination()

    DataMovementEvent dmEvent = DataMovementEvent.create(1, ByteBuffer.wrap(new byte[0]));
    // 4 source task outputs - same as original number of partitions
    Assert.assertEquals(4, edgeManager.getNumSourceTaskPhysicalOutputs(0));
    // 4 destination task inputs - 2 source tasks + 2 merged partitions
    Assert.assertEquals(4, edgeManager.getNumDestinationTaskPhysicalInputs(0));
    edgeManager.routeDataMovementEventToDestination(dmEvent, 1, dmEvent.getSourceIndex(), targets);
    Assert.assertEquals(1, targets.size());
    Map.Entry<Integer, List<Integer>> e = targets.entrySet().iterator().next();
    Assert.assertEquals(0, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(3, e.getValue().get(0).intValue());

View Full Code Here

Examples of org.apache.tez.dag.api.EdgeManagerPlugin.routeDataMovementEventToDestination()

    Assert.assertEquals(0, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(3, e.getValue().get(0).intValue());
    targets.clear();
    dmEvent = DataMovementEvent.create(2, ByteBuffer.wrap(new byte[0]));
    edgeManager.routeDataMovementEventToDestination(dmEvent, 0, dmEvent.getSourceIndex(), targets);
    Assert.assertEquals(1, targets.size());
    e = targets.entrySet().iterator().next();
    Assert.assertEquals(1, e.getKey().intValue());
    Assert.assertEquals(1, e.getValue().size());
    Assert.assertEquals(0, e.getValue().get(0).intValue());

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.