Examples of org.apache.hadoop.mapred.SimulatorTaskTracker

org.apache.hadoop.mapred.SimulatorTaskTracker
This class simulates a {@link TaskTracker}. Its main purpose is to call heartbeat() of the simulated Job Tracker with apropriately updated statuses of the tasks assigned to it. The events emitted and consumed are HeartbeatEvent and TaskAttemptCompletionEvent . Internal naming convention: accept() dispatches simulation events to process*Event() methods. heartbeat() dispactches task tracker actions to handle*Action() methods.

      long subRandomSeed = RandomSeedGenerator.getSeed(
         "forTaskTracker" + numTaskTrackers, masterRandomSeed);
      jobConf.setLong("mumak.tasktracker.random.seed", subRandomSeed);
      numTaskTrackers++;
      port++;
      SimulatorTaskTracker tt = new SimulatorTaskTracker(jt, jobConf);
      long firstHeartbeat = now + random.nextInt(startDuration);
      queue.addAll(tt.init(firstHeartbeat));
    }
    
    // In startDuration + heartbeat interval of the full cluster time each 
    // TT is started up and told on its 2nd heartbeat to beat at a rate 
    // corresponding to the steady state of the cluster

View Full Code Here

      long subRandomSeed = RandomSeedGenerator.getSeed(
         "forTaskTracker" + numTaskTrackers, masterRandomSeed);
      jobConf.setLong("mumak.tasktracker.random.seed", subRandomSeed);
      numTaskTrackers++;
      port++;
      SimulatorTaskTracker tt = new SimulatorTaskTracker(jt, jobConf);
      long firstHeartbeat = now + random.nextInt(startDuration);
      queue.addAll(tt.init(firstHeartbeat));
    }
    
    // In startDuration + heartbeat interval of the full cluster time each 
    // TT is started up and told on its 2nd heartbeat to beat at a rate 
    // corresponding to the steady state of the cluster

View Full Code Here

      RackNode rackNode = node.getRackNode();
      StaticMapping.addNodeToRack(hostname, rackNode.getName());
      String taskTrackerName = "tracker_" + hostname + ":localhost/127.0.0.1:"
          + port;
      port++;
      SimulatorTaskTracker tt = new SimulatorTaskTracker(jt, taskTrackerName,
          hostname, node.getMapSlots(), node.getReduceSlots());
      queue.addAll(tt.init(ms++));
    }
  }

View Full Code Here

TOP

Related Classes of org.apache.hadoop.mapred.SimulatorTaskTracker

org.apache.hadoop.mapred.SimulatorEngine

org.apache.hadoop.mapred.TaskStatus.Phase

org.apache.hadoop.mapred.TaskStatus.State

org.apache.hadoop.mapreduce.TaskAttemptID

java.util.Random

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.