Examples of JobTracker

com.hazelcast.mapreduce.JobTracker
The JobTracker interface is used to create instances of {@link Job}s depending on the given data structure / data source.

The underlying created instance of the {@link Job} depends on whether it is used for a{@link com.hazelcast.client.HazelcastClient} or a {@link com.hazelcast.core.Hazelcast} member node.

The default usage is same for both cases and looks similar to the following example:
```
 HazelcastInstance hz = getHazelcastInstance(); IMap map = hz.getMap( getMapName() ); JobTracker tracker = hz.getJobTracker( "default" ); Job job = tracker.newJob( KeyValueSource.fromMap( map ) ); 
```
The created instance of JobTracker is fully threadsafe and can be used concurrently and multiple times.
Caution: Do not use the JobTracker with data structures of other {@link com.hazelcast.core.HazelcastInstance}instances than the one used for creation of the JobTracker. Unexpected results may happen!
@since 3.2
org.apache.hadoop.mapred.JobTracker
JobTracker is the central location for submitting and tracking MR jobs in a network environment.
org.rssowl.ui.internal.util.JobTracker
The JobTracker guarantees that at anytime only the most recent ITask is executed. @author bpasero

Examples of org.apache.hadoop.mapred.JobTracker

    }


    @Override
    public void shutdown() throws IOException {
      MiniMRCluster.JobTrackerRunner runner = mr.getJobTrackerRunner();
      JobTracker tracker = runner.getJobTracker();
      if (tracker != null) {
        for (JobInProgress running : tracker.getRunningJobs()) {
          try {
            running.kill();
          } catch (Exception e) {
            // ignore
          }

View Full Code Here

Examples of org.apache.hadoop.mapred.JobTracker

        return myJob;
      }
    });


    // Make the job go into RUNNING state by forceful initialization.
    JobTracker jt = mr.getJobTrackerRunner().getJobTracker();
    JobInProgress jip =
        jt.getJob(org.apache.hadoop.mapred.JobID.downgrade(job.getJobID()));
    jt.initJob(jip);


    return job;
  }

View Full Code Here

Examples of org.apache.hadoop.mapred.JobTracker


            NameNode.format(conf);
            final String[] emptyArgs = {};
            NameNode.createNameNode(emptyArgs, conf);
            DataNode.createDataNode(emptyArgs, conf);
            final JobTracker jobTracker = JobTracker.startTracker(new JobConf(conf));
            new Thread(new Runnable() {
                @Override
                public void run() {
                    try {
                        jobTracker.offerService();
                    } catch (Exception e) {
                        throw new RuntimeException(e);
                    }
                }
            }).start();

View Full Code Here

Examples of org.apache.hadoop.mapred.JobTracker

        for (Enumeration e = properties.keys(); e.hasMoreElements();) {
            Object key = e.nextElement();
            Object val = properties.get(key);
            conf.set( key.toString(), val.toString() );
        }
        JobTracker jobTracker = JobTracker.startTracker(conf);
        jobTracker.offerService();
        return jobTracker;
    }

View Full Code Here

Examples of org.apache.hadoop.mapred.JobTracker

     */
    private static Thread getJobTrackerThread() {
        Thread jobTrackerThread = new Thread(new Runnable() {


            public void run() {
                JobTracker jobTracker = null;


                while (true) {
                    try {
                        jobTracker = JobTracker.startTracker(new CassandraJobConf());
                        logger.info("Hadoop Job Tracker Started...");
                        jobTrackerStarted.countDown();
                        jobTracker.offerService();


                    } catch (Throwable t) {
                        if (t instanceof InterruptedException) {
                            try {
                                jobTracker.stopTracker();
                                logger.info("Job Tracker shutdown property");
                            } catch (Exception e) {
                                logger.error("An Error occured when stopping Job tracker");
                            }
                        }


                        // on OOM shut down the tracker
                        if (t instanceof OutOfMemoryError || t.getCause() instanceof OutOfMemoryError) {
                            try {
                                jobTracker.stopTracker();
                            } catch (IOException e) {


                            }
                            logger.warn("Error starting job tracker", t);
                            break;

View Full Code Here

Examples of org.rssowl.ui.internal.util.JobTracker

   */
  public FilterBar(FeedView feedView, Composite parent) {
    fFeedView = feedView;
    fParent = parent;
    fLayoutVertical = feedView.fInitialLayoutVertical;
    fQuickSearchTracker = new JobTracker(500, false, true, ITask.Priority.SHORT);
    fGlobalPreferences = Owl.getPreferenceService().getGlobalScope();
    fMaximized = fGlobalPreferences.getBoolean(DefaultPreferences.FV_BROWSER_MAXIMIZED);
    createControl();
  }

View Full Code Here

Examples of org.rssowl.ui.internal.util.JobTracker

   */
  public FilterBar(FeedView feedView, Composite parent) {
    fFeedView = feedView;
    fParent = parent;
    fLayoutVertical = feedView.fInitialLayoutVertical;
    fQuickSearchTracker = new JobTracker(500, false, true, ITask.Priority.SHORT);
    fGlobalPreferences = Owl.getPreferenceService().getGlobalScope();
    fMaximized = fGlobalPreferences.getBoolean(DefaultPreferences.FV_BROWSER_MAXIMIZED);
    createControl();
  }

View Full Code Here

Examples of org.rssowl.ui.internal.util.JobTracker

   * @param parent
   */
  public FilterBar(FeedView feedView, Composite parent) {
    fFeedView = feedView;
    fParent = parent;
    fQuickSearchTracker = new JobTracker(500, false, true, ITask.Priority.SHORT);
    fGlobalPreferences = Owl.getPreferenceService().getGlobalScope();
    fMaximized = fGlobalPreferences.getBoolean(DefaultPreferences.FV_BROWSER_MAXIMIZED);
    createControl();
  }

View Full Code Here

Examples of org.rssowl.ui.internal.util.JobTracker

   * @param parent
   */
  public FilterBar(FeedView feedView, Composite parent) {
    fFeedView = feedView;
    fParent = parent;
    fQuickSearchTracker = new JobTracker(500, false, true, ITask.Priority.SHORT);
    fGlobalPreferences = Owl.getPreferenceService().getGlobalScope();


    createControl();
  }

View Full Code Here

0 1 2 3

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.