Examples of com.hazelcast.mapreduce.JobTracker

com.hazelcast.mapreduce.JobTracker
The JobTracker interface is used to create instances of {@link Job}s depending on the given data structure / data source.

The underlying created instance of the {@link Job} depends on whether it is used for a{@link com.hazelcast.client.HazelcastClient} or a {@link com.hazelcast.core.Hazelcast} member node.

The default usage is same for both cases and looks similar to the following example:
```
 HazelcastInstance hz = getHazelcastInstance(); IMap map = hz.getMap( getMapName() ); JobTracker tracker = hz.getJobTracker( "default" ); Job job = tracker.newJob( KeyValueSource.fromMap( map ) ); 
```
The created instance of JobTracker is fully threadsafe and can be used concurrently and multiple times.
Caution: Do not use the JobTracker with data structures of other {@link com.hazelcast.core.HazelcastInstance}instances than the one used for creation of the JobTracker. Unexpected results may happen!
@since 3.2

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 10000; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.onKeys(50).mapper(new TestMapper()).submit(new GroupingTestCollator());


        int result = future.get();


        assertEquals(50, result);

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 10000; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.keyPredicate(new TestKeyPredicate()).mapper(new TestMapper())
                .submit(new GroupingTestCollator());


        int result = future.get();

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.mapper(new GroupingTestMapper()).reducer(new TestReducerFactory())
                .submit(new TestCollator());


        int result = future.get();

View Full Code Here


        final Map<String, List<Integer>> listenerResults = new HashMap<String, List<Integer>>();
        final Semaphore semaphore = new Semaphore(1);
        semaphore.acquire();


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, List<Integer>>> future = job.mapper(new TestMapper()).submit();


        future.andThen(new ExecutionCallback<Map<String, List<Integer>>>() {
            @Override
            public void onResponse(Map<String, List<Integer>> response) {

View Full Code Here


        final Map<String, List<Integer>> listenerResults = new HashMap<String, List<Integer>>();
        final Semaphore semaphore = new Semaphore(1);
        semaphore.acquire();


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, List<Integer>>> future = job.onKeys(50).mapper(new TestMapper()).submit();


        future.andThen(new ExecutionCallback<Map<String, List<Integer>>>() {
            @Override
            public void onResponse(Map<String, List<Integer>> response) {

View Full Code Here


        final Map<String, Integer> listenerResults = new HashMap<String, Integer>();
        final Semaphore semaphore = new Semaphore(1);
        semaphore.acquire();


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, Integer>> future = job.mapper(new GroupingTestMapper()).reducer(new TestReducerFactory())
                .submit();


        future.andThen(new ExecutionCallback<Map<String, Integer>>() {
            @Override

View Full Code Here


        final int[] result = new int[1];
        final Semaphore semaphore = new Semaphore(1);
        semaphore.acquire();


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.mapper(new GroupingTestMapper())//
                .submit(new GroupingTestCollator());


        future.andThen(new ExecutionCallback<Integer>() {
            @Override

View Full Code Here


        final int[] result = new int[1];
        final Semaphore semaphore = new Semaphore(1);
        semaphore.acquire();


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.mapper(new GroupingTestMapper()).reducer(new TestReducerFactory())
                .submit(new TestCollator());


        future.andThen(new ExecutionCallback<Integer>() {
            @Override

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, Integer>> future = job.mapper(new GroupingTestMapper()).combiner(new TestCombinerFactory())
                                                             .reducer(new TestReducerFactory()).submit();


        Map<String, Integer> result = future.get();

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.mapper(new GroupingTestMapper()).combiner(new TestCombinerFactory())
                                                .reducer(new TestReducerFactory()).submit(new TestCollator());


        int result = future.get();

View Full Code Here

0 1 2

TOP

Related Classes of com.hazelcast.mapreduce.JobTracker

com.hazelcast.client.mapreduce.ClientMapReduceTest

com.hazelcast.client.mapreduce.DistributedMapperClientMapReduceTest

com.hazelcast.client.proxy.ClientMapProxy

com.hazelcast.client.proxy.ClientMultiMapProxy

com.hazelcast.map.impl.proxy.MapProxyImpl

com.hazelcast.map.proxy.MapProxyImpl

com.hazelcast.mapreduce.impl.MapReduceService

com.hazelcast.multimap.impl.ObjectMultiMapProxy

com.hazelcast.multimap.ObjectMultiMapProxy

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.