Examples of com.hazelcast.mapreduce.JobTracker

com.hazelcast.mapreduce.JobTracker
The JobTracker interface is used to create instances of {@link Job}s depending on the given data structure / data source.

The underlying created instance of the {@link Job} depends on whether it is used for a{@link com.hazelcast.client.HazelcastClient} or a {@link com.hazelcast.core.Hazelcast} member node.

The default usage is same for both cases and looks similar to the following example:
```
 HazelcastInstance hz = getHazelcastInstance(); IMap map = hz.getMap( getMapName() ); JobTracker tracker = hz.getJobTracker( "default" ); Job job = tracker.newJob( KeyValueSource.fromMap( map ) ); 
```
The created instance of JobTracker is fully threadsafe and can be used concurrently and multiple times.
Caution: Do not use the JobTracker with data structures of other {@link com.hazelcast.core.HazelcastInstance}instances than the one used for creation of the JobTracker. Unexpected results may happen!
@since 3.2

        return ConcurrencyUtil.getOrPutSynchronized(jobTrackers, objectName, jobTrackers, constructor);
    }


    @Override
    public void destroyDistributedObject(String objectName) {
        JobTracker jobTracker = jobTrackers.remove(objectName);
        if (jobTracker != null) {
            jobTracker.destroy();
        }
    }

View Full Code Here

    public <SuppliedValue, Result> Result aggregate(Supplier<K, V, SuppliedValue> supplier,
                                                    Aggregation<K, SuppliedValue, Result> aggregation) {




        HazelcastInstance hazelcastInstance = getNodeEngine().getHazelcastInstance();
        JobTracker jobTracker = hazelcastInstance.getJobTracker("hz::aggregation-multimap-" + getName());
        return aggregate(supplier, aggregation, jobTracker);
    }

View Full Code Here

    @Override
    public <SuppliedValue, Result> Result aggregate(Supplier<K, V, SuppliedValue> supplier,
                                                    Aggregation<K, SuppliedValue, Result> aggregation) {


        HazelcastInstance hazelcastInstance = getNodeEngine().getHazelcastInstance();
        JobTracker jobTracker = hazelcastInstance.getJobTracker("hz::aggregation-map-" + getName());
        return aggregate(supplier, aggregation, jobTracker);
    }

View Full Code Here

    public <SuppliedValue, Result> Result aggregate(Supplier<K, V, SuppliedValue> supplier,
                                                    Aggregation<K, SuppliedValue, Result> aggregation) {




        HazelcastInstance hazelcastInstance = getNodeEngine().getHazelcastInstance();
        JobTracker jobTracker = hazelcastInstance.getJobTracker("hz::aggregation-multimap-" + getName());
        return aggregate(supplier, aggregation, jobTracker);
    }

View Full Code Here

    @Override
    public <SuppliedValue, Result> Result aggregate(Supplier<K, V, SuppliedValue> supplier,
                                                    Aggregation<K, SuppliedValue, Result> aggregation) {


        HazelcastInstance hazelcastInstance = getNodeEngine().getHazelcastInstance();
        JobTracker jobTracker = hazelcastInstance.getJobTracker("hz::aggregation-map-" + getName());
        return aggregate(supplier, aggregation, jobTracker);
    }

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, List<Integer>>> future = job.mapper(new ExceptionThrowingMapper()).submit();


        try {
            Map<String, List<Integer>> result = future.get();
            fail();

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, List<Integer>>> future = job.mapper(new TimeConsumingMapper()).submit();


        future.cancel(true);


        try {

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, List<Integer>>> future = job.mapper(new TestMapper()).submit();


        Map<String, List<Integer>> result = future.get();


        assertEquals(100, result.size());

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Map<String, Integer>> future = job.mapper(new GroupingTestMapper()).reducer(new TestReducerFactory())
                .submit();


        Map<String, Integer> result = future.get();

View Full Code Here

        IMap<Integer, Integer> m1 = client.getMap(MAP_NAME);
        for (int i = 0; i < 100; i++) {
            m1.put(i, i);
        }


        JobTracker tracker = client.getJobTracker("default");
        Job<Integer, Integer> job = tracker.newJob(KeyValueSource.fromMap(m1));
        ICompletableFuture<Integer> future = job.mapper(new GroupingTestMapper()).submit(new GroupingTestCollator());


        int result = future.get();


        // Precalculate result

View Full Code Here

0 1 2

TOP

Related Classes of com.hazelcast.mapreduce.JobTracker

com.hazelcast.client.mapreduce.ClientMapReduceTest

com.hazelcast.client.mapreduce.DistributedMapperClientMapReduceTest

com.hazelcast.client.proxy.ClientMapProxy

com.hazelcast.client.proxy.ClientMultiMapProxy

com.hazelcast.map.impl.proxy.MapProxyImpl

com.hazelcast.map.proxy.MapProxyImpl

com.hazelcast.mapreduce.impl.MapReduceService

com.hazelcast.multimap.impl.ObjectMultiMapProxy

com.hazelcast.multimap.ObjectMultiMapProxy

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.