Examples of com.hazelcast.mapreduce.impl.operation.KeysAssignmentOperation

Package com.hazelcast.mapreduce.impl.operation

Examples of com.hazelcast.mapreduce.impl.operation.KeysAssignmentOperation

com.hazelcast.mapreduce.impl.operation.KeysAssignmentOperation
This operation is used to request assignment for keys on the job owners node. The job owner is the only node capable of assigning those reducing nodes to be aware of the number of reducers per partition and also aware of possible topology changes while executing the job.

        try {
            MapReduceService mapReduceService = supervisor.getMapReduceService();
            String name = supervisor.getConfiguration().getName();
            String jobId = supervisor.getConfiguration().getJobId();
            KeysAssignmentResult assignmentResult = mapReduceService
                    .processRequest(supervisor.getJobOwner(), new KeysAssignmentOperation(name, jobId, keys), name);


            if (assignmentResult.getResultState() == SUCCESSFUL) {
                Map<Object, Address> assignment = assignmentResult.getAssignment();
                for (Map.Entry<Object, Address> entry : assignment.entrySet()) {
                    // Cache the keys for later mappings

View Full Code Here

            }
        };
        constructors[KEYS_ASSIGNMENT_OPERATION] = new ConstructorFunction<Integer, IdentifiedDataSerializable>() {
            @Override
            public IdentifiedDataSerializable createNew(Integer arg) {
                return new KeysAssignmentOperation();
            }
        };
        constructors[POSTPONE_PARTITION_PROCESSING_OPERATION] = new ConstructorFunction<Integer, IdentifiedDataSerializable>() {
            @Override
            public IdentifiedDataSerializable createNew(Integer arg) {

View Full Code Here

        try {
            MapReduceService mapReduceService = supervisor.getMapReduceService();
            String name = supervisor.getConfiguration().getName();
            String jobId = supervisor.getConfiguration().getJobId();
            KeysAssignmentResult assignmentResult = mapReduceService
                    .processRequest(supervisor.getJobOwner(), new KeysAssignmentOperation(name, jobId, keys), name);


            if (assignmentResult.getResultState() == SUCCESSFUL) {
                Map<Object, Address> assignment = assignmentResult.getAssignment();
                for (Map.Entry<Object, Address> entry : assignment.entrySet()) {
                    // Cache the keys for later mappings

View Full Code Here

            }
        };
        constructors[KEYS_ASSIGNMENT_OPERATION] = new ConstructorFunction<Integer, IdentifiedDataSerializable>() {
            @Override
            public IdentifiedDataSerializable createNew(Integer arg) {
                return new KeysAssignmentOperation();
            }
        };
        constructors[POSTPONE_PARTITION_PROCESSING_OPERATION] = new ConstructorFunction<Integer, IdentifiedDataSerializable>() {
            @Override
            public IdentifiedDataSerializable createNew(Integer arg) {

View Full Code Here

TOP

Related Classes of com.hazelcast.mapreduce.impl.operation.KeysAssignmentOperation

com.hazelcast.mapreduce.impl.MapReduceDataSerializerHook

com.hazelcast.mapreduce.impl.MapReduceService

com.hazelcast.mapreduce.impl.MapReduceUtil

com.hazelcast.mapreduce.impl.task.JobSupervisor

com.hazelcast.mapreduce.TopologyChangedStrategy

com.hazelcast.nio.Address

com.hazelcast.mapreduce.TopologyChangedException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.