Examples of io.crate.executor.transport.distributed.DistributedRequestContextManager

Package io.crate.executor.transport.distributed

Examples of io.crate.executor.transport.distributed.DistributedRequestContextManager

io.crate.executor.transport.distributed.DistributedRequestContextManager
this class handles the contexts for each {@link io.crate.executor.transport.task.DistributedMergeTask}there is a possible race condition that the {@link io.crate.executor.transport.merge.TransportMergeNodeAction} receives results from a collectorbefore the MergeTasks.start() method initialized the context. in case of this race condition the rows that are sent from the collector cannot be de-serialized immediately so they are placed into a memoryStream and later read. this class is also responsible for this lazy-de-serialization. the merge itself is done inside {@link DownstreamOperationContext}

        requestSender.writeTo(streamOutput);
        // -- end sender




        // receiver
        DistributedRequestContextManager contextManager =
                new DistributedRequestContextManager(new DummyDownstreamOperationFactory(rows), functions,
                        new StatsTables(ImmutableSettings.EMPTY, mock(NodeSettingsService.class)));
        BytesStreamInput streamInput = new BytesStreamInput(streamOutput.bytes());
        DistributedResultRequest requestReceiver = new DistributedResultRequest(contextManager);
        requestReceiver.readFrom(streamInput);


        assertFalse(requestReceiver.rowsRead());
        assertNotNull(requestReceiver.memoryStream());
        assertTrue(requestReceiver.memoryStream().size() > 0);




        contextManager.addToContext(requestReceiver);
        final SettableFuture<Object[][]> result = SettableFuture.create();


        contextManager.createContext(dummyMergeNode, new ActionListener<NodeMergeResponse>() {
            @Override
            public void onResponse(NodeMergeResponse nodeMergeResponse) {
                result.set(nodeMergeResponse.rows());
            }

View Full Code Here

        final ImplementationSymbolVisitor implementationSymbolVisitor = new ImplementationSymbolVisitor(
                referenceResolver, functions, RowGranularity.DOC
        );


        planNodeStreamerVisitor = new PlanNodeStreamerVisitor(functions);
        this.contextManager = new DistributedRequestContextManager(new DownstreamOperationFactory<MergeNode>() {
            @Override
            public DownstreamOperation create(MergeNode node) {
                return new MergeOperation(
                        clusterService,
                        settings,

View Full Code Here

        topNProjection.outputs(Arrays.<Symbol>asList(
                new InputColumn(0, DataTypes.INTEGER),
                new InputColumn(1, DataTypes.INTEGER)));
        dummyMergeNode.projections(Arrays.<Projection>asList(topNProjection));


        DistributedRequestContextManager contextManager =
                new DistributedRequestContextManager(new DummyDownstreamOperationFactory(rows), functions,
                        new StatsTables(ImmutableSettings.EMPTY, mock(NodeSettingsService.class)));


        contextManager.createContext(dummyMergeNode, new NoopActionListener());


        Streamer<?>[] streamers = new Streamer[2];
        streamers[0] = DataTypes.INTEGER.streamer();
        streamers[1] = DataTypes.STRING.streamer();

View Full Code Here

TOP

Related Classes of io.crate.executor.transport.distributed.DistributedRequestContextManager

io.crate.executor.transport.merge.DistributedResultRequestTest

io.crate.executor.transport.merge.NodeMergeResponse

io.crate.executor.transport.merge.TransportMergeNodeAction

io.crate.planner.node.PlanNodeStreamerVisitor

org.elasticsearch.common.io.stream.BytesStreamInput

org.elasticsearch.common.io.stream.HandlesStreamInput

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.