Examples of com.asakusafw.compiler.flow.ShuffleDescription

com.asakusafw.compiler.flow.ShuffleDescription
シャッフル操作に関する情報。

    private ShuffleDescription extractDescription(
            RendezvousProcessor processor,
            FlowElementInput input) {
        assert processor != null;
        assert input != null;
        ShuffleDescription desc = processor.getShuffleDescription(
                input.getOwner().getDescription(),
                input.getDescription());
        return desc;
    }

View Full Code Here

            FlowElementDescription element,
            FlowElementPortDescription port) {
        FlowElementPortDescription output = element.getOutputPorts().get(Summarize.ID_OUTPUT);
        LinePartProcessor line = new Prologue(port.getDataType(), output.getDataType());
        line.initialize(getEnvironment());
        return new ShuffleDescription(
                output.getDataType(),
                rebuildShuffleKey(output, port),
                line);
    }

View Full Code Here

            }


            List<ShuffleModel.Segment> segmentsInElement = Lists.create();
            LOG.debug("{}は{}を使ってシャッフルの情報を分析します", element, proc);
            for (FlowElementInput input : element.getInputPorts()) {
                ShuffleDescription desc = extractDescription(proc, input);
                ShuffleModel.Segment segment = resolveDescription(
                        elementId,
                        segments.size() + segmentsInElement.size() + 1,
                        input,
                        desc);

View Full Code Here

TOP

Related Classes of com.asakusafw.compiler.flow.ShuffleDescription

com.asakusafw.compiler.flow.processor.SummarizeFlowProcessor

com.asakusafw.compiler.flow.stage.ShuffleAnalyzer

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.