Examples of cascading.flow.hadoop.planner.rule.assertion.DualStreamedAccumulatedMergePipelineAssert

Package cascading.flow.hadoop.planner.rule.assertion

Examples of cascading.flow.hadoop.planner.rule.assertion.DualStreamedAccumulatedMergePipelineAssert

cascading.flow.hadoop.planner.rule.assertion.DualStreamedAccumulatedMergePipelineAssert
Throws a planner failure if a Tap, both accumulating and streamed, flows into a single merge within a given pipeline.
The optimization is to remove the streamed edge between tap and merge, but GraphFinder needs to support marking edges.


    // PostPipelines
    addRule( new RemoveMalformedHashJoinPipelineTransformer() );


    // remove when GraphFinder supports captured edges
    addRule( new DualStreamedAccumulatedMergePipelineAssert() );


    // enable when GraphFinder supports captured edges
//    addRule( new RemoveStreamedBranchTransformer() );


    }

View Full Code Here

TOP

Related Classes of cascading.flow.hadoop.planner.rule.assertion.DualStreamedAccumulatedMergePipelineAssert

cascading.flow.hadoop.planner.MapReduceHadoopRuleRegistry

cascading.flow.hadoop.planner.rule.expression.DualStreamedAccumulatedExpression

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.