Examples of cascading.pipe.Merge

cascading.pipe.Merge
The Merge Pipe allows for multiple branches, with the same fields to be spliced back into a single stream.
The behavior is similar to the {@link GroupBy} merging features, but Merge does not perform any grouping orsorting on keys. Thus, when using a MapReduce platform, no Reducer is required.
Merge is non-blocking and performs no processing. Any number of branches and merges may be performed in a {@link cascading.flow.Flow} without triggering any additional MapReduce jobs on the Hadoop platform.
Unlike {@link HashJoin}, no preference need be made for left-hand or right-hand sided-ness of streams in relation to their sizes. @see GroupBy


    Pipe splice = new HashJoin( pipeLower, new Fields( "num1" ), pipeOffset, new Fields( "num2" ) );


    splice = new Retain( splice, new Fields( "num1", "char1" ) );


    splice = new Merge( "merge1", splice, pipeUpper );


    splice = new HashJoin( splice, new Fields( "num1" ), pipeOffset, new Fields( "num2" ) );


    splice = new Retain( splice, new Fields( "num1", "char1" ) );


    splice = new Merge( "merge2", splice, pipeUpper );


    splice = new HashJoin( splice, new Fields( "num1" ), pipeOffset, new Fields( "num2" ) );


    splice = new Pipe( "sink", splice );

View Full Code Here

0 1 2

TOP

Related Classes of cascading.pipe.Merge

cascading.FieldedPipesPlatformTest

cascading.flow.iso.graph.HashJoinMergeIntoHashJoinStreamedStreamedMergeGraph

cascading.flow.iso.graph.HashJoinsIntoMerge

cascading.flow.iso.graph.MulitStepFlowGraph

cascading.JoinFieldedPipesPlatformTest

cascading.MergePipesPlatformTest

cascading.pipe.assembly.AssemblyHelpersPlatformTest

cascading.TraceTest

cascading.TypedFieldedPipesPlatformTest

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.