Examples of cascading.pipe.joiner.InnerJoin$JoinIterator

cascading.pipe.joiner.InnerJoin
Class InnerJoin will return an {@link Iterator} that will iterate over a given {@link Joiner} and return tuples that representand inner join of the CoGrouper internal grouped tuple collections.
Joins perform based on the equality of the join keys. In the case of null values, Java treats two null values as equivalent. SQL does not treat null values as equal. To produce SQL like results in a given join, a new {@link java.util.Comparator} will need to be used on the joined values to prevent null fromequaling null. As a convenience, see the {@link cascading.util.NullNotEquivalentComparator} class.

    Tap sink = getPlatform().getTextFile( new Fields( "line" ), getOutputPath( "cross" ), SinkMode.REPLACE );


    Pipe pipeLower = new Each( "lhs", new Fields( "line" ), new RegexSplitter( new Fields( "numLHS", "charLHS" ), " " ) );
    Pipe pipeUpper = new Each( "rhs", new Fields( "line" ), new RegexSplitter( new Fields( "numRHS", "charRHS" ), " " ) );


    Pipe cross = new HashJoin( pipeLower, new Fields( "numLHS" ), pipeUpper, new Fields( "numRHS" ), new InnerJoin() );


    Flow flow = getPlatform().getFlowConnector().connect( sources, sink, cross );


    flow.complete();

View Full Code Here

    results.add( new Tuple( "4", "d1", "4", "D1" ) );
    results.add( new Tuple( "4", "d2", "4", "D1" ) );
    results.add( new Tuple( "4", "d3", "4", "D1" ) );
    results.add( new Tuple( null, "h1", null, "H1" ) );


    handleJoins( "joininner", new InnerJoin(), results );
    }

View Full Code Here


    pipeUpper1 = new Each( pipeUpper1, new Identity() );
    pipeUpper1 = new Each( pipeUpper1, new Identity() );
    pipeUpper1 = new Each( pipeUpper1, new Identity() );


    Pipe splice1 = new CoGroup( "group", Pipe.pipes( pipeLower1, pipeLower2, pipeUpper1 ), Fields.fields( new Fields( "num" ), new Fields( "num" ), new Fields( "num" ) ), new Fields( "num1", "char1", "num2", "char2", "num3", "char3" ), new InnerJoin() );


    Pipe output1 = new Each( splice1, AssertionLevel.VALID, new AssertNotNull() );
    output1 = new Each( output1, new Identity() );
    output1 = new Pipe( "output1", output1 );

View Full Code Here


    Pipe left = new Each( new Pipe( "left" ), new Fields( "line" ), new RegexFilter( ".*46.*" ) );
    Pipe right = new Each( new Pipe( "right" ), new Fields( "line" ), new RegexFilter( ".*192.*" ) );


    Fields[] fields = Fields.fields( new Fields( "offset" ), new Fields( "offset" ) );
    Pipe merge = new HashJoin( "join", Pipe.pipes( left, right ), fields, Fields.size( 4 ), new InnerJoin() );


    merge = new Every( merge, new MaxValue() );


    Map sources = new HashMap();
    sources.put( "left", source1 );

View Full Code Here

                          Joiner joinerInput,
                          CoGroupOrder coGroupOrder,
                          Mode mode) {
    Pipe lhs, rhs;
    Fields lhsFields, rhsFields;
    Joiner joiner = new InnerJoin();


    if (coGroupOrder == CoGroupOrder.LARGE_LHS) {
      lhs = filtered;
      lhsFields = largeJoinFields;
      rhs = keysOrig;

View Full Code Here

    String name = stack.getNameFor( groupFields.isNone() ? HashJoin.class : CoGroup.class, pipes );


    Pipe join;


    if( groupFields.isNone() ) // not grouping, just appending tuples into a single row
      join = new HashJoin( name, pipes, groupFieldsArray, declaredFields, new InnerJoin() );
    else
      join = new CoGroup( name, pipes, groupFieldsArray, declaredFields, new InnerJoin() );


    join = new Retain( join, outgoingNamedFields );


    join = stack.addDebug( this, join );

View Full Code Here

  private Joiner getJoiner()
    {
    switch( getJoinType() )
      {
      case INNER:
        return new InnerJoin();
      case LEFT:
        return new LeftJoin();
      case RIGHT:
        return new RightJoin();
      case FULL:

View Full Code Here

0 1

TOP

Related Classes of cascading.pipe.joiner.InnerJoin$JoinIterator

cascading.CoGroupFieldedPipesPlatformTest

cascading.flow.hadoop.BuildJobsHadoopPlatformTest

cascading.JoinFieldedPipesPlatformTest

cascading.lingual.optiq.CascadingAggregateRel

cascading.lingual.optiq.CascadingJoinRel

cascading.pipe.Splice

cascading.tuple.Tuple

cascading.TypedFieldedPipesPlatformTest

com.liveramp.cascading_ext.assembly.BloomAssembly

copa.Main

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.