Examples of cascading.pipe.assembly.Retain

cascading.pipe.assembly.Retain
Class Retain is a {@link SubAssembly} that will discard all incoming fields except those given on the constructor.
Use this pipe to narrow a stream of tuples, removing unused data. @see Discard

    Map<String, Tap> sources = new HashMap<String, Tap>();
    sources.put("s1", source1);
    sources.put("s2", source2);


    Pipe s1 = new Pipe("s1");
    s1 = new Retain(s1, new Fields("key", "num"));


    Pipe s2 = new Pipe("s2");
    s2 = new Retain(s2, new Fields("key", "num1", "num2"));


    Pipe results = new MultiGroupBy(s1, new Fields("key"), s2, new Fields("key"),
        new Fields("key-rename"), new CustomBuffer(new Fields("result")));


    CascadingUtil.get().getFlowConnector().connect(sources, sink, results).complete();

View Full Code Here

    if( groupFields.isNone() ) // not grouping, just appending tuples into a single row
      join = new HashJoin( name, pipes, groupFieldsArray, declaredFields, new InnerJoin() );
    else
      join = new CoGroup( name, pipes, groupFieldsArray, declaredFields, new InnerJoin() );


    join = new Retain( join, outgoingNamedFields );


    join = stack.addDebug( this, join );


    return new Branch( join, branch );
    }

View Full Code Here


      Fields aggResultFields = makeFieldsFor( aggCall );


      Pipe current = previous;


      current = new Retain( current, uniqueFields );
      current = new Unique( aggResultFields.toString(), current, uniqueFields, Unique.Include.NO_NULLS );


      current = stack.addDebug( this, current );


      if( aggregationName.equals( "COUNT" ) )

View Full Code Here

    }


  private static Pipe addRetain( RelOptCluster cluster, RexProgram program, Pipe pipe )
    {
    Fields resultFields = createTypedFields( cluster, program.getOutputRowType(), false );
    return new Retain( pipe, resultFields );
    }

View Full Code Here

0 1

TOP

Related Classes of cascading.pipe.assembly.Retain

cascading.flow.iso.graph.HashJoinMergeIntoHashJoinStreamedStreamedMergeGraph

cascading.lingual.optiq.CalcProjectUtil

cascading.lingual.optiq.CascadingAggregateRel

cascading.MergePipesPlatformTest

cascading.operation.Identity

cascading.pattern.pmml.PMMLPlanner

cascading.pipe.Each

com.liveramp.cascading_ext.assembly.MultiGroupBy

com.liveramp.cascading_ext.assembly.TestMultiGroupBy

com.liveramp.cascading_ext.combiner.MultiCombiner

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.