Examples of cascading.pipe.assembly.MinBy

cascading.pipe.assembly.MinBy

Class MinBy is used to find the minimum value in a grouping.

Typically finding the min value of a field in a tuple stream relies on a {@link cascading.pipe.GroupBy} and a{@link cascading.operation.aggregator.MinValue} {@link cascading.operation.Aggregator} operation.

This SubAssembly also uses the {@link cascading.pipe.assembly.MinBy.MinPartials} {@link cascading.pipe.assembly.AggregateBy.Functor}to track the minimum value before the GroupBy operator to reduce IO over the network.

This strategy is similar to using {@code combiners}, except no sorting or serialization is invoked and results in a much simpler mechanism.

The {@code threshold} value tells the underlying MinPartials functions how many unique key sums to accumulatein the LRU cache, before emitting the least recently used entry.

By default, either the value of {@link #AGGREGATE_BY_THRESHOLD} System property or {@link AggregateBy#DEFAULT_THRESHOLD}will be used. @see cascading.pipe.assembly.AggregateBy

      if( aggregationName.equals( "COUNT" ) )
        aggregates.add( new CountBy( current, groupFields, argFields, aggResultFields, CountBy.Include.NO_NULLS ) );
      else if( aggregationName.equals( "SUM" ) )
        aggregates.add( new SumBy( current, groupFields, argFields, aggResultFields ) );
      else if( aggregationName.equals( "MIN" ) )
        aggregates.add( new MinBy( current, groupFields, argFields, aggResultFields ) );
      else if( aggregationName.equals( "MAX" ) )
        aggregates.add( new MaxBy( current, groupFields, argFields, aggResultFields ) );
      else if( aggregationName.equals( "AVG" ) )
        aggregates.add( new AverageBy( current, groupFields, argFields, aggResultFields, AverageBy.Include.NO_NULLS ) );
      else

      if( aggregationName.equals( "COUNT" ) )
        aggregates.add( new CountBy( argFields, aggResultFields, CountBy.Include.NO_NULLS ) );
      else if( aggregationName.equals( "SUM" ) )
        aggregates.add( new SumBy( argFields, aggResultFields ) );
      else if( aggregationName.equals( "MIN" ) )
        aggregates.add( new MinBy( argFields, aggResultFields ) );
      else if( aggregationName.equals( "MAX" ) )
        aggregates.add( new MaxBy( argFields, aggResultFields ) );
      else if( aggregationName.equals( "AVG" ) )
        aggregates.add( new AverageBy( argFields, aggResultFields, AverageBy.Include.NO_NULLS ) );
      else

Examples of cascading.pipe.assembly.MinBy

Related Classes of cascading.pipe.assembly.MinBy