Examples of cascading.tuple.hadoop.util.BytesComparator

cascading.tuple.hadoop.util.BytesComparator
Class BytesComparator is used to compare arrays of bytes.
Note that BytesComparator implements {@link Hasher}, but for the Hasher interface to be applied during grouping, sorting or joining, it must be set on a {@link cascading.tuple.Fields} instance via{@link cascading.tuple.Fields#setComparator(Comparable,java.util.Comparator)}.

    }


  @Override
  public Comparator<byte[]> getComparator( Class<byte[]> type )
    {
    return new BytesComparator();
    }

View Full Code Here

    pipe = new Each( pipe, new Fields( "line" ), new RegexParser( new Fields( "ip" ), "^[^ ]*" ), new Fields( "ip" ) );


    pipe = new Each( pipe, new InsertRawBytes( new Fields( "bytes" ), "inserted text as bytes", true, true ), Fields.ALL );


    Fields bytes = new Fields( "bytes" );
    bytes.setComparator( "bytes", new BytesComparator() );
    pipe = new GroupBy( pipe, bytes );


    pipe = new Every( pipe, new Count(), new Fields( "bytes", "count" ) );


    Tap sink = new Hfs( new SequenceFile( Fields.ALL ), getOutputPath( "grouponbytes" ), SinkMode.REPLACE );

View Full Code Here


    // test sorting comparison
    Fields valueFields = new Fields( "value" );


    if( !useDefaultComparator )
      valueFields.setComparator( "value", new BytesComparator() );


    if( secondarySortOnValue )
      splice = new GroupBy( splice, groupFields, valueFields );
    else
      splice = new GroupBy( splice, groupFields );

View Full Code Here

TOP

Related Classes of cascading.tuple.hadoop.util.BytesComparator

cascading.tuple.hadoop.BytesSerialization

cascading.tuple.hadoop.SerializedPipesPlatformTest

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.