Examples of cascading.operation.text.DateParser

cascading.operation.text.DateParser
Class DateParser is used to convert a text date string to a timestamp, the number of milliseconds since January 1, 1970, 00:00:00 GMT, using the {@link SimpleDateFormat} syntax.
If given, individual {@link Calendar} fields can be stored in unique fields for a given {@link TimeZone} and {@link Locale}.

    // create an assembly to parse out the time field into a timestamp
    // then count the number of requests per second and per minute


    // apply a text parser to create a timestamp with 'second' granularity
    // declares field "ts"
    DateParser dateParser = new DateParser( new Fields( "ts" ), "dd/MMM/yyyy:HH:mm:ss Z" );
    Pipe tsPipe = new Each( "arrival rate", new Fields( "time" ), dateParser, Fields.RESULTS );


    // name the per second assembly and split on tsPipe
    Pipe tsCountPipe = new Pipe( "tsCount", tsPipe );
    tsCountPipe = new GroupBy( tsCountPipe, new Fields( "ts" ) );

View Full Code Here


    lhsPipe = new Each( lhsPipe, new Fields( "date" ), AssertionLevel.STRICT, new AssertExpression( "date instanceof Long", Object.class ) );


    Pipe rhsPipe = new Pipe( "rhs" );


    rhsPipe = new Each( rhsPipe, new Fields( "date" ), new DateParser( new Fields( "date", Long.class ), TestConstants.APACHE_DATE_FORMAT ), Fields.REPLACE );
    rhsPipe = new Each( rhsPipe, new Fields( "date" ), AssertionLevel.STRICT, new AssertExpression( "date instanceof Long", Object.class ) );


    Fields declared = lhsFields.append( Fields.mask( rhsFields, lhsFields ) );


    Pipe pipe = new CoGroup( lhsPipe, new Fields( "date" ), rhsPipe, new Fields( "date" ), declared );

View Full Code Here

    pipe = new Each( pipe, new Fields( "line" ), apacheCommonParser );


    pipe = new Each( pipe, new Insert( new Fields( "col" ), 1 ), Fields.ALL );


    // DateParser.APACHE declares: "ts"
    pipe = new Each( pipe, new Fields( "time" ), new DateParser( "dd/MMM/yyyy:HH:mm:ss Z" ), new Fields( "col", "status", "ts", "event", "ip", "size" ) );


    pipe = new GroupBy( pipe, new Fields( "col" ), new Fields( "does-not-exist" ) );


    pipe = new Each( pipe, new Identity() ); // let's force the stack to be exercised

View Full Code Here

TOP

Related Classes of cascading.operation.text.DateParser

cascading.SortedValuesPlatformTest

cascading.tuple.Fields

cascading.tuple.Tuple

cascading.TypedFieldedPipesPlatformTest

loganalysis.Main

cascading.operation.OperationException

java.util.Date

java.util.Calendar

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.