Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

Package org.apache.pig.piggybank.evaluation.util.apachelogparser

Examples of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor
DateExtractor has four different constructors which each allow for different functionality. The incomingDateFormat ("dd/MMM/yyyy:HH:mm:ss Z" by default) is used to match the date string that gets passed in from the log. The outgoingDateFormat ("yyyy-MM-dd" by default) is used to format the returned string. Different constructors exist for each combination; please use the appropriate respective constructor. Note that any data that exists in the SimpleDateFormat schema can be supported. For example, if you were starting with the default incoming format and wanted to extract just the year, you would use the single string constructor DateExtractor("yyyy"). From pig latin you will need to use aliases to use a non-default format, like define MyDateExtractor org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor("yyyy-MM"); A = FOREACH row GENERATE DateExtractor(dayTime); If a string cannot be parsed, null will be returned and an error message printed to stderr. By default, the DateExtractor uses the GMT timezone. You can use the three-parameter constructor to override the timezone.

    private Tuple input=DefaultTupleFactory.getInstance().newTuple(1);
    
  
   @Test
    public void testInstantiation() {
        assertNotNull(new DateExtractor());
    }

View Full Code Here

        assertNotNull(new DateExtractor());
    }


    @Test
    public void testDefaultFormatters() throws Exception {
        DateExtractor dayExtractor = new DateExtractor();
        // test that GMT conversion moves the day
        input.set(0, "20/Sep/2008:23:53:04 -0600");
        assertEquals("2008-09-21", dayExtractor.exec(input));
        
        // test that if the string is already in GMT, nothing moves
        input.set(0, "20/Sep/2008:23:53:04 -0000");
        assertEquals("2008-09-20", dayExtractor.exec(input));
    }

View Full Code Here

        assertEquals("2008-09-20", dayExtractor.exec(input));
    }


    @Test
    public void testMZFormatters() throws Exception {
        DateExtractor extractor = new DateExtractor("dd/MMM/yyyy:HH:mm:ss Z", "yyyy-MM-dd", "PST");
        input.set(0, "20/Sep/2008:23:53:04 -0700");
        assertEquals("2008-09-20", extractor.exec(input));
    }

View Full Code Here

        assertEquals("2008-09-20", extractor.exec(input));
    }
    
    @Test
    public void testFailureThenSuccess() throws Exception {
        DateExtractor dayExtractor = new DateExtractor();
        input.set(0,"dud");
        assertEquals(null, dayExtractor.exec(input));
        input.set(0,"20/Sep/2008:23:53:04 -0000");
        assertEquals("2008-09-20", dayExtractor.exec(input));
    }

View Full Code Here

        assertEquals("2008-09-20", dayExtractor.exec(input));
    }


    @Test
    public void testPassedOutputFormatter() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("MM-dd-yyyy");
        input.set(0,"20/Sep/2008:23:53:04 -0000");
        assertEquals("09-20-2008", dayExtractor.exec(input));
    }

View Full Code Here

        assertEquals("09-20-2008", dayExtractor.exec(input));
    }


    @Test
    public void testPassedInputOutputFormatter() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("dd/MMM/yyyy:HH:mm:ss", "MM~dd~yyyy");
        input.set(0,"20/Sep/2008:23:53:04");
        assertEquals("09~20~2008", dayExtractor.exec(input));
    }

View Full Code Here

        assertEquals("09~20~2008", dayExtractor.exec(input));
    }


    @Test
    public void testPassedOutputInputFormatterYear() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("dd/MMM/yyyy:HH:mm:ss", "yyyy");
        input.set(0,"20/Sep/2008:23:53:04");
        assertEquals("2008", dayExtractor.exec(input));
    }

View Full Code Here

        assertEquals("2008", dayExtractor.exec(input));
    }


    @Test
    public void testPassedOutputFormatterYear() throws Exception {
        DateExtractor dayExtractor = new DateExtractor("yyyy");
        input.set(0, "20/Sep/2008:23:53:04 -0600");
        assertEquals("2008", dayExtractor.exec(input));
    }

View Full Code Here

    private Tuple input=DefaultTupleFactory.getInstance().newTuple(1);
    
  
   @Test
    public void testInstantiation() {
        assertNotNull(new DateExtractor());
    }

View Full Code Here

        assertNotNull(new DateExtractor());
    }


    @Test
    public void testDefaultFormatters() throws Exception {
        DateExtractor dayExtractor = new DateExtractor();
        input.set(0, "20/Sep/2008:23:53:04 -0600");
        assertEquals("2008-09-20", dayExtractor.exec(input));
    }

View Full Code Here

0 1

TOP

Related Classes of org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

org.apache.pig.FuncSpec

org.apache.pig.impl.logicalLayer.schema.Schema

org.apache.pig.piggybank.test.evaluation.util.apachelogparser.TestDateExtractor

java.io.IOException

java.util.TimeZone

java.util.Date

java.text.SimpleDateFormat

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.