Examples of org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POCounter

Package org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Examples of org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POCounter

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POCounter
This operator is part of the RANK operator implementation. It adds a local counter and a unique task id to each tuple. There are 2 modes of operations: regular and dense. The local counter is depends on the mode of operation. With regular rank is considered duplicate rows while assigning numbers to distinct values groups. With dense rank counts the number of distinct values, without considering duplicate rows. Depending on if it is considered. the entire tuple (row number) or a by a set of columns (rank by). This Physical Operator relies on some specific MR class, available at PigMapReduceCounter.

        POCounter counter = getCounterOperation();
        return (counter != null)?counter.isRowNumber():false;
    }


    public String getOperationID() {
        POCounter counter = getCounterOperation();
        return (counter != null)?counter.getOperationID():null;
    }

View Full Code Here

0 1

TOP

Related Classes of org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POCounter

org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceOper

org.apache.pig.backend.hadoop.executionengine.physicalLayer.Result

org.apache.pig.data.Tuple

org.apache.pig.newplan.logical.relational.LogToPhyTranslationVisitor

org.apache.pig.pen.util.ExampleTuple

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.