Examples of org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.NoopFilterRemover

Package org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer

Examples of org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.NoopFilterRemover

org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.NoopFilterRemover
For historical reasons splits will always produce filters that pass everything through unchanged. This optimizer removes these. The condition we look for is POFilters with a constant boolean (true) expression as it's plan.


    private void optimize(TezOperPlan tezPlan, PigContext pc) throws VisitorException {
        Configuration conf = ConfigurationUtil.toConfiguration(pc.getProperties());
        boolean aggregateWarning = conf.getBoolean("aggregate.warning", false);


        NoopFilterRemover filter = new NoopFilterRemover(tezPlan);
        filter.visit();


        // Run CombinerOptimizer on Tez plan
        boolean nocombiner = conf.getBoolean(PigConfiguration.PROP_NO_COMBINER, false);
        if (!pc.inIllustrator && !nocombiner)  {
            boolean doMapAgg = Boolean.parseBoolean(pc.getProperties().getProperty(

View Full Code Here

TOP

Related Classes of org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.NoopFilterRemover

org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan

org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher

org.apache.pig.impl.plan.VisitorException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.