Package org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer

Examples of org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.SecondaryKeyOptimizerTez

356
357
358
359
360
361
362
363
364
365
366
367
        // Run optimizer to make use of secondary sort key when possible for nested foreach
        // order by and distinct. Should be done before AccumulatorOptimizer
        boolean noSecKeySort = conf.getBoolean(PigConfiguration.PIG_EXEC_NO_SECONDARY_KEY, false);
        if (!pc.inIllustrator && !noSecKeySort)  {
            SecondaryKeyOptimizerTez skOptimizer = new SecondaryKeyOptimizerTez(tezPlan);
            skOptimizer.visit();
        }

        boolean isMultiQuery = conf.getBoolean(PigConfiguration.OPT_MULTIQUERY, true);
        if (isMultiQuery) {
            // reduces the number of TezOpers in the Tez plan generated
View Full Code Here
56
57
58
59
60
61
62
63
64
65
                            "false"));
            CombinerOptimizer co = new CombinerOptimizer(tezPlan, doMapAgg);
            co.visit();
        }

        SecondaryKeyOptimizerTez skOptimizer = new SecondaryKeyOptimizerTez(
                tezPlan);
        skOptimizer.visit();
        return skOptimizer;
    }
View Full Code Here
TOP

Related Classes of org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.SecondaryKeyOptimizerTez

  • org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan
  • org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez
  • org.apache.pig.backend.hadoop.executionengine.tez.plan.TezEdgeDescriptor
  • org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator
  • org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher
  • org.apache.pig.backend.hadoop.executionengine.util.SecondaryKeyOptimizerUtil.SecondaryKeyOptimizerInfo
  • org.apache.pig.tez.TestSecondarySortTez
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.