Examples of cascading.pipe.Operator

cascading.pipe.Operator
An Operator is a type of {@link Pipe}. Operators pass specified arguments to a given {@link cascading.operation.BaseOperation}.
The argFields value select the input fields used by the operation. By default the whole input Tuple is passes as arguments. The outFields value select the fields in the result Tuple returned by this Pipe. By default, the operation results of the given operation replace the input Tuple.

  public boolean applies( PlannerContext plannerContext, ElementGraph elementGraph, FlowElement flowElement )
    {
    if( !( flowElement instanceof Operator ) )
      return false;


    Operator operator = (Operator) flowElement;


    if( !operator.hasPlannerLevel() )
      return false;


    PlannerLevel plannerLevel = plannerContext.getPlannerLevelFor( plannerLevelClass );


    if( plannerLevel == null )
      return false;


    if( !( (PlannedOperation) operator.getOperation() ).supportsPlannerLevel( plannerLevel ) )
      return false;


    return operator.getPlannerLevel().isStricterThan( plannerLevel );
    }

View Full Code Here

  private boolean testPlannerLevel( FlowElement flowElement )
    {
    if( !( flowElement instanceof Operator ) )
      return false;


    Operator operator = (Operator) flowElement;


    if( !operator.hasPlannerLevel() )
      return false;


    for( PlannerLevel plannerLevel : plannerLevels )
      {
      if( ( (PlannedOperation) operator.getOperation() ).supportsPlannerLevel( plannerLevel ) )
        return operator.getPlannerLevel().isStricterThan( plannerLevel );
      }


    throw new IllegalStateException( "encountered unsupported planner level: " + operator.getPlannerLevel().getClass().getName() );
    }

View Full Code Here

  }


  private void verifyAllOperationsAreSerializable(ElementGraph elementGraph) {
    for (FlowElement flowElement : elementGraph.vertexSet()) {
      if (flowElement instanceof Operator) {
        Operator operator = (Operator) flowElement;
        verifySingleOperationIsSerializable(operator.getOperation());
      }
    }
  }

View Full Code Here

TOP

Related Classes of cascading.pipe.Operator

cascading.flow.planner.ElementGraph

cascading.flow.planner.iso.expression.PlannerLevelElementExpression

cascading.flow.planner.Scope

cascading.tuple.Fields

com.liveramp.cascading_ext.flow.LoggingHadoopPlanner

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.