Examples of org.apache.tez.runtime.api.InputInitializer

org.apache.tez.runtime.api.InputInitializer
InputInitializers are typically used to initialize vertices connected to data sources. They run in the App Master and can be used to distribute data across the tasks for the vertex, determine the number of tasks at runtime, update the Input payload etc.

    @Override
    protected InputInitializer createInitializer(
        RootInputLeafOutput<InputDescriptor, InputInitializerDescriptor> input,
        InputInitializerContext context) {


      return new InputInitializer(context) {
        @Override
        public List<Event> initialize() throws
            Exception {
          return null;
        }

View Full Code Here

      inputs) {
    for (RootInputLeafOutput<InputDescriptor, InputInitializerDescriptor> input : inputs) {


      InputInitializerContext context =
          new TezRootInputInitializerContextImpl(input, vertex, appContext);
      InputInitializer initializer = createInitializer(input, context);


      InitializerWrapper initializerWrapper = new InitializerWrapper(input, initializer, context, vertex);
      initializerMap.put(input.getName(), initializerWrapper);
      ListenableFuture<List<Event>> future = executor
          .submit(new InputInitializerCallable(initializerWrapper, dagUgi));

View Full Code Here




  @VisibleForTesting
  protected InputInitializer createInitializer(RootInputLeafOutput<InputDescriptor, InputInitializerDescriptor>
      input, InputInitializerContext context) {
    InputInitializer initializer = ReflectionUtils
        .createClazzInstance(input.getControllerDescriptor().getClassName(),
            new Class[]{InputInitializerContext.class}, new Object[]{context});
    return initializer;
  }

View Full Code Here

TOP

Related Classes of org.apache.tez.runtime.api.InputInitializer

org.apache.tez.dag.app.dag.impl.TestVertexImpl$RootInputInitializerManagerControlled

org.apache.tez.dag.app.dag.RootInputInitializerManager

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.