Examples of InputInitializer

org.apache.tez.runtime.api.InputInitializer
InputInitializers are typically used to initialize vertices connected to data sources. They run in the App Master and can be used to distribute data across the tasks for the vertex, determine the number of tasks at runtime, update the Input payload etc.

Examples of org.apache.tez.runtime.api.InputInitializer

    @Override
    protected InputInitializer createInitializer(
        RootInputLeafOutput<InputDescriptor, InputInitializerDescriptor> input,
        InputInitializerContext context) {


      return new InputInitializer(context) {
        @Override
        public List<Event> initialize() throws
            Exception {
          return null;
        }

View Full Code Here

Examples of org.apache.tez.runtime.api.InputInitializer

      inputs) {
    for (RootInputLeafOutput<InputDescriptor, InputInitializerDescriptor> input : inputs) {


      InputInitializerContext context =
          new TezRootInputInitializerContextImpl(input, vertex, appContext);
      InputInitializer initializer = createInitializer(input, context);


      InitializerWrapper initializerWrapper = new InitializerWrapper(input, initializer, context, vertex);
      initializerMap.put(input.getName(), initializerWrapper);
      ListenableFuture<List<Event>> future = executor
          .submit(new InputInitializerCallable(initializerWrapper, dagUgi));

View Full Code Here

Examples of org.apache.tez.runtime.api.InputInitializer




  @VisibleForTesting
  protected InputInitializer createInitializer(RootInputLeafOutput<InputDescriptor, InputInitializerDescriptor>
      input, InputInitializerContext context) {
    InputInitializer initializer = ReflectionUtils
        .createClazzInstance(input.getControllerDescriptor().getClassName(),
            new Class[]{InputInitializerContext.class}, new Object[]{context});
    return initializer;
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.