Examples of cascading.tap.Tap.sourceConfInit()

cascading.tap.Tap.sourceConfInit()

Method sourceConfInit initializes this instance as a source.

This method maybe called more than once if this Tap instance is used outside the scope of a {@link cascading.flow.Flow}instance or if it participates in multiple times in a given Flow or across different Flows in a {@link cascading.cascade.Cascade}.

In the context of a Flow, it will be called after {@link cascading.flow.FlowListener#onStarting(cascading.flow.Flow)}

Note that no resources or services should be modified by this method. @param flowProcess of type FlowProcess @param conf of type Config


    // set the combine flag
    conf.setBoolean( HfsProps.COMBINE_INPUT_FILES, true );


    // test the input format and the split
    source.sourceConfInit( process, conf );


    InputFormat inputFormat = conf.getInputFormat();


    assertEquals( Hfs.CombinedInputFormat.class, inputFormat.getClass() );
    InputSplit[] splits = inputFormat.getSplits( conf, 1 );

        Tap tap = (Tap) element;


        if( tap.getIdentifier() == null )
          throw new IllegalStateException( "tap may not have null identifier: " + tap.toString() );


        tap.sourceConfInit( flowProcess, current );


        Map<String, String> map = flowProcess.diffConfigIntoMap( new TezConfiguration( conf ), new TezConfiguration( current ) );
        conf.set( "cascading.node.accumulated.source.conf." + Tap.id( tap ), pack( map, conf ) );


        setLocalMode( conf, current, tap );

        Tap tap = (Tap) element;


        if( tap.getIdentifier() == null )
          throw new IllegalStateException( "tap may not have null identifier: " + tap.toString() );


        tap.sourceConfInit( flowProcess, current );


        setLocalMode( conf, current, tap );
        }


      String id = FlowElements.id( element );

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.