List of openTapForRead() Examples

Examples of openTapForRead()

cascading.flow.Flow.openTapForRead()
Method openTapForRead return a {@link cascading.tuple.TupleEntryIterator} for the given Tap instance.
Note the returned iterator will return the same instance of {@link cascading.tuple.TupleEntry} on every call,thus a copy must be made of either the TupleEntry or the underlying {@code Tuple} instance if they are to bestored in a Collection. @param tap of type Tap @return TupleIterator @throws IOException when there is an error opening the resource

Examples of cascading.flow.Flow.openTapForRead()

    Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );


    flow.complete();


    Tap test = getPlatform().getTextFile( new Fields( "line" ), sink.getIdentifier().toString() + "/1-a" );
    validateLength( flow.openTapForRead( test ), 1, Pattern.compile( "[0-9]\\+[a-z]\\+[A-Z]" ) );


    test = getPlatform().getTextFile( new Fields( "line" ), sink.getIdentifier().toString() + "/2-b" );
    validateLength( flow.openTapForRead( test ), 1, Pattern.compile( "[0-9]\\+[a-z]\\+[A-Z]" ) );
    }

View Full Code Here

Examples of cascading.flow.Flow.openTapForRead()


    Tap test = getPlatform().getTextFile( new Fields( "line" ), sink.getIdentifier().toString() + "/1-a" );
    validateLength( flow.openTapForRead( test ), 1, Pattern.compile( "[0-9]\\+[a-z]\\+[A-Z]" ) );


    test = getPlatform().getTextFile( new Fields( "line" ), sink.getIdentifier().toString() + "/2-b" );
    validateLength( flow.openTapForRead( test ), 1, Pattern.compile( "[0-9]\\+[a-z]\\+[A-Z]" ) );
    }


  @Test
  public void testTemplateTapView() throws IOException
    {

View Full Code Here

Examples of cascading.flow.Flow.openTapForRead()

    Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );


    flow.complete();


    Tap test = getPlatform().getTabDelimitedFile( new Fields( "upper" ), sink.getIdentifier().toString() + "/1-a", SinkMode.KEEP );
    validateLength( flow.openTapForRead( test ), 1, 1 );


    test = getPlatform().getTabDelimitedFile( new Fields( "upper" ), sink.getIdentifier().toString() + "/2-b", SinkMode.KEEP );
    validateLength( flow.openTapForRead( test ), 1, 1 );


    TupleEntryIterator input = flow.openTapForRead( test ); // open 2-b

View Full Code Here

Examples of cascading.flow.Flow.openTapForRead()


    Tap test = getPlatform().getTabDelimitedFile( new Fields( "upper" ), sink.getIdentifier().toString() + "/1-a", SinkMode.KEEP );
    validateLength( flow.openTapForRead( test ), 1, 1 );


    test = getPlatform().getTabDelimitedFile( new Fields( "upper" ), sink.getIdentifier().toString() + "/2-b", SinkMode.KEEP );
    validateLength( flow.openTapForRead( test ), 1, 1 );


    TupleEntryIterator input = flow.openTapForRead( test ); // open 2-b


    assertEquals( "wrong value", "B", input.next().getObject( 0 ) );

View Full Code Here

Examples of cascading.flow.Flow.openTapForRead()

    validateLength( flow.openTapForRead( test ), 1, 1 );


    test = getPlatform().getTabDelimitedFile( new Fields( "upper" ), sink.getIdentifier().toString() + "/2-b", SinkMode.KEEP );
    validateLength( flow.openTapForRead( test ), 1, 1 );


    TupleEntryIterator input = flow.openTapForRead( test ); // open 2-b


    assertEquals( "wrong value", "B", input.next().getObject( 0 ) );


    input.close();
    }

View Full Code Here

Examples of cascading.flow.Flow.openTapForRead()


    assertTrue( tuples.contains( new Tuple( "A", "a", "1" ) ) );
    assertTrue( tuples.contains( new Tuple( "B", "b", "2" ) ) );


    test = getPlatform().getTextFile( new Fields( "line" ), sink.getIdentifier() );
    validateLength( secondFlow.openTapForRead( test ), 74, Pattern.compile( "[0-9]\\+[a-z]\\+[A-Z]" ) );
    }


  @Test
  public void testTupleEntrySchemeIteratorExceptionHandling() throws IOException
    {

View Full Code Here

Examples of cascading.flow.Flow.openTapForRead()

    Flow flow = getPlatform().getFlowConnector().connect( input, output, pipe );


    flow.complete();


    Fields fields = new Fields( "first", "second", "third", "fourth", "fifth" );
    TupleEntryIterator iterator = flow.openTapForRead( getPlatform().getDelimitedFile( fields, true, true, ",", "\"", null, output1.getIdentifier(), SinkMode.REPLACE ) );


    validateLength( iterator, 13, 5 );


    assertHeaders( output1, flow );
    assertHeaders( output2, flow );

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.