Examples of com.alexholmes.hadooputils.test.TextIOJobBuilder

com.alexholmes.hadooputils.test.TextIOJobBuilder
A class that helps with testing MapReduce jobs with the {@link org.apache.hadoop.mapred.LocalJobRunner}, which is an in-memory MapReduce implementation.
It allows the user to create input files, and then provides some utility methods to help test the output file contents generated by a MapReduce job.

    }


    @Test
    public void runEndScenario3() throws Exception {


        TextIOJobBuilder builder = new TextIOLocalJobBuilder(new Configuration(), TEST_ROOT_DIR)
                .addInput("foo bar")
                .addInput("clump hump")
                .addExpectedOutput("foo bar")
                .addExpectedOutput("clump hump")
                .writeInputs();


        run(new SortConfig(builder.getFs().getConf()).setStartKey(2).setEndKey(2), builder);
    }

View Full Code Here

    }


    @Test
    public void runFieldSeparator() throws Exception {


        TextIOJobBuilder builder = new TextIOLocalJobBuilder(new Configuration(), TEST_ROOT_DIR)
                .addInput("foo-hump")
                .addInput("clump-bar")
                .addExpectedOutput("clump-bar")
                .addExpectedOutput("foo-hump")
                .writeInputs();


        run(new SortConfig(builder.getFs().getConf()).setStartKey(2).setEndKey(2).setFieldSeparator("-"), builder);
    }

View Full Code Here

0 1

TOP

Related Classes of com.alexholmes.hadooputils.test.TextIOJobBuilder

com.alexholmes.hadooputils.sort.SortTest

com.alexholmes.hadooputils.sort.TotalOrderSortTest

org.apache.hadoop.fs.Path

org.apache.hadoop.fs.PathFilter

java.io.DataOutputStream

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.