Examples of org.lilyproject.repository.bulk.LineMappingContext

org.lilyproject.repository.bulk.LineMappingContext
Context object that is provided to {@link LineMapper}s when doing line mapping. Contains base functionality needed to create and write Lily records.

        int numLines = 0;


        try {
            LineMapper lineMapper = new JythonLineMapper(Files.toString(new File(pythonMapperPath), Charsets.UTF_8),
                    pythonSymbol);
            LineMappingContext mappingContext = new LineMappingContext(bulkIngester, recordWriter);
            String line;
            while ((line = bufferedReader.readLine()) != null) {
                lineMapper.mapLine(line, mappingContext);
                numLines++;
            }

View Full Code Here

        Configuration conf = context.getConfiguration();
        lineMapper = new JythonLineMapper(conf.get(MAPPER_CODE), conf.get(MAPPER_SYMBOL_NAME));
        bulkIngester = BulkIngester.newBulkIngester(conf.get(LILY_ZK_STRING), 30000, conf.get(REPOSITORY_NAME),
                conf.get(TABLE_NAME), Boolean.valueOf(conf.get(BULK_MODE)));
        recordWriter = new MapReduceRecordWriter(bulkIngester);
        lineMappingContext = new LineMappingContext(bulkIngester, recordWriter);
    }

View Full Code Here

TOP

Related Classes of org.lilyproject.repository.bulk.LineMappingContext

org.lilyproject.repository.bulk.mapreduce.LilyJythonMapper

org.lilyproject.repository.bulk.serial.BulkImportTool

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.