Examples of com.cloudera.flume.handlers.hdfs.CustomDfsSink

Package com.cloudera.flume.handlers.hdfs

Examples of com.cloudera.flume.handlers.hdfs.CustomDfsSink

com.cloudera.flume.handlers.hdfs.CustomDfsSink
This creates a raw hadoop dfs file that outputs data formatted by the provided OutputFormat. It is assumed that the output is a file of some sort.

    }


    // sink does exist for event, create it.
    LOG.info("Opening " + realpath);


    w = new CustomDfsSink(realpath, format);
    SinkCloseNotifier<EventSink, HiveDirCreatedNotification> notif = new SinkCloseNotifier<EventSink, HiveDirCreatedNotification>(
        w) {
      @Override
      public HiveDirCreatedNotification getNotificationEvent() {
        // take the dir part of the path

View Full Code Here

    }


    // sink does exist for event, create it.
    LOG.info("Opening " + realpath);


    w = new CustomDfsSink(realpath, format,null);
    SinkCloseNotifier<EventSink, HiveDirCreatedNotification> notif =
        new SinkCloseNotifier<EventSink, HiveDirCreatedNotification>(w) {
          @Override
          public HiveDirCreatedNotification getNotificationEvent() {
            // take the dir part of the path

View Full Code Here

TOP

Related Classes of com.cloudera.flume.handlers.hdfs.CustomDfsSink

com.cloudera.flume.conf.FlumeConfiguration

com.cloudera.flume.conf.SinkFactory.SinkBuilder

com.cloudera.flume.handlers.hive.HiveNotifyingDfsSink

com.cloudera.flume.handlers.hive.MarkerStore

com.cloudera.flume.handlers.text.output.OutputFormat

com.cloudera.flume.reporter.ReportEvent

com.cloudera.util.PathManager

org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.FSDataOutputStream

org.apache.hadoop.fs.Path

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.