Examples of EscapedCustomDfsSink

com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink
Writes events the a file give a hadoop uri path. If no uri is specified It defaults to the set by the given configured by fs.default.name config variable. The user can specify an output format for the file. If none is specified the default set by flume.collector.outputformat in the flumeconfiguration file is used. TODO (jon) eventually, the CustomDfsSink should be replaced with just a EventSink. TODO (jon) this is gross, please deprecate me.

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

    final File f = FileUtil.mktempdir();
    RollSink snk = new RollSink(new Context(), "test", new TimeTrigger(tagger,
        10000), 250) {
      @Override
      protected EventSink newSink(Context ctx) throws IOException {
        return new EscapedCustomDfsSink("file:///" + f.getPath(),
            "sub-%{service}%{rolltag}");
      }
    };


    Event e = new EventImpl("this is a test message".getBytes());

View Full Code Here

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

    final File f = FileUtil.mktempdir();
    RollSink snk = new RollSink(new Context(), "test", new TimeTrigger(tagger,
        10000), 250) {
      @Override
      protected EventSink newSink(Context ctx) throws IOException {
        return new EscapedCustomDfsSink("file:///" + f.getPath(),
            "sub-%{service}%{rolltag}");
      }
    };


    Event e = new EventImpl("this is a test message".getBytes());

View Full Code Here

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

    final File f = FileUtil.mktempdir();
    RollSink snk = new RollSink(new Context(), "test", new TimeTrigger(tagger,
        10000), 250) {
      @Override
      protected EventSink newSink(Context ctx) throws IOException {
        return new EscapedCustomDfsSink("file:///" + f.getPath(),
            "sub-%{service}%{rolltag}");
      }
    };


    Event e = new EventImpl("this is a test message".getBytes());

View Full Code Here

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

        tagger, millis), checkmillis) {
      @Override
      public EventSink newSink(Context ctx) throws IOException {
        String tag = tagger.newTag();
        String path = logdir + Path.SEPARATOR_CHAR;
        EventSink dfs = new EscapedCustomDfsSink(path, filename + tag);
        return new RollDetectDeco(dfs, tag);
      }
    };


    long initMs = FlumeConfiguration.get().getInsistentOpenInitBackoff();

View Full Code Here

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

        millis), checkmillis) {
      @Override
      public EventSink newSink(Context ctx) throws IOException {
        String tag = tagger.newTag();
        String path = logdir + Path.SEPARATOR_CHAR;
        EventSink dfs = new EscapedCustomDfsSink(path, filename + tag, hiveTableName);
        
        return new RollDetectDeco(dfs, tag);
      }
    };
    snk = new AckChecksumChecker<EventSink>(s, accum);

View Full Code Here

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

      @Override
      public EventSink newSink(Context ctx) throws IOException {
        String tag = tagger.newTag();
        String path = logdir + Path.SEPARATOR_CHAR;
        
        EventSink dfs = new EscapedCustomDfsSink(path, filename + tag, hiveTableName, elasticSearchUrl, elasticIndex, elasticType);
        
        return new RollDetectDeco(dfs, tag);
      }
    };
    snk = new AckChecksumChecker<EventSink>(s, accum);

View Full Code Here

Examples of com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink

      @Override
      public EventSink newSink(Context ctx) throws IOException {
        String tag = tagger.newTag();
        String path = logdir + Path.SEPARATOR_CHAR;
        
        EventSink dfs = new EscapedCustomDfsSink(path, filename + tag, hiveTableName, elasticSearchUrl, elasticIndex, elasticType, runMarkerQueries);
        
        return new RollDetectDeco(dfs, tag);
      }
    };
    snk = new AckChecksumChecker<EventSink>(s, accum);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.