Examples of com.cloudera.flume.handlers.debug.NoNlSynthSource

Package com.cloudera.flume.handlers.debug

Examples of com.cloudera.flume.handlers.debug.NoNlSynthSource

com.cloudera.flume.handlers.debug.NoNlSynthSource
Syslog parser depends on using '\n' as a record delimiter. When we just use random data, there is a chance that '\n's are in the event and can foul benchmarks (due to format exceptions) that assume clean data. This wrapper just replaces '\n' with ' '

    Benchmark b = new Benchmark("new extract - scan 100 blocks");


    b.mark("build dataset");
    ByteArrayOutputStream out = new ByteArrayOutputStream();
    // 1M x 100 byte messages, 0 is the rand seed
    NoNlSynthSource src = new NoNlSynthSource(1000000, 100, 0);


    src.open();
    Event e = null;
    while ((e = src.next()) != null) {
      out.write("<33>".getBytes());
      out.write(e.getBody());
      out.write('\n');
    }

View Full Code Here

    Benchmark b = new Benchmark("new extract - scan 1000 blocks");


    b.mark("build dataset");
    ByteArrayOutputStream out = new ByteArrayOutputStream();
    // 1M x 100 byte messages, 0 is the rand seed
    NoNlSynthSource src = new NoNlSynthSource(1000000, 100, 0);


    src.open();
    Event e = null;
    while ((e = src.next()) != null) {
      out.write("<33>".getBytes());
      out.write(e.getBody());
      out.write('\n');
    }

View Full Code Here

    Benchmark b = new Benchmark("new extract - scan single byte");


    b.mark("build dataset");
    ByteArrayOutputStream out = new ByteArrayOutputStream();
    // 1M x 100 byte messages, 0 is the rand seed
    NoNlSynthSource src = new NoNlSynthSource(1000000, 100, 0);


    src.open();
    Event e = null;
    while ((e = src.next()) != null) {
      out.write("<33>".getBytes());
      out.write(e.getBody());
      out.write('\n');
    }

View Full Code Here

    Benchmark b = new Benchmark("regex extract");


    b.mark("build dataset");
    ByteArrayOutputStream out = new ByteArrayOutputStream();
    // 1M x 100 byte messages, 0 is the rand seed
    NoNlSynthSource src = new NoNlSynthSource(1000000, 100, 0);


    src.open();
    Event e = null;
    while ((e = src.next()) != null) {
      out.write("<33>".getBytes());
      out.write(e.getBody());
      out.write('\n');
    }

View Full Code Here

TOP

Related Classes of com.cloudera.flume.handlers.debug.NoNlSynthSource

com.cloudera.flume.conf.SourceFactory.SourceBuilder

com.cloudera.flume.core.Event

com.cloudera.flume.handlers.syslog.PerfSyslogWireExtract

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.