Examples of com.cloudera.flume.conf.Context

com.cloudera.flume.conf.Context
This context is an abstraction for scopes. Prior to this there were one scopes the physical node (essentially conf file). This allows for new subscopes such as logical node contexts. This allows information to be passed to specific logical nodes (such as logicalnode name). This interface will likely subsume FlumeConfiguration (physical node scope), and configuration information grabbed from the master such as as logical node specific failover chains (master scope). With scope chaining and shadowing we can in the future introduce node specific configuration settings transparently.


    // close


    String snk = "  { intervalDroppyAppend(15)  => { ackChecker => [ console, counter(\""
        + rpt + "\") ] } }  ";
    Context ctx = new ReportTestingContext();
    EventSink es = FlumeBuilder.buildSink(ctx, snk);


    NaiveFileWALDeco wal = new NaiveFileWALDeco(ctx, es, node.getWalManager(),
        new TimeTrigger(new ProcessTagger(), 100000), node.getAckChecker()
            .getAgentAckQueuer(), 1000);

View Full Code Here


    // close


    String snk = "  { intervalDroppyAppend(16)  => { ackChecker => [ console, counter(\""
        + rpt + "\") ] } }  ";
    Context ctx = new ReportTestingContext();
    EventSink es = FlumeBuilder.buildSink(ctx, snk);


    NaiveFileWALDeco wal = new NaiveFileWALDeco(ctx, es, node.getWalManager(),
        new TimeTrigger(new ProcessTagger(), 100000), node.getAckChecker()
            .getAgentAckQueuer(), 1000);

View Full Code Here


    // close


    String snk = "  { intervalDroppyAppend(21)  => { ackChecker => [ console, counter(\""
        + rpt + "\") ] } }  ";
    Context ctx = new ReportTestingContext();
    EventSink es = FlumeBuilder.buildSink(ctx, snk);


    // Big delay values so that test has to force different actions.
    NaiveFileWALDeco wal = new NaiveFileWALDeco(ctx, es, node.getWalManager(),
        new TimeTrigger(new ProcessTagger(), 100000), node.getAckChecker()

View Full Code Here

      InterruptedException {


    int count = 20;
    String rpt = "foo";
    String snk = "{ ackChecker => [ console, counter(\"" + rpt + "\") ] }";
    Context ctx = new ReportTestingContext();
    EventSink es = FlumeBuilder.buildSink(ctx, snk);
    NaiveFileWALDeco wal = new NaiveFileWALDeco(ctx, es, node.getWalManager(),
        new TimeTrigger(new ProcessTagger(), 100), node.getAckChecker()
            .getAgentAckQueuer(), 10000);

View Full Code Here

   * Successful if no exceptions thrown.
   */
  @Test
  public void testDigestBuilder() throws IOException, FlumeSpecException, InterruptedException {
    EventSink snk =
        new CompositeSink(new Context(),
            "{ digest(\"MD5\", \"digest\") => counter(\"count\") }");
    snk.open();
    Event e = new EventImpl("content".getBytes());
    snk.append(e);
    snk.close();

View Full Code Here

   * Successful if no exceptions thrown.
   */
  @Test
  public void testDigestBuilderBase64() throws IOException, FlumeSpecException, InterruptedException {
    EventSink snk =
        new CompositeSink(new Context(),
            "{ digest(\"MD5\", \"digest\", base64=\"true\") => counter(\"count\") }");
    snk.open();
    Event e = new EventImpl("content".getBytes());
    snk.append(e);
    snk.close();

View Full Code Here

   * Successful if no exceptions thrown.
   */
  @Test(expected=FlumeSpecException.class)
  public void testDigestBuilderInvalidAlgorithm() throws IOException, FlumeSpecException, InterruptedException {
    EventSink snk =
        new CompositeSink(new Context(),
            "{ digest(\"INVALID\", \"digest\") => counter(\"count\") }");
  }

View Full Code Here

   * @throws InterruptedException
   */
  @Test
  public void testSelectBuilder() throws IOException, FlumeSpecException, InterruptedException {
    EventSink snk =
        new CompositeSink(new Context(),
            "{ select(\"foo\", \"bar\",\"bork\") => counter(\"count\") }");
    snk.open();
    Event e = new EventImpl("content".getBytes());
    Attributes.setString(e, "foo", "foo data");
    Attributes.setString(e, "bar", "bar data");

View Full Code Here

   * @throws InterruptedException
   */
  @Test
  public void testMaskBuilder() throws IOException, FlumeSpecException, InterruptedException {
    EventSink snk =
        new CompositeSink(new Context(),
            "{ mask(\"foo\", \"bar\",\"bork\") => counter(\"count\") }");
    snk.open();
    Event e = new EventImpl("content".getBytes());
    Attributes.setString(e, "foo", "foo data");
    Attributes.setString(e, "bar", "bar data");

View Full Code Here

   * @throws InterruptedException
   */
  @Test
  public void testSurviveCloseException() throws IOException,
      InterruptedException {
    LogicalNode node = new LogicalNode(new Context(), "test");


    class CloseExnSource extends EventSource.Base {
      @Override
      public void close() throws IOException {
        throw new IOException("arg!");

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

Related Classes of com.cloudera.flume.conf.Context

com.cloudera.flume.agent.AgentFailChainSink

com.cloudera.flume.agent.AgentSink

com.cloudera.flume.agent.diskfailover.NaiveFileFailoverManager

com.cloudera.flume.agent.diskfailover.TestDiskFailoverBehavior

com.cloudera.flume.agent.diskfailover.TestDiskFailoverDeco

com.cloudera.flume.agent.durability.TestConcurrentWALMan

com.cloudera.flume.agent.durability.TestNaiveFileWALDeco

com.cloudera.flume.agent.durability.TestNaiveFileWALManagerConcurrently

com.cloudera.flume.agent.FlumeNode

com.cloudera.flume.agent.LogicalNodeManager

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.