Examples of com.cloudera.flume.handlers.endtoend.AckListener

Package com.cloudera.flume.handlers.endtoend

Examples of com.cloudera.flume.handlers.endtoend.AckListener

com.cloudera.flume.handlers.endtoend.AckListener
This is a interface decouple event-stream extracted notifications from the actions that are triggered by them. This explicitly encapsulates any necessary references to FlumeNodes or FlumeControlServer/FlumeConfigMaster (masters) and simplifies testing and mocking out objects.

      flushRollAcks();
      LOG.debug("closed  roll detect deco {}", tag);
    }


    void flushRollAcks() throws IOException {
      AckListener master = ackDest;
      Collection<String> acktags;
      synchronized (rollAckSet) {
        acktags = new ArrayList<String>(rollAckSet);
        rollAckSet.clear();
        LOG.debug("Roll closed, pushing acks for " + tag + " :: " + acktags);
      }


      for (String at : acktags) {
        master.end(at);
      }
    }

View Full Code Here

      InterruptedException {
    // This will register the FlumeNode with a MockMasterRPC so it doesn't go
    // across the network
    MockMasterRPC mock = new MockMasterRPC();
    FlumeNode node = new FlumeNode(mock, false /* starthttp */, false /* onshot */);
    AckListener pending = node.getAckChecker().getAgentAckQueuer();


    // initial source of data.
    MemorySinkSource mem = new MemorySinkSource();
    byte[] tag = "my tag".getBytes();
    AckChecksumInjector<EventSink> ackinj = new AckChecksumInjector<EventSink>(

View Full Code Here

      flushRollAcks();
      LOG.debug("closed  roll detect deco {}", tag);
    }


    void flushRollAcks() throws IOException {
      AckListener master = ackDest;
      Collection<String> acktags;
      synchronized (rollAckSet) {
        acktags = new ArrayList<String>(rollAckSet);
        rollAckSet.clear();
        LOG.debug("Roll closed, pushing acks for " + tag + " :: " + acktags);
      }


      for (String at : acktags) {
        master.end(at);
      }
    }

View Full Code Here

  public void testForceRetransmit() throws FlumeSpecException, IOException {
    // This will register the FlumeNode with a MockMasterRPC so it doesn't go
    // across the network
    MockMasterRPC mock = new MockMasterRPC();
    FlumeNode node = new FlumeNode(mock, false /* starthttp */, false /* onshot */);
    AckListener pending = node.getAckChecker().getAgentAckQueuer();


    // initial source of data.
    MemorySinkSource mem = new MemorySinkSource();
    byte[] tag = "my tag".getBytes();
    AckChecksumInjector<EventSink> ackinj = new AckChecksumInjector<EventSink>(

View Full Code Here


    @Override
    public void close() throws IOException {
      super.close();


      AckListener master = FlumeNode.getInstance().getCollectorAckListener();
      Collection<String> acktags = rollAckMap.get(curRollTag);
      LOG.debug("Roll closed, pushing acks for " + curRollTag + " :: "
          + acktags);


      for (String at : acktags) {
        master.end(at);
      }
    }

View Full Code Here

TOP

Related Classes of com.cloudera.flume.handlers.endtoend.AckListener

com.cloudera.flume.agent.TestAckedWALDecorator

com.cloudera.flume.collector.CollectorSink$RollDetectDeco

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.