Examples of org.apache.hadoop.chukwa.datacollection.OffsetStatsManager

Package org.apache.hadoop.chukwa.datacollection

Examples of org.apache.hadoop.chukwa.datacollection.OffsetStatsManager

org.apache.hadoop.chukwa.datacollection.OffsetStatsManager
Manages stats for multiple objects of type T. T can be any class that is used as a key for offset statistics (i.e. Agent, Collector, etc.). A client would create an instance of this class and call addOffsetDataPoint repeatedly over time. Then calcAverageRate can be called to retrieve the average offset-unit per second over a given time interval. For a given object T that is actively adding data points, stats are kept for up to 20 minutes. Care should be taken to always call remove() when old T objects should no longer be tracked.




294
295
296
297
298
299
300
301
302
303
304       controlSock.start(); // this sets us up as a daemon
      log.info("control socket started on port " + controlSock.portno);


      // start the HTTP server with stats collection
      try {
        this.adaptorStatsManager = new OffsetStatsManager(STATS_DATA_TTL_MS);
        this.statsCollector = new Timer("ChukwaAgent Stats Collector");


        startHttpServer(conf);


        statsCollector.scheduleAtFixedRate(new StatsCollectorTask(),

View Full Code Here





284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303     appendNvp(out, indent, "data_type", adaptor.getType());
    appendNvp(out, indent, "offset", agent.offset(adaptor).offset());
    appendNvp(out, indent, "adaptor_class", adaptor.getClass().getName());
    appendNvp(out, indent, "adaptor_params", adaptor.getCurrentStatus(), true);


    OffsetStatsManager adaptorStats = agent.getAdaptorStatsManager();


    appendNvp(out, indent, "average_rates", "");
    indent += 4;
    appendNvp(out, indent, "- rate",
            DECIMAL_FORMAT.format(adaptorStats.calcAverageRate(adaptor,  60)));
    appendNvp(out, indent, "interval", "60");
    appendNvp(out, indent, "- rate",
            DECIMAL_FORMAT.format(adaptorStats.calcAverageRate(adaptor,  300)));
    appendNvp(out, indent, "interval", "300");
    appendNvp(out, indent, "- rate",
            DECIMAL_FORMAT.format(adaptorStats.calcAverageRate(adaptor,  600)));
    appendNvp(out, indent, "interval", "600");
    indent -= 4;
  }

View Full Code Here


310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328             "offset", agent.offset(adaptor).offset());


    appendElement(out, "AdaptorClass", adaptor.getClass().getName());
    appendElement(out, "AdaptorParams", adaptor.getCurrentStatus());


    OffsetStatsManager adaptorStats = agent.getAdaptorStatsManager();


    appendElement(out, "AverageRate",
            DECIMAL_FORMAT.format(adaptorStats.calcAverageRate(adaptor,  60)),
            "intervalSeconds", "60");
    appendElement(out, "AverageRate",
            DECIMAL_FORMAT.format(adaptorStats.calcAverageRate(adaptor,  300)),
            "intervalSeconds", "300");
    appendElement(out, "AverageRate",
            DECIMAL_FORMAT.format(adaptorStats.calcAverageRate(adaptor,  600)),
            "intervalSeconds", "600");


    appendEndTag(out, "Adaptor");
  }

View Full Code Here


294
295
296
297
298
299
300
301
302
303
304       controlSock.start(); // this sets us up as a daemon
      log.info("control socket started on port " + controlSock.portno);


      // start the HTTP server with stats collection
      try {
        this.adaptorStatsManager = new OffsetStatsManager(STATS_DATA_TTL_MS);
        this.statsCollector = new Timer("ChukwaAgent Stats Collector");


        startHttpServer(conf);


        statsCollector.scheduleAtFixedRate(new StatsCollectorTask(),

View Full Code Here



TOP

Related Classes of org.apache.hadoop.chukwa.datacollection.OffsetStatsManager

org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent
org.apache.hadoop.chukwa.datacollection.agent.rest.AdaptorController
java.util.Date



Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.