Examples of org.apache.hadoop.hbase.util.SizeBasedThrottler

org.apache.hadoop.hbase.util.SizeBasedThrottler
Utility class that can be used to implement queues with limited capacity (in terms of memory). It maintains internal counter and provides two operations: increase and decrease. Increase blocks until internal counter is lower than given threshold and then increases internal counter. Decrease decreases internal counter and wakes up waiting threads if counter is lower than threshold. This implementation allows you to set the value of internal counter to be greater than threshold. It happens when internal counter is lower than threshold and increase method is called with parameter 'delta' big enough so that sum of delta and internal counter is greater than threshold. This is not a bug, this is a feature. It solves some problems: - thread calling increase with big parameter will not be starved by other threads calling increase with small arguments. - thread calling increase with argument greater than threshold won't deadlock. This is useful when throttling queues - you can submit object that is bigger than limit. This implementation introduces small costs in terms of synchronization (no synchronization in most cases at all), but is vulnerable to races. For details see documentation of increase method.

    this.warnDelayedCalls = conf.getInt(WARN_DELAYED_CALLS,
                                        DEFAULT_WARN_DELAYED_CALLS);
    this.delayedCalls = new AtomicInteger(0);




    this.responseQueuesSizeThrottler = new SizeBasedThrottler(
        conf.getLong(RESPONSE_QUEUES_MAX_SIZE, DEFAULT_RESPONSE_QUEUES_MAX_SIZE));


    // Create the responder here
    responder = new Responder();
  }

View Full Code Here

    this.warnDelayedCalls = conf.getInt(WARN_DELAYED_CALLS,
                                        DEFAULT_WARN_DELAYED_CALLS);
    this.delayedCalls = new AtomicInteger(0);




    this.responseQueuesSizeThrottler = new SizeBasedThrottler(
        conf.getLong(RESPONSE_QUEUES_MAX_SIZE, DEFAULT_RESPONSE_QUEUES_MAX_SIZE));


    // Create the responder here
    responder = new Responder();
  }

View Full Code Here

    this.warnDelayedCalls = conf.getInt(WARN_DELAYED_CALLS,
                                        DEFAULT_WARN_DELAYED_CALLS);
    this.delayedCalls = new AtomicInteger(0);




    this.responseQueuesSizeThrottler = new SizeBasedThrottler(
        conf.getLong(RESPONSE_QUEUES_MAX_SIZE, DEFAULT_RESPONSE_QUEUES_MAX_SIZE));


    // Create the responder here
    responder = new Responder();
  }

View Full Code Here

    this.warnDelayedCalls = conf.getInt(WARN_DELAYED_CALLS,
                                        DEFAULT_WARN_DELAYED_CALLS);
    this.delayedCalls = new AtomicInteger(0);




    this.responseQueuesSizeThrottler = new SizeBasedThrottler(
        conf.getLong(RESPONSE_QUEUES_MAX_SIZE, DEFAULT_RESPONSE_QUEUES_MAX_SIZE));


    // Create the responder here
    responder = new Responder();
  }

View Full Code Here

TOP

Related Classes of org.apache.hadoop.hbase.util.SizeBasedThrottler

org.apache.hadoop.hbase.ipc.HBaseServer

java.util.concurrent.atomic.AtomicLong

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.