Examples of org.apache.hadoop.hbase.io.hadoopbackport.ThrottledInputStream

Package org.apache.hadoop.hbase.io.hadoopbackport

Examples of org.apache.hadoop.hbase.io.hadoopbackport.ThrottledInputStream

org.apache.hadoop.hbase.io.hadoopbackport.ThrottledInputStream
The ThrottleInputStream provides bandwidth throttling on a specified InputStream. It is implemented as a wrapper on top of another InputStream instance. The throttling works by examining the number of bytes read from the underlying InputStream from the beginning, and sleep()ing for a time interval if the byte-transfer is found exceed the specified tolerable maximum. (Thus, while the read-rate might exceed the maximum for a given short interval, the average tends towards the specified maximum, overall.)

      }


      InputStream in = openSourceFile(context, inputPath);
      int bandwidthMB = context.getConfiguration().getInt(CONF_BANDWIDTH_MB, 100);
      if (Integer.MAX_VALUE != bandwidthMB) {
        in = new ThrottledInputStream(new BufferedInputStream(in), bandwidthMB * 1024 * 1024);
      }
      try {
        context.getCounter(Counter.BYTES_EXPECTED).increment(inputStat.getLen());


        // Ensure that the output folder is there and copy the file

View Full Code Here

      }


      InputStream in = openSourceFile(context, inputInfo);
      int bandwidthMB = context.getConfiguration().getInt(CONF_BANDWIDTH_MB, 100);
      if (Integer.MAX_VALUE != bandwidthMB) {
        in = new ThrottledInputStream(new BufferedInputStream(in), bandwidthMB * 1024 * 1024);
      }


      try {
        context.getCounter(Counter.BYTES_EXPECTED).increment(inputStat.getLen());

View Full Code Here

      }


      InputStream in = openSourceFile(context, inputInfo);
      int bandwidthMB = context.getConfiguration().getInt(CONF_BANDWIDTH_MB, 100);
      if (Integer.MAX_VALUE != bandwidthMB) {
        in = new ThrottledInputStream(new BufferedInputStream(in), bandwidthMB * 1024 * 1024);
      }


      try {
        context.getCounter(Counter.BYTES_EXPECTED).increment(inputStat.getLen());

View Full Code Here

      }


      InputStream in = openSourceFile(context, inputPath);
      int bandwidthMB = context.getConfiguration().getInt(CONF_BANDWIDTH_MB, 100);
      if (Integer.MAX_VALUE != bandwidthMB) {
        in = new ThrottledInputStream(new BufferedInputStream(in), bandwidthMB * 1024 * 1024);
      }
      try {
        context.getCounter(Counter.BYTES_EXPECTED).increment(inputStat.getLen());


        // Ensure that the output folder is there and copy the file

View Full Code Here

      }


      InputStream in = openSourceFile(context, inputPath);
      int bandwidthMB = context.getConfiguration().getInt(CONF_BANDWIDTH_MB, 100);
      if (Integer.MAX_VALUE != bandwidthMB) {
        in = new ThrottledInputStream(new BufferedInputStream(in), bandwidthMB * 1024 * 1024);
      }
      try {
        context.getCounter(Counter.BYTES_EXPECTED).increment(inputStat.getLen());


        // Ensure that the output folder is there and copy the file

View Full Code Here

      }


      InputStream in = openSourceFile(context, inputInfo);
      int bandwidthMB = context.getConfiguration().getInt(CONF_BANDWIDTH_MB, 100);
      if (Integer.MAX_VALUE != bandwidthMB) {
        in = new ThrottledInputStream(new BufferedInputStream(in), bandwidthMB * 1024 * 1024);
      }


      try {
        context.getCounter(Counter.BYTES_EXPECTED).increment(inputStat.getLen());

View Full Code Here

TOP

Related Classes of org.apache.hadoop.hbase.io.hadoopbackport.ThrottledInputStream

org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper

java.io.IOException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.