Examples of co.cask.cdap.data2.increment.hbase96.IncrementHandler

Package co.cask.cdap.data2.increment.hbase96

Examples of co.cask.cdap.data2.increment.hbase96.IncrementHandler

co.cask.cdap.data2.OperationException
HBase coprocessor that handles reading and writing read-less increment operations.
Writes of incremental values are performed as normal {@code Put}s, flagged with a special attribute {@link co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseOrderedTable#DELTA_WRITE}. The coprocessor intercepts these writes and rewrites the cell value to use a special marker prefix.

For read (for {@code Get} and {@code Scan}) operations, all of the delta values are summed up for a column, up to and including the most recent "full" (non-delta) value. The sum of these delta values, plus the full value (if found) is returned for the column.

To mitigate the performance impact on reading, this coprocessor also overrides the scanner used in flush and compaction operations, using {@link IncrementSummingScanner} to generate a new "full" value aggregated fromall the successfully committed delta values.

      hTable.increment(increment);
    } catch (IOException e) {
      // figure out whether this is an illegal increment
      // currently there is not other way to extract that from the HBase exception than string match
      if (e.getMessage() != null && e.getMessage().contains("isn't 64 bits wide")) {
        throw new OperationException(StatusCode.ILLEGAL_INCREMENT, e.getMessage(), e);
      }
      throw e;
    }
    hTable.flushCommits();
  }

View Full Code Here

      return Bytes.toLong(result.getValue(DATA_COLUMN_FAMILY, column));
    } catch (IOException e) {
      // figure out whether this is an illegal increment
      // currently there is not other way to extract that from the HBase exception than string match
      if (e.getMessage() != null && e.getMessage().contains("isn't 64 bits wide")) {
        throw new OperationException(StatusCode.ILLEGAL_INCREMENT, e.getMessage(), e);
      }
      throw e;
    }
  }

View Full Code Here

      byte[] oldVal = (oldValue == null) ? null : Bytes.toBytes(oldValue);
      byte[] newVal = (newValue == null) ? null : Bytes.toBytes(newValue);


      return aggregatesTable.swap(row, col, oldVal, newVal);
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

          increments.put(Bytes.toBytes(tag.getTag()), (long) tag.getValue());
        }
        aggregatesTable.increment(rowKey, increments);
      }
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

  public void delete(String contextPrefix) throws OperationException {
    Preconditions.checkArgument(contextPrefix != null, "null context not allowed");
    try {
      aggregatesTable.deleteAll(entityCodec.encodeWithoutPadding(MetricsEntityType.CONTEXT, contextPrefix));
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

    byte[] endRow = getRawPaddedKey(contextPrefix, metricPrefix, runId, 0xff);
    try {
      aggregatesTable.deleteRange(startRow, endRow, tags == null ? null : Bytes.toByteArrays(tags),
                                  getFilter(contextPrefix, metricPrefix, runId));
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

   */
  public void clear() throws OperationException {
    try {
      aggregatesTable.deleteAll(new byte[] { });
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

    }


    try {
      timeSeriesTable.put(table);
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

  public void delete(String contextPrefix) throws OperationException {
    Preconditions.checkArgument(contextPrefix != null, "null context not allowed for delete");
    try {
      timeSeriesTable.deleteAll(entityCodec.encodeWithoutPadding(MetricsEntityType.CONTEXT, contextPrefix));
    } catch (Exception e) {
      throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
    }
  }

View Full Code Here

          Bytes.concat(contextPair.getSecond(), metricPair.getSecond(), tagPair.getSecond(),
                       FOUR_ONE_BYTES, runIdPair.getSecond()))));


        timeSeriesTable.deleteRange(startRow, endRow, null, filter);
      } catch (Exception e) {
        throw new OperationException(StatusCode.INTERNAL_ERROR, e.getMessage(), e);
      }
    }
  }

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

Related Classes of co.cask.cdap.data2.increment.hbase96.IncrementHandler

co.cask.cdap.api.dataset.DatasetAdmin

co.cask.cdap.api.dataset.DatasetSpecification

co.cask.cdap.api.dataset.module.DatasetModule

co.cask.cdap.api.dataset.table.Result

co.cask.cdap.api.dataset.table.Row

co.cask.cdap.api.dataset.table.Scanner

co.cask.cdap.common.hooks.MetricsReporterHook

co.cask.cdap.common.http.HttpRequest

co.cask.cdap.common.http.HttpResponse

co.cask.cdap.common.io.BinaryEncoder

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.