Examples of ColumnReader

org.apache.hadoop.hbase.codec.prefixtree.decode.column.ColumnReader
Position one of these appropriately in the data block and you can call its methods to retrieve the family or qualifier at the current position.
org.springframework.data.cassandra.convert.ColumnReader
Helpful class to read a column's value from a row, with possible type conversion. @author Matthew T. Adams
parquet.column.ColumnReader
Reader for (repetition level, definition level, values) triplets. At any given point in time, a ColumnReader points to a single (r, d, v) triplet. In order to move to the next triplet, call {@link #consume()}. Depending on the type and the encoding of the column only a subset of the get* methods are implemented. Dictionary specific methods enable the upper layers to read the dictionary IDs without decoding the data. In particular the Converter will decode the strings in the dictionary only once and iterate on the dictionary IDs instead of the values.
- The current definition level defines if the value is null.
- If the value is defined we can read it with the correct get*() method.
- Looking ahead to the next repetition determines what is the next column to read for in the FSA.
@author Julien Le Dem

Examples of org.apache.hadoop.hbase.codec.prefixtree.decode.column.ColumnReader

    for (int i = 0; i < rowNodes.length; ++i) {
      rowNodes[i] = new RowNodeReader();
    }
    this.rowBuffer = new byte[rowBufferLength];
    this.familyBuffer = new byte[PrefixTreeBlockMeta.MAX_FAMILY_LENGTH];
    this.familyReader = new ColumnReader(familyBuffer, ColumnNodeType.FAMILY);
    this.qualifierBuffer = new byte[qualifierBufferLength];
    this.tagsBuffer = new byte[tagsBufferLength];
    this.qualifierReader = new ColumnReader(qualifierBuffer, ColumnNodeType.QUALIFIER);
    this.tagsReader = new ColumnReader(tagsBuffer, ColumnNodeType.TAGS);
    this.timestampDecoder = new TimestampDecoder();
    this.mvccVersionDecoder = new MvccVersionDecoder();
  }

View Full Code Here

Examples of org.apache.hadoop.hbase.codec.prefixtree.decode.column.ColumnReader

    writer = new ColumnSectionWriter(blockMeta, builder, ColumnNodeType.QUALIFIER);
    ByteArrayOutputStream baos = new ByteArrayOutputStream();
    writer.compile().writeBytes(baos);
    bytes = baos.toByteArray();
    buffer = new byte[blockMeta.getMaxQualifierLength()];
    reader = new ColumnReader(buffer, ColumnNodeType.QUALIFIER);
    reader.initOnBlock(blockMeta, bytes);


    List<TokenizerNode> builderNodes = Lists.newArrayList();
    builder.appendNodes(builderNodes, true, true);
    int i = 0;

View Full Code Here

Examples of org.springframework.data.cassandra.convert.ColumnReader

  private ColumnReader underTest;


  @Before
  public void setup() {
    given(row.getColumnDefinitions()).willReturn(columnDefinitions);
    underTest = new ColumnReader(row);
  }

View Full Code Here

Examples of parquet.column.ColumnReader

   */
  private void skipToMatch() {
    while (recordsRead < recordCount && !recordFilter.isMatch()) {
      State currentState = getState(0);
      do {
        ColumnReader columnReader = currentState.column;


        // currentLevel = depth + 1 at this point
        // set the current value
        if (columnReader.getCurrentDefinitionLevel() >= currentState.maxDefinitionLevel) {
          columnReader.skip();
        }
        columnReader.consume();


        // Based on repetition level work out next state to go to
        int nextR = currentState.maxRepetitionLevel == 0 ? 0 : columnReader.getCurrentRepetitionLevel();
        currentState = currentState.getNextState(nextR);
      } while (currentState != null);
      ++ recordsRead;
    }
  }

View Full Code Here

Examples of parquet.column.ColumnReader

  public T read() {
    int currentLevel = 0;
    recordRootConverter.start();
    State currentState = states[0];
    do {
      ColumnReader columnReader = currentState.column;
      int d = columnReader.getCurrentDefinitionLevel();
      // creating needed nested groups until the current field (opening tags)
      int depth = currentState.definitionLevelToDepth[d];
      for (; currentLevel <= depth; ++currentLevel) {
        currentState.groupConverterPath[currentLevel].start();
      }
      // currentLevel = depth + 1 at this point
      // set the current value
      if (d >= currentState.maxDefinitionLevel) {
        // not null
        columnReader.writeCurrentValueToConverter();
      }
      columnReader.consume();


      int nextR = currentState.maxRepetitionLevel == 0 ? 0 : columnReader.getCurrentRepetitionLevel();
      // level to go to close current groups
      int next = currentState.nextLevel[nextR];
      for (; currentLevel > next; currentLevel--) {
        currentState.groupConverterPath[currentLevel - 1].end();
      }

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.