Examples of com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader$Record

Package com.google.appengine.tools.mapreduce.inputs

Examples of com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader$Record

com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader
google.com/p/leveldb/"}This implementation deviates from the specification above, in that it allows blocks to be zero padded regardless of how much data is in the block, rather than only if the block is within 6 bytes of full. Data is read in as needed, so the only state required to reconstruct this class when it is serialized is the offset. In the event that corrupt data is encountered a {@link CorruptDataException} is thrown. If thisoccurs, do not continue to attempt to read. Behavior is not guaranteed. For internal use only. User code cannot safely depend on this class.


    for (int i = 0; i < writtenData.length; i++) {
      for (int j = 0; j < 8; j++) {
        writtenData[i] = (byte) (writtenData[i] ^ (1 << j));
        ByteArrayInputStream arrayInputStream = new ByteArrayInputStream(writtenData);
        LevelDbInputReader reader =
            new TestLevelDbInputReader(Channels.newChannel(arrayInputStream), overriddenBlockSize);
        try {
          verifyWrittenData(written, reader);
          fail();
        } catch (CorruptDataException e) {

View Full Code Here

    writer.endShard();
    byte[] writtenData = arrayOutputWriter.toByteArray();
    for (int i = 0; i < 11 * 10; i++) {
      byte[] toRead = Arrays.copyOf(writtenData, i);
      ByteArrayInputStream arrayInputStream = new ByteArrayInputStream(toRead);
      LevelDbInputReader reader =
          new TestLevelDbInputReader(Channels.newChannel(arrayInputStream), overriddenBlockSize);
      try {
        verifyWrittenData(written, reader);
        fail();
      } catch (CorruptDataException | NoSuchElementException e) {

View Full Code Here

    written.addAll(writeRandomItems(r, writer, num, size));
    writer.endShard();
    byte[] writtenData = arrayOutputWriter.toByteArray();
    assertEquals(0, writtenData.length % BLOCK_SIZE);
    ByteArrayInputStream arrayInputStream = new ByteArrayInputStream(writtenData);
    LevelDbInputReader reader = new TestLevelDbInputReader(Channels.newChannel(arrayInputStream));
    verifyWrittenData(written, reader);
  }

View Full Code Here

    List<byte[]> written = writeRandomItems(r, writer, number, size);
    writer.endShard();
    byte[] writtenData = arrayOutputWriter.toByteArray();
    assertEquals(0, writtenData.length % BLOCK_SIZE);
    ByteArrayInputStream arrayInputStream = new ByteArrayInputStream(writtenData);
    LevelDbInputReader reader = new TestLevelDbInputReader(Channels.newChannel(arrayInputStream));
    verifyWrittenData(written, reader);
  }

View Full Code Here

TOP

Related Classes of com.google.appengine.tools.mapreduce.inputs.LevelDbInputReader$Record

com.alibaba.jstorm.container.cgroup.Device

com.google.appengine.tools.mapreduce.impl.util.Crc32c

com.google.appengine.tools.mapreduce.impl.util.LevelDbConstants.RecordType

com.google.appengine.tools.mapreduce.outputs.LevelDbTest

com.ibm.icu.text.CanonicalIterator

com.vividsolutions.jts.geom.CoordinateSequence

com.vividsolutions.jts.geom.CoordinateSequenceFactory

com.vividsolutions.jts.geom.Envelope

com.vividsolutions.jts.geom.LinearRing

org.apache.avro.Schema.Field

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.