Examples of org.apache.hadoop.hdfs.client.ShortCircuitReplica

org.apache.hadoop.hdfs.client.ShortCircuitReplica
A ShortCircuitReplica object contains file descriptors for a block that we are reading via short-circuit local reads. The file descriptors can be shared between multiple threads because all the operations we perform are stateless-- i.e., we use pread instead of read, to avoid using the shared position state.

    @Override
    public ShortCircuitReplicaInfo createShortCircuitReplicaInfo() {
      try {
        ExtendedBlockId key = new ExtendedBlockId(blockId, "test_bp1");
        return new ShortCircuitReplicaInfo(
            new ShortCircuitReplica(key,
                pair.getFileInputStreams()[0], pair.getFileInputStreams()[1],
                cache, Time.monotonicNow(), null));
      } catch (IOException e) {
        throw new RuntimeException(e);
      }

View Full Code Here

          new File(sockDir.getDir().getAbsolutePath(),
            UUID.randomUUID().toString()), "rw");
      raf.setLength(8192);
      FileInputStream shmStream = new FileInputStream(raf.getFD());
      shm = new ShortCircuitShm(ShmId.createRandom(), shmStream);
      ShortCircuitReplica replica = 
          new ShortCircuitReplica(key, dataIn, metaIn, shortCircuitCache,
              Time.now(), shm.allocAndRegisterSlot(
                  ExtendedBlockId.fromExtendedBlock(block)));
      blockReaderLocal = new BlockReaderLocal.Builder(
              new DFSClient.Conf(conf)).
          setFilename(TEST_PATH.getName()).

View Full Code Here

0 1

TOP

Related Classes of org.apache.hadoop.hdfs.client.ShortCircuitReplica

org.apache.hadoop.fs.TestEnhancedByteBufferAccess

org.apache.hadoop.hdfs.BlockReaderFactory

org.apache.hadoop.hdfs.client.ShortCircuitCache

org.apache.hadoop.hdfs.client.ShortCircuitCache$CacheCleaner

org.apache.hadoop.hdfs.TestBlockReaderLocal

org.apache.hadoop.hdfs.TestShortCircuitCache

org.apache.hadoop.hdfs.TestShortCircuitCache$SimpleReplicaCreator

java.nio.channels.FileChannel

java.io.IOException

java.nio.MappedByteBuffer

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.