Examples of org.commoncrawl.util.shared.FlexBuffer

org.commoncrawl.util.shared.FlexBuffer
A tweaking of the hadoop Buffer class, basically allowing for cheap buffer copies (via underlying storage sharing), some copy on write support, and most importantly, support of offset based backing buffers A byte sequence that is used as a Java native type for buffer. It is resizable and distinguishes between the count of the seqeunce and the current capacity. @author rana

      // ok set count in underlying object
      stringBytes.setLength(utfLen);
      // now if length != 0
      if (utfLen != 0) {
        // access the underlying buffer object
        FlexBuffer buffer = stringBytes.getBuffer();
        // make sure copy on write status
        buffer.copyOnWrite();
        // ok read in buytes
        in.readFully(buffer.get(), buffer.getOffset(), utfLen);
      }
    }
    // ok read in new way
    else {
      stringBytes.readFields(in);

View Full Code Here

      queryDetails.setQueryDataClassType(_queryData.getClass().getName());
      // marshall data buffer
      DataOutputBuffer outputBuffer = new DataOutputBuffer();
      _queryData.serialize(outputBuffer,new BinaryProtocol());
      // and add it to query details
      queryDetails.setQueryDataBuffer(new FlexBuffer(outputBuffer.getData(),0,outputBuffer.getLength(),true));
      // set shard id 
      queryDetails.setShardId(split.getShardId());
      
      // allocate a new query status 
      QueryStatus queryStatus = new QueryStatus();

View Full Code Here

TOP

Related Classes of org.commoncrawl.util.shared.FlexBuffer

org.commoncrawl.query.Query

org.commoncrawl.rpc.BinaryProtocol

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.