Examples of com.google.code.yanf4j.buffer.IoBuffer

com.google.code.yanf4j.buffer.IoBuffer
cate heap buffer by default. IoBuffer.setUseDirectBuffer(false); // A new heap buffer is returned. IoBuffer buf = IoBuffer.allocate(1024);

Wrapping existing NIO buffers and arrays

This class provides a few wrap(...) methods that wraps any NIO buffers and byte arrays.
AutoExpand

Writing variable-length data using NIO ByteBuffers is not really easy, and it is because its size is fixed. {@link IoBuffer} introducesautoExpand property. If autoExpand property is true, you never get {@link BufferOverflowException} or{@link IndexOutOfBoundsException} (except when index is negative). Itautomatically expands its capacity and limit value. For example:
```
 String greeting = messageBundle.getMessage("hello"); IoBuffer buf = IoBuffer.allocate(16); // Turn on autoExpand (it is off by default) buf.setAutoExpand(true); buf.putString(greeting, utf8encoder); 
```
The underlying {@link ByteBuffer} is reallocated by {@link IoBuffer} behindthe scene if the encoded data is larger than 16 bytes in the example above. Its capacity will double, and its limit will increase to the last position the string is written.

AutoShrink

You might also want to decrease the capacity of the buffer when most of the allocated memory area is not being used. {@link IoBuffer} providesautoShrink property to take care of this issue. If autoShrink is turned on, {@link IoBuffer} halves the capacity of thebuffer when {@link #compact()} is invoked and only 1/4 or less of the currentcapacity is being used.
You can also {@link #shrink()} method manually to shrink the capacity of thebuffer.
The underlying {@link ByteBuffer} is reallocated by {@link IoBuffer} behindthe scene, and therefore {@link #buf()} will return a different{@link ByteBuffer} instance once capacity changes. Please also note{@link #compact()} or {@link #shrink()} will not decrease the capacity if thenew capacity is less than the {@link #minimumCapacity()} of the buffer.
Derived Buffers

Derived buffers are the buffers which were created by {@link #duplicate()}, {@link #slice()}, or {@link #asReadOnlyBuffer()}. They are useful especially when you broadcast the same messages to multiple {@link IoSession}s. Please note that the buffer derived from and its derived buffers are not both auto-expandable neither auto-shrinkable. Trying to call {@link #setAutoExpand(boolean)} or {@link #setAutoShrink(boolean)} withtrue parameter will raise an {@link IllegalStateException}.

Changing Buffer Allocation Policy

{@link IoBufferAllocator} interface lets you override the default buffermanagement behavior. There are two allocators provided out-of-the-box:
- {@link SimpleBufferAllocator} (default)
- {@link CachedBufferAllocator}
You can implement your own allocator and use it by calling {@link #setAllocator(IoBufferAllocator)}.
@author The Apache MINA Project (dev@mina.apache.org) @version $Rev: 748525 $, $Date: 2009-02-27 14:45:31 +0100 (Fri, 27 Feb 2009)$

      if (message.getWriteFuture() != null) {
        message.getWriteFuture().setResult(Boolean.TRUE);
      }
      return message.getMessage();
    }
    IoBuffer writeBuffer = message.getWriteBuffer();
    // begin writing
    message.writing();
    if (this.useBlockingWrite) {
      return this.blockingWrite(this.selectableChannel, message, writeBuffer);
    } else {
      while (true) {
        long n = this.doRealWrite(this.selectableChannel, writeBuffer);
        if (n > 0) {
          this.statistics.statisticsWrite(n);
          this.scheduleWritenBytes.addAndGet(0 - n);
        }
        if (writeBuffer == null || !writeBuffer.hasRemaining()) {
          if (message.getWriteFuture() != null) {
            message.getWriteFuture().setResult(Boolean.TRUE);
          }
          return message.getMessage();
        } else if (n == 0) {

View Full Code Here

        ByteUtils.getBytes(key), null, innerKeyExpMap.get(key), false);
    lastCommand.encode();
    bufferList.add(lastCommand.getIoBuffer());
    totalLength += lastCommand.getIoBuffer().remaining();


    IoBuffer mergedBuffer = IoBuffer.allocate(totalLength);
    for (IoBuffer buffer : bufferList) {
      mergedBuffer.put(buffer.buf());
    }
    mergedBuffer.flip();


    Command resultCommand = new BinaryGetMultiCommand(key,
        CommandType.GET_MANY, latch);
    resultCommand.setIoBuffer(mergedBuffer);
    this.sendCommand(resultCommand);

View Full Code Here

        OpCode.GET_KEY, false);
    lastCommand.encode();
    bufferList.add(lastCommand.getIoBuffer());
    totalLength += lastCommand.getIoBuffer().remaining();


    IoBuffer mergedBuffer = IoBuffer.allocate(totalLength);
    for (IoBuffer buffer : bufferList) {
      mergedBuffer.put(buffer.buf());
    }
    mergedBuffer.flip();
    Command resultCommand = new BinaryGetMultiCommand(key, cmdType, latch);
    resultCommand.setIoBuffer(mergedBuffer);
    return resultCommand;
  }

View Full Code Here

  public void testEncode() {
    this.encoder = new MemcachedCodecFactory().getEncoder();
    Command command = new TextCommandFactory().createVersionCommand(
        new CountDownLatch(1), null);
    command.encode();
    IoBuffer buffer = this.encoder.encode(command, null);
    assertEquals(buffer.buf(), ServerAddressAware.VERSION);
  }

View Full Code Here

        OpCode.GET_KEY, false);
    lastCommand.encode();
    bufferList.add(lastCommand.getIoBuffer());
    totalLength += lastCommand.getIoBuffer().remaining();


    IoBuffer mergedBuffer = IoBuffer.allocate(totalLength);
    for (IoBuffer buffer : bufferList) {
      mergedBuffer.put(buffer.buf());
    }
    mergedBuffer.flip();
    Command resultCommand = new BinaryGetMultiCommand(key, cmdType, latch);
    resultCommand.setIoBuffer(mergedBuffer);
    return resultCommand;
  }

View Full Code Here


    @Test
    public void testAllocate() throws Exception {
        for (int i = 10; i < 1048576 * 2; i = i * 11 / 10) // increase by 10%
        {
            IoBuffer buf = IoBuffer.allocate(i);
            assertEquals(0, buf.position());
            assertEquals(buf.capacity(), buf.remaining());
            assertTrue(buf.capacity() >= i);
            assertTrue(buf.capacity() < i * 2);
        }
    }

View Full Code Here

    }




    @Test
    public void testAutoExpand() throws Exception {
        IoBuffer buf = IoBuffer.allocate(1);


        buf.put((byte) 0);
        try {
            buf.put((byte) 0);
            fail("Buffer can't auto expand, with autoExpand property set at false");
        }
        catch (BufferOverflowException e) {
            // Expected Exception as auto expand property is false
            assertTrue(true);
        }


        buf.setAutoExpand(true);
        buf.put((byte) 0);
        assertEquals(2, buf.position());
        assertEquals(2, buf.limit());
        assertEquals(2, buf.capacity());


        buf.setAutoExpand(false);
        try {
            buf.put(3, (byte) 0);
            fail("Buffer can't auto expand, with autoExpand property set at false");
        }
        catch (IndexOutOfBoundsException e) {
            // Expected Exception as auto expand property is false
            assertTrue(true);
        }


        buf.setAutoExpand(true);
        buf.put(3, (byte) 0);
        assertEquals(2, buf.position());
        assertEquals(4, buf.limit());
        assertEquals(4, buf.capacity());


        // Make sure the buffer is doubled up.
        buf = IoBuffer.allocate(1).setAutoExpand(true);
        int lastCapacity = buf.capacity();
        for (int i = 0; i < 1048576; i++) {
            buf.put((byte) 0);
            if (lastCapacity != buf.capacity()) {
                assertEquals(lastCapacity * 2, buf.capacity());
                lastCapacity = buf.capacity();
            }
        }
    }

View Full Code Here

    }




    @Test
    public void testAutoExpandMark() throws Exception {
        IoBuffer buf = IoBuffer.allocate(4).setAutoExpand(true);


        buf.put((byte) 0);
        buf.put((byte) 0);
        buf.put((byte) 0);


        // Position should be 3 when we reset this buffer.
        buf.mark();


        // Overflow it
        buf.put((byte) 0);
        buf.put((byte) 0);


        assertEquals(5, buf.position());
        buf.reset();
        assertEquals(3, buf.position());
    }

View Full Code Here

    }




    @Test
    public void testAutoShrink() throws Exception {
        IoBuffer buf = IoBuffer.allocate(8).setAutoShrink(true);


        // Make sure the buffer doesn't shrink too much (less than the initial
        // capacity.)
        buf.sweep((byte) 1);
        buf.fill(7);
        buf.compact();
        assertEquals(8, buf.capacity());
        assertEquals(1, buf.position());
        assertEquals(8, buf.limit());
        buf.clear();
        assertEquals(1, buf.get());


        // Expand the buffer.
        buf.capacity(32).clear();
        assertEquals(32, buf.capacity());


        // Make sure the buffer shrinks when only 1/4 is being used.
        buf.sweep((byte) 1);
        buf.fill(24);
        buf.compact();
        assertEquals(16, buf.capacity());
        assertEquals(8, buf.position());
        assertEquals(16, buf.limit());
        buf.clear();
        for (int i = 0; i < 8; i++) {
            assertEquals(1, buf.get());
        }


        // Expand the buffer.
        buf.capacity(32).clear();
        assertEquals(32, buf.capacity());


        // Make sure the buffer shrinks when only 1/8 is being used.
        buf.sweep((byte) 1);
        buf.fill(28);
        buf.compact();
        assertEquals(8, buf.capacity());
        assertEquals(4, buf.position());
        assertEquals(8, buf.limit());
        buf.clear();
        for (int i = 0; i < 4; i++) {
            assertEquals(1, buf.get());
        }


        // Expand the buffer.
        buf.capacity(32).clear();
        assertEquals(32, buf.capacity());


        // Make sure the buffer shrinks when 0 byte is being used.
        buf.fill(32);
        buf.compact();
        assertEquals(8, buf.capacity());
        assertEquals(0, buf.position());
        assertEquals(8, buf.limit());


        // Expand the buffer.
        buf.capacity(32).clear();
        assertEquals(32, buf.capacity());


        // Make sure the buffer doesn't shrink when more than 1/4 is being used.
        buf.sweep((byte) 1);
        buf.fill(23);
        buf.compact();
        assertEquals(32, buf.capacity());
        assertEquals(9, buf.position());
        assertEquals(32, buf.limit());
        buf.clear();
        for (int i = 0; i < 9; i++) {
            assertEquals(1, buf.get());
        }
    }

View Full Code Here

    }




    @Test
    public void testGetString() throws Exception {
        IoBuffer buf = IoBuffer.allocate(16);
        CharsetDecoder decoder;


        Charset charset = Charset.forName("UTF-8");
        buf.clear();
        buf.putString("hello", charset.newEncoder());
        buf.put((byte) 0);
        buf.flip();
        assertEquals("hello", buf.getString(charset.newDecoder()));


        buf.clear();
        buf.putString("hello", charset.newEncoder());
        buf.flip();
        assertEquals("hello", buf.getString(charset.newDecoder()));


        decoder = Charset.forName("ISO-8859-1").newDecoder();
        buf.clear();
        buf.put((byte) 'A');
        buf.put((byte) 'B');
        buf.put((byte) 'C');
        buf.put((byte) 0);


        buf.position(0);
        assertEquals("ABC", buf.getString(decoder));
        assertEquals(4, buf.position());


        buf.position(0);
        buf.limit(1);
        assertEquals("A", buf.getString(decoder));
        assertEquals(1, buf.position());


        buf.clear();
        assertEquals("ABC", buf.getString(10, decoder));
        assertEquals(10, buf.position());


        buf.clear();
        assertEquals("A", buf.getString(1, decoder));
        assertEquals(1, buf.position());


        // Test a trailing garbage
        buf.clear();
        buf.put((byte) 'A');
        buf.put((byte) 'B');
        buf.put((byte) 0);
        buf.put((byte) 'C');
        buf.position(0);
        assertEquals("AB", buf.getString(4, decoder));
        assertEquals(4, buf.position());


        buf.clear();
        buf.fillAndReset(buf.limit());
        decoder = Charset.forName("UTF-16").newDecoder();
        buf.put((byte) 0);
        buf.put((byte) 'A');
        buf.put((byte) 0);
        buf.put((byte) 'B');
        buf.put((byte) 0);
        buf.put((byte) 'C');
        buf.put((byte) 0);
        buf.put((byte) 0);


        buf.position(0);
        assertEquals("ABC", buf.getString(decoder));
        assertEquals(8, buf.position());


        buf.position(0);
        buf.limit(2);
        assertEquals("A", buf.getString(decoder));
        assertEquals(2, buf.position());


        buf.position(0);
        buf.limit(3);
        assertEquals("A", buf.getString(decoder));
        assertEquals(2, buf.position());


        buf.clear();
        assertEquals("ABC", buf.getString(10, decoder));
        assertEquals(10, buf.position());


        buf.clear();
        assertEquals("A", buf.getString(2, decoder));
        assertEquals(2, buf.position());


        buf.clear();
        try {
            buf.getString(1, decoder);
            fail();
        }
        catch (IllegalArgumentException e) {
            // Expected an Exception, signifies test success
            assertTrue(true);
        }


        // Test getting strings from an empty buffer.
        buf.clear();
        buf.limit(0);
        assertEquals("", buf.getString(decoder));
        assertEquals("", buf.getString(2, decoder));


        // Test getting strings from non-empty buffer which is filled with 0x00
        buf.clear();
        buf.putInt(0);
        buf.clear();
        buf.limit(4);
        assertEquals("", buf.getString(decoder));
        assertEquals(2, buf.position());
        assertEquals(4, buf.limit());


        buf.position(0);
        assertEquals("", buf.getString(2, decoder));
        assertEquals(2, buf.position());
        assertEquals(4, buf.limit());
    }

View Full Code Here

0 1 2 3 4

TOP

Related Classes of com.google.code.yanf4j.buffer.IoBuffer

com.google.code.yanf4j.core.impl.ByteBufferCodecFactory$ByteBufferDecoder

com.google.code.yanf4j.core.impl.ByteBufferCodecFactory$ByteBufferEncoder

com.google.code.yanf4j.core.impl.TextLineCodecFactory$StringEncoder

com.google.code.yanf4j.nio.impl.NioTCPSession

com.google.code.yanf4j.test.unittest.buffer.IoBufferTest

com.google.code.yanf4j.test.unittest.core.impl.ByteBufferCodecFactoryUnitTest

com.google.code.yanf4j.test.unittest.core.impl.TextLineCodecFactoryUnitTest

net.rubyeye.xmemcached.command.BinaryCommandFactory

net.rubyeye.xmemcached.test.unittest.codec.MemcachedEncoderUnitTest

net.rubyeye.xmemcached.XMemcachedClient

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of com.google.code.yanf4j.buffer.IoBuffer

Wrapping existing NIO buffers and arrays

AutoExpand

AutoShrink

Derived Buffers

Changing Buffer Allocation Policy

Related Classes of com.google.code.yanf4j.buffer.IoBuffer