Examples of java.nio.charset.CharsetEncoder

java.nio.charset.CharsetEncoder
An converter that can convert 16-bit Unicode character sequence to byte sequence in some charset .
The input character sequence is wrapped by {@link java.nio.CharBuffer CharBuffer} and the output character sequence is{@link java.nio.ByteBuffer ByteBuffer}. A encoder instance should be used in following sequence, which is referred to as a encoding operation:
1. Invoking the {@link #reset() reset} method to reset the encoder if theencoder has been used;
2. Invoking the {@link #encode(CharBuffer,ByteBuffer,boolean) encode}method until the addtional input is not needed, the endOfInput parameter must be set to false, the input buffer must be filled and the output buffer must be flushed between invocations;
3. Invoking the {@link #encode(CharBuffer,ByteBuffer,boolean) encode}method last time, and the the endOfInput parameter must be set to true
4. Invoking the {@link #flush(ByteBuffer) flush} method to flush theoutput.
The {@link #encode(CharBuffer,ByteBuffer,boolean) encode} method willconvert as many characters as possible, and the process won't stop except the input characters has been run out of, the output buffer has been filled or some error has happened. A {@link CoderResult CoderResult} instance will bereturned to indicate the stop reason, and the invoker can identify the result and choose further action, which can include filling the input buffer, flushing the output buffer, recovering from error and trying again.

There are two common encoding errors. One is named as malformed and it is returned when the input content is illegal 16-bit Unicode character sequence, the other is named as unmappable character and occurs when there is a problem mapping the input to a valid byte sequence in the specific charset.

The two errors can be handled in three ways, the default one is to report the error to the invoker by a {@link CoderResult CoderResult} instance, and thealternatives are to ignore it or to replace the erroneous input with the replacement byte array. The replacement byte array is {(byte)'?'} by default and can be changed by invoking {@link #replaceWith(byte[]) replaceWith}method. The invoker of this encoder can choose one way by specifing a {@link CodingErrorAction CodingErrorAction} instance for each error type via{@link #onMalformedInput(CodingErrorAction) onMalformedInput} method and{@link #onUnmappableCharacter(CodingErrorAction) onUnmappableCharacter}method.

This class is abstract class and encapsulate many common operations of encoding process for all charsets. encoder for specific charset should extend this class and need only implement {@link #encodeLoop(CharBuffer,ByteBuffer) encodeLoop} method for basicencoding loop. If a subclass maintains internal state, it should override the {@link #implFlush(ByteBuffer) implFlush} method and{@link #implReset() implReset} method in addition.

This class is not thread-safe.
@see java.nio.charset.Charset @see java.nio.charset.CharsetDecoder

                IoBuffer buffer = IoBuffer.allocate(1);
                buffer.setAutoExpand(true);


                Charset charset = Charset.forName("UTF-8");


                CharsetEncoder encoder = charset.newEncoder();


                for (int i = 0; i < 5; i++) {
                    try {
                        buffer.putString("\u89d2", encoder);
                        buffer.putPrefixedString("\u89d2", encoder);

View Full Code Here

    public static void putDecoder(CharsetDecoder decoder) { decoders.put(decoder) ; }
    
    /** Allocate a CharsetEncoder, creating as necessary */
    public static CharsetEncoder allocEncoder()
    {
        CharsetEncoder enc = Chars.getEncoder();
        // Blocking finite Pool - does not happen.
        // Plain Pool (sync wrapped) - might - allocate an extra one. 
        if ( enc == null ) 
            enc = Chars.createEncoder() ;
        enc
          .onMalformedInput(CodingErrorAction.REPLACE)
          .onUnmappableCharacter(CodingErrorAction.REPLACE)
          .reset() ;
        
        return enc ;

View Full Code Here

     *            The {@code OutputStream} to write to.
     * @throws IOException
     *             If an error occurs writing the {@code Manifest}.
     */
    static void write(Manifest manifest, OutputStream out) throws IOException {
        CharsetEncoder encoder = ThreadLocalCache.utf8Encoder.get();
        ByteBuffer buffer = ThreadLocalCache.byteBuffer.get();


        String version = manifest.mainAttributes
                .getValue(Attributes.Name.MANIFEST_VERSION);
        if (version != null) {

View Full Code Here

    /** Encode a string into a ByteBuffer : on return position is the end of the encoding */
    public static int toByteBuffer(CharSequence s, ByteBuffer bb)
    {
        //BlockUTF8.fromChars(s, bb) ;
        // To be removed (Dec 2011)
        CharsetEncoder enc = Chars.allocEncoder();
        int x = toByteBuffer(s, bb, enc) ;
        Chars.deallocEncoder(enc) ;
        return x ;
    }

View Full Code Here

    String toString(byte[] ba) {
        return toString(ba, ba.length);
    }


    byte[] getBytes(String s) {
        CharsetEncoder ce = encoder().reset();
        char[] ca = s.toCharArray();
        int len = (int)(ca.length * ce.maxBytesPerChar());
        byte[] ba = new byte[len];
        if (len == 0)
            return ba;
        // UTF-8 only for now. Other ArrayDeocder only handles
        // CodingErrorAction.REPLACE mode.
        if (isUTF8 && ce instanceof ArrayEncoder) {
            int blen = ((ArrayEncoder)ce).encode(ca, 0, ca.length, ba);
            if (blen == -1)    // malformed
                throw new IllegalArgumentException("MALFORMED");
            return Arrays.copyOf(ba, blen);
        }
        ByteBuffer bb = ByteBuffer.wrap(ba);
        CharBuffer cb = CharBuffer.wrap(ca);
        CoderResult cr = ce.encode(cb, bb, true);
        if (!cr.isUnderflow())
            throw new IllegalArgumentException(cr.toString());
        cr = ce.flush(bb);
        if (!cr.isUnderflow())
            throw new IllegalArgumentException(cr.toString());
        if (bb.position() == ba.length)  // defensive copy?
            return ba;
        else

View Full Code Here

  public static String convertToHTMLEntities(String s, boolean encodeTags) {
    return convertToHTMLEntities(s, null, encodeTags);
  }
  
  public static String convertToHTMLEntities(String s, String charset, boolean encodeTags) {
    CharsetEncoder ce = charset == null ? null : Charset.forName(charset).newEncoder();
    StringBuffer sb = new StringBuffer(s.length());
    
    for (int i = 0; i < s.length(); i++) {
      char c = s.charAt(i);
      int n = ((int) c) & 0xFFFF;
      
      if (n > 127) {
        if (ce != null && ce.canEncode(c)) {
          sb.append(c);
        } else {
          String ent = NUMBER_TO_ENTITY.getProperty(Integer.toString(c));
          
          if (ent == null) {

View Full Code Here

    public String getCharsetName() {
        return charset.name();
    }


    private CharsetEncoder getEncoder() {
        CharsetEncoder encoder = (CharsetEncoder) getReference(encoderCache);
        if (encoder == null) {
            encoder = charset.newEncoder().onMalformedInput(
                    CodingErrorAction.REPLACE).onUnmappableCharacter(
                    CodingErrorAction.REPLACE);
            setReference(encoderCache, encoder);

View Full Code Here

     *            the char sequence
     * @return the encoded byte buffer
     */
    public ByteBuffer encode(CharSequence sequence) {
        CharBuffer buffer = CharBuffer.wrap(sequence);
        CharsetEncoder encoder = getEncoder();


        int n = 0;
        if (buffer.remaining() > 0) {
            n = (int) (buffer.remaining() * encoder.averageBytesPerChar());
            if (n == 0) {
                n = (int) (buffer.remaining() * encoder.maxBytesPerChar());
            }
        }
        ByteBuffer result = ByteBuffer.allocate(n); // judge result length
        if (n == 0) {
            return result;
        }


        encoder.reset();
        while (true) {
            CoderResult cr = buffer.hasRemaining() ? encoder.encode(buffer,
                    result, true) : encoder.flush(result);
            if (cr.isUnderflow()) {
                break;
            } else if (cr.isOverflow()) {
                n *= 2;
                result.flip();

View Full Code Here

     * @return the encoded byte buffer array
     * @throws IllegalArgumentException
     */
    public ByteBuffer[] encode(CharSequence sequence, int bufferCapcity) {
        CharBuffer buffer = CharBuffer.wrap(sequence);
        CharsetEncoder encoder = getEncoder();
        encoder.reset();


        Collection buffers = new ArrayList();
        while (true) {
            ByteBuffer out = ByteBuffer.allocate(bufferCapcity);
            CoderResult cr = encoder.encode(buffer, out, true);
            if (cr.isUnderflow()) {
                encoder.flush(out);
                out.flip();
                buffers.add(out);
                break;
            }
            if (cr.isOverflow()) {

View Full Code Here

     */
    public static BufferedWriter newBufferedWriter(Path path, Charset cs,
                                                   OpenOption... options)
        throws IOException
    {
        CharsetEncoder encoder = cs.newEncoder();
        Writer writer = new OutputStreamWriter(newOutputStream(path, options), encoder);
        return new BufferedWriter(writer);
    }

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

Related Classes of java.nio.charset.CharsetEncoder

com.alibaba.json.bvt.serializer.SerialWriterStringEncoderTest2

com.alimama.mdrill.utils.zip.NioZipEncoding

com.aragost.javahg.internals.Server

com.corundumstudio.socketio.protocol.PacketEncoder

com.datastax.driver.core.TypeCodec$StringCodec

com.google.code.yanf4j.test.unittest.buffer.IoBufferTest

com.googlecode.totallylazy.Characters

com.ibm.icu.dev.test.charset.TestCharset

com.itextpdf.text.pdf.PdfEncodings

com.knife.String.StringConverterUtil

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.