Examples of org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.initialize()

Package org.apache.hadoop.hive.serde2.lazy

Class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe

Examples of org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.initialize()

org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.initialize()
Initialize the SerDe given the parameters. serialization.format: separator char or byte code (only supports byte-value up to 127) columns: ","-separated column names columns.types: ",", ":", or ";"-separated column types @see SerDe#initialize(Configuration,Properties)

    schema.setProperty(Constants.SERIALIZATION_DDL, ddl);
    schema.setProperty(Constants.SERIALIZATION_LIB, DynamicSerDe.class.getName());
    schema.setProperty(Constants.SERIALIZATION_SORT_ORDER, order);


    DynamicSerDe serde = new DynamicSerDe();
    serde.initialize(new Configuration(), schema);


    ObjectInspector oi = serde.getObjectInspector();


    // Try to serialize
    BytesWritable bytes[] = new BytesWritable[structs.length];

View Full Code Here

      schema.setProperty(Constants.COLLECTION_DELIM, "1");
      schema.setProperty(Constants.LINE_DELIM, "2");
      schema.setProperty(Constants.MAPKEY_DELIM, "4");


      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      TCTLSeparatedProtocol prot = (TCTLSeparatedProtocol)serde.oprot_;
      assertTrue(prot.getPrimarySeparator().equals("\u0009"));
      
      ObjectInspector oi = serde.getObjectInspector();

View Full Code Here

                         "struct test { i32 hello, list<string> bye, map<string,i32> another}");
      schema.setProperty(Constants.SERIALIZATION_LIB, new DynamicSerDe().getClass().toString());
      schema.setProperty(TCTLSeparatedProtocol.ReturnNullsKey, "true");


      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      ObjectInspector oi = serde.getObjectInspector();
      
      // Try to serialize
      BytesWritable bytes = (BytesWritable) serde.serialize(struct, oi);

View Full Code Here

                         "struct test { i32 hello, list<string> bye, map<string,i32> another}");
      schema.setProperty(Constants.SERIALIZATION_LIB, new DynamicSerDe().getClass().toString());
      schema.setProperty(TCTLSeparatedProtocol.ReturnNullsKey, "true");


      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      ObjectInspector oi = serde.getObjectInspector();


      // Try to serialize
      BytesWritable bytes = (BytesWritable) serde.serialize(struct, oi);

View Full Code Here

                         "struct test { i32 hello, list<string> bye, map<string,i32> another}");
      schema.setProperty(Constants.SERIALIZATION_LIB, new DynamicSerDe().getClass().toString());


      schema.setProperty(TCTLSeparatedProtocol.ReturnNullsKey, "true");
      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      ObjectInspector oi = serde.getObjectInspector();


      // Try to serialize
      BytesWritable bytes = (BytesWritable) serde.serialize(struct, oi);

View Full Code Here

                         "struct test { i32 hello, list<string> bye, map<string,i32> another}");
      schema.setProperty(Constants.SERIALIZATION_LIB, new DynamicSerDe().getClass().toString());


      schema.setProperty(TCTLSeparatedProtocol.ReturnNullsKey, "false");
      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      ObjectInspector oi = serde.getObjectInspector();


      // Try to serialize
      BytesWritable bytes = (BytesWritable) serde.serialize(struct, oi);

View Full Code Here

      struct.add(Integer.valueOf(234));
      struct.add(bye);
      struct.add(another);


      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      ObjectInspector oi = serde.getObjectInspector();


      // Try to serialize
      BytesWritable bytes = (BytesWritable) serde.serialize(struct, oi);

View Full Code Here

      schema.setProperty(Constants.COLLECTION_DELIM, "1");
      schema.setProperty(Constants.LINE_DELIM, "2");
      schema.setProperty(Constants.MAPKEY_DELIM, "4");


      DynamicSerDe serde = new DynamicSerDe();
      serde.initialize(new Configuration(), schema);


      TCTLSeparatedProtocol prot = (TCTLSeparatedProtocol)serde.oprot_;
      assertTrue(prot.getPrimarySeparator().equals("\u0009"));
      
      ObjectInspector oi = serde.getObjectInspector();

View Full Code Here

    dsp.setProperty(Constants.SERIALIZATION_FORMAT, org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.class.getName());
    dsp.setProperty(org.apache.hadoop.hive.metastore.api.Constants.META_TABLE_NAME, "result");
    dsp.setProperty(Constants.SERIALIZATION_DDL, client.getSchema());
    dsp.setProperty(Constants.SERIALIZATION_LIB, ds.getClass().toString());
    dsp.setProperty(Constants.FIELD_DELIM, "9");
    ds.initialize(new Configuration(), dsp);


    String row = client.fetchOne();
    Object o = ds.deserialize(new BytesWritable(row.getBytes()));


    assertEquals(o.getClass().toString(), "class java.util.ArrayList");

View Full Code Here

    client.execute(sql);
    row = client.fetchOne();
    dsp.setProperty(Constants.SERIALIZATION_DDL, client.getSchema());
    // Need a new DynamicSerDe instance - re-initialization is not supported.
    ds = new DynamicSerDe();
    ds.initialize(new Configuration(), dsp);
    o = ds.deserialize(new BytesWritable(row.getBytes()));
  }


}

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.