Examples of org.apache.pig.impl.util.UDFContext.serialize()

Class org.apache.pig.impl.util.UDFContext

Examples of org.apache.pig.impl.util.UDFContext.serialize()

org.apache.pig.impl.util.UDFContext.serialize()
Serialize the UDF specific information into an instance of JobConf. This function is intended to be called on the front end in preparation for sending the data to the backend. @param conf JobConf to serialize into @throws IOException if underlying serialization throws it

                if (loader instanceof SampleLoader) {
                    Long iSize = FileLocalizer.getSize(spec.getFileName(), pigContext.getProperties());                     
                    UDFContext udfc = UDFContext.getUDFContext();
                    Properties p = udfc.getUDFProperties(SampleLoader.class);
                    p.setProperty("pig.input." + i + ".size", Long.toString(iSize));
                    udfc.serialize(job);
                }
            
        Slice[] pigs = spec.getSlicer().slice(store, spec.getFileName());
        for (Slice split : pigs) {
            splits.add(new SliceWrapper(split, pigContext.getExecType(), i, fs, inpTargets.get(i)));

View Full Code Here

        udfc.addJobConf(job);
        udfc.deserialize();
        
        wrapped.init(store);
        
        udfc.serialize(job);


        job.set("map.target.ops", ObjectSerializer.serialize(targetOps));
        // Mimic org.apache.hadoop.mapred.FileSplit if feasible...
        String[] locations = wrapped.getLocations();
        if (locations.length > 0) {

View Full Code Here

        SchemaTupleBackend.initialize(conf, pigContext);


        UDFContext udfContext = UDFContext.getUDFContext();
        udfContext.addJobConf(conf);
        udfContext.setClientSystemProps(pigContext.getProperties());
        udfContext.serialize(conf);


        PigMapReduce.sJobConfInternal.set(conf);
        String dtzStr = conf.get("pig.datetime.default.tz");
        if (dtzStr != null && dtzStr.length() > 0) {
            // ensure that the internal timezone is uniformly in UTC offset style

View Full Code Here

        SchemaTupleBackend.initialize(conf, pigContext);


        UDFContext udfContext = UDFContext.getUDFContext();
        udfContext.addJobConf(conf);
        udfContext.setClientSystemProps(pigContext.getProperties());
        udfContext.serialize(conf);


        PigMapReduce.sJobConfInternal.set(conf);
        String dtzStr = conf.get("pig.datetime.default.tz");
        if (dtzStr != null && dtzStr.length() > 0) {
            // ensure that the internal timezone is uniformly in UTC offset style

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.