Examples of org.apache.hadoop.hive.ql.QueryPlan

org.apache.hadoop.hive.ql.QueryPlan
QueryPlan can be serialized to disk so that we can restart/resume the progress of it in the future, either within or outside of the current jvm.

      emptyScratchDirStr = ctx.getMRTmpFileURI();
      emptyScratchDir = new Path(emptyScratchDirStr);
      FileSystem fileSys = emptyScratchDir.getFileSystem(newJob);
      fileSys.mkdirs(emptyScratchDir);
      
      QueryPlan plan = drv.getPlan();
      MapRedTask selectTask = (MapRedTask)plan.getRootTasks().get(0);
      
      ExecDriver.addInputPaths(newJob, selectTask.getWork(), emptyScratchDir.toString(), ctx);
      Utilities.setMapRedWork(newJob, selectTask.getWork(), ctx.getMRTmpFileURI());
      
      CombineHiveInputFormat combineInputFormat = ReflectionUtils.newInstance(

View Full Code Here

   */
  public static QueryPlan deserializeQueryPlan(InputStream in, Configuration conf) {
    XMLDecoder d = null;
    try {
      d = new XMLDecoder(in, null, null);
      QueryPlan ret = (QueryPlan) d.readObject();
      return (ret);
    } finally {
      if (null != d) {
        d.close();
      }

View Full Code Here

0 1 2 3 4 5

TOP

Related Classes of org.apache.hadoop.hive.ql.QueryPlan

com.facebook.presto.hive.shaded.org.apache.thrift.protocol.TBinaryProtocol

com.facebook.presto.hive.shaded.org.apache.thrift.protocol.TJSONProtocol

com.facebook.presto.hive.shaded.org.apache.thrift.transport.TMemoryBuffer

org.apache.hadoop.hive.ql.exec.ConditionalTask

org.apache.hadoop.hive.ql.exec.ExecDriver

org.apache.hadoop.hive.ql.exec.mr.ExecDriver

org.apache.hadoop.hive.ql.exec.Utilities

org.apache.hadoop.hive.ql.hooks.ATSHook

org.apache.hadoop.hive.ql.hooks.CheckColumnAccessHook

org.apache.hadoop.hive.ql.hooks.CheckTableAccessHook

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.