Examples of org.apache.hadoop.hive.ql.exec.tez.tools.InputMerger

Package org.apache.hadoop.hive.ql.exec.tez.tools

Examples of org.apache.hadoop.hive.ql.exec.tez.tools.InputMerger

org.apache.hadoop.hive.ql.exec.tez.tools.InputMerger
A KeyValuesReader implementation that returns a sorted stream of key-values by doing a sorted merge of the key-value in LogicalInputs. Tags are in the last byte of the key, so no special handling for tags is required. Uses a priority queue to pick the KeyValuesReader of the input that is next in sort order.

      if(shuffleInputs.size() == 1){
        //no merging of inputs required
        kvsReader = (KeyValuesReader) shuffleInputs.get(0).getReader();
      }else {
        //get a sort merged input
        kvsReader = new InputMerger(shuffleInputs);
      }
    } catch (Exception e) {
      throw new IOException(e);
    }

View Full Code Here

      if(shuffleInputs.size() == 1){
        //no merging of inputs required
        kvsReader = (KeyValuesReader) shuffleInputs.get(0).getReader();
      }else {
        //get a sort merged input
        kvsReader = new InputMerger(shuffleInputs);
      }
    } catch (Exception e) {
      throw new IOException(e);
    }

View Full Code Here

TOP

Related Classes of org.apache.hadoop.hive.ql.exec.tez.tools.InputMerger

org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor

org.apache.hadoop.io.BinaryComparable

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.