Examples of KeyValueWriter

org.apache.tez.runtime.library.api.KeyValueWriter
A key/value(s) pair based {@link Writer}
org.freezedry.persistence.writers.KeyValueWriter
Writes the semantic model as a list of key-value pairs to the specified output stream. The writer uses a {@link KeyValueBuilder} that flattens the semantic model and returns a list of key-value pairs. The {@link KeyValueBuilder} can be specified, or a default one is createdbased on the supplied specifications for the {@link KeyValueBuilder}. @author Robert Philipp

Examples of org.apache.tez.runtime.library.api.KeyValueWriter


    ShuffledUnorderedKVInput kvInput = (ShuffledUnorderedKVInput) li;
    MROutput mrOutput = (MROutput) lo;


    KeyValueReader kvReader = kvInput.getReader();
    KeyValueWriter kvWriter = mrOutput.getWriter();
    while (kvReader.next()) {
      Object key = kvReader.getCurrentKey();
      Object value = kvReader.getCurrentValue();


      kvWriter.write(key, value);
    }
    if (processorContext.canCommit()) {
      mrOutput.commit();
    } else {
      mrOutput.abort();

View Full Code Here

Examples of org.apache.tez.runtime.library.api.KeyValueWriter

  }


  @Override
  public synchronized KeyValueWriter getWriter() throws IOException {
    Preconditions.checkState(isStarted.get(), "Cannot get writer before starting the Output");
    return new KeyValueWriter() {
      @Override
      public void write(Object key, Object value) throws IOException {
        sorter.write(key, value);
      }
    };

View Full Code Here

Examples of org.apache.tez.runtime.library.api.KeyValueWriter

            if (output == null) {
                throw new ExecException("Output to vertex " + outputKey
                        + " is missing");
            }
            try {
                KeyValueWriter writer = (KeyValueWriter) output.getWriter();
                writers.add(writer);
                LOG.info("Attached output to vertex " + outputKey + " : output=" + output + ", writer=" + writer);
            } catch (Exception e) {
                throw new ExecException(e);
            }

View Full Code Here

Examples of org.freezedry.persistence.writers.KeyValueWriter

  @Override
  protected KeyValueWriter getPersistenceWriter()
  {
    if( keyValueWriter == null )
    {
      keyValueWriter = new KeyValueWriter();
    }
    return keyValueWriter;
  }

View Full Code Here

0 1 2 3 4

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.