Examples of VrecordIngressMR

com.intel.hadoop.graphbuilder.partition.mapreduce.vrecord.VrecordIngressMR
The MapRedue class takes from input directory a list of {@code VertexRecrod}and distribute each record to its partitions. The output directory is
For example: this vrecord {gvid:"123","mirrors":[0,1,2,4],...} will appear in the partition 0,1,2,4 of the output directory.

Input directory contains list of vertex records. Output directory structure:
- $outputdir/partition{$i}/vrecord for list of vertex records.
- $outputdir/partition{$i}/meta for meta info.

Examples of com.intel.hadoop.graphbuilder.partition.mapreduce.vrecord.VrecordIngressMR

        IngressJobKeyValueFactory.getValueClassByClassName(
            vidClass().getName(), vdataClass().getName(), edataClass()
                .getName()));
    // Distribute new class file to cluster.
    FsUtil.distributedTempClassToClassPath(job1.getConf());
    VrecordIngressMR job2 = new VrecordIngressMR();


    try {
      job1.run(inputs, output + "/edges", nparts, "greedy");
      job2.run(nparts, output + "/edges/vrecord", output + "/vrecords");
    } catch (Exception e) {
      e.printStackTrace();
      return false;
    }
    return true;

View Full Code Here

Examples of com.intel.hadoop.graphbuilder.partition.mapreduce.vrecord.VrecordIngressMR

 * @author Haijie Gu
 */
public class VrecordMapReduceTest {
  public static void main(String[] args) throws IOException {


    (new VrecordIngressMR()).run(Integer.valueOf(args[0]), args[1], args[2]);
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.