Examples of org.archive.access.nutch.jobs.ImportArcs$WaxFetcherOutputFormat

org.archive.access.nutch.jobs.ImportArcs
Override of nutch FetcherOutputFormat so I can substitute my own ParseOutputFormat, {@link WaxParseOutputFormat}. While I'm here, removed content references. NutchWAX doesn't save content. @author stack

    Path segment = new Path(od.getSegments(),
      Generator.generateSegmentName() +
        ((collectionName == null || collectionName.length() <= 0)?
          "": "-" + collectionName));
        
    new ImportArcs(getJobConf()).importArcs(input, segment, collectionName);
  }

View Full Code Here

TOP

Related Classes of org.archive.access.nutch.jobs.ImportArcs$WaxFetcherOutputFormat

org.apache.commons.httpclient.Header

org.apache.hadoop.fs.Path

org.apache.hadoop.io.Text

org.apache.hadoop.io.Writable

org.apache.hadoop.mapred.JobConf

org.apache.hadoop.mapred.RecordWriter

org.apache.nutch.crawl.CrawlDatum

org.apache.nutch.crawl.MapWritable

org.apache.nutch.fetcher.FetcherOutput

org.apache.nutch.metadata.Metadata

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.