Package org.apache.nutch.scoring

Examples of org.apache.nutch.scoring.ScoreDatum

55
56
57
58
59
60
61
62
63
64
65
    scoreData.clear();
    Map<Utf8, Utf8> outlinks = page.getOutlinks();
    if (outlinks != null) {
      for (Entry<Utf8, Utf8> e : outlinks.entrySet()) {
        scoreData.add(new ScoreDatum(0.0f, e.getKey().toString(), e.getValue().toString()));
      }
    }

    // TODO: Outlink filtering (i.e. "only keep the first n outlinks")
    try {
View Full Code Here
58
59
60
61
62
63
64
65
66
67
68
    if (outlinks != null) {
      for (Entry<Utf8, Utf8> e : outlinks.entrySet()) {
                int depth=Integer.MAX_VALUE;
        Utf8 depthUtf8=page.getFromMarkers(DbUpdaterJob.DISTANCE);
        if (depthUtf8 != null) depth=Integer.parseInt(depthUtf8.toString());
        scoreData.add(new ScoreDatum(0.0f, e.getKey().toString(),
            e.getValue().toString(), depth));
      }
    }

    // TODO: Outlink filtering (i.e. "only keep the first n outlinks")
View Full Code Here
TOP

Related Classes of org.apache.nutch.scoring.ScoreDatum

  • org.apache.nutch.crawl.DbUpdateMapper
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.