Examples of org.archive.wayback.resourceindex.filters.WARCRevisitAnnotationFilter

Package org.archive.wayback.resourceindex.filters

Examples of org.archive.wayback.resourceindex.filters.WARCRevisitAnnotationFilter

org.archive.wayback.resourceindex.filters.WARCRevisitAnnotationFilter
Filter class that observes a stream of SearchResults tracking for each complete record, a mapping of that records Digest to: Arc/Warc Filename Arc/Warc offset HTTP Response MIME-Type Redirect URL If subsequent SearchResults are missing these fields ("-") and the Digest field is in the map, then the SearchResults missing fields are replaced with the values from the previously seen record with the same digest, and an additional annotation field is added. @author brad @version $Date: 2011-11-28 22:03:59 -0800 (Mon, 28 Nov 2011) $, $Revision: 3574 $

  private ObjectFilterChain<CaptureSearchResult> chain;


  public AnnotatingCaptureFilterGroup(LocalResourceIndex index) {
    chain = new ObjectFilterChain<CaptureSearchResult>();
    if(index.isDedupeRecords()) {
      chain.addFilter(new WARCRevisitAnnotationFilter());
      chain.addFilter(new ConditionalGetAnnotationFilter());
      //chain.addFilter(new DuplicateHashFilter());
    }
  }

View Full Code Here

TOP

Related Classes of org.archive.wayback.resourceindex.filters.WARCRevisitAnnotationFilter

org.archive.wayback.core.CaptureSearchResult

org.archive.wayback.resourceindex.filterfactory.AnnotatingCaptureFilterGroup

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.