Package de.anomic.crawler

Examples of de.anomic.crawler.CrawlQueues

585
586
587
588
589
590
591
592
593
594
595
        // start a loader
        this.log.logConfig("Starting Crawl Loader");
        this.loader = new LoaderDispatcher(this);
        final Map<String, File> oaiFriends = OAIListFriendsLoader.loadListFriendsSources(new File("defaults/oaiListFriendsSource.xml"), getDataPath());
        OAIListFriendsLoader.init(this.loader, oaiFriends);
        this.crawlQueues = new CrawlQueues(this, this.queuesRoot);
        this.crawlQueues.noticeURL.setMinimumDelta(
                getConfigLong("minimumLocalDelta", this.crawlQueues.noticeURL.getMinimumLocalDelta()),
                getConfigLong("minimumGlobalDelta", this.crawlQueues.noticeURL.getMinimumGlobalDelta()));

        /*
 
View Full Code Here
611
612
613
614
615
616
617
618
619
620
621
        // start a loader
        this.log.logConfig("Starting Crawl Loader");
        this.loader = new LoaderDispatcher(this);
        final Map<String, File> oaiFriends = OAIListFriendsLoader.loadListFriendsSources(new File("defaults/oaiListFriendsSource.xml"), getDataPath());
        OAIListFriendsLoader.init(this.loader, oaiFriends);
        this.crawlQueues = new CrawlQueues(this, this.queuesRoot);
        this.crawlQueues.noticeURL.setMinimumDelta(
                getConfigLong("minimumLocalDelta", this.crawlQueues.noticeURL.getMinimumLocalDelta()),
                getConfigLong("minimumGlobalDelta", this.crawlQueues.noticeURL.getMinimumGlobalDelta()));

        /*
 
View Full Code Here
TOP

Related Classes of de.anomic.crawler.CrawlQueues

  • de.anomic.crawler.retrieval.Request
  • de.anomic.crawler.retrieval.Response
  • de.anomic.search.Switchboard
  • de.anomic.search.Switchboard.indexingQueueEntry
  • de.anomic.yacy.yacySeed
  • net.yacy.cora.document.RSSFeed
  • net.yacy.kelondro.data.meta.DigestURI
  • net.yacy.kelondro.logging.Log
  • net.yacy.peers.Seed
  • net.yacy.search.Switchboard
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.