Examples of com.flaptor.hounder.crawler.pagedb.distributed.PageCatcher

Package com.flaptor.hounder.crawler.pagedb.distributed

Examples of com.flaptor.hounder.crawler.pagedb.distributed.PageCatcher

com.flaptor.hounder.crawler.pagedb.distributed.PageCatcher
The PageCatcher implements an RMI service that acts as a remote PageDB, for other crawlers to send pages to. These pages will be catched into a local pagedb and served to the local DPageDB upon request for merging. @author Flaptor Development Team

    public void crawl (final int cycles) {
        try {
            StopMonitor.reset();
            FetchdataProcessor processor = new FetchdataProcessor();
            if (distributed) {
                pageCatcher = new PageCatcher("catch");
            }
            int cyclesCounter = 0;
            boolean createNewPageDB = (cycles != 0);


            while (running()) {

View Full Code Here

TOP

Related Classes of com.flaptor.hounder.crawler.pagedb.distributed.PageCatcher

com.flaptor.hounder.crawler.Crawler

com.flaptor.hounder.crawler.pagedb.PageDB

com.flaptor.util.remote.RmiServer

java.io.File

java.io.IOException

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.