Examples of com.flaptor.hounder.crawler.CrawlerProgress

com.flaptor.hounder.crawler.CrawlerProgress
Keeps stats about the progress of the crawler and reports them to a file. @author jorge

                }
                PageDB orig = new PageDB(args[1]);
                PageDB dest = new PageDB(args[2]);
                long unfetched = orig.getSize() - orig.getFetchedSize();
                PageDBTrimmer trimmer = new PageDBTrimmer();
                CrawlerProgress cp = new CrawlerProgress(0);
                cp.addDiscovered(unfetched);
                trimmer.trimPageDB(orig, dest, cp);


            } else if ("reset".equals(cmd)) {


                if (args.length < 3) {

View Full Code Here

TOP

Related Classes of com.flaptor.hounder.crawler.CrawlerProgress

com.flaptor.hounder.crawler.pagedb.PageDB

com.flaptor.util.Config

java.io.FileInputStream

java.io.ObjectOutputStream

java.text.SimpleDateFormat

java.io.FileOutputStream

java.io.ObjectInputStream

java.io.FileWriter

java.io.BufferedWriter

java.io.File

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.