Package com.googlecode.flaxcrawler.parse

Examples of com.googlecode.flaxcrawler.parse.Parser

85
86
87
88
89
90
91
92
93
94
95
96
97
            if (page != null) {
                crawlerTask.setTimeDownloaded(new Date());

                if (page.getResponseCode() == HttpURLConnection.HTTP_OK) {
                    log.debug(url + " was downloaded successfully. Download time " + page.getResponseTime());
                    Parser parser = parserController.getParser(page);
                    log.debug("Parsing " + url);
                    parser.parse(page);
                    crawlerTask.setTimeParsed(new Date());
                    log.debug(url + " has been parsed. " + page.getLinks().size() + " links were found");
                }
            }
        } finally {
View Full Code Here
TOP

Related Classes of com.googlecode.flaxcrawler.parse.Parser

  • com.googlecode.flaxcrawler.DefaultCrawler
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.