Package edu.udo.cs.wvtool.crawler

Examples of edu.udo.cs.wvtool.crawler.WVToolCrawler


                else
                    return dummyStemmer;
            }
        });

        WVToolCrawler test = new WVToolCrawler("", "", "") {

            protected boolean vectorizePage(Page page) {

                String url = page.getURL().toExternalForm();

                return (url.indexOf("html")>-1);
            }

            public boolean shouldVisit(Link arg0) {

                return true;

            }
        };

        test.addRoot(new Link(new URL("http://www.bankersonline.com/")));
        test.setMaxDepth(2);

        // Initialize the input list with two classes
        WVTInputList list = new CrawledInputList(test);

        // Generate the word list
View Full Code Here

TOP

Related Classes of edu.udo.cs.wvtool.crawler.WVToolCrawler

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.