Package fr.eolya.crawler.connectors.web

Examples of fr.eolya.crawler.connectors.web.StartingUrls

28
29
30
31
32
33
34
35
36
  public String getUserAgent() {
    return getSrcDataString("user_agent");
  }

  public boolean isOptimized() {
    StartingUrls startingUrls = getStartingUrls();
    if (startingUrls==null) return false;
    return startingUrls.isOptimized();
  }
View Full Code Here
42
43
44
45
46
47
48
49
50
51
52
  }

  public StartingUrls getStartingUrls() {
    if (startingUrls==null) {
      try {
        startingUrls = new StartingUrls(getSrcDataStringAsXml("url"));
      } catch (Exception e) {
        e.printStackTrace();
        return null;
      }
    }
View Full Code Here
TOP

Related Classes of fr.eolya.crawler.connectors.web.StartingUrls

  • fr.eolya.crawler.connectors.web.SourceWeb
  • org.dom4j.Document
  • org.dom4j.Element
  • java.net.URL
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.