Package org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache

Examples of org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache.RobotsResult


      if (!url.startsWith(HTTP_PREFIX) && !url.startsWith(HTTPS_PREFIX)) {
        url = HTTP_PREFIX + url;
      }
     
      //RobotsContext context = robotsCache.forceUpdate(url, minUpdateTime);
      RobotsResult result = robotsCache.forceUpdate(url, minUpdateTime, false);
     
      if (result == null) {
        writer.println("<p>Error Updating Robots (see logs)</p>");
        return true;
      }
           
      if (!result.isSameRobots()) {
        writer.println("<b>UPDATED Robots</b>");
        writer.println("<p><i>Old Robots:</i></p>");
        writer.println("<pre>" + result.oldRobots + "</pre>");
        writer.println("<p><i>NEW Updated Robots:</i></p>");
      } else {
View Full Code Here

TOP

Related Classes of org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache.RobotsResult

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.