Package org.archive.wayback.accesscontrol.robotstxt.redis

Examples of org.archive.wayback.accesscontrol.robotstxt.redis.RobotsTxtResource

48
49
50
51
52
53
54
55
56
57
58
      if (responseStatus >= 400 || responseStatus < 200) {
        throw new LiveDocumentNotAvailableException("Invalid Status: " + responseStatus);
      }   
     
      in = ByteStreams.limit(method.getResponseBodyAsStream(), maxRobotsSize);
      return new RobotsTxtResource(IOUtils.toString(in));
     
    } catch (IOException io) {
      throw new LiveDocumentNotAvailableException(io.toString());
    } finally {
      if (in != null) {
View Full Code Here
TOP

Related Classes of org.archive.wayback.accesscontrol.robotstxt.redis.RobotsTxtResource

  • org.archive.wayback.liveweb.LiveRobotsNoCache
  • java.io.ByteArrayInputStream
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.