Package net.vidageek.crawler

Examples of net.vidageek.crawler.Status


      log.debug("Requesting url: [" + encodedUrl + "]");
      HttpGet method = new HttpGet(encodedUrl);

      try {
        HttpResponse response = client.execute(method);
        Status status = Status.fromHttpCode(response.getStatusLine().getStatusCode());

        if (!acceptsMimeType(response.getLastHeader("Content-Type"))) {
          return new RejectedMimeTypePage(url, status, response.getLastHeader("Content-Type").getValue());
        }
View Full Code Here

TOP

Related Classes of net.vidageek.crawler.Status

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.