Package org.commoncrawl.util.shared.GZIPUtils

Examples of org.commoncrawl.util.shared.GZIPUtils.UnzipResult

230
231
232
233
234
235
236
237
238
239
240
      if (crawlData != null && encoding != null
          && encoding.equalsIgnoreCase("gzip")) {
        int compressedSize = crawlData.length;
        try {
          UnzipResult result = GZIPUtils.unzipBestEffort(crawlData,2 << 20);

          crawlData = result.data;
          crawlDataOffset = 0;
          crawlDataLen = result.data.length;
View Full Code Here
TOP

Related Classes of org.commoncrawl.util.shared.GZIPUtils.UnzipResult

  • org.commoncrawl.util.shared.ArcFileReaderTests
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.