Package org.terrier.utility

Examples of org.terrier.utility.ProcessInputStream


          {
            /* WARC format files have multiple compressed records. JDK one can't deal with this
             * See: http://crawler.archive.org/apidocs/index.html?org/archive/io/arc/ARCWriter.html
             * We get around this by using an external zcat process
             */
            is = new java.io.BufferedInputStream(new ProcessInputStream("/usr/bin/gzip -dc ", filename));
          }
          else
            is = Files.openFileStream(filename); //throws an IOException, throw upwards
          //logger.info("WARCCollection processing "+filename);
          //no need to loop again
View Full Code Here

TOP

Related Classes of org.terrier.utility.ProcessInputStream

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.