Examples of org.elasticsearch.river.wikipedia.bzip2.CBZip2InputStream$Data

Package org.elasticsearch.river.wikipedia.bzip2

Examples of org.elasticsearch.river.wikipedia.bzip2.CBZip2InputStream$Data

org.codehaus.plexus.archiver.bzip2.CBZip2InputStream
An input stream that decompresses from the BZip2 format (without the file header chars) to be read as any other stream.

The decompression requires large amounts of memory. Thus you should call the {@link #close() close()} method as soon aspossible, to force CBZip2InputStream to release the allocated memory. See {@link CBZip2OutputStream CBZip2OutputStream} for information about memory usage.

CBZip2InputStream reads bytes from the compressed source stream via the single byte {@link java.io.InputStream#read() read()} method exclusively. Thus you should consider to use abuffered source stream.

Instances of this class are not threadsafe.

      LOG.info("Reading deletes from " + deletesFile);
      
      FileInputStream fin = new FileInputStream(deletesFile);
      byte[] ignoreBytes = new byte[2];
      fin.read(ignoreBytes); // "B", "Z" bytes from commandline tools
      BufferedReader br = new BufferedReader(new InputStreamReader(new CBZip2InputStream(fin)));


      String s;
      while ((s = br.readLine()) != null) {
        if (s.contains("\t")) {
          deletes.add(Long.parseLong(s.split("\t")[0]));

View Full Code Here

                throw new Exception("Invalid bz2 content.");
            }


            int read = 0;
            final byte[] data = new byte[1024];
            final CBZip2InputStream zippedContent = new CBZip2InputStream(source);


            tempFile = File.createTempFile("bunzip","tmp");
            tempFile.deleteOnExit();


            // creating a temp file to store the uncompressed data
            final FileOutputStream out = new FileOutputStream(tempFile);


            // reading gzip file and store it uncompressed
            while((read = zippedContent.read(data, 0, 1024)) != -1) {
                out.write(data, 0, read);
            }
            zippedContent.close();
            out.close();


            // creating a new parser class to parse the unzipped content
            docs = TextParser.parseSource(location, null, null, tempFile, false);
        } catch (final Exception e) {

View Full Code Here

        if (b != 'B')
            throw new IOException(tr("Invalid bz2 file."));
        b = bis.read();
        if (b != 'Z')
            throw new IOException(tr("Invalid bz2 file."));
        return new CBZip2InputStream(bis, /* see #9537 */ true);
    }

View Full Code Here

        InputStream is = resource.read();
        try {
            // CBZip2InputStream expects the opening "BZ" to be skipped
            byte[] skip = new byte[2];
            is.read(skip);
            return new CBZip2InputStream(is);
        } catch (Exception e) {
            String message = String.format("Unable to create bzip2 input stream for resource %s.", resource.getDisplayName());
            throw new ResourceException(message, e);
        }
    }

View Full Code Here

            throw new IOException("Not BZIP2 format");
        }
        if (in.read() != 'Z') {
            throw new IOException("Not BZIP2 format");
        }
        BufferedInputStream gzis = new BufferedInputStream(new CBZip2InputStream(in));
        String path = doc.get("path");
        if (path != null &&
                (path.endsWith(".bz2") || path.endsWith(".BZ2") || path.endsWith(".bz"))
                ) {
            String newname = path.substring(0, path.lastIndexOf('.'));

View Full Code Here

      }
      if (this.getAlgorithm() == BZIP2)
      {
          try
          {
              return new CBZip2InputStream(this.getInputStream());
          }
          catch (IOException e)
          {
              throw new PGPException("I/O problem with stream: " + e, e);
          }

View Full Code Here

      }
      if (this.getAlgorithm() == BZIP2)
      {
          try
          {
              return new CBZip2InputStream(this.getInputStream());
          }
          catch (IOException e)
          {
              throw new PGPException("I/O problem with stream: " + e, e);
          }

View Full Code Here

                    if ( istream.read() != magic[ i ] )
                    {
                        throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                    }
                }
                return new CBZip2InputStream( istream );
            }
            return istream;
        }

View Full Code Here

                        if ( istream.read() != magic[ i ] )
                        {
                            throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                        }
                    }
                    return new CBZip2InputStream( istream );
                }
            }
            return istream;
        }

View Full Code Here

                        if ( istream.read() != magic[ i ] )
                        {
                            throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                        }
                    }
                    return new CBZip2InputStream( istream );
                }
            }
            return istream;
        }

View Full Code Here

0 1 2 3 4 5 6 7

TOP

Related Classes of org.elasticsearch.river.wikipedia.bzip2.CBZip2InputStream$Data

at.molindo.utils.io.StreamUtils

cc.twittertools.index.IndexStatuses

codec.asn1.ASN1ObjectIdentifier

codec.pkcs12.AuthenticatedSafe

com.endgame.binarypig.util.BuildSequenceFileFromArchive

com.google.gwt.ant.taskdefs.TarCat$UntarCompressionMethod

com.google.gwt.user.client.ui.RadioButton

com.google.refine.importing.ImportingUtilities

com.inmethod.grid.common.AbstractGridRow

com.inmethod.grid.common.AttachPrelightBehavior

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.