Examples of org.elasticsearch.river.wikipedia.bzip2.CBZip2InputStream

Package org.elasticsearch.river.wikipedia.bzip2

Examples of org.elasticsearch.river.wikipedia.bzip2.CBZip2InputStream

org.elasticsearch.common.compress.bzip2.CBZip2InputStream
An input stream that decompresses from the BZip2 format (without the file header chars) to be read as any other stream.

The decompression requires large amounts of memory. Thus you should call the {@link #close() close()} method as soon aspossible, to force CBZip2InputStream to release the allocated memory. See {@link CBZip2OutputStream CBZip2OutputStream} for information about memory usage.

CBZip2InputStream reads bytes from the compressed source stream via the single byte {@link java.io.InputStream#read() read()} method exclusively. Thus you should consider to use abuffered source stream.

Instances of this class are not threadsafe.

            throw new IOException("Not BZIP2 format");
        }
        if (in.read() != 'Z') {
            throw new IOException("Not BZIP2 format");
        }
        BufferedInputStream gzis = new BufferedInputStream(new CBZip2InputStream(in));
        String path = doc.get("path");
        if (path != null &&
                (path.endsWith(".bz2") || path.endsWith(".BZ2") || path.endsWith(".bz"))
                ) {
            String newname = path.substring(0, path.lastIndexOf('.'));

View Full Code Here

      }
      if (this.getAlgorithm() == BZIP2)
      {
          try
          {
              return new CBZip2InputStream(this.getInputStream());
          }
          catch (IOException e)
          {
              throw new PGPException("I/O problem with stream: " + e, e);
          }

View Full Code Here

      }
      if (this.getAlgorithm() == BZIP2)
      {
          try
          {
              return new CBZip2InputStream(this.getInputStream());
          }
          catch (IOException e)
          {
              throw new PGPException("I/O problem with stream: " + e, e);
          }

View Full Code Here

                    if ( istream.read() != magic[ i ] )
                    {
                        throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                    }
                }
                return new CBZip2InputStream( istream );
            }
            return istream;
        }

View Full Code Here

                        if ( istream.read() != magic[ i ] )
                        {
                            throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                        }
                    }
                    return new CBZip2InputStream( istream );
                }
            }
            return istream;
        }

View Full Code Here

                        if ( istream.read() != magic[ i ] )
                        {
                            throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                        }
                    }
                    return new CBZip2InputStream( istream );
                }
            }
            return istream;
        }

View Full Code Here

                    if ( istream.read() != magic[ i ] )
                    {
                        throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                    }
                }
                return new CBZip2InputStream( istream );
            }
            return istream;
        }

View Full Code Here

                        if ( istream.read() != magic[ i ] )
                        {
                            throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                        }
                    }
                    return new CBZip2InputStream( istream );
                }
            }
            return istream;
        }

View Full Code Here

                        if ( istream.read() != magic[ i ] )
                        {
                            throw new ArchiverException( "Invalid bz2 file." + file.toString() );
                        }
                    }
                    return new CBZip2InputStream( istream );
                }
            }
            return istream;
        }

View Full Code Here

            br = new BufferedReader(new InputStreamReader(new GZIPInputStream(wikiXMLFile.openStream()), "UTF-8"));
        } else if (wikiXMLFile.toExternalForm().endsWith(".bz2")) {
            InputStream fis = wikiXMLFile.openStream();
            byte[] ignoreBytes = new byte[2];
            fis.read(ignoreBytes); //"B", "Z" bytes from commandline tools
            br = new BufferedReader(new InputStreamReader(new CBZip2InputStream(fis), "UTF-8"));
        } else {
            br = new BufferedReader(new InputStreamReader(wikiXMLFile.openStream(), "UTF-8"));
        }


        return new InputSource(br);

View Full Code Here

0 1 2 3 4 5 6 7

TOP

Related Classes of org.elasticsearch.river.wikipedia.bzip2.CBZip2InputStream

at.molindo.utils.io.StreamUtils

cc.twittertools.index.IndexStatuses

com.endgame.binarypig.util.BuildSequenceFileFromArchive

com.google.gwt.ant.taskdefs.TarCat$UntarCompressionMethod

com.google.refine.importing.ImportingUtilities

com.packetloop.packetpig.loaders.pcap.PcapRecordReader

com.packetloop.packetpig.loaders.pcap.StreamingPcapRecordReader

edu.umd.cloud9.collection.wikipedia.WikipediaPagesBz2InputStream

er.woinstaller.archiver.XarFile

mwt.wow.mpq.BZip2Reader

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.