Examples of org.apache.lucene.codecs.lucene40.Lucene40StoredFieldsFormat

Package org.apache.lucene.codecs.lucene40

Examples of org.apache.lucene.codecs.lucene40.Lucene40StoredFieldsFormat

org.apache.lucene.codecs.lucene40.Lucene40RWCodec
Lucene 4.0 Stored Fields Format.
Stored fields are represented by two files:
1. The field index, or .fdx file.
  
  This is used to find the location within the field data file of the fields of a particular document. Because it contains fixed-length data, this file may be easily randomly accessed. The position of document n 's field data is the {@link DataOutput#writeLong Uint64} at n*8 in this file.
  This contains, for each document, a pointer to its field data, as follows:
  - FieldIndex (.fdx) --> <Header>, <FieldValuesPosition> ^SegSize
  - Header --> {@link CodecUtil#writeHeader CodecHeader}
  - FieldValuesPosition --> {@link DataOutput#writeLong Uint64}
2. The field data, or .fdt file.
  
  This contains the stored fields of each document, as follows:
  - FieldData (.fdt) --> <Header>, <DocFieldData> ^SegSize
  - Header --> {@link CodecUtil#writeHeader CodecHeader}
  - DocFieldData --> FieldCount, <FieldNum, Bits, Value> ^FieldCount
  - FieldCount --> {@link DataOutput#writeVInt VInt}
  - FieldNum --> {@link DataOutput#writeVInt VInt}
  - Bits --> {@link DataOutput#writeByte Byte}
  - Value --> String | BinaryValue | Int | Long (depending on Bits)
  - BinaryValue --> ValueSize, < {@link DataOutput#writeByte Byte}>^ValueSize
  - ValueSize --> {@link DataOutput#writeVInt VInt}
@lucene.experimental

 */
@Deprecated
public class AppendingCodec extends FilterCodec {


  public AppendingCodec() {
    super("Appending", new Lucene40Codec());
  }

View Full Code Here

    throw new UnsupportedOperationException("this codec can only be used for reading");
  }


  @Override
  public FieldsProducer fieldsProducer(SegmentReadState state) throws IOException {
    PostingsReaderBase postings = new Lucene40PostingsReader(state.directory, state.fieldInfos, state.segmentInfo, state.context, state.segmentSuffix);
    
    boolean success = false;
    try {
      FieldsProducer ret = new AppendingTermsReader(
                                                    state.directory,
                                                    state.fieldInfos,
                                                    state.segmentInfo,
                                                    postings,
                                                    state.context,
                                                    state.segmentSuffix,
                                                    state.termsIndexDivisor);
      success = true;
      return ret;
    } finally {
      if (!success) {
        postings.close();
      }
    }
  }

View Full Code Here

 */


class AppendingRWPostingsFormat extends AppendingPostingsFormat {
  @Override
  public FieldsConsumer fieldsConsumer(SegmentWriteState state) throws IOException {
    PostingsWriterBase docsWriter = new Lucene40PostingsWriter(state);
    boolean success = false;
    try {
      FieldsConsumer ret = new AppendingTermsWriter(state, docsWriter, BlockTreeTermsWriter.DEFAULT_MIN_BLOCK_SIZE, BlockTreeTermsWriter.DEFAULT_MAX_BLOCK_SIZE);
      success = true;
      return ret;
    } finally {
      if (!success) {
        docsWriter.close();
      }
    }
  }

View Full Code Here

 * Read-write version of AppendingCodec for testing
 */
public class AppendingRWCodec extends FilterCodec {


  public AppendingRWCodec() {
    super("Appending", new Lucene40RWCodec());
  }

View Full Code Here

    
    dir.close();
  }
  
  public void testDisableImpersonation() throws Exception {
    Codec[] oldCodecs = new Codec[] { new Lucene40RWCodec(), new Lucene41RWCodec(), new Lucene42RWCodec() };
    Directory dir = newDirectory();
    IndexWriterConfig conf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));
    conf.setCodec(oldCodecs[random().nextInt(oldCodecs.length)]);
    IndexWriter writer = new IndexWriter(dir, conf);

View Full Code Here

    dir.close();
  }
  
  @Test
  public void testUpdateOldSegments() throws Exception {
    Codec[] oldCodecs = new Codec[] { new Lucene40RWCodec(), new Lucene41RWCodec(), new Lucene42RWCodec(), new Lucene45RWCodec() };
    Directory dir = newDirectory();
    
    boolean oldValue = OLD_FORMAT_IMPERSONATION_IS_ACTIVE;
    // create a segment with an old Codec
    IndexWriterConfig conf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));

View Full Code Here

    dir.close();
  }
  
  @Test
  public void testUpdateOldSegments() throws Exception {
    Codec[] oldCodecs = new Codec[] { new Lucene40RWCodec(), new Lucene41RWCodec(), new Lucene42RWCodec(), new Lucene45RWCodec() };
    Directory dir = newDirectory();
    
    boolean oldValue = OLD_FORMAT_IMPERSONATION_IS_ACTIVE;
    // create a segment with an old Codec
    IndexWriterConfig conf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));

View Full Code Here

    
    dir.close();
  }
  
  public void testUpdateOldSegments() throws Exception {
    Codec[] oldCodecs = new Codec[] { new Lucene40RWCodec(), new Lucene41RWCodec(), new Lucene42RWCodec(), new Lucene45RWCodec() };
    Directory dir = newDirectory();
    
    boolean oldValue = OLD_FORMAT_IMPERSONATION_IS_ACTIVE;
    // create a segment with an old Codec
    IndexWriterConfig conf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));

View Full Code Here

    
    dir.close();
  }
  
  public void testDisableImpersonation() throws Exception {
    Codec[] oldCodecs = new Codec[] { new Lucene40RWCodec(), new Lucene41RWCodec(), new Lucene42RWCodec() };
    Directory dir = newDirectory();
    IndexWriterConfig conf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));
    conf.setCodec(oldCodecs[random().nextInt(oldCodecs.length)]);
    IndexWriter writer = new IndexWriter(dir, conf);

View Full Code Here

    dir.close();
  }
  
  @Test
  public void testUpdateOldSegments() throws Exception {
    Codec[] oldCodecs = new Codec[] { new Lucene40RWCodec(), new Lucene41RWCodec(), new Lucene42RWCodec(), new Lucene45RWCodec() };
    Directory dir = newDirectory();
    
    boolean oldValue = OLD_FORMAT_IMPERSONATION_IS_ACTIVE;
    // create a segment with an old Codec
    IndexWriterConfig conf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));

View Full Code Here

0 1

TOP

Related Classes of org.apache.lucene.codecs.lucene40.Lucene40StoredFieldsFormat

org.apache.lucene.analysis.MockAnalyzer

org.apache.lucene.codecs.appending.AppendingCodec

org.apache.lucene.codecs.appending.AppendingPostingsFormat

org.apache.lucene.codecs.appending.AppendingRWCodec

org.apache.lucene.codecs.appending.AppendingRWPostingsFormat

org.apache.lucene.codecs.blocktree.BlockTreeTermsReader

org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter

org.apache.lucene.codecs.BlockTreeTermsReader

org.apache.lucene.codecs.BlockTreeTermsWriter

org.apache.lucene.codecs.Codec

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.