Examples of it.unimi.dsi.mg4j.document.IdentityDocumentFactory

it.unimi.dsi.mg4j.document.IdentityDocumentFactory

A factory that provides a single field containing just the raw input stream; the encoding is set using the property {@link it.unimi.dsi.mg4j.document.PropertyBasedDocumentFactory.MetadataKeys#ENCODING}. The field is named text, but you can change the name using the property fieldname.

By default, the {@link WordReader} provided by this factoryis just a {@link FastBufferedReader}, but you can specify an alternative word reader using the property {@link it.unimi.dsi.mg4j.document.PropertyBasedDocumentFactory.MetadataKeys#WORDREADER}. For instance, if you need to index a list of identifiers to retrieve documents from the collection more easily, you can use a {@link LineWordReader}to index each line of a file as a whole.

  // We keep track of the last returned sequence to close it without cluttering the test code
  private DocumentSequence lastSequence;


  public DocumentSequence getSequence() throws ConfigurationException, IOException {
    if ( lastSequence != null ) lastSequence.close();
    return lastSequence = new CompositeDocumentSequence( new InputStreamDocumentSequence( this.getClass().getResourceAsStream( "documents.data" ), 10, new IdentityDocumentFactory(
        new String[] { "encoding=UTF-8" } ), NUMBER_OF_DOCUMENTS ), new IntArrayDocumentCollection( INTEGER_DOCUMENT ), new DateArrayDocumentCollection( DATE_DOCUMENT ),
        new MapVirtualDocumentCollection( VIRTUAL_DOCUMENT ) );
  }

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of it.unimi.dsi.mg4j.document.IdentityDocumentFactory

Related Classes of it.unimi.dsi.mg4j.document.IdentityDocumentFactory