Examples of it.unimi.dsi.mg4j.document.HtmlDocumentFactory

it.unimi.dsi.mg4j.document.HtmlDocumentFactory
A factory that provides fields for body and title of HTML documents. It uses internally a {@link BulletParser}. A default encoding can be provided using the property {@link it.unimi.dsi.mg4j.document.PropertyBasedDocumentFactory.MetadataKeys#ENCODING}.
By default, the {@link WordReader} provided by this factoryis just a {@link FastBufferedReader}, but you can specify an alternative word reader using the property {@link it.unimi.dsi.mg4j.document.PropertyBasedDocumentFactory.MetadataKeys#WORDREADER}.

    TRECDocumentCollection collection = new TRECDocumentCollection(
        new String[] { temp.toString() },
        CompositeDocumentFactory
            .getFactory(new DocumentFactory[] {
                new TRECHeaderDocumentFactory(),
                new HtmlDocumentFactory( new String[] { "encoding=ISO-8859-1" } ) } ),
        4, // Very small, to induce fragmentation
        false);


    try {
      DocumentIterator iter = collection.iterator();

View Full Code Here

    TRECDocumentCollection collection = new TRECDocumentCollection(
        new String[] { temp.toString(), tempAgain.toString() },
        CompositeDocumentFactory
            .getFactory(new DocumentFactory[] {
                new TRECHeaderDocumentFactory(),
                new HtmlDocumentFactory( new String[] { "encoding=ISO-8859-1" } ) } ),
        4, // Very small, to induce fragmentation
        false);


    DocumentIterator iter = collection.iterator();
    Document d = null;

View Full Code Here

TOP

Related Classes of it.unimi.dsi.mg4j.document.HtmlDocumentFactory

it.unimi.dsi.io.FastBufferedReader

it.unimi.dsi.mg4j.document.TRECDocumentCollectionTest

it.unimi.dsi.mg4j.util.parser.callback.AnchorExtractor

it.unimi.dsi.parser.BulletParser

it.unimi.dsi.parser.callback.ComposedCallbackBuilder

it.unimi.dsi.parser.callback.TextExtractor

org.apache.commons.configuration.ConfigurationException

java.io.InputStreamReader

java.io.Reader

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.