Examples of WARCDocumentCollection

net.bpiwowar.mg4j.extensions.warc.WARCDocumentCollection
Managing TREC collections provided in a WARC format, as used for instance by the TREC session track. A document collection basically consists of a set of descriptors pointing to important locations in the (possibly zipped) document archive. This is called a sequence. @author Ingo Frommholz @author Benjamin Piwowarski @see net.bpiwowar.mg4j.extensions.trec.TRECDocumentCollection @see DocumentFactory

Examples of net.bpiwowar.mg4j.extensions.warc.WARCDocumentCollection

                collection = new TRECDocumentCollection(files,
                            documentFactory, SegmentedDocumentCollection.DEFAULT_BUFFER_SIZE, compression, metadataFile);
                break;


            case "warc/0.18":
                collection = new WARCDocumentCollection(files, SegmentedDocumentCollection.DEFAULT_BUFFER_SIZE, compression, metadataFile);
                break;
            default:
                LOGGER.error(String.format("Unknown document type [%s]", docType));
                System.exit(-1);
                throw new AssertionError();

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.