Examples of edu.ucla.sspace.text.OneLinePerDocumentIterator

edu.ucla.sspace.text.OneLinePerDocumentIterator
An iterator implementation that returns {@link Document} instances given afile that contains list of files.
This class is thread-safe.

     * file name provided.
     */
    protected void addDocIterators(Collection<Iterator<Document>> docIters,
                                   String[] fileNames) throws IOException {
        for (String s : fileNames)
            docIters.add(new OneLinePerDocumentIterator(s));
    }

View Full Code Here


        String[] fileNames = sentenceList.split(",");
        // we have a file that contains the list of all document sentences we
        // are to process
        for (String s : fileNames) {
            docIters.add(new OneLinePerDocumentIterator(s));        
        }


        // combine all of the document iterators into one iterator.
        docIter = new CombinedIterator<Document>(docIters);
        return docIter;

View Full Code Here

            for (String s : argOptions.getStringOption('f').split(","))
                docIters.add(new BufferedFileListDocumentIterator(s));
        }
        if (argOptions.hasOption('d')) {
            for (String s : argOptions.getStringOption('d').split(","))
                docIters.add(new OneLinePerDocumentIterator(s));
        }


         if (docIters.size() == 0)
             throw new IllegalStateException(
                 "Must specify at least one document source");

View Full Code Here

TOP

Related Classes of edu.ucla.sspace.text.OneLinePerDocumentIterator

edu.ucla.sspace.mains.GenericMain

edu.ucla.sspace.mains.GrefenstetteMain

edu.ucla.sspace.tools.IterativeBigramExtractor

java.io.FileReader

java.io.BufferedReader

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.