Examples of edu.stanford.nlp.sequences.ColumnTabDocumentReaderWriter$BufferedReaderIterator

• edu.stanford.nlp.sequences.ColumnTabDocumentReaderWriter
  Version of ColumnDocumentReaderAndWriter that doesn't read in entire file and stores it in memory before parsing it. Reads in one line at a time. Assumes that sequences are broken up by empty lines. Also differs from ColumnDocumentReaderAndWriter in following ways:

  • Splits on tabs (delimiterPattern)
  • Replaces within field whitespaces with "_" (replaceWhitespace)
  • Assumes that a line with just one column and starts with "* xxxxx" indicates the document id (hasDocId)

  Accepts the following properties

  Field	Type	Default	Description
  columns	String		Comma separated list of mapping between annotation (see {@link edu.stanford.nlp.ling.AnnotationLookup.KeyLookup}) and column index (starting from 0). Example: word=0,tag=1
  delimiter	String	\t	Regular expression for delimiter
  replaceWhitespace	Boolean	true	Replace whitespaces with "_"
  tokens	Class	{@link edu.stanford.nlp.ling.CoreAnnotations.TokensAnnotation edu.stanford.nlp.ling.CoreAnnotations$TokensAnnotation}	Annotation field for tokens
  tokenFactory	Class	{@link CoreLabelTokenFactory edu.stanford.nlp.process.CoreLabelTokenFactory}	Factory for creating tokens

  @author Angel Chang @author Sonal Gupta (made the class generic)

Related Classes of edu.stanford.nlp.sequences.ColumnTabDocumentReaderWriter$BufferedReaderIterator