List of currentTag() Examples

Examples of currentTag()

org.terrier.indexing.TRECFullTokenizer.currentTag()
Returns the name of the tag the tokenizer is currently in. @return the name of the tag the tokenizer is currently in

Examples of org.terrier.indexing.TRECFullTokenizer.currentTag()

              // Removed the code that checks if "description" and 
              // "narrative" appear in "desc" and "narr", respective. 
              // THIS WILL HURT THE RETRIEVAL PERFORMANCE. Therefore, 
              // it is recommended to add these words in the stopword 
              // list.
              if (!seenDescriptionToken && queryTokenizer
                .currentTag()
                .toUpperCase()
                 .equals("DESC")
                 && token.toUpperCase().equals("DESCRIPTION"))
                 continue;

View Full Code Here

Examples of org.terrier.indexing.TRECFullTokenizer.currentTag()

                .currentTag()
                .toUpperCase()
                 .equals("DESC")
                 && token.toUpperCase().equals("DESCRIPTION"))
                 continue;
                if (!seenNarrativeToken && queryTokenizer
                 .currentTag()
                 .toUpperCase()
                 .equals("NARR")
                 && token.toUpperCase().equals("NARRATIVE"))
                 continue;

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.