Package org.terrier.indexing.tokenisation

Examples of org.terrier.indexing.tokenisation.IdentityTokeniser

93
94
95
96
97
98
99
100
101
102
103
    final boolean QueryLineHasQueryID = Boolean.parseBoolean(ApplicationSetup.getProperty("SingleLineTRECQuery.queryid.exists","true"));
    final boolean QueryTokenise = Boolean.parseBoolean(ApplicationSetup.getProperty("SingleLineTRECQuery.tokenise",
        ApplicationSetup.getProperty("SingleLineTRECQuery.periods.allowed", "false")));
    //logger.info("Extracting queries from "+queryfilename + " - queryids "+QueryLineHasQueryID);
    if (tokeniser == null) {
      tokeniser = QueryTokenise ? Tokeniser.getTokeniser() : new IdentityTokeniser();
    }
    try {
      BufferedReader br;
      if (! Files.exists(queryfilename))
      {
View Full Code Here
TOP

Related Classes of org.terrier.indexing.tokenisation.IdentityTokeniser

  • org.terrier.structures.SingleLineTRECQuery
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.