Examples of EdgeNGramTokenFilter

org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter
Tokenizes the given token into n-grams of given size(s).
This {@link TokenFilter} create n-grams from the beginning edge or ending edge of a input token.

Examples of org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter


          @Override
          protected TokenStreamComponents wrapComponents(String fieldName, TokenStreamComponents components) {
            if (fieldName.equals("textgrams") && minPrefixChars > 0) {
              return new TokenStreamComponents(components.getTokenizer(),
                                               new EdgeNGramTokenFilter(matchVersion,
                                                                        components.getTokenStream(),
                                                                        1, minPrefixChars));
            } else {
              return components;
            }

View Full Code Here

Examples of org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter


          @Override
          protected TokenStreamComponents wrapComponents(String fieldName, TokenStreamComponents components) {
            if (fieldName.equals("textgrams") && minPrefixChars > 0) {
              return new TokenStreamComponents(components.getTokenizer(),
                                               new EdgeNGramTokenFilter(matchVersion,
                                                                        components.getTokenStream(),
                                                                        1, minPrefixChars));
            } else {
              return components;
            }

View Full Code Here

Examples of org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter

      side = EdgeNGramTokenFilter.Side.FRONT.getLabel();
    }
  }


  public EdgeNGramTokenFilter create(TokenStream input) {
    return new EdgeNGramTokenFilter( input, side, minGramSize, maxGramSize );
  }

View Full Code Here

Examples of org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter


  private class NGramAnalyzer extends Analyzer {
    @Override
    protected TokenStreamComponents createComponents(String fieldName, Reader reader) {
      final Tokenizer tokenizer = new KeywordTokenizer(reader);
      return new TokenStreamComponents(tokenizer, new ReverseStringFilter(TEST_VERSION_CURRENT, new EdgeNGramTokenFilter(TEST_VERSION_CURRENT, new ReverseStringFilter(TEST_VERSION_CURRENT, tokenizer), 10, 20)));
    }

View Full Code Here

Examples of org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter


      @Override
      protected TokenStreamComponents wrapComponents(String fieldName, TokenStreamComponents components) {
        if (fieldName.equals("textgrams") && minPrefixChars > 0) {
          return new TokenStreamComponents(components.getTokenizer(),
                                           new EdgeNGramTokenFilter(matchVersion,
                                                                    components.getTokenStream(),
                                                                    1, minPrefixChars));
        } else {
          return components;
        }

View Full Code Here

Examples of org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter

        if (version.onOrAfter(Version.LUCENE_4_3) && esVersion.onOrAfter(org.elasticsearch.Version.V_0_90_2)) {
            /*
             * We added this in 0.90.2 but 0.90.1 used LUCENE_43 already so we can not rely on the lucene version.
             * Yet if somebody uses 0.90.2 or higher with a prev. lucene version we should also use the deprecated version.
             */
            result = new EdgeNGramTokenFilter(result, minGram, maxGram);
        } else {
            result = new Lucene43EdgeNGramTokenFilter(result, minGram, maxGram);
        }
        
        // side=BACK is not supported anymore but applying ReverseStringFilter up-front and after the token filter has the same effect

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.