List of tokenStreamValue() Examples

Examples of tokenStreamValue()

org.apache.lucene.document.Field.tokenStreamValue()
The TokesStream for this field to be used when indexing, or null. If null, the Reader value or String value is analyzed to produce the indexed tokens.
org.apache.lucene.document.Fieldable.tokenStreamValue()
The TokenStream for this field to be used when indexing, or null. @see #stringValue()
org.apache.lucene.document.NumericField.tokenStreamValue()
Returns a {@link NumericTokenStream} for indexing the numeric value.
org.elasticsearch.common.lucene.all.AllField.tokenStreamValue()

Examples of org.apache.lucene.document.Field.tokenStreamValue()

          
          for (Iterator it = fields.iterator(); it.hasNext(); ) {
            
            Field field = (Field) it.next();


            if (field.isIndexed() && field.tokenStreamValue() != null) {
              
              TokenStream tokenStream = field.tokenStreamValue();
              
              Collection<AnnotationFS> matchingTextAnnotations = new LinkedList<AnnotationFS>();

View Full Code Here

Examples of org.apache.lucene.document.Field.tokenStreamValue()

            
            Field field = (Field) it.next();


            if (field.isIndexed() && field.tokenStreamValue() != null) {
              
              TokenStream tokenStream = field.tokenStreamValue();
              
              Collection<AnnotationFS> matchingTextAnnotations = new LinkedList<AnnotationFS>();


              QueryScorer scorer = new QueryScorer(query.query(), field.name());
              scorer.startFragment(new TextFragment(

View Full Code Here

Examples of org.apache.lucene.document.Field.tokenStreamValue()

    Analyzer analyzer = getRunData().getAnalyzer();
    int tokenCount = 0;
    for(int i=0;i<numField;i++) {
      final Field field = (Field) fields.get(i);
      final TokenStream stream;
      final TokenStream streamValue = field.tokenStreamValue();


      if (streamValue != null) 
        stream = streamValue;
      else {
        // the field does not have a TokenStream,

View Full Code Here

Examples of org.apache.lucene.document.Field.tokenStreamValue()


        if (field.isTokenized()) {
          int termCounter = 0;
          final TokenStream tokenStream;
          // todo readerValue(), binaryValue()
          if (field.tokenStreamValue() != null) {
            tokenStream = field.tokenStreamValue();
          } else {
            tokenStream = analyzer.tokenStream(field.name(), new StringReader(field.stringValue()));
          }

View Full Code Here

Examples of org.apache.lucene.document.Field.tokenStreamValue()

        if (field.isTokenized()) {
          int termCounter = 0;
          final TokenStream tokenStream;
          // todo readerValue(), binaryValue()
          if (field.tokenStreamValue() != null) {
            tokenStream = field.tokenStreamValue();
          } else {
            tokenStream = analyzer.tokenStream(field.name(), new StringReader(field.stringValue()));
          }


          final Token reusableToken = new Token();

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()


        if (field.isTokenized()) {
          int termCounter = 0;
          final TokenStream tokenStream;
          // todo readerValue(), binaryValue()
          if (field.tokenStreamValue() != null) {
            tokenStream = field.tokenStreamValue();
          } else {
            tokenStream = analyzer.tokenStream(field.name(), new StringReader(field.stringValue()));
          }

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

        if (field.isTokenized()) {
          int termCounter = 0;
          final TokenStream tokenStream;
          // todo readerValue(), binaryValue()
          if (field.tokenStreamValue() != null) {
            tokenStream = field.tokenStreamValue();
          } else {
            tokenStream = analyzer.tokenStream(field.name(), new StringReader(field.stringValue()));
          }


          // reset the TokenStream to the first token

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

          fieldState.length++;
          fieldState.position++;
          anyToken = valueLength > 0;
        } else {                                  // tokenized field
          final TokenStream stream;
          final TokenStream streamValue = field.tokenStreamValue();


          if (streamValue != null) 
            stream = streamValue;
          else {
            // the field does not have a TokenStream,

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

          fieldState.offset += valueLength;
          fieldState.length++;
          fieldState.position++;
        } else {                                  // tokenized field
          final TokenStream stream;
          final TokenStream streamValue = field.tokenStreamValue();


          if (streamValue != null) 
            stream = streamValue;
          else {
            // the field does not have a TokenStream,

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                        for (int k = 0; k < fields.length; k++)
                        {
                           Fieldable field = fields[k];
                           // assume properties fields use
                           // SingleTokenStream
                           t = field.tokenStreamValue().next(t);
                           String value = new String(t.termBuffer(), 0, t.termLength());
                           if (value.startsWith(namePrefix))
                           {
                              // extract value
                              value = value.substring(namePrefix.length());

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.