List of tokenStreamValue() Examples

Examples of tokenStreamValue()

org.apache.lucene.document.Field.tokenStreamValue()
The TokesStream for this field to be used when indexing, or null. If null, the Reader value or String value is analyzed to produce the indexed tokens.
org.apache.lucene.document.Fieldable.tokenStreamValue()
The TokenStream for this field to be used when indexing, or null. @see #stringValue()
org.apache.lucene.document.NumericField.tokenStreamValue()
Returns a {@link NumericTokenStream} for indexing the numeric value.
org.elasticsearch.common.lucene.all.AllField.tokenStreamValue()

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                            Fieldable[] fields = aDoc.getFieldables(FieldNames.PROPERTIES);
                            Token t = new Token();
                            for (int k = 0; k < fields.length; k++) {
                                Fieldable field = fields[k];
                                // assume properties fields use SingleTokenStream
                                t = field.tokenStreamValue().next(t);
                                String value = new String(t.termBuffer(), 0, t.termLength());
                                if (value.startsWith(namePrefix)) {
                                    // extract value
                                    value = value.substring(namePrefix.length());
                                    // create new named value

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

          fieldState.offset += valueLength;
          fieldState.length++;
          fieldState.position++;
        } else {                                  // tokenized field
          final TokenStream stream;
          final TokenStream streamValue = field.tokenStreamValue();


          if (streamValue != null) 
            stream = streamValue;
          else {
            // the field does not have a TokenStream,

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                        for (int k = 0; k < fields.length; k++)
                        {
                           Fieldable field = fields[k];
                           // assume properties fields use
                           // SingleTokenStream
                           t = field.tokenStreamValue().next(t);
                           String value = new String(t.termBuffer(), 0, t.termLength());
                           if (value.startsWith(namePrefix))
                           {
                              // extract value
                              value = value.substring(namePrefix.length());

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

            addPosition(fieldName, stringValue, position++, null, null);
          offset += stringValue.length();
          length++;
        } else 
        { // tokenized field
          TokenStream stream = field.tokenStreamValue();
          
          // the field does not have a TokenStream,
          // so we have to obtain one from the analyzer
          if (stream == null) {
            Reader reader;        // find or make Reader

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                        for (int k = 0; k < fields.length; k++)
                        {
                           Fieldable field = fields[k];
                           // assume properties fields use
                           // SingleTokenStream
                           t = field.tokenStreamValue().next(t);
                           String value = new String(t.termBuffer(), 0, t.termLength());
                           if (value.startsWith(namePrefix))
                           {
                              // extract value
                              value = value.substring(namePrefix.length());

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                        {
                           Fieldable field = fields[k];
                           // assume properties fields use
                           // SingleTokenStream
                           //t = field.tokenStreamValue().next(t);
                           field.tokenStreamValue().incrementToken();
                           CharTermAttribute term = field.tokenStreamValue().getAttribute(CharTermAttribute.class);
                           PayloadAttribute payload = field.tokenStreamValue().getAttribute(PayloadAttribute.class);


                           String value = new String(term.buffer(), 0, term.length());

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                           Fieldable field = fields[k];
                           // assume properties fields use
                           // SingleTokenStream
                           //t = field.tokenStreamValue().next(t);
                           field.tokenStreamValue().incrementToken();
                           CharTermAttribute term = field.tokenStreamValue().getAttribute(CharTermAttribute.class);
                           PayloadAttribute payload = field.tokenStreamValue().getAttribute(PayloadAttribute.class);


                           String value = new String(term.buffer(), 0, term.length());


                           if (value.startsWith(namePrefix))

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                           // assume properties fields use
                           // SingleTokenStream
                           //t = field.tokenStreamValue().next(t);
                           field.tokenStreamValue().incrementToken();
                           CharTermAttribute term = field.tokenStreamValue().getAttribute(CharTermAttribute.class);
                           PayloadAttribute payload = field.tokenStreamValue().getAttribute(PayloadAttribute.class);


                           String value = new String(term.buffer(), 0, term.length());


                           if (value.startsWith(namePrefix))
                           {

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

          fieldState.offset += valueLength;
          fieldState.length++;
          fieldState.position++;
        } else {                                  // tokenized field
          final TokenStream stream;
          final TokenStream streamValue = field.tokenStreamValue();


          if (streamValue != null) 
            stream = streamValue;
          else {
            // the field does not have a TokenStream,

View Full Code Here

Examples of org.apache.lucene.document.Fieldable.tokenStreamValue()

                        for (int k = 0; k < fields.length; k++)
                        {
                           Fieldable field = fields[k];
                           // assume properties fields use
                           // SingleTokenStream
                           t = field.tokenStreamValue().next(t);
                           String value = new String(t.termBuffer(), 0, t.termLength());
                           if (value.startsWith(namePrefix))
                           {
                              // extract value
                              value = value.substring(namePrefix.length());

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.