Examples of PerFieldAnalyzerWrapper

org.apache.lucene.analysis.PerFieldAnalyzerWrapper
This analyzer is used to facilitate scenarios where different fields require different analysis techniques. Use {@link #addAnalyzer}to add a non-default analyzer on a field name basis.
Example usage:
```
 PerFieldAnalyzerWrapper aWrapper = new PerFieldAnalyzerWrapper(new StandardAnalyzer()); aWrapper.addAnalyzer("firstname", new KeywordAnalyzer()); aWrapper.addAnalyzer("lastname", new KeywordAnalyzer()); 
```
In this example, StandardAnalyzer will be used for all fields except "firstname" and "lastname", for which KeywordAnalyzer will be used.
A PerFieldAnalyzerWrapper can be used like any other analyzer, for both indexing and query parsing.
org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper
This analyzer is used to facilitate scenarios where different fields require different analysis techniques. Use the Map argument in {@link #PerFieldAnalyzerWrapper(Analyzer,java.util.Map)}to add non-default analyzers for fields.
Example usage:
```
 {@code Map analyzerPerField = new HashMap(); analyzerPerField.put("firstname", new KeywordAnalyzer()); analyzerPerField.put("lastname", new KeywordAnalyzer()); PerFieldAnalyzerWrapper aWrapper = new PerFieldAnalyzerWrapper(new StandardAnalyzer(version), analyzerPerField);}
```
In this example, StandardAnalyzer will be used for all fields except "firstname" and "lastname", for which KeywordAnalyzer will be used.
A PerFieldAnalyzerWrapper can be used like any other analyzer, for both indexing and query parsing.

Examples of org.apache.lucene.analysis.PerFieldAnalyzerWrapper

            String analyzerPrefix = fullPrefix + ".fields." + field;
            Analyzer analyzer = pluginRegistry.getBeanByFullPrefix(analyzerPrefix, Analyzer.class);
            analyzers.put(field, analyzer);
        }


        return new PerFieldAnalyzerWrapper(defaultAnalyzer, analyzers);
    }

View Full Code Here

Examples of org.apache.lucene.analysis.PerFieldAnalyzerWrapper

   *
   * @return Returns the <code>Analyzer</code> that is used for all analyzation
   * of Fields and Queries.
   */
  public static Analyzer createAnalyzer() {
    PerFieldAnalyzerWrapper analyzer = new PerFieldAnalyzerWrapper(new DefaultAnalyzer());


    /* Standard (Lowercase, Letter, Stop,...) */
    StandardAnalyzer stdAnalyzer;
    if (DISABLE_STOP_WORDS)
      stdAnalyzer = new StandardAnalyzer(Collections.EMPTY_SET);
    else
      stdAnalyzer = new StandardAnalyzer();


    analyzer.addAnalyzer(String.valueOf(INews.TITLE), stdAnalyzer);
    analyzer.addAnalyzer(String.valueOf(INews.DESCRIPTION), stdAnalyzer);
    analyzer.addAnalyzer(String.valueOf(INews.ATTACHMENTS_CONTENT), stdAnalyzer);


    /* Simple (Lowercase, Whitespace Tokzenizer) */
    LowercaseWhitespaceAnalyzer simpleAnalyzer = new LowercaseWhitespaceAnalyzer();
    analyzer.addAnalyzer(String.valueOf(INews.AUTHOR), simpleAnalyzer);
    analyzer.addAnalyzer(String.valueOf(INews.LABEL), simpleAnalyzer);


    /* Simple (Lowercase, Delim Tokenizer) */
    analyzer.addAnalyzer(String.valueOf(INews.CATEGORIES), new LowercaseDelimiterAnalyzer('\n'));


    return analyzer;
  }

View Full Code Here

Examples of org.apache.lucene.analysis.PerFieldAnalyzerWrapper

        } catch (Exception e) {
            logger.error("failed to return search analyzer. are the analyzers specified correctly in server.conf? {language='"+language+"', class='"+className+"'}",e);
            logger.error("recovering by returning default archiver analyzer. indexing and search may be impaired. urgent fix required.");
            analyzer = new ArchivaAnalyzer();
        } 
        PerFieldAnalyzerWrapper wrapper = new PerFieldAnalyzerWrapper(analyzer);
        
        if (operation==Operation.INDEX) {
          wrapper.addAnalyzer("to", new EmailAnalyzer());
          wrapper.addAnalyzer("from", new EmailAnalyzer());
          wrapper.addAnalyzer("cc", new EmailAnalyzer());
          wrapper.addAnalyzer("bcc", new EmailAnalyzer());
          wrapper.addAnalyzer("deliveredto", new EmailAnalyzer());
          wrapper.addAnalyzer("attachname", new FileNameAnalyzer());
        } else {
          wrapper.addAnalyzer("to", new WhitespaceAnalyzer());
           wrapper.addAnalyzer("from", new WhitespaceAnalyzer());
           wrapper.addAnalyzer("cc", new WhitespaceAnalyzer());
           wrapper.addAnalyzer("bcc", new WhitespaceAnalyzer());
           wrapper.addAnalyzer("deliveredto", new WhitespaceAnalyzer());
           wrapper.addAnalyzer("attachname", new FileNameAnalyzer());
        }
        return wrapper;
    }

View Full Code Here

Examples of org.apache.lucene.analysis.PerFieldAnalyzerWrapper

     * Create a {@link Analyzer} which is used to index the {@link MailboxMembership}'s
     * 
     * @return analyzer
     */
    public static Analyzer createAnalyzer() {
        PerFieldAnalyzerWrapper wrapper = new PerFieldAnalyzerWrapper(new ImapSearchAnalyzer());
        return wrapper;
    }

View Full Code Here

Examples of org.apache.lucene.analysis.PerFieldAnalyzerWrapper

        myFilter      = diskFilter;
      
      
      }
      
      PerFieldAnalyzerWrapper qAnalyzer = new PerFieldAnalyzerWrapper(analyzer);
      QueryParser    queryParser = new QueryParser(DOCUMENT_KEY,qAnalyzer);
      
      //add any keyword fields
      if(query.isSetKeyword_fields()){      
        for(String field : query.keyword_fields)
          qAnalyzer.addAnalyzer(field, kwAnalyzer);
      }
      
      //parse query
      //TODO: Cache?
      try{

View Full Code Here

Examples of org.apache.lucene.analysis.PerFieldAnalyzerWrapper

                                   String usResult,
                                   String frResult,
                                   String svResult,
                                   String dkResult) throws Exception {
    RAMDirectory indexStore = new RAMDirectory();
    PerFieldAnalyzerWrapper analyzer
      = new PerFieldAnalyzerWrapper(new WhitespaceAnalyzer(TEST_VERSION_CURRENT));
    analyzer.addAnalyzer("US", usAnalyzer);
    analyzer.addAnalyzer("France", franceAnalyzer);
    analyzer.addAnalyzer("Sweden", swedenAnalyzer);
    analyzer.addAnalyzer("Denmark", denmarkAnalyzer);
    IndexWriter writer = new IndexWriter(indexStore, new IndexWriterConfig(
        TEST_VERSION_CURRENT, analyzer));


    // document data:
    // the tracer field is used to determine which document was hit

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

    public void doAddData(String fileContent, String filePath, String fileName) {
        try {


            if (Vars.writerForLucene != null) {
                Document doc = new Document();
                PerFieldAnalyzerWrapper fieldAnalyzer;


                if (lang == null) {
                    if (fileContent.length() < 1000) {
                        lang = Vars.TextCategorizerLocal.categorize(
                                fileContent.substring(0, fileContent.length()));

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

     * @param language A string containing the name of the language.
     * @return Returns the type of Analyzer.
     */
    public PerFieldAnalyzerWrapper getAnalyzer(String language) {
        if (language.equals("russian")) {
            return (new PerFieldAnalyzerWrapper(new RussianAnalyzer(Version.LUCENE_40)));
        }
        if (language.equals("english")) {
            return (new PerFieldAnalyzerWrapper(new StandardAnalyzer(Version.LUCENE_40)));
        }


        return (new PerFieldAnalyzerWrapper(new StandardAnalyzer(Version.LUCENE_40)));
    }

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

        Analyzer skosAnalyzer = new SKOSAnalyzer(indexPath, skosFile, ExpansionType.URI);


        /* Define different analyzers for different fields */
        Map<String, Analyzer> analyzerPerField = new HashMap<String, Analyzer>();
        analyzerPerField.put("subject", skosAnalyzer);
        PerFieldAnalyzerWrapper indexAnalyzer = new PerFieldAnalyzerWrapper(
                new SimpleAnalyzer(SKOSAnalysisPlugin.getLuceneVersion()), analyzerPerField);


        /* setting up a writer with a default (simple) analyzer */
        writer = new IndexWriter(new RAMDirectory(), new IndexWriterConfig(SKOSAnalysisPlugin.getLuceneVersion(),
                indexAnalyzer));

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

                ExpansionType.LABEL);


        /* Define different analyzers for different fields */
        Map<String, Analyzer> analyzerPerField = new HashMap<String, Analyzer>();
        analyzerPerField.put("subject", skosAnalyzer);
        PerFieldAnalyzerWrapper indexAnalyzer = new PerFieldAnalyzerWrapper(
                new SimpleAnalyzer(SKOSAnalysisPlugin.getLuceneVersion()), analyzerPerField);


        /* setting up a writer with a default (simple) analyzer */
        writer = new IndexWriter(new RAMDirectory(), new IndexWriterConfig(SKOSAnalysisPlugin.getLuceneVersion(),
                indexAnalyzer));

View Full Code Here

0 1 2 3 4

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.