Examples of PerFieldAnalyzerWrapper

org.apache.lucene.analysis.PerFieldAnalyzerWrapper
This analyzer is used to facilitate scenarios where different fields require different analysis techniques. Use {@link #addAnalyzer}to add a non-default analyzer on a field name basis.
Example usage:
```
 PerFieldAnalyzerWrapper aWrapper = new PerFieldAnalyzerWrapper(new StandardAnalyzer()); aWrapper.addAnalyzer("firstname", new KeywordAnalyzer()); aWrapper.addAnalyzer("lastname", new KeywordAnalyzer()); 
```
In this example, StandardAnalyzer will be used for all fields except "firstname" and "lastname", for which KeywordAnalyzer will be used.
A PerFieldAnalyzerWrapper can be used like any other analyzer, for both indexing and query parsing.
org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper
This analyzer is used to facilitate scenarios where different fields require different analysis techniques. Use the Map argument in {@link #PerFieldAnalyzerWrapper(Analyzer,java.util.Map)}to add non-default analyzers for fields.
Example usage:
```
 {@code Map analyzerPerField = new HashMap(); analyzerPerField.put("firstname", new KeywordAnalyzer()); analyzerPerField.put("lastname", new KeywordAnalyzer()); PerFieldAnalyzerWrapper aWrapper = new PerFieldAnalyzerWrapper(new StandardAnalyzer(version), analyzerPerField);}
```
In this example, StandardAnalyzer will be used for all fields except "firstname" and "lastname", for which KeywordAnalyzer will be used.
A PerFieldAnalyzerWrapper can be used like any other analyzer, for both indexing and query parsing.

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

  public Indexer(Directory dir, Language language) {
    try {
      final Map<String, Analyzer> analyzerMap = new HashMap<String, Analyzer>();
      analyzerMap.put(FIELD_NAME, new LanguageToolAnalyzer(LUCENE_VERSION, new JLanguageTool(language), false));
      analyzerMap.put(FIELD_NAME_LOWERCASE, new LanguageToolAnalyzer(LUCENE_VERSION, new JLanguageTool(language), true));
      final Analyzer analyzer = new PerFieldAnalyzerWrapper(new DoNotUseAnalyzer(), analyzerMap);
      final IndexWriterConfig writerConfig = new IndexWriterConfig(LUCENE_VERSION, analyzer);
      writerConfig.setOpenMode(OpenMode.CREATE);
      writer = new IndexWriter(dir, writerConfig);
      sentenceTokenizer = language.getSentenceTokenizer();
    } catch (Exception e) {

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper


    // TODO: avoid duplication - use Indexer.java!
    final Map<String, Analyzer> analyzerMap = new HashMap<>();
    analyzerMap.put(FIELD_NAME, new LanguageToolAnalyzer(LUCENE_VERSION, new JLanguageTool(language), false));
    analyzerMap.put(FIELD_NAME_LOWERCASE, new LanguageToolAnalyzer(LUCENE_VERSION, new JLanguageTool(language), true));
    final Analyzer analyzer = new PerFieldAnalyzerWrapper(new DoNotUseAnalyzer(), analyzerMap);


    final IndexWriterConfig config = new IndexWriterConfig(LUCENE_VERSION, analyzer);
    final IndexWriter writer = new IndexWriter(directory, config);
    try {
      addDocument(writer, "How do you thin about this wonderful idea?");

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

          if (analyzer != null) {
            analyzerPerField.put(field, analyzer);
          }
        }
        
        this.analyzer = new PerFieldAnalyzerWrapper(new StandardAnalyzer(VER), analyzerPerField) ;


        // force creation of the index if it don't exist
        // otherwise if we get a search before data is written we get an
        // exception
        startIndexing() ;

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

          if (analyzer != null) {
            analyzerPerField.put(field, analyzer);
          }
        }
        
        this.analyzer = new PerFieldAnalyzerWrapper(new StandardAnalyzer(VER), analyzerPerField) ;


        // force creation of the index if it don't exist
        // otherwise if we get a search before data is written we get an
        // exception
        startIndexing() ;

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

        // entity and graph fields and StandardAnalyzer for all other
        Map<String, Analyzer> analyzerPerField = new HashMap<String, Analyzer>() ;
        analyzerPerField.put(def.getEntityField(), new KeywordAnalyzer()) ;
        if ( def.getGraphField() != null )
            analyzerPerField.put(def.getGraphField(), new KeywordAnalyzer()) ;
        this.analyzer = new PerFieldAnalyzerWrapper(new StandardAnalyzer(VER), analyzerPerField) ;


        // force creation of the index if it don't exist
        // otherwise if we get a search before data is written we get an
        // exception
        startIndexing() ;

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

     *
     * @param stopwords
     * @return
     */
  private static PerFieldAnalyzerWrapper createHardCodedPerFieldAnalyzerWrapper(Set<String> stopwords, char[] ignoreChars) {
        PerFieldAnalyzerWrapper pfaw;
        Analyzer geoNetworkAnalyzer = SearchManager.createGeoNetworkAnalyzer(stopwords, ignoreChars);
    Map<String, Analyzer> analyzers = new HashMap<String, Analyzer>();
    analyzers.put(LuceneIndexField.UUID, new GeoNetworkAnalyzer());
    analyzers.put(LuceneIndexField.PARENTUUID, new GeoNetworkAnalyzer());
    analyzers.put(LuceneIndexField.OPERATESON, new GeoNetworkAnalyzer());
    analyzers.put(LuceneIndexField.SUBJECT, new KeywordAnalyzer());
    
    pfaw = new PerFieldAnalyzerWrapper(geoNetworkAnalyzer, analyzers );
        return pfaw;
  }

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

            Log.debug(Geonet.LUCENE, "Get analyzer for searching: " + forSearching + " and language: " + language);
        }
        
        Map<String, Analyzer> map = forSearching ? searchAnalyzerMap : analyzerMap;
        
        PerFieldAnalyzerWrapper analyzer = (PerFieldAnalyzerWrapper)map.get(language); 
        if(analyzer != null) {
            return analyzer;
        } else {
            if(Log.isDebugEnabled(Geonet.LUCENE)) {
                Log.debug(Geonet.LUCENE, "Returning default analyzer.");

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

            }
      Analyzer analyzer = createAnalyzerFromLuceneConfig(aClassName, field, stopwordsForLanguage);
      extraFieldAnalyzers.put(field, analyzer);
    }


    PerFieldAnalyzerWrapper pfa = new PerFieldAnalyzerWrapper( defaultAnalyzer, extraFieldAnalyzers);
    


    // Register to a reference map if needed
    if (referenceMap != null) {
      referenceMap.put(referenceKey, pfa);

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

        IndexAndTaxonomy indexAndTaxonomy = getNewIndexReader(null);
        String searchValueWithoutWildcard = searchValue.replaceAll("[*?]", "");


        final Element request = new Element("request").addContent(new Element("any").setText(searchValue));
        String language = LuceneSearcher.determineLanguage(context, request, _settingInfo).analyzerLanguage;
        final PerFieldAnalyzerWrapper analyzer = SearchManager.getAnalyzer(language, true);
        String analyzedSearchValue = LuceneSearcher.analyzeText(fieldName, searchValueWithoutWildcard, analyzer);
        boolean startsWithOnly = !searchValue.startsWith("*") && searchValue.endsWith("*");
        
        try {
            GeonetworkMultiReader multiReader = indexAndTaxonomy.indexReader;

View Full Code Here

Examples of org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper

        LuceneConfig luceneConfig = getLuceneConfig();
        if (luceneExpr == null) {
            data = null;
            Log.info(Geonet.CSW_SEARCH, "LuceneSearcher made null query");
        } else {
            PerFieldAnalyzerWrapper analyzer = SearchManager.getAnalyzer(_lang.analyzerLanguage, true);
            SettingInfo.SearchRequestLanguage requestedLanguageOnly = sm.getSettingInfo().getRequestedLanguageOnly();
            data = LuceneSearcher.makeLocalisedQuery(luceneExpr,
                analyzer, luceneConfig, _lang.presentationLanguage, requestedLanguageOnly);
            Log.info(Geonet.CSW_SEARCH, "LuceneSearcher made query:\n" + data.toString());
        }

View Full Code Here

0 1 2 3 4

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.