Examples of LanguageConfiguration

org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration
Utility that supports the configuration of languages and language specific parameters.
Language configuration
Languages are configured as follows:
```
 de,en 
```
or
```
 !fr,!cn,*
```
The '!{lang}' is used to {@link #getExplicitlyExcluded() explicitly exclude} an language. '*' can be used tospecify that all languages are allowed. '{lang}' {@link #getExplicitlyIncluded() explicitly includes} a language.',' is used as separator between multiple configurations however this class also supports the usage of String[] and {@link Collection} (in case of Collections the{@link Object#toString()} method is used to obtain the configuration).If an array or a collection is used for the configuration, than comma is NOT used as separator!

Parameter Support
This class supports the parsing of language specific parameters by the followng syntax
```
 {language};{param-name}={param-value};{param-name}={param-value}
```
Parameters that apply to all {languages} with no configuration can be either set for the '*' or an empty language tag. Here is an example
```
 *;myParam=myValue ;myParam=myValue
```
Multiple default configurations will cause a {@link ConfigurationException}.
The {@link #getParameters(String)} and {@link #getParameters(String,String)}will return values of the {@link #getDefaultParameters()} if nolanguage specific parameters are present for the requested language. However the default configuration is not merged but replaced by language specific parameter declarations. Applications that want to use the default configuration as fallback to language specific settings can implement this by using the properties provided by {@link #getDefaultParameters()}.
Notes
- only the first occurrence of '=' within an parameter is used as separator between the param name and value. This means that the {param-name} is allowed to contain '='.
- in case a comma separated string is used for the lanugage configuration parameter declaration MUST NOT contain ',' (comma) values. In case a String[] or an {@link Collection} is used this is not the case.
@author Rupert Westenthaler

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

        //We can create the default configuration only here, as it depends on the
        //name of the solrIndex
        String defaultConfig = "*;" 
                + IndexConfiguration.PARAM_FST + "=" + indexReference.getIndex() + ";"
                + IndexConfiguration.PARAM_FIELD + "=" + IndexConfiguration.DEFAULT_FIELD;
        fstConfig = new LanguageConfiguration(IndexConfiguration.FST_CONFIG, new String[]{defaultConfig});
        //now set the actual configuration parsed to the engine
        value = properties.get(IndexConfiguration.FST_CONFIG);
        if(value != null && !StringUtils.isBlank(value.toString())){
            fstConfig.setConfiguration(properties);
        } //else keep the default

View Full Code Here

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

            solrIndexRef.getIndex());
        Assert.assertNotNull("Unable to get SolrCore '" + config.getIndexConfigurationName()
            + "' from SolrServer "+server, core);
        yard = new SolrYard(server,config,null);
        //setup the index configuration
        LanguageConfiguration langConf = new LanguageConfiguration("not.used", 
            new String[]{"en;field=dbpedia-ont:surfaceForm;generate=true"});
        fstConfig = new IndexConfiguration(langConf, core, FieldEncodingEnum.SolrYard);
        fstConfig.setExecutorService(Executors.newFixedThreadPool(1));
        fstConfig.setTypeField("rdf:type");
        fstConfig.setRankingField("entityhub:entityRank");

View Full Code Here

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

                @Override
                public Object addingService(ServiceReference reference) {
                    if(managerServicePid.equals(reference.getProperty(Constants.SERVICE_PID))){
                        return null; //do not track this manager!
                    }
                    LanguageConfiguration langConf = new LanguageConfiguration(SUPPORTED_LANUAGES, DEFAULT_LANG_CONF);
                    try {
                        langConf.setConfiguration(reference);
                    } catch (ConfigurationException e) {
                        log.error("Unable to track ServiceReference {} becuase of invalid LanguageConfiguration("
                            + SUPPORTED_LANUAGES+"="+reference.getProperty(SUPPORTED_LANUAGES)+")!",e);
                        return null;
                    }
                    Object service = bundleContext.getService(reference);
                    if(service != null){
                        ref2LangConfig.put(reference, langConf);
                        langTokenizers.clear();
                    }
                    return service;
                }




                @Override
                public void modifiedService(ServiceReference reference, Object service) {
                    if(managerServicePid.equals(reference.getProperty(Constants.SERVICE_PID))){
                        return; //ignore this service!
                    }
                    LanguageConfiguration langConf = new LanguageConfiguration(SUPPORTED_LANUAGES, DEFAULT_LANG_CONF);
                    try {
                        langConf.setConfiguration(reference);
                        ref2LangConfig.put(reference, langConf);
                        langTokenizers.clear();
                    } catch (ConfigurationException e) {
                        log.error("Unable to track ServiceReference {} becuase of invalid LanguageConfiguration("
                            + SUPPORTED_LANUAGES+"="+reference.getProperty(SUPPORTED_LANUAGES)+")!",e);

View Full Code Here

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

    
    private List<ServiceReference> initTokenizers(String language) {
        List<ServiceReference> tokenizers = new ArrayList<ServiceReference>();
        if(labelTokenizerTracker.getServiceReferences() != null){
            for(ServiceReference ref : labelTokenizerTracker.getServiceReferences()){
                LanguageConfiguration langConf = ref2LangConfig.get(ref);
                if(langConf != null && langConf.isLanguage(language)){
                    tokenizers.add(ref);
                }
            }
        }
        if(tokenizers.size() > 1){

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of LanguageConfiguration

Language configuration

Parameter Support

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration

Examples of org.apache.stanbol.enhancer.nlp.utils.LanguageConfiguration