Examples of com.cybozu.labs.langdetect.Detector

com.cybozu.labs.langdetect.Detector

{@link Detector} class is to detect language from specified text. Its instance is able to be constructed via the factory class {@link DetectorFactory}.

After appending a target text to the {@link Detector} instance with {@link #append(Reader)} or {@link #append(String)}, the detector provides the language detection results for target text via {@link #detect()} or {@link #getProbabilities()}. {@link #detect()} method returns a single language name which has the highest probability.{@link #getProbabilities()} methods returns a list of multiple languages and their probabilities.

The detector has some parameters for language detection. See {@link #setAlpha(double)}, {@link #setMaxTextLength(int)} and {@link #setPriorMap(HashMap)}.

 import java.util.ArrayList; import com.cybozu.labs.langdetect.Detector; import com.cybozu.labs.langdetect.DetectorFactory; import com.cybozu.labs.langdetect.Language; class LangDetectSample { public void init(String profileDirectory) throws LangDetectException { DetectorFactory.loadProfile(profileDirectory); } public String detect(String text) throws LangDetectException { Detector detector = DetectorFactory.create(); detector.append(text); return detector.detect(); } public ArrayList detectLangs(String text) throws LangDetectException { Detector detector = DetectorFactory.create(); detector.append(text); return detector.getProbabilities(); } }

4x faster improvement based on Elmer Garduno's code. Thanks!

@author Nakatani Shuyo @see DetectorFactory

        detector.append(text);
        return detector.detect();
    }
    
    public ArrayList<Language> getLanguages(String text) throws LangDetectException {
        Detector detector = DetectorFactory.create();
        detector.append(text);
        return detector.getProbabilities();
    }

            reporter.getCounter("LANGUAGE ID", "EMPTY TEXT").increment(1);
            return new BehemothDocument[] { inputDoc };
        }


        try {
            Detector detector = DetectorFactory.create();
            detector.append(inputDoc.getText());
            lang = detector.detect();
            inputDoc.getMetadata(true).put(languageMDKey, new Text(lang));
        } catch (LangDetectException e) {
            LOG.error("Exception on doc " + inputDoc.getUrl(), e);
            lang = null;
        }

Examples of com.cybozu.labs.langdetect.Detector

Related Classes of com.cybozu.labs.langdetect.Detector