Examples of edu.stanford.nlp.process.Morphology

edu.stanford.nlp.process.Morphology

nformatics.susx.ac.uk/research/nlp/carroll/morph.html . There are several ways of invoking Morphology. One is by calling the static methods WordTag stemStatic(String word, String tag) or WordTag stemStatic(WordTag wordTag). If we have created a Morphology object already we can use the methods WordTag stem(String word, string tag) or WordTag stem(WordTag wordTag).
Another way of using Morphology is to run it on an input file by running java Morphology filename. In this case, POS tags MUST be separated from words by an underscore ("_").
Note that a single instance of Morphology is not thread-safe, as the underlying lexer object is not built to be re-entrant. One thing that you can do to get around this is build a new Morphology object for each set of calls to the Morphology. For example, the MorphaAnnotator builds a Morphology for each document it annotates. The other approach is to use the synchronized methods in this class.
@author Kristina Toutanova (kristina@cs.stanford.edu) @author Christopher Manning

        // choose rarer scales for neutral tweets
        return Chance.test(50) ? Scale.LYDIAN : Scale.DORIAN;
    }


    private Variation getVariation(List<Tweet> tweets, TimelineMusic meta) {
        Morphology morphology = new Morphology(new StringReader(""));
        Multiset<String> words = HashMultiset.create();
        for (Tweet tweet : tweets) {
            String tweetText = tweet.getText().toLowerCase();
            List<String> urls = TimelineToMusicService.extractUrls(tweetText);
            for (String url : urls) {
                tweetText = tweetText.replace(url, "");
            }
            List<String> usernames = TimelineToMusicService.extractMentionedUsernames(tweetText);
            for (String username : usernames) {
                tweetText = tweetText.replace(username, "").replace("rt", "");
            }


            String[] wordsInTweet = tweetText.split("[^\\p{L}&&[^']]+");
            for (String word : wordsInTweet) {
                try {
                    words.add(morphology.stem(word));
                } catch (Exception ex) {
                    words.add(word);
                }
            }
        }

public class WordStemmer implements TreeVisitor {


  private Morphology morpha;


  public WordStemmer() {
    morpha = new Morphology();
  }

Examples of edu.stanford.nlp.process.Morphology

Related Classes of edu.stanford.nlp.process.Morphology