Examples of edu.stanford.nlp.ling.BasicDatum

edu.stanford.nlp.ling.BasicDatum
Basic implementation of Datum interface that can be constructed with a Collection of features and one more more labels. The features must be specified at construction, but the labels can be set and/or changed later. @author Joseph Smarr (jsmarr@stanford.edu) @author Sarah Spikes (sdspikes@cs.stanford.edu) (Templatization) @param < LabelType> The type of the labels in the Dataset @param < FeatureType> The type of the features in the Dataset

          logProbs.setCount(tag, Double.NEGATIVE_INFINITY);
        }
      }
      return;
    }
    Datum datum = new BasicDatum(featExtractor.makeFeatures(wordIndex.get(word)));
    logProbs = scorer.logProbabilityOf(datum);
    if (subtractTagScore) {
      Set<String> tagSet = logProbs.keySet();
      for (String tag : tagSet) {
        logProbs.incrementCount(tag, -Math.log(tagDist.probabilityOf(tag)));

View Full Code Here

      }
      tagCounter.incrementCount(word.tag());
      if (trainByType) {
        count = 1;
      }
      data.add(new BasicDatum(featExtractor.makeFeatures(word.word()), word.tag()), count);
    }
    datumCounter = null;


    tagDist = Distribution.laplaceSmoothedDistribution(tagCounter, tagCounter.size(), 0.5);
    tagCounter = null;

View Full Code Here

TOP

Related Classes of edu.stanford.nlp.ling.BasicDatum

edu.stanford.nlp.parser.lexparser.ChineseMaxentLexicon

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.