Examples of UnifyRareWordsCleanAlgorithm

net.sourceforge.align.filter.modifier.modify.clean.UnifyRareWordsCleanAlgorithm

Represents clean algorithm changing all words in segments that are not present in given vocabulary to given string (in other words replacing all unknown words with predefined string).

To split segments into words uses given splitting algorithm or default, simple one.
@author loomchild

Examples of net.sourceforge.align.filter.modifier.modify.clean.UnifyRareWordsCleanAlgorithm

        sourceWidList, sourceVocabulary);
    targetVocabulary = VocabularyUtil.createTruncatedVocabulary(
        targetWidList, targetVocabulary);


    ModifyAlgorithm sourceAlgorithm = 
      new UnifyRareWordsCleanAlgorithm(sourceVocabulary);
    ModifyAlgorithm targetAlgorithm = 
      new UnifyRareWordsCleanAlgorithm(targetVocabulary);


    Filter filter = new Modifier(sourceAlgorithm, targetAlgorithm);
    
    return filter.apply(alignmentList);

View Full Code Here

Examples of net.sourceforge.align.filter.modifier.modify.clean.UnifyRareWordsCleanAlgorithm

    targetVocabulary = VocabularyUtil.createTruncatedVocabulary(
        targetWidList, targetVocabulary, 
        maxWordCount, minOccurenceCount);


    ModifyAlgorithm sourceAlgorithm = 
      new UnifyRareWordsCleanAlgorithm(sourceVocabulary);
    ModifyAlgorithm targetAlgorithm = 
      new UnifyRareWordsCleanAlgorithm(targetVocabulary);


    return new Pair<ModifyAlgorithm, ModifyAlgorithm>(
        sourceAlgorithm, targetAlgorithm);
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.