Examples of edu.stanford.nlp.io.NumberRangesFileFilter

edu.stanford.nlp.io.NumberRangesFileFilter
Implements a file filter that examines a number in a filename to determine acceptance. This is useful for wanting to process ranges of numbered files in collections where each file has some name, part of which is alphabetic and constant, and part of which is numeric. The test is evaluated based on the rightmost natural number found in the filename string. (It only looks in the final filename, not in other components of the path.) Number ranges are inclusive.
This filter can select multiple discontinuous ranges based on a format similar to page selection ranges in various formatting software, such as "34,52-65,67,93-95". The constructor takes a String of this sort and deconstructs it into a list of ranges. The accepted syntax is:
ranges = range
ranges = range "," ranges
range = integer
range = integer "-" integer
Whitespace will be ignored. If the filter constructor is passed anything that is not a list of numeric ranges of this sort, including being passed an empty String, then an IllegalArgumentException will be thrown. @author Christopher Manning @version 2003/03/31

      // first check if we have a file range option and make sure it's valid
      final EnumMap<FilterType,String> filters = getFilters(fileFilterPanel);
      if (filters.containsKey(FilterType.isInRange)) {
        try {
          // if we can creat it, then it's not invalid!
          new NumberRangesFileFilter(filters.get(FilterType.isInRange), false);
        } catch(Exception e) {
          JOptionPane.showMessageDialog(dialog, new JLabel("<html>Please check the range you specified for the file number.  Ranges must be numerical, and disjoint <br>ranges should be separated by commas.  For example \"1-200,250-375\" is a valid range.</html>"), "Error in File Number Range", JOptionPane.ERROR_MESSAGE);
          return;
        }
      }

View Full Code Here

    op.doDep = false;
    op.testOptions.maxLength = 90;


    LexicalizedParser lp;
    try {
      FileFilter trainFilt = new NumberRangesFileFilter(args[1], false);


      lp = LexicalizedParser.trainFromTreebank(args[0], trainFilt, op);
      try {
        String filename = "chineseCharTagPCFG.ser.gz";
        System.err.println("Writing parser in serialized format to file " + filename + " ");
        System.err.flush();
        ObjectOutputStream out = IOUtils.writeStreamFromString(filename);


        out.writeObject(lp);
        out.close();
        System.err.println("done.");
      } catch (IOException ioe) {
        ioe.printStackTrace();
      }
    } catch (IllegalArgumentException e) {
      lp = LexicalizedParser.loadModel(args[1], op);
    }


    FileFilter testFilt = new NumberRangesFileFilter(args[2], false);
    MemoryTreebank testTreebank = ctpp.memoryTreebank();
    testTreebank.loadPath(new File(args[0]), testFilt);
    PrintWriter pw = new PrintWriter(new OutputStreamWriter(new FileOutputStream("out.chi"), "GB18030"), true);
    WordCatEquivalenceClasser eqclass = new WordCatEquivalenceClasser();
    WordCatEqualityChecker eqcheck = new WordCatEqualityChecker();

View Full Code Here

    DiskTreebank treebank = new DiskTreebank(trf,config.getEncoding());
    TreeTransformer transformer = config.getTreeTransformer();
    TreeNormalizer normalizer = config.getTreeNormalizer();


    if (config.getTreeRange() != null) {
      treebank.loadPath(filename, new NumberRangesFileFilter(config.getTreeRange(), true));
    } else {
      treebank.loadPath(filename);
    }
    for (Tree t : treebank) {
      if (normalizer != null) {

View Full Code Here

    TreeReaderFactory trf = new LabeledScoredTreeReaderFactory();
    TreeTransformer transformer = config.getTreeTransformer();
    TreeNormalizer normalizer = config.getTreeNormalizer();
    DiskTreebank treebank = new DiskTreebank(trf, config.getEncoding());
    if (config.getTreeRange() != null) {
      treebank.loadPath(filename, new NumberRangesFileFilter(config.getTreeRange(), true));
    } else {
      treebank.loadPath(filename);
    }
    for (Tree t : treebank) {
      if (normalizer != null) {

View Full Code Here

  public static void main(String[] args) {
    if (args.length < 2) {
      System.err.println("usage: Relation treebank numberRanges");
      return;
    }
    FileFilter testFilt = new NumberRangesFileFilter(args[1], true);
    TreeReaderFactory trf = new PennTreeReaderFactory(new NPTmpRetainingTreeNormalizer());
    DiskTreebank testTreebank = new DiskTreebank(trf);
    testTreebank.loadPath(new File(args[0]), testFilt);
    HeadFinder hf = new ModCollinsHeadFinder();
    List<Relation> relations = new ArrayList<Relation>();

View Full Code Here

0 1

TOP

Related Classes of edu.stanford.nlp.io.NumberRangesFileFilter

edu.stanford.nlp.parser.common.ArgUtils

edu.stanford.nlp.parser.lexparser.BaseLexicon

edu.stanford.nlp.parser.lexparser.ChineseCharacterBasedLexiconTraining

edu.stanford.nlp.parser.lexparser.ChineseLexiconAndWordSegmenter

edu.stanford.nlp.parser.lexparser.ChineseMaxentLexicon

edu.stanford.nlp.parser.lexparser.ChineseTreebankParserParams

edu.stanford.nlp.parser.lexparser.TreeAnnotatorAndBinarizer

edu.stanford.nlp.tagger.io.TaggedFileRecord

edu.stanford.nlp.tagger.maxent.ReadDataTagged

edu.stanford.nlp.tagger.maxent.TestClassifier

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.