group=-1 (the default) is equivalent to "split". In this case, the tokens will be equivalent to the output from (without empty tokens): {@link String#split(java.lang.String)}
Using group >= 0 selects the matching group as the token. For example, if you have:
pattern = \'([^\']+)\' group = 0 input = aaa 'bbb' 'ccc'the output will be two tokens: 'bbb' and 'ccc' (including the ' marks). With the same input but using group=1, the output would be: bbb and ccc (no ' marks)
NOTE: This Tokenizer does not output tokens that are of zero length.
@version $Id: PatternTokenizer.java 940806 2010-05-04 11:18:46Z uschindler $ @see Pattern | |