Simple abstract class to abstract tokenization process. Implementation provides rules of tokenization, ie. chars(delimiters) based on which String is broken down into tokens.
@author baranowb
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.