Examples of java.util.StringTokenizer

java.util.StringTokenizer
The string tokenizer class allows an application to break a string into tokens. The tokenization method is much simpler than the one used by the StreamTokenizer class. The StringTokenizer methods do not distinguish among identifiers, numbers, and quoted strings, nor do they recognize and skip comments.
The set of delimiters (the characters that separate tokens) may be specified either at creation time or on a per-token basis.
An instance of StringTokenizer behaves in one of two ways, depending on whether it was created with the returnDelims flag having the value true or false:
- If the flag is false, delimiter characters serve to separate tokens. A token is a maximal sequence of consecutive characters that are not delimiters.
- If the flag is true, delimiter characters are themselves considered to be tokens. A token is thus either one delimiter character, or a maximal sequence of consecutive characters that are not delimiters.
A StringTokenizer object internally maintains a current position within the string to be tokenized. Some operations advance this current position past the characters processed.
A token is returned by taking a substring of the string that was used to create the StringTokenizer object.
The following is one example of the use of the tokenizer. The code:
```
 StringTokenizer st = new StringTokenizer("this is a test"); while (st.hasMoreTokens()) { System.out.println(st.nextToken()); } 
```
prints the following output:
```
 this is a test 
```
StringTokenizer is a legacy class that is retained for compatibility reasons although its use is discouraged in new code. It is recommended that anyone seeking this functionality use the split method of String or the java.util.regex package instead.
The following example illustrates how the String.split method can be used to break up a string into its basic tokens:
```
 String[] result = "this is a test".split("\\s"); for (int x=0; x<result.length; x++) System.out.println(result[x]); 
```
prints the following output:
```
 this is a test 
```
@author unascribed @version 1.35, 11/17/05 @see java.io.StreamTokenizer @since JDK1.0

        }
        return buf.toString();
    }


    public static byte[] decodeMacAddress(final String mac) {
        final StringTokenizer tokens = new StringTokenizer(mac, "-");
        if(tokens.countTokens() != MAC_ADDRESS_TOKENS) {
            throw new IllegalArgumentException("Unexpected mac address representation: " + mac);
        }
        final StringBuilder buf = new StringBuilder(MAC_ADDRESS_TOKENS * 2);
        for(int i = 0; i < MAC_ADDRESS_TOKENS; i++) {
            buf.append(tokens.nextToken());
        }
        char[] c = buf.toString().toCharArray();
        return StringUtils.decodeHex(c);
    }

View Full Code Here

   * @param str Full string
   * @param splitter Characters to split on
   * @return List of String pieces from full string
   */
    public static List<String> split(String str, String splitter) {
        StringTokenizer tokens = new StringTokenizer(str, splitter);
        ArrayList<String> l = new ArrayList<String>(tokens.countTokens());
        while(tokens.hasMoreTokens()) {
            l.add(tokens.nextToken());
        }
        return l;
    }

View Full Code Here

   * @param splitter Characters to split on
   * @return List of String pieces from full string
   */
  public static List splitPreservingQuotedSubstring(String str, String splitter) {
    ArrayList l = new ArrayList();
    StringTokenizer tokens = new StringTokenizer(str, splitter);
        StringBuffer token = new StringBuffer();
    while(tokens.hasMoreTokens()) {
            token.setLength(0);
            token.append(tokens.nextToken());
            if ( token.charAt(0) == '"' ) {
                token.deleteCharAt(0);
                while ( tokens.hasMoreTokens() ) {
                    token.append(Constants.SPACE + tokens.nextToken()); 
                    if ( token.charAt(token.length() -1) == '"' ) {
                        token.deleteCharAt(token.length() - 1);
                        break;
                    }
                }

View Full Code Here

   * @param delimiter Characters which are delimit tokens
   * @return List of string tokens contained in the tokenized string
   */
  public static List getTokens(String str, String delimiter) {
    ArrayList l = new ArrayList();
    StringTokenizer tokens = new StringTokenizer(str, delimiter);
    while(tokens.hasMoreTokens()) {
      l.add(tokens.nextToken());
    }
    return l;
    }

View Full Code Here

     * @param str String to be tokenized
     * @param delimiter Characters which are delimit tokens
     * @return Number of tokens seperated by the delimiter
     */
    public static int getTokenCount(String str, String delimiter) {
        StringTokenizer tokens = new StringTokenizer(str, delimiter);
        return tokens.countTokens();
    }

View Full Code Here

        if (text == null  ||  text.length() == 0) {
            return defaultValue;
        }
        final StringBuffer buf = new StringBuffer();
        String token;
        for (final StringTokenizer iter = new StringTokenizer(text, "_");  iter.hasMoreTokens();) { //$NON-NLS-1$
            token = iter.nextToken().toLowerCase();
            if (buf.length() > 0) {
                buf.append(' ');
            }
            buf.append(Character.toUpperCase(token.charAt(0)));
            buf.append(token.substring(1));

View Full Code Here

     * @since 5.0
     */
    public static String collapseWhitespace(String raw) {
        StringBuffer rv = new StringBuffer(raw.length());


        StringTokenizer izer = new StringTokenizer(raw, " "); //$NON-NLS-1$
        while (izer.hasMoreTokens()) {
            String tok = izer.nextToken();
            // Added one last check here so we don't append a "space" on the end of the string
            rv.append(tok);
            if( izer.hasMoreTokens() ) {
                rv.append(' ');
            }
        } // endwhile


        return rv.toString();

View Full Code Here

        StandardXMLTranslator translator = new StandardXMLTranslator(new StreamSource(new StringReader(sourceXML)));
        compareDocuments(sourceXML, translator.getString());
    }    
    
    private void compareDocuments(String expectedDoc, String actualDoc) {
        StringTokenizer tokens1 = new StringTokenizer(expectedDoc, "\r\n"); //$NON-NLS-1$
        StringTokenizer tokens2 = new StringTokenizer(actualDoc, "\n");//$NON-NLS-1$
        while(tokens1.hasMoreTokens()){
            String token1 = tokens1.nextToken().trim();
            if(!tokens2.hasMoreTokens()){
                fail("XML doc mismatch: expected=" + token1 + "\nactual=none");//$NON-NLS-1$ //$NON-NLS-2$
            }
            String token2 = tokens2.nextToken().trim();
            assertEquals("XML doc mismatch: ", token1, token2); //$NON-NLS-1$
        }
        if(tokens2.hasMoreTokens()){
            fail("XML doc mismatch: expected=none\nactual=" + tokens2.nextToken().trim());//$NON-NLS-1$
        }
    }

View Full Code Here

        return names.xmlNames;
    }


    static PdfArray createDestinationArray(String value, PdfWriter writer) {
        PdfArray ar = new PdfArray();
        StringTokenizer tk = new StringTokenizer(value);
        int n = Integer.parseInt(tk.nextToken());
        ar.add(writer.getPageReference(n));
        if (!tk.hasMoreTokens()) {
            ar.add(PdfName.XYZ);
            ar.add(new float[]{0, 10000, 0});
        }
        else {
            String fn = tk.nextToken();
            if (fn.startsWith("/"))
                fn = fn.substring(1);
            ar.add(new PdfName(fn));
            for (int k = 0; k < 4 && tk.hasMoreTokens(); ++k) {
                fn = tk.nextToken();
                if (fn.equals("null"))
                    ar.add(PdfNull.PDFNULL);
                else
                    ar.add(new PdfNumber(fn));
            }

View Full Code Here

      }


      if (mBeans != null) {
        for (Iterator iterator = mBeans.iterator(); iterator.hasNext();) {
          String mBean = (String) iterator.next();
          StringTokenizer st = new StringTokenizer((String) attlist.get(name), ",");
          while (st.hasMoreTokens()) {
            String token = st.nextToken();
            if (token.equals("*")) {
              // Get all mbean's attributes
              try {
                List attributes = MXWrapper.getAttributeNames(mBean);
                if (attributes != null) {

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

Related Classes of java.util.StringTokenizer

co.nubetech.hiho.hive.HiveUtility

co.nubetech.hiho.job.DBQueryInputJob

co.nubetech.hiho.job.ExportToOracleDb

com.ibm.sbt.services.client.connections.activitystreams.ActivityStreamService

com.sun.jna.Native

com.sun.messaging.ums.core.UMSServlet

com.sun.messaging.ums.provider.openmq.ProviderBrokerInfoService

com.vaadin.ui.AbstractComponent

de.FBEditor.utils.Encryption

de.sciss.eisenkraut.util.PrefsUtil

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.