StringTokenizer Class in Java

15 Jun, 2022
StringTokenizer class in Java is used to break a string into tokens. A StringTokenizer object internally maintains a current position within the string to be tokenized. Some operations advance this current position past the characters processed. A token is returned by taking a substring of the string that was used to create the StringTokenizer object. It provides the first step in the parsing process often called lexer or scanner. The String Tokenizer class allows an application to break strings into tokens. It implements the Enumeration interface. This class is used for parsing data. To use String Tokenizer class we have to specify an input string and a string that contains delimiters. Delimiters are the characters that separate tokens. Each character in the delimiter string is considered a valid delimiter. Default delimiters are whitespaces, new line, space, and tab. 
Illustration: 
Constructors of StringToken: Let us consider ‘str’ as the string to be tokenized
StringTokenizer(String str): default delimiters like newline, space, tab, carriage return, and form feed.StringTokenizer(String str, String delim):  delim is a set of delimiters that are used to tokenize the given string.StringTokenizer(String str, String delim, boolean flag): The first two parameters have the same meaning wherein The flag serves the following purpose.
StringTokenizer(String str): default delimiters like newline, space, tab, carriage return, and form feed.
StringTokenizer(String str, String delim):  delim is a set of delimiters that are used to tokenize the given string.
StringTokenizer(String str, String delim, boolean flag): The first two parameters have the same meaning wherein The flag serves the following purpose.
3.1: If the flag is false, delimiter characters serve to separate tokens
Example:
Input : if string --> "hello geeks" and Delimiter is " ", then 
Output:  tokens are "hello" and "geeks".
3.2: If the flag is true, delimiter characters are considered to be tokens.
Example:
Input : String --> is "hello geeks"and Delimiter is " ", then 
Output: Tokens --> "hello", " " and "geeks".
Implementation:
Java
// Java Program to Illustrate StringTokenizer Class // Importing required classesimport java.util.*; // Main classpublic class GFG {     // Main driver method    public static void main(String args[])    {         // Constructor 1        System.out.println("Using Constructor 1 - ");         // Creating object of class inside main() method        StringTokenizer st1 = new StringTokenizer(            "Hello Geeks How are you", " ");         // Condition holds true till there is single token        // remaining using hasMoreTokens() method        while (st1.hasMoreTokens())             // Getting next tokens            System.out.println(st1.nextToken());         // Constructor 2        System.out.println("Using Constructor 2 - ");         // Again creating object of class inside main()        // method        StringTokenizer st2 = new StringTokenizer(            "JAVA : Code : String", " :");         // If tokens are present        while (st2.hasMoreTokens())             // Print all tokens            System.out.println(st2.nextToken());         // Constructor 3        System.out.println("Using Constructor 3 - ");         // Again creating object of class inside main()        // method        StringTokenizer st3 = new StringTokenizer(            "JAVA : Code : String", " :", true);         while (st3.hasMoreTokens())            System.out.println(st3.nextToken());    }}
Using Constructor 1 - 
Hello
Geeks
How
are
you
Using Constructor 2 - 
JAVA
Code
String
Using Constructor 3 - 
JAVA
 
:
 
Code
 
:
 
String
This article is contributed by Mohit Gupta. If you like GeeksforGeeks and would like to contribute, you can also write an article using write.geeksforgeeks.org or mail your article to review-team@geeksforgeeks.org. See your article appearing on the GeeksforGeeks main page and help other Geeks.
solankimayank
sumitgumber28
aayushi2402
Java-Library
Java-Strings
Java
Java-Strings
Java
Writing code in comment?
Please use ide.geeksforgeeks.org,
generate link and share the link here.
Object Oriented Programming (OOPs) Concept in Java
How to iterate any Map in Java
Interfaces in Java
HashMap in Java with Examples
Stream In Java
ArrayList in Java
Collections in Java
Singleton Class in Java
Multidimensional Arrays in Java
Set in Java