JavaTokenizer This program tokenize Java file. example input : java file package JavaTokenizer; public class Hoge { public void hoge() { return; } } output : tokenized java file package JavaTokenizer ; public class Hoge { public void hoge ( ) { return ; } }