Added comments. Fixed minor file reading bug.
Added finally block to make sure that TokenStream is closed.