Top-level token recognition
Added processing methods. Before token return refactoring.
_maketoken refactoring
Fix bug in skipping of multiline comments