create_token now has access to the end of the input string

Changed so that `create_token` can create comment tokens.