Integration of a TokenQueue in AbstractLexer class

The token queue in AbstractLexer class is now an instance of the
TokenQueue class.