Debugged error where a potential series of characters could be left behind and not tokenized