slex regression #2: post process last scanned token before bailing.