That actually breaks the append at line 127.  If we haven't assigned lastfound since the last iteration (which would happen if we hit a malformed token or other tokenlike nontoken) then that append will read from the previous lastfound, which will copy extra leading stuff.  If I wanted to move that assignment to the end of the loop and remove the dummy variable, I'd need to add redundant logic to all of the continues.  I'm going to leave it as is, and we can refactor it later.