Build regex only once for each token.

This reduces runtime of CORE:regcomp.
Removed useless call to skip_space_and_comment.