hopefully finalizing the initial regex searches for tokens. will begin to separate the token candidates into the finalized tokens