Make TOKENS the canonical place to determine tokens.
Patch by brandonwilliams, reviewed by thobbs for CASSANDRA-5131