Minor cleanup in tokenization & tests.

Use characters rather than single-character regexes in the state machine
definition.

Remove the `:reload-all` from the test namespace form.
Add chain training and generation.