handle zenkaku digits
added another tricky test case
added generate_test.py
clarified instructions
parse remaining tokens to pass unit test
slightly more functional UI
Included link to unit tests from main page.
added test cases from JE
fixing off-by-one error in read_tokens_mixed