fixup! Use the nose skip plugin to actually properly skip tests.
Remove a single \n from each field of test files.

Prior to this, we would remove two trailing \n characters from the
final section of a test.
Add expected failures for the tokenizer (except lone surrogates!).

We can't currently add the lone-surrogates tests because the
expected failures file is UTF-8 and we can't have lone-surrogates
there. Le sigh…