Extented tokeniser's unit tests and fixed failing ones. The tokenizers wasn't removing tokens containing special characters properly and tests were not covering that. Also, the NE IOB tag was not properly taken into account in a Token's equals
re-enabled a safety check I  removed yesterday