wildebeest-nlp (pypi): The wildebeest scripts investigate, repair and normalize a wide range of text file problems at the character level, e.g. encoding errors, normalization of characters into their canonical form, mapping digits and some punctuation to ASCII, deletion of some non-printable characters.
Keywords: machine translation|datasets|NLP|natural language processing|computational linguistics