Added support for removing transliterational noise and inline comments when tagging corpus.