textoken (rubygems): Textoken is a Ruby library for text tokenization. This gem extracts words from text with many customizations. It can be used in many fields like Web Crawling and Natural Language Processing.
Keywords: nlp|ruby|rubynlp|tokenization