scikit-learn/scikit-learn — pull request #668 by ogrisel (2012-03-03 16:34:13+00:00)
Title: WIP: Text feature extraction simplification

Early PR to demonstrate ongoing work on simplification of the sklearn.feature_extraction.text module. The goal is to simplify the usage by avoiding the nested preprocessor into analyzer into vectorizer constructor pattern.

The CountVectorizer has now many parameters but that makes it much more straightforward

TODO before merging:

- narrative documentation

- check docstrings completeness

- flatten the `Vectorizer` class as well? The semi-hidden `tc` and `tfidf` attributes are a source of confusion even for myself when I forget about them.