Adjusted graph functions to work more independently.
Pulled out getting data since x, y is unpickled and added vectorizer in case x is not vectorized.
Updated graphs just for logistic regression.
Split out evaluating the model from building the model to make sure there is a clear delineation in what is built and then when its tested.
Split out evaluating the model from building the model to make sure there is a clear delineation in what is built and then when its tested.
Pulled test points and pulled custom tokenizer because accuracy was slightly improved without it.
Add rank functionality back into evaluate the model as building.
Adjusted rank features so it will call correctly.
Pulled out feature ranking because it can be used with model building more but also leveraged here. Thus put that into common.
Adjusted sections and added in feature rank because its really for evaluating model performance as its built.
Moved feature rank to the build model scriptbecause its really for evaluating model performance as its built.
Pulled uneeded parameter.
Added back the nltk special tokenizer. The standard sci-kit seems to perform as good and possibly give better top words but they are so close, going to stick with where I landed earlier in the week for now.
Fixed a couple things to make sure functions work and provide further function independence. Also tested new dataset.