Mostly worked on feature improvements around stemming and word shape, n_grams and experimenting with vectorizer parameters. Started looking at feature engineering. Next steps are to run grid search on the data pipeline between the vecotrizer and the model to see what are the most optimal parameters for both.
Applied optimizaton approach to improve how to open and close the db connection with context manager.
Applied optimizaton approach to improve how to open and close the db connection with context manager.
Applied optimizaton approach to improve how to open and close the db connection with context manager.
Renamed variables to clarify the flow and tried different parameters for vectorizer. Also added ways to improve the feature set like stemming, shaping, dropping punctuation and so forth.
Added notes on the different models and parameters tried in previous model runs. Tweaked the functions on what is returned to help the flow of checking the model success.
Adjustments to improve code flow, prevent unpickling if there are no new emails for example.