Capstone report scafold
move statistics and theory from the latex report to the markdown
describe acquisition and cleaning
cleaning and sampling
tokenization theory from latex to markdown
Add 1-4 ngram tokenizers and barplots of the top 10 ngrams
add theory for the TDM and sample results
show how prediction works based on the TDM
describe prediction results
profanity filtering
measure the distribution of the word frequencies
coverage of 50% of word instances
90% coverage of word instances
describe next steps
document the idea of using elasticsearch
add the elasticsearch idea also in the TDM that faces the performance problem
Improve the abstract
submitted report to http://rpubs.com/theofpa/capstone