moved corpus to top level
model and query separated
query
transform the training data into internal structure
added recommendations
split train and test set