Question: what do you think are the advantages and disadvantages of bag of words?
Answer: Disadvantages: Bag of words leads to a high dimensional feature vector due to large size of Vocabulary, V. Bag of words doesn't leverage co-occurrence statistics between words. In other words, it assumes all words are independent of each other.