defect: should flush for each sentence
compare crf and hmm