tokens: FWIW : the technique you 're using is something called a sliding window into a stream , and it 's worth pushing it off into a separate class to handle the logic of keeping the window filled and up to date .
ner_tags: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O