now, tokens/trigrams of those lines are used that have one or more of the candidates in them