Remove non-unique ngrams if things go wrong.