commit before trying to filter ngrams by repeated first (n-1) words...
order distribution before saving...