Optimize wrt low frequency word tokens.