token compression for unigram.