token-based tf&idf for compressed index
Merge remote-tracking branch 'origin/huiyang'