morfologik/morfologik-stemming — pull request #13 by jaumeortola (2013-12-09 18:48:14+00:00)
Title: Add frequency data to dictionary

This adds the use of frequency data in the FSA dictionary. A flag is used in the .info file: "fsa.dict.frequency-included=true". The frequency data is in the last byte of each dictionary entry, with codes A..J (A: less frequent words, J: more frequent words).