synhershko/HebMorph — pull request #21 by EgozyN (2014-10-23 13:15:04+00:00)
Title: New branch, removed LingInfo from being used while loading. Load prefixe...

...s from external files.

Renaming for new files, some minor fixes.

Save and Load a complete dictionary from a temporary file format.
TODO: Fix end-of-file reading and find out why the last words aren't read.

Currectly load a complete dictionary from gz file. Loading time is cut in half.

Up for review.
Currently prefixes are loaded from separate files, dictionary is loaded from a premade file.
Tests are all loading the dictionary from a dict_file except for 3 which specifically test Loader.java.

Minor corrections.

Load/save dictionary+prefixes to/from a single file.
Prefixes are currently stored as a static member to preserve backwards compatibility

Load/aave dictionary+prefixes to/from a single file.
Prefixes are currently stored as a static member to preserve backwards compatibility

Merged dictionary and prefixes under DictHebMorph object.
Some uses of the old prefixes(tokenizers) and dictionaries(lemmatizers) still exist.
Todo: add complex unit-testing for the DictHebMorph.

Identation throughout the project.

Renamed FileUtils->HebLoader.
Other minor corrections.

Fixed some minor review notes

Prefix single load is now sent on a path basis rather than boolean