Merge pull request #17 from philip30/master

Bunch of fixes in LookupTable FSM
Merge pull request #18 from philip30/master

Fixed memory access in FSM LookupTable
Engineered the tokenizer
Updated training guide to use Ckylark
Memory updates to words
Halfway through refactoring lookup-table-fsm
Fixed bugs and memory leaks
Changed to dynamic calculation to save memory
Merge pull request #19 from philip30/master

Added Advance Interpolation Evaluation Measurement
Added information about the calculation score
Added documentation for advanced evaluation measure