Writing new organised code. Written till k-gram. Syllables and probability measures left
Going to write the syllable FSM. Defined unicodes of Hindi characters.
Being able to extract syllables and kgrams properly
Written code for coprpus analysis
Made FSM graph
Written P(l) and exclusion from corpus code for Hindi
Corpus analysis word n syllables both done. k-gram extraction being done efficiently for the main file
Added the old code which I previously had made and the name used to be NLP_Files
Slight modification in corpus result and English main file
Getting jp, cp, mi
All done except djp. Now testing phase
Applied morphology
Getting good results for lal and neela and bada - file1.txt n file2.txt
At last some results, :D ... Need to test for different cases
Relative frequency also giving good results
Initial commit
Merge https://github.com/PrashantJalan/NLP
Written for English. Some modification for Hindi - 1)MI will only be combined when both positive 2)exclude a particular freq can now be done with a function. *A lot of testing is required for English
Change the english corpus words. More testing to be done
Added more files in commentaries. Got a good result now