use decimal.Decimal for arithmetic precision
test program for iterative learning
smooth initial emission dictionary with uniformly distributed expected counts
copy lexicon in smoothing function instead of changing the input lexicon
in initialisation punctuation automatically receives correct tag
With larger files, all expected counts are 0. I should write a test module to make sure the forward backward functions are correct, so that I can figure out what the issue is (and whether it is maybe an issue of arithmetic precision).
solved some issues with begin and starting tags
solved some issues with begin and starting tags
Tests for consistency probability model after transformation from counts and equality results forward backward algoritm with brute forcing