completed
fixed stemming and tokenizing code to rectify the ranking problem.
initiated project 2
spell checker is being implemented
spellchecking is half way done. Now I'm gonna working on Likelihood
class.
update likelihood class. the words in query log are not necessarily
aligned. must accommodate unaligned variations.
spell checker is completed. I used the upperlimit for edit distance with
4 rather than 3 to get "screening" can have higher probability than
"screaming".
the most recent version of project 1. The text processing is too much so
this is not the best version. Go back to older one.
all 9 features completed.
snippet generation can be done separately or combinatory now
the original DataProcessor is created.
DataProcessor is working. The docs are separated into 5 collections for
cross-validation.
MNBClassification: naively implemented. get DC_training & test, then
compute IG and get selected features, and create multinomial
representations (training_set and test_set). Takes a while to finish the
process; need to be optimized later.
MNBProbability: laplacian smoothing completed.
MNBProbability: implement computeClassProbability method.
MNBProbablity: getWordProbablity and getClassProbability are
implemented.
MNBClassificaiton: label method is implemented.
label method: debugged. when tf is computed, I referred to the wrong one
so I always get zero if the class is not the answer.
Project 3: completed code
arff export added
most recent one