luispedro/milk — pull request #2 by ishalyminov (2011-10-15 18:34:28+00:00)
Title: Weighted voting AdaBoost

Hello Luis!

milk/supervised/weighted_voting_adaboost.py is the code I was supposed to send.
I see it as a generalization of AdaBoost for working with multiple class labels.

A learner for this classifier initialization must be already constructed, e.g.:
learner = weighted_voting_ada_learner(100, one_against_one(tree_learner(criterion=neg_z1_loss)))

Maybe I am wrong, but I've discovered that multiclass strategies can't work with weights. For an example, one_against_one.train (milk/supervised/multi.py:114). I think this train() method works with no respect to input weights. And that probably causes my adaboost incorrect learning.

Best regards,
Igor