FIX bug in scorers that take probabilities

The class implementing this did not actually work and was never tested.
Found this out while rebasing #2103.