But I don't agree that the current implementation should be the default. I find it much more intuitive and natural to average each output / task 's score. I would vote for changing the default behavior and updating the unit tests.