I'm still not convinced this is the way to go since 
`mean_absolute_error(y_true, y_pred, average="micro") == mean_absolute_error(y_true, y_pred, average="macro") == 
mean_absolute_error(y_true, y_pred, average="samples")`. What is your opionion @mblondel ?