I've pushed one attempt at this. It still has global `SCORERS` and `SCORER_DEPRECATION`, but I don't think a more encapsulated approach (using closures or a singleton class to define `get_scorer`) is in keeping with scikit-learn style.