It can be used for Classification problems. I can try to create a good example and extend the current functionality. Although the consensus as of now was to only implement it for regression problems as a start. @ogrisel @GaelVaroquaux Your opinions?