My reasoning here was that if the classifier fails on some specific folds but not others then this is due to data and should probably result in a ValueError. It seems that it is generally recommended to only catch a subset of exceptions rather than all of them. But perhaps assuming that it will be a ValueError is going too far.