Just drop the classifier entirely