Factoring out the MNIST SVM classifier