Ran some profiling on multi class DPM classification with multinomial logistic regression, convolution does indeed account for roughly 70% of the training time. Really need some GPU help here...