More convolution matrix optimizations