cant make the assumption the filter size is the same as the input wrt convolutional nets