ENH: remove unnecessary copy of convolve inputs