Sparse matrix multiplication: only convert array if needed

This closes https://github.com/scipy/scipy/issues/4203