Sparse matrix multiplication: only convert array if needed (with proper fix branch)

This overrides https://github.com/scipy/scipy/pull/4235 according to this comment: https://github.com/scipy/scipy/pull/4235#issuecomment-66931766