if center or scale, force to dense matrix