Taking up a new loan can cause your credit score to dip, but because refinancing replaces an existing loan with another of roughly the same amount, its impact on your credit score is minimal.