Refinancing will hurt your credit score a bit initially, but might actually help in the long run. Refinancing can significantly lower your debt amount and/or your monthly payment, and lenders like to see both of those. Your score will typically dip a few points, but it can bounce back within a few months.