Your credit score will drop immediately if you refinance, but it could be good for you in the long run. Lenders want a significant drop in the total debt owed and a reduction in the monthly payment amount.