Taking out any new loan has a temporary negative impact on your credit score, but as long as you continue to make your loan repayments properly, this effect will be temporary and your credit score will rebound. Refinancing will only have a long term negative effect if you fail to meet your new loan’s obligations.