Taking on new debt usually causes a slight drop in your credit score. However, if you replace an existing loan with one of roughly the same size, the impact on your credit score should be minimal.
In fact, if you refinance to increase your disposable income, you are more likely to be able to meet your monthly repayment requirements on all of your financial obligations, which will benefit your credit report in the long run.