It is best to refinance your loan in the early stages of your loan. The interest gradually declines over the lifetime of your loan, so your potential to save money is much higher at the start of your loan. Be mindful that you likely won't be able to refinance within the first six months.