Sticking with your current mortgage company might spare you the trouble of filling out new forms and sending in your documents all over again. However, your primary concern should be finding the best mortgage refinance rates and lowest fees, which your lender might not have.