Refinancing does come with trade-offs — for instance, you’ll have to pay fees and closing costs to refinance your mortgage. And if you’re planning to move in the future, you may end up losing money by refinancing.