If refinancing helps you accomplish your financial goals or saves you money over the long run, it can be a smart idea. Just make sure that any fees you pay are justified by the benefits of refinancing.