With interest rates currently in the 5-6% range, the interest difference between each 50 basis point on a 25-year $100,000 mortgage is approximately $3,000. Depending on your mortgage balance and the penalty you must pay, it may make sense if there is overall cost savings.