If you decide to break your mortgage contract before the term is up, it often comes with a penalty. Ultimately, the amount you pay depends on your agreement and the terms of the lender. For example, the fee could be a percentage of the remaining balance, a fixed amount, or based on a sliding scale. Every case is different, so contact your lender and ask for help when you need it.