Yes. Deferring your payments does not cancel them out or make your unpaid mortgage balance disappear. When your deferral period ends, you must repay any principal, interest, and fees that you accumulated during that time. If you still can’t afford your payments by that point, inform your lender immediately to work out a solution.