If you need to withdraw the money from your HSA for non-medical expenses before age 65, you can do so. However, you can expect to fork over a lot of your proceeds right away. Specifically, you’ll have to pay a 20% penalty for withdrawing funds early and income taxes on the amounts you withdraw.