There is a penalty when using an HSA to pay for things that are not qualifying medical expenses. First, you have to pay taxes on that money as it now counts as income. Next, if you are younger than 65, you are charged another 20% penalty on the funds. To avoid this, do not withdraw HSA funds for non-medical expenses.