Of course, you are allowed to do such though there are some consequences to that based on tax. You are allowed to take out money at any moment from the HSA. There is no tax on every withdrawal you make for eligible medical expenditure but when it is used for a different purpose, then there would be a revenue tax attached to it.However, this does not apply to all age grades as people who are below 65 years have an extra 20% tax charged when they make such withdrawals.