The IRS charges a 20% penalty on any amount that you withdraw from your retirement account before you reach the age of 59½. This can be a significant amount of money, so it is important to think carefully before you decide to take money out of your account prematurely.