The IRS will charge you a 6% penalty tax on the excess amount for each year in which you don't take action to correct the error. For example, if you contributed $1,000 more than you were allowed, you'd owe $60 each year until you correct the mistake.