Sort of. If you open an interest-bearing account within a retirement account, you won't have to pay tax on it. But in general, savings account interest is always taxable at your ordinary income rate, and is reported to the IRS if you earn $10 or more during the year.