Brokerage accounts (also called non-qualified accounts) are taxed differently than qualified retirement plans like a 401(k) or a 403(b). Even without taking money from the account, your brokerage account will be subject to tax each year.