People who are the primary breadwinners in their households and make less than $18,800 per year (if they are under 65) or less than $20,500 per year (if they are 65 or older) do not have to pay the tax. Likewise, if you are unmarried, over 65, and make less than $14,250 in gross income, you are exempt from paying federal income taxes.