Unfortunately, there isn’t a “golden age” where you stop paying taxes on your Social Security benefit. Instead, your tax liability is based on your total income. If you earn income that supplements your Social Security, there’s a good chance that you’ll have to pay taxes on both your income and your Social Security distributions!