Generally, your Social Security benefits are taxable to the extent that they exceed one half your benefits plus your includable income over a base amount. The base amount for married couples for 2016 is $32,000. IRS publication 915 contains a worksheet that can be used to determine the amount.