Not if that is your only income. You only lose your social security benefits between ages 62 – 66 if you have “Earned income ” over certain limits (starts at $15,720/year). Your pension income is not considered earned income. Earned income would be from things like wages or self employment income.