In the vast majority of cases, no. If the pension is from an employer that withheld FICA taxes from your paychecks, as almost all do, it won't affect your Social Security retirement benefits.