For more than two decades , regardless of which political party was in power , Congress has been accused of raiding the Social Security trust funds to pay for other programs , masking the size of the budget deficit .