If you are working in a foreign country that the United States has entered into a Bilateral social security agreement (sometimes referred to as a Totalization Agreement) and the agreement has provision for your foreign employment to be subject to US social security, then yes you will have to pay.