On 27 June 2016, following the mass resignations from the Labour Shadow Cabinet after the British electorate narrowly voted in favour of leaving the European Union in the EU membership referendum, Smith announced he was stepping down as the Shadow Secretary of State for Work and Pensions. He resigned over concerns about the leadership of Jeremy Corbyn, saying "It breaks my heart to say I cannot see how he can continue as leader."