Coe is unconcerned by the prospect of a change in national government , with Prime Minister Gordon Brown and his Labour Party widely expected to be swept from power by David Cameron 's opposition Conservative Party in national elections to be held by June 2010 .