Born in Edmonton, London, Livermore was a trainee at Arsenal and went on to feature for Millwall, where he became club captain. With Millwall, he won the 2001 Division Two title. While at the club he also played in the 2004 FA Cup Final, but he conceded a penalty as they lost to Manchester United. He as well netted the 1000th goal of the Coca-Cola £1 million goal chase against Nottingham Forest. In 2006, LIvermore won Millwall's Player of the Year award.