Mills was born in Portsmouth, the grandson of Portsmouth's 1934 FA Cup goalkeeper, Jock Gilfillan. He attended Gosport County Grammar School and represented Hampshire Schools. He came to The Dell on a week's trial as a 15-year-old schoolboy and was promptly snapped up by manager Ted Bates, joining the Saints as a trainee in February 1969, signing as a professional in July 1971.