Kingsford was born in Sydenham and was educated at Marlborough College, where he played football for the college. After leaving college, he played for the Old Marlburians and the Wanderers, winning the FA Cup with the Wanderers in 1873. In the final, played at Lillie Bridge on 29 March 1873, the Wanderers defeated Oxford University 2–0.