Born in Astypalaia, Kapsis' family moved to Keratsini when he was young. Kapsis played for the Panathinaikos F.C. from 1969 until 1984 and was a member of that team when it played in Wembley Stadium, located in London, England, in the 1971 European Cup Final.