Predominately a left back throughout his career, Xu mainly played for Nanjing Army Football Team and Bayi Football Team. The Chinese Cultural Revolution saw his career severely shortened, but when it ended he was able to resume his career and help win the league title for Bayi in 1974. He was even able to play for the Chinese football team in its successful qualification for the 1976 AFC Asian Cup.