In 1953, the Welsh international signed with Bob Brocklebank's Birmingham City. The "Blues" finished seventh in the Second Division in 1953–54, before winning the Second Division title in an extremely tight 1954–55 campaign under Arthur Turner's stewardship, finishing above third place Rotherham United on goal average. Kinsey scored 17 goals in 40 games of the club's historic 1955–56 campaign, including a hat-trick against Everton on Boxing Day at St Andrew's. They went on to finish sixth in the First Division, the best finish in the club's history, and also reached the 1956 FA Cup Final at Wembley. He scored a 15th-minute equaliser but Manchester City went on to win 3–1 despite goalkeeper Bert Trautmann suffering a serious neck injury, leaving Kinsey with a runners-up medal. Birmingham finished 12th in 1956–57 and 13th in 1957–58. Kinsey scored a total of 55 goals in 173 league and cup competitions for Birmingham City.