Fowler's first international competition was the 1964 Tokyo Games, where he won three gold medals in swimming in the Men's 25 m Breaststroke complete class 1, Men's 25 m Freestyle Prone complete class 1, and Men's 25 m Freestyle Supine complete class 1 events, and two silver medals in archery in the Men's St. Nicholas Round open and Men's St. Nicholas Round Team open events. In archery, he also won a silver medal in the Men's FITA Round open event and a bronze medal in the Men's FITA Round Team open event at the 1972 Heidelberg Games, and participated but did not win any medals in both archery and dartchery at the 1968 Tel Aviv and 1976 Toronto games. His favourite sport was archery, and he reached the top 20 in the world in able-bodied archery competition.