Brooks continued his ice hockey career with the University of Minnesota Gophers from 1955 to 1959. He was a member of the 1960 Olympic team, only to become the last cut the week before the Games started. Three weeks later, Brooks sat at home with his father and watched the team he almost made win gold in Squaw Valley. Afterwards, Brooks went up to the coach, Jack Riley, and said, "Well, you must have made the right decision—you won". This humbling moment served as further motivation for Brooks, an already self-driven person.