At the FIS Alpine World Ski Championships 1958 in Austria, Zimmermann met American skier Penny Pitou. They married in 1961 and had two children, living in New Hampshire, U.S. After a divorce in 1968 Zimmerman returned to Austria.