Vaughan married alpine ski racer Lucile Wheeler (b.1935) of Quebec in 1960. She was a double world champion in downhill and giant slalom in 1958 and won the Lou Marsh Trophy. Wheeler also won a bronze medal in downhill at the 1956 Winter Olympics and is a member of the Canadian Sports Hall of Fame. For a time they lived in Ottawa, where he played football through 1964, but in 1967 moved to the village of Knowlton in Quebec's Eastern Townships. Vaughan's son Jake was born in 1963 in Ottawa and went on to play in the CFL with the Toronto Argonauts from 1987 to 1988.