Spence was born in Kent, England to an Irish mother and an Australian-born father serving with the British Army. When her father finally left the service, Spence and her family (including her sister-in-law, casting director Kerry Spence) moved to Hong Kong when she was three and then to Australia when she was six. After leaving school, she was trained as a secretary and later traveled to Montreal where she was a hostess for the Australia Pavilion (Expo 67) at the Canadian Expo.