Calhoun was born in Hollywood in 1924. She spent her childhood weekends with her family on Venice Beach and Santa Monica, practicing swimming and diving. Calhoun was a competitive swimmer, having trained for the 1940 Summer Olympics, before the event was cancelled due to World War II. She also worked as a stunt performer.