Lilly Fenichel was born in Vienna, Austria, to a Jewish family. Her father was a doctor and her mother a fashion designer; the psychoanalyst Otto Fenichel was her uncle. In 1939, following the Nazi invasion of Austria, her family fled the country, going first to the United Kingdom and then to the United States, where they settled in Hollywood.