He married Lucienne Boyer in 1939 and they were divorced in 1951. On 20 September 1952, he married singer Édith Piaf. However, in 1957, this marriage also ended in divorce. He was the father of Jacqueline Boyer, who won the 1960 Eurovision contest the year after her father's participation. Upon his death, he became the first Eurovision contestant to die.