In 1935 he began a relationship with a woman named Elisabeth Schmitt, and later in the year married her and with her had his first child, Marie-Claire Schaeffer.
Sprva se je zdelo, da bo Pierre prav tako videl glasbo kot kariero, a so ga starši odvrnili od tega in se je zato izobraževal v inženirstvu.