In his autobiography Olivier later wrote that he was smitten with Esmond, and that her cool indifference to him did nothing but further his ardour.
Ko je leta 1922 nenadoma umrl njen oče, se je Esmondova vrnila v šolo in celo premišljevala o prenehanju igralske kariere.