Due to poverty as a single parent, his mother eventually placed Sassoon and his younger brother in a Jewish orphanage, where they stayed for seven years, until he was 11, when his mother remarried.
Karena kemiskinan sebagai orang tua tunggal, ibunya akhirnya menempatkan Sassoon dan adik laki-lakinya di panti asuhan Yahudi, di mana mereka tinggal selama tujuh tahun, sampai umur 11 tahun, saat ibunya menikah lagi.