In 1917, Rubinstein married Eugénie Lew. They had two sons, Jonas in 1918 and Sammy in 1927. For a time, they lived above the restaurant that Eugénie operated. After she died in 1954, Rubinstein lived in an old-people's home until his death in 1961 at the age of 80. He reportedly still followed chess in his final years; his sons recalled going over the games of the 1954 Botvinnik–Smyslov world championship match with him.