All five resided together in the family home.
Po očetovi hospitalizaciji so Howarda vzgajali njegova mati, teti (Lillian Delora Phillips in Annie Emeline Phillips) in dedek Whipple Van Buren Phillips, ameriški poslovnež.