their mother left them when carlyle was only four years