No one went because no one had a true connection to the man. The only people around him were those who were using him for his wealth. Once he died, he had no value to them.