They all have their own story, their own goals and motivations, their own reasons to join you...or to leave you. They do NOT need to be in your party for this to happen as companions are living people that don't stop existing just because you leave them home.