Remove player bars when they leave party