When your friend leaves or you simply want to resume multiplayer on your own, press the Xbox button in the middle of the second controller, and sign out of the Xbox profile associated with it.