Fix issue not unhosting and removing startup listener when starting without announcing own join