When joining more than once, remove old queuing entry