Remove membership channel from map on quit