make sure we set temporary conf bans properly