Closing incoming connections earlier when client isn't whitelisted