Loads bans earlier, so the server cfg bans are applied.