Handle the excluded IPs from config