Use the list of actually seen addresses to determine the subnet