Yes, to sync settings across multiple devices on Windows, the devices need to have internet connectivity, at least during setting up. The data required for the sync is minimal, and the process hardly takes any time.