No, reboot of Windows 10 will not affect any DNS entry on the DNS cache saved in the system, and the entries saved with IPs need to be removed with manual command only using the Windows Command Prompt.