No, Windows 10 does not have any in-built CPU temp monitor. You can use other software like Speccy, OP Manager Monitoring tool, AIDA64 Extreme, etc.