Open Windows Widget using WIn + W, and then click on the three-dot menu on the weather widget. Change the location and update it. Once done, close the Widget, and the weather should automatically update on the Taskbar based on the new location.