Budapest is known for its network of thermal springs under the ground. So all the thermal baths in the city are naturally heated, so even in winter, you'll find that the temperatures are comfortably warm.