The amount of time the water will stay hot in the heater without power depends on how big your tank is. This question is invalid with tankless water heaters as they have no storage space. But with tank water heaters, the water stays warm for up to a day or two. Of course, other factors such as the location of the heater and the insulation also affect the time that the water can stay warm.