This depends on your model of hot water heater. An electric hot water heater will stop working during a power outage. However, a gas water heater (if it has a continuous pilot light) may keep working during a power outage.