A tankless water heater is small because it does not require a large tank to store water. The unit requires a heating element. The element can flash heat enough water for your entire house regardless of how much you use in a sitting. You could run your appliances, wash the dishes, and shower simultaneously and still have plenty of hot water.