It will only take about 15 seconds for a tankless water heater to heat up water. However, it is important to note that you will still need to wait a little bit for your plumbing to deliver that hot water to wherever it is going to be used.