Consider energy efficiency, the type of heater, and potential long-term cost savings, especially with options like solar water heaters.