Typically, an electric garage heater is cheaper to purchase and install, but a natural gas heater is cheaper to operate.