Wood stoves are generally the most affordable option, especially if you have access to inexpensive or free firewood. Costs can vary based on your location and the availability of materials.