Portable heaters can save you money only if used to heat small areas for short periods of time. Leave shades and draperies open on sunny days and allow the sun to help heat your rooms but remember to close them at night. Close the fireplace damper when the fireplace is not in use. Light a candle in the fireplace to keep the draft from entering your home. The rising heat from the candle will not be strong enough to carry the heat out but will keep the cold from sinking.
Ceiling fans work well in the winter as well as the summer.
In winter, reverse the direction of the blades if you can to push warmer air on the ceiling down. If you have window air conditioning units, remove them in the winter to prevent heat loss through the units. If you can't remove the units, buy a cover. Make sure doors and vents are closed off.