When purchasing a space heater, look for safety features such as tip-over protection, overheat protection, and cool-touch exteriors. These features are designed to prevent accidents and ensure the safe operation of the heater.