If your chicken coop heater doesn't have any exposed heating elements, you can use a damp rag with vinegar and baking soda mix to clean it.