Heat lamps can help baby goats regulate their body temperature, but they should only be used under supervision as they can create a real fire risk. Usually, the warmth it gets from its mother and towels will suffice. Using heat lamps is not necessary unless the temperature is below freezing.