Yes, it's safe to heat eggnog as long as you do so gently and avoid boiling it. Heat it on medium heat while whisking constantly until it reaches a temperature of 140-155°F (60-68°C).