The safest way to warm up baby oil is to simply place some in your palms and rub your hands together. This ensures the oil won't get too hot or have hot spots hidden in it. After rubbing your hands together, you can place them directly on your baby's skin and massage if you wish.