A newborn having a high fever can signify a serious infection. If your baby has symptoms like vomiting and fever for more than 3 days, it's time to take him to the hospital. If he doesn't show serious symptoms, the fever will disappear on its own. Always call your doctor for advice!