As much as you see fit, you can check your baby's temperature. Every 3 to 4 hours is a proper frequency when they are sick. The most important thing to watch out for is their behavior and other signs of serious illness.