Yes, baby Tylenol can be used to help ease teething pain or if your child becomes sick or develops a slight fever. Baby Tylenol can be administered every 4 to 6 hours as needed, but no more than 5 doses in a 24-hr period.