Most coughs do not require immediate treatment, but you should take your baby to urgent care if they have a fever of 100.4 F and are less than three months old, or have a fever over 102.2 F for those over three months or have other concerning symptoms.