If your baby's head circumference is much smaller than expected for their age, their doctor will let you know. A small head circumference can mean that your baby's brain isn't growing normally. If there's cause for concern, your pediatrician will likely refer you to a specialist.