Yes, the startle reflex is a normal part of a baby's neurological development and is usually present from birth up to around 5 or 6 months.