A parent or guardian can start a savings account for a newborn right up to a child aged 12 to 14 years old. This depends on a bank’s age requirements, which tend to vary. The child must also have an Australian residential address for tax purposes.