Yes!, as the person responsible for the baby’s account, you can withdraw from your child’s savings account. However, if there is any limit to withdrawal set initially at the account opening, then you will have to adhere to it. Moreso, the money should be used for the baby’s/child’s benefit.