Sure, we may need to remove our children from the service for a time, rather than allow them to disrupt the worship of others. But only for a time, and always with the goal of helping them become worshipers of the living God. These are places where our little ones go until they are ready to sit with us. But at the same time, they remind us of God's promise to be God to us for generations to come. Baptism, we are told, distinguishes our children from the children of non-Christians.
Baptism includes our children in the covenant, the visible expression of which is our worship.
They should never know a moment in their lives when they were not made to feel that church and the promises of Christ belong to them as much as to their parents. From the creed to the Lord's prayer . We catechize them and we teach them to worship. This is our duty as parents. This is our responsibility as a church.