The parent should know what is best for the child, though he may not like it. It is commonly objected that by keeping the children in the service, they learn to hate the worship service. We reply by asking if you think you can teach your child to love the service by keeping them out. You cannot teach your children to appreciate the worship of God without disciplining them to witness and participate in it anymore than you can teach them to like spinach by giving them ice cream. There is a better way to teach.
Appreciation comes by degrees.
It takes time, patience, and skill. And because of that, many people opt for whatever method seems easy. But the work that is used in teaching little children to love the ordinances of Christ is well worth the effort. Even if it means that the parent misses most of the sermon himself, he can hardly have spent his time better if he makes his children sit quietly and listen. In the long run, he and those around him will hear more sermons.