There are several things you can do to keep your baby occupied during church. If you can, choose a church ceremony that is around your baby's naptime. If you're lucky, you can enjoy a sleeping baby at church. More realistically, though, if your baby is awake, you can occupy them with snacks or soft, quiet toys.