Yes you can, bring them along. They will be made welcome and no-one learns about God without being taught. Even if they don’t believe, they will be exposed to tools and support that they may want to call on later on in their life. Equip them with what God has provided.