It depends on what testing software you choose, and most often — yes, you’ll be gathering stats from your live app that customers download from the App Store.