I wouldn't advice it. For one, yogurt makes these coconut chocolate popsicles more creamy. Secondly, if you use milk - being it more "watery" - the coconut flour would end up sinking at the bottom of your molds.