If you find that your homemade frozen yogurt is icy after you pull it out of the freezer, it’s because you didn’t store it in an airtight container. Make sure to freeze your frozen yogurt in an airtight container with a tight-fitting lid or ice crystals will form over top.