Using full-fat milk or yogurt is what will keep your popsicles from freezing too hard.Â