The more coconut cream the popsicles contain, the softer they'll be. So, for the softest and creamiest popsicles, use coconut cream. Light coconut milk and other plant milk will give you a slightly harder popsicle. They'll still be delicious, though.