Be careful not to confuse the cream of coconut with coconut milk. These are two different things. Cream of coconut is very sweet and typically used for making cocktails. Coconut milk is unsweetened and typically used in cooking and baking. These are both found in the baking aisle or Asian food section of your local grocery store.