Besides the milk fat in heavy cream, whole milk also contains proteins — such as whey and casein — and lactose. The latter is sugar that (upon consumption) raises your blood sugar levels and can kick you out of ketosis. While the milk proteins don't impact nutritional ketosis, one of them (casein Beta-A1) is highly inflammatory.