Yes, both buttermilk and cream and be substituted for the whole milk. Each will result in a slightly different texture and flavor but they work well. I would not however recommend replacing whole milk with skim milk.