No, you don't. You can use whole milk instead of buttermilk and use plain yogurt instead of sour cream or mayonnaise for the tang you get from the buttermilk.