Yes, leaving vanilla extract or vanilla bean out of a recipe such as cakes, frosting, custard, and ice cream will make a big difference. However, if you are using it in recipes with other pronounced flavors such as chocolate bakes or cookies with additional choc chips it won’t make as big of a difference.