No! You don't have too. It just gives the cake more flavor and makes it look nice.