When overused, lavender can potentially add a bitter, soap-like taste to foods. The reason for the comparison may be that lavender has a floral scent, just like many soaps. That’s why it's always best to use it in small doses, so it only adds a subtle flavor.