While it is hard to exactly describe the flavor, caraway seeds do taste like licorice, with an aroma of citrus and pepper. They can be toasted, and the flavor will be a bit nuttier. That’s why they are traditionally used in bread and baked goods.