While lavender adds a unique floral note, you can omit it if you don't have any or prefer a different flavor profile. The custards will still be delicious!