Lavender-infused sugar made with dried and ground lavender buds is ready to use right away. If burying whole dried buds in a jar of sugar, it can take up to two weeks for the lavender flavor to be noticeable.