Rye: Rye has a spicier taste. Many feel that it has notes of grass and pepper, as well as oak, smoke, and fruit. Bourbon: Most will agree that bourbon has a sweeter taste than rye with notes of vanilla, caramel, and oak. Bourbon has an overall lighter and smoother taste than rye.