Yes! Rosemary is an aromatic herb and has a peppery and lemony flavor. Start with small amounts, as a little goes a long way when adding it to mashed potatoes.