You can! We think the flavor is best with brown sugar or a mix of brown sugar and white sugar.