Sure, you can! But it is generally quite sour and sometimes bitter, but the light tartness of rhubarb is perfect for baking and balancing the sweet flavors.