You don't have to peel rhubarb before baking with it. However, if you notice a stringy texture and don't care for that, you can go the extra step to peel it.