Yes you do as the outer layer of the stalk is quite woody and really not very nice if you were to consume it. You want to peel it to get to the soft, light green flesh underneath.