No you don't unless it's dirty from harvesting or something (I don't usually). Totally up to you!