Yes, you are supposed to peel a Kumquat. Kumquats are a type of citrus that is tart and acidic. They are typically eaten fresh or in a salad.