No you don't need to peel kumquats, you can just bite into the fruit as they are. The skin is soft and mildly acidic.