The answer is either way! It comes down to personal preference. Jess likes the skins left on because of the texture and flavor they add to the dish. However, it is still super yummy to peel them first before boiling.