You sure don't! Since we're blending it all up anyway (and since there's lots of good flavor and nutrients in the peels), keep it simple and leave the peels on.