This is a personal preference. However I prefer not to leave the skin on for butternut squash soup, as the texture isn't very nice.