If the carrots and very large and have been sitting in the produce section awhile, the skin is likely to be tough and dirty—so, yes, it's a good idea to peel them. However, if the carrots are small, young, and well-scrubbed, you can get away without peeling them.