Technically, yes - they're not poisonous or anything. But they do take on an unpleasant muddy texture and color when cooked. It's best to scrape them out.