Koi fish that grow in the wild have a bit of a muddy taste, just like goldfish or catfish and other bottom feeders. This is due to the conditions that these fish are grown in — usually cold, stagnant water.