Just like other foods, unfortunately, fudge also goes bad. The general signs are pretty easy to spot, such as textural change (drying out, crumbly, oily, or soggy), off-smell, or rancid smell. Do not consume fudge if you find any of these symptoms.