When chestnuts have gone bad, they will have a dark brown or black coloration on the outside of the shell. The nuts will also be soft to the touch and may have a rancid smell. If you are unsure if your chestnuts are still good, it is best to err on the side of caution and throw them out.