Large crystals in fudge can give it a grainy flavor and texture. Stirring the fudge during the cooling process allows sucrose (sugar) crystals to stick to one another resulting in graininess. This is why you shouldn't stir or touch it between putting it in the baking dish and cutting it into squares. Just put it in the foil-lined dish and leave it alone!