Stirring too much during cooling allows the sucrose molecules to form crystals (basically forming sugar crystals). Resist the urge to stir and simply transfer the fudge to your prepared pan, spread, and refrigerate to set.