This happens when the sugar is not cooked enough. Make sure to boil this fudge to 230 degrees F. and stir continuously.