This can happen if the condensed milk wasn't heated up enough. The melted fudge mixture should be tacky and sticky before it sets.