I let the fudge set in room temperature for an hour or so and then set it further for couple of hours in the refrigerator.