In the refrigerator, pumpkin fudge will take about 3 hours to set firm.