It takes about 35 minutes, or even up to 1 hour depending on how long the fudge mixture was cooked and the humidity in the room.  If they weren't made correctly, or if it's too humid in your kitchen, they may not set properly at all.  Make sure to use a candy thermometer!