There could be a few reasons. Overcooking the chocolate and milk mixture can affect its setting capability. Also, ensure it's chilled for the recommended time or longer. If your fridge's temperature is too low, it might take longer to set.