Patent Document ID: 20140025610
Application ID: 14033690
Patent Status: 0

Claim One:
1. A system for benchmarking a progressive combinatorial solver in which a combinatorial problem is described by a problem scenario, the system comprising: a processor programmed to implement a benchmark control, combinatorial solver and parametric model generator, wherein the benchmark control is configured to initialize a parametric model collector; wherein the combinatorial solver module is configured to perform a plurality of parametric trials associated with respective numbers of sub-part iterations of the progressive combinatorial solver, the combinatorial solver module including a solver control, progressive combinatorial solver and statistical model generator, wherein for each of the plurality of parametric trials: the solver control is configured to initialize a statistical data collector; the progressive combinatorial solver is configured to perform a plurality of randomized executions with a respective number of sub-part iterations, including being configured to find respective solutions to the combinatorial problem, and add data including metric values for the respective solutions to the statistical data collector; and the statistical model generator is configured to determine one or more statistical parameters of data in the statistical data collector, and add data including an indication of the respective number of sub-part iterations, a cost of finding the metric values for the respective solutions, and the statistical parameters of the trial to the parametric data collector; and wherein the parametric model generator is configured to determine a best-fit model from data in the parametric data collector, the best-fit model relating metric value to cost for numbers of sub-part iterations of the progressive combinatorial solver.