Patent ID: 8850396

Claim:
A method comprising: enabling, by a processing device of a computer system, a first test execution script to execute, on a test execution platform of the computer system, a first group of first tests in view of a first set of hardware configuration settings, wherein each of the first tests comprise different software configurations tested on the same first set of hardware configuration settings during the runtime of the first test execution script, wherein the different software configurations comprise at least one of components of a product being tested, other software applications running on the computer system, virtual machine speed, number of virtual machines in iteration, or operating system for the first tests; receiving, in runtime, script representations of a second group of second tests generated, without user interaction, in view of one or more of first results of the first tests or historical statistics of previously-run tests that are relevant to the first tests, wherein the second group of second tests are tested on a second set of hardware configuration settings that is different from the first set of hardware configuration settings, wherein each of the second tests comprise different software configurations; generating, in runtime, a second test execution script from the received script representations; enabling, in runtime, the second test execution script to execute, on the test execution platform, the second group of second tests in view of the second set of hardware configuration settings, wherein the different software configurations of the second tests are tested on the same second set of hardware configuration settings during the runtime of the second test execution script.