Patent ID: 8892953

Claim:
A method for testing software using test suites, the method comprising: defining a plurality of testing goals and a testing strategy for the software; determining a plurality of objects under test within said software; designing a plurality of test eases, and a plurality of test suites for said defined testing strategy; defining a plurality of test categories for said designed plurality of test suites; generating a test automation framework for executing said designed plurality of test suites defining: a test execution sequence for said designed plurality of test suites, and said defined plurality of test categories; and for each of said plurality of test suites, test continuation rules defining whether the test execution sequence, upon an occurrence of at least one of an error in a test object and a fail event in the test system during execution of that test suite, shall (a) terminate execution of the remaining test sequence for the remainder of that test suite and any remaining test suites to be executed, (b) terminate execution of the remainder of that test suite but continue with execution of the next test suite in the test execution sequence, or (c) continue execution of that test suite despite the error or fail event: wherein different test continuation rules are defined for at least two of the test suites in the plurality of test suites in the test automation framework; running the test automation framework on said software under test, and analyzing the results obtained from running the test automation framework on said software.