Patent ID: 8661412

Claim:
A method comprising: identifying, via a testing system that includes a processor, an application for which approval is requested; testing the application by applying multiple automated tests to the application in groups of automated tests, each of the groups of automated tests including multiple ones of the multiple automated tests; identifying, prior to completing all of the multiple automated tests and for one or more of the multiple automated tests that returns an inconclusive result, that a manual check is to be performed for the application based on the one or more automated tests, the inconclusive result indicating that the one or more automated tests cannot determine whether the application is to receive a fail result or a pass result; for each of the groups of automated tests causing, after applying the automated tests in the group, an indication that the application is rejected to be returned if one or more of the automated tests in the group returns a fail result, the indication that the application is rejected including an identification of why the application is rejected; identifying, if none of the multiple automated tests returns a fail result, that a manual testing phase is to be performed; and causing, after the manual testing phase, an indication that the application is approved to be returned if none of multiple manual tests in the manual testing phase returns a fail result.