Patent ID: 8145651

Claim:
A method, comprising: receiving a developed application from a developer at an on-demand database service, the developed application including an updated version of an application; creating a data structure describing aspects of the developed application; identifying information associated with at least one other application of at least one subscriber with which the developed application is to operate, the at least one other application including an older version of the application from which the updated version of the application was developed; and determining whether the developed application and the at least one other application will properly operate together, utilizing the data structure and the information, by: identifying settings used in an application environment of the at least one subscriber including the at least one other application, using the information associated with the at least one other application; creating a temporary test environment having the identified settings; determining from the settings a version of the application to be tested; identifying a portion of the developed application including the version of the application to be tested, using the data structure; and testing the identified portion of the developed application in the temporary test environment.