Patent ID: 8001422

Claim:
A computer-implemented method of testing a service, comprising: under the control of one or more computer systems configured with executable instructions, receiving a production request to a production service and generating a production response; transmitting information in the production request and the production response from the production service to a shadow service; forwarding information in the production request from the shadow service to a test service as a test request; receiving a test response from the test service to the shadow service in response to the test request; performing a two-way comparison of the production response and test response using a comparison engine able to distinguish between significant and insignificant differences so as to determine any differences between the production response and test response by determining values in the production response that are missing in the test response and values in the test response that are missing in the production response, and detecting differences between matching values in the production response and the test response; determining whether any determined differences constitute significant differences between the production response and test response; and generating statistics for the significant differences, wherein the statistics are collected for multiple production requests, and wherein the collected statistics are indicative of potential errors in the production or test service.