Patent Document ID: 8751477
Application ID: 13645809

Base Claim:
1. A host computer system for providing results in response to queries, comprising: at least a first engine; a quality control system, including: a challenge keyword transmission module transmitting the challenge keyword to a remote search engine computer system; and a reference result receiving module receiving at least one reference result from the search engine computer system in response to the transmission of the challenge keyword to the remote search engine computer system; a reference score calculation module calculating a reference score, wherein the reference score is calculated based on the reference search result; a challenge keyword submission module entering a challenge keyword into at least a first engine; a challenge result receiving module receiving at least one challenge result from the first engine in response to the challenge keyword; a challenge answer score calculation module calculating a challenge answer score based on the challenge result; a challenge answer-to-reference score calculation module calculating a challenge reference score for the first engine based on a comparison of the challenge answer score for the first engine with the reference score; and an engine relevance score publishing module publishing an engine relevance score based on the challenge reference score for the first engine; and a live system including: a live query receiving module receiving a live query having a user keyword over a network from at least one live remote computer system; a user keyword submission module entering the user keyword into the first engine; a live result receiving module receiving at least one live result from the first engine based on the user keyword; and a live result transmission module transmitting the live result from the first engine over the network to the at least one live remote computer system.

---

Claim 8:
8. The host computer system of claim 1 , wherein: the challenge keyword submission module enters the challenge keyword into at least a second engine; a challenge result receiving module receives at least one challenge result from the second engine in response to the challenge keyword; the challenge answer score calculation module calculates a challenge answer score based on the challenge result received from the second engine; calculating a challenge reference score for the second engine based on a comparison of the challenge answer score received from the second engine with the challenge reference score; the challenge reference score publishing module publishes the challenge reference score for the second engine; the user keyword submission module enters the user keyword into the second engine; the live result receiving module receives at least on live result from the second engine based on the user keyword; and the live result transmission module transmits the live result received from the second engine over the network to the at least one live remote computer system.