Patent Document ID: 9524522
Application ID: 13790854
Patent Flag: 1

Claim One:
1. A hybrid recommendation system comprising: a server including a hardware processor, a network interface to connect the hybrid recommendation system to web browsers and other external applications and systems, including an online testing system, via the Internet, and a non-transitory computer readable medium storing machine readable instructions executable by the processor; and a cluster of data store servers storing recommendation indices, wherein the cluster of data store servers are to perform map and reduce tasks in parallel to perform lookups on the recommendation indices; wherein the machine readable instructions comprise an offline testing module executed by the processor to perform an offline testing of recommendation functions based on a dataset and performance metrics, and to adjust the recommendation functions; wherein the machine readable instructions comprise an online testing module executed by the processor to receive, via the network interface, from the online testing system, online behavior of users captured during online testing of the recommendation functions; wherein the machine readable instructions comprise a recommendation engine executed by the processor to generate the recommendation indices from the recommendation functions determined based at least on the offline testing and store the recommendation indices in the data store servers, wherein the recommendation indices are identifiers of products to recommend; wherein the machine readable instructions comprise a selection module executed by the processor to receive dynamic data identifying current activity of a user, wherein the dynamic data identifying current activity of a user is sent to the data store servers, and at least one of the data store servers performs a lookup on the recommendation indices with the dynamic data identifying current activity of a user to determine candidate recommendations; and wherein the machine readable instructions comprise a filter module executed by the processor to receive the candidate recommendations determined from the lookup performed by at the least one of the data store servers and select recommendations from the candidate recommendations based on a filter or rule and present the recommendations to the user, and the processor delivers the recommendations to a web browser of the user via the network interface, wherein the performance metrics comprise recall and precision, wherein the recall performance metric is a ratio of a number of items placed in an online shopping cart that match the recommendations over a total number of items placed in the online shopping cart, and wherein the precision performance metric is a percentage of the recommendations that were purchased.