Patent ID: 9679308
Date: 2017-06-13
CPC Classifications: G06Q,H04L

Claim:
1. A method for measuring brand uplift comprising: receiving, by the data processing system including one or more processors, a plurality of requests for content from a plurality of computing devices associated with device identifiers; identifying, for each of the plurality of requests for content, a third-party content item of a first set of content items suitable for display with the content associated with the request, each of the first set of content items identifying a first brand; determining that the first brand promoted by the identified third-party content item is participating in a brand uplift experiment; determining, by the data processing system, responsive to receiving the requests for content, to display third-party content items of the first set of content items to a first subset of the plurality of computing devices, the first subset of the plurality of computing devices associated with a first subset of the device identifiers; providing, for display, the third-party content items of the first set of content items at the first subset of the plurality of computing devices responsive to determining to display the third-party content items of the first set of content items to the first subset of the plurality of computing devices; determining to not display the first set of content items to a remaining subset of the plurality of computing devices that are associated with a remaining subset of the device identifiers; selecting, for the remaining subset of the plurality of computing devices, third-party content items of a second set of content items, none of the second set of content items identifying the first brand; identifying, from a search query log including search queries associated with the device identifiers corresponding to the plurality of computing devices, a portion of the first subset of device identifiers that performed a search using a search query that included a keyword from a predetermined set of brand keywords associated with the first brand; determining a first brand awareness metric value based on a ratio of the portion of the first subset of device identifiers to the first subset of device identifiers; identifying, from the search query log, a portion of the second subset of device identifiers that performed a search using a search query that included a keyword from the predetermined set of brand keywords associated with the first brand; determining a second brand awareness metric value based on a ratio of the portion of the second subset of device identifiers to the second subset of device identifiers; computing a brand uplift metric value indicating an uplift in brand awareness of the brand identified by the first set of content items based on the first brand awareness metric value and the second brand awareness metric value; and displaying, to a content provider of the first set of content items, the brand uplift metric value.