Patent ID: 8832096

Claim:
A method performed by data processing apparatus, the method comprising: receiving, by a data processing apparatus, image search data for different search sessions, a search session being a pre-specified period, the image search data for a search session including: search query data specifying text search queries that were received during the search session; responsive image data specifying images that were identified in response to the text search queries; and interaction data specifying images referenced by search results with which a user interacted; identifying, based on the image search data, two or more images that were selected by a user during a search session as co-selected images for the search session; determining that a pair of images from the two or more images are co-selected images for a particular text query based on a co-selection rate for the pair of images meeting a co-selection threshold, wherein the co-selection rate is based on a number of times that different users interacted with the pair of images during a search session; determining, based in part on the co-selected images for the particular text query, a query-dependent image profile for the particular text query, the query-dependent image profile specifying an importance of one or more visual characteristics of images for identifying images responsive to the particular text query; receiving, from a user device, the particular text search query; identifying one or more images responsive to the particular text query based on visual characteristics of the one or more images and the query-dependent image profile for the particular text query; and providing, to the user device, data specifying the one or more images that were identified as responsive to the particular text query based on the query-dependent image profile.