Patent ID: 10540378

Abstract:
Approaches provide for analyzing image data to determine and/or recognize text in the image data. The recognized text can be used to generate a search query that can be automatically submitted to a search engine without having to type the search query to identify a product (or related products) associated with the image. For example, a camera of a computing device can be used to capture a live camera view (or single images) an item. An application executing on the computing device (or at least in communication with the computing device) can analyze the image data of the live camera view to determine a set of keywords (e.g., identified text) based on visual features extracted from the image data. The keywords can be used to query an index of product titles, common search queries, among other indexed data to return a ranked list of search suggestions based on a relevance function. The relevance function can consider the ordering of the keywords to rank search suggestions more highly that contain the keywords having the same word order. Further, the relevance function can consider the confidence of the visual recognition of each keyword, the confidence of each search suggestion, customer impact, as well as other factors to determine the ranking of the search suggestions. The search suggestions can be further refined to ensure search results that the user will be more likely to view and/or purchase.