Source: https://patents.google.com/patent/US10191991B2/en
Timestamp: 2019-04-24 12:59:39+00:00

Document:
A method and system for detecting a search intent of a user. The method includes tokenizing the search query into at least one tokenized query; sending, to a plurality of engines, the at least one tokenized query, wherein each engine is configured with at least one entity, wherein each entity represents a topic of interest; receiving, from each engine, the at least one entity of the engine and at least one certainty score, wherein each certainty score indicates a probability that a tokenized query of the at least one tokenized query is mapped to the at least one entity of the engine; and determining, based on the received entities and certainty scores, the search intent of the user.
This application is a continuation of U.S. patent application Ser. No. 14/103,536 filed on Dec. 11, 2013, now allowed, which claims the benefit of U.S. provisional application No. 61/822,376 filed on May 12, 2013. The Ser. No. 14/103,536 application is a continuation-in-part of U.S. patent application Ser. No. 13/712,563 filed on Dec. 12, 2012, now U.S. Pat. No. 9,141,702. The Ser. No. 13/712,563 application claims the benefit of U.S. provisional patent application No. 61/653,562 filed on May 31, 2012, and is a continuation-in-part application of U.S. patent application Ser. No. 13/156,999 filed on Jun. 9, 2011, now U.S. Pat. No. 9,323,844. The Ser. No. 13/156,999 application claims the benefit of U.S. provisional patent application No. 61/468,095 filed on Mar. 28, 2011, and of U.S. provisional application No. 61/354,022 filed on Jun. 11, 2010. The Ser. No. 13/712,563 application is also a continuation-in-part application of U.S. patent application Ser. No. 13/296,619 filed on Nov. 15, 2011, now pending.
The contents of the above-referenced applications are incorporated herein by reference.
The disclosure generally relates to search engines for providing one or more search results respective of a query received from a user, and more specifically to a system and methods for detecting user intent with respect to a query.
Search engines are used to search for information over the World Wide Web. A web search query refers to a query that a user enters into a web search engine in order to receive search results.
A query received from a user device may be explicit or implicit in different levels. An implicit query makes it complicated to provide appropriate search results to the user because the user intent behind such queries is unclear. As an example, if the input query is “Madonna clips” it is unclear whether the user is interested in listening to the entertainer Madonna's music clips, viewing Madonna's video clips, or downloading Madonna's music or video clips to the user's device.
It would therefore be advantageous to provide a solution that overcomes the limitations of the prior art.
Certain embodiments disclosed herein include a method for detecting a search intent of a user. The method comprises tokenizing the search query into at least one tokenized query; sending, to a plurality of engines, the at least one tokenized query, wherein each engine is configured with at least one entity, wherein each entity represents a topic of interest; receiving, from each engine, the at least one entity of the engine and at least one certainty score, wherein each certainty score indicates a probability that a tokenized query of the at least one tokenized query is mapped to the at least one entity of the engine; and determining, based on the received entities and certainty scores, the search intent of the user.
Certain embodiments disclosed herein also include a non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to perform a process, the process comprising: tokenizing the search query into at least one tokenized query; sending, to a plurality of engines, the at least one tokenized query, wherein each engine is configured with at least one entity, wherein each entity represents a topic of interest; receiving, from each engine, the at least one entity of the engine and at least one certainty score, wherein each certainty score indicates a probability that a tokenized query of the at least one tokenized query is mapped to the at least one entity of the engine; and determining, based on the received entities and certainty scores, the search intent of the user.
Certain exemplary embodiments also include an intent detector for detecting a search intent of a user. The intent detector comprises a network interface, wherein the network interface is configured to at least receive the search query; a processing circuitry; and a memory connected to the processing circuitry and configured to contain a plurality of instructions that, when executed by the processing circuitry, configure the intent detector to: tokenize the search query into at least one tokenized query; send, to a plurality of engines, the at least one tokenized query, wherein each engine is configured with at least one entity, wherein each entity represents a topic of interest; receive, from each engine, the at least one entity of the engine and at least one certainty score, wherein each certainty score indicates a probability that a tokenized query of the at least one tokenized query is mapped to the at least one entity of the engine; and determine, based on the received entities and certainty scores, the search intent of the user.
The subject matter that is disclosed herein is particularly pointed out and distinctly claimed in the claims at the conclusion of the specification. The foregoing and other objects, features and advantages of the disclosed embodiments will be apparent from the following detailed description taken in conjunction with the accompanying drawings.
FIG. 3 is a flowchart describing the operation of detecting a search intent of a user according to an embodiment.
The embodiments disclosed herein are only examples of the many possible advantageous uses and implementations of the innovative teachings presented herein. In general, statements made in the specification of the present application do not necessarily limit any of the various claimed embodiments. Moreover, some statements may apply to some inventive features but not to others. In general, unless otherwise indicated, singular elements may be in plural and vice versa with no loss of generality. In the drawings, like numerals refer to like parts through several views.
According to exemplary embodiments disclosed herein, a system and method for detecting the search intent of users based on queries entered by the users are provided. An input query is received from a user device. The input query is tokenized into at least one tokenized query that is then processed by a plurality of engines. Each engine of the plurality of engines computes the probability that a tokenized query is mapped to an entity. An entity defines a topic of interest. Each of the plurality of engines provides an entity together with a certainty score. The intent is then determined based on the certainty score received from each of the plurality of engines.
FIG. 1 depicts an exemplary and non-limiting schematic diagram of a system 100 utilized for describing certain embodiments disclosed herein. A user device 110 is connected to a network 120. The network 120 may be, but is not limited to, a local area network (LAN), a wide area network (WAN), a metro area network (MAN), the world wide web (WWW), the Internet, a wired network, a wireless network, etc., as well as any combination thereof.
The user device 110 is configured to submit queries to a search server 130 which is also connected to the network 120. The search server 130 is configured to send and receive queries to and from an intent detection unit (IDU) 140. The IDU 140 is configured to determine the search intent of a user of the user device 110 respective of an input query or part of the input query.
The search intent represents the type of content, the content, and/or actions that may be of interest to the user during a current time period. For example, the search intent may represent the user's desire to view a clip, download the clip, or listen to the clip. Further, the search intent provides which song or performer the intent is directed to. In an embodiment, the IDU 140 is further configured to send the determined search intent to the search server 130. In one embodiment, the IDU 140 may be integrated in the search server 130 or communicatively connected to the server 130.
With this aim, according to one embodiment, the IDU 140 tokenizes a received query and analyzes the tokens via use of a plurality of engines. Each engine is configured to handle a certain topic of interest so that each engine of the plurality of engines handles different one or more topics. Upon determination of the search intent, the search server 130 can provide one or more search results respective of the query and the user intent. To this end, the search server 130 uses the search intent to query one or more resources from a plurality of resources that are the most appropriate to fulfill the search intent of the user. The resources may include, but are not limited to, a plurality of web search engines, servers of content providers, vertical comparison engines, servers of content publishers, native content installed on the user device, and so on. The query provided by the search server 130 is generated, in part, respective of the determined intent, or variations thereof, to a resource in a communication format that is proper for that specific resource, thereby enabling search of such resources that require a customized interface to perform any kind of successful processing.
The system 100 may further include a database 150 for storing information such as prior user intents, prior queries received from users, semantic and statistic data for enhancing the search experience, and so on. The system 100 may further include an agent 115 installed locally on the user device 110. The agent 115 is configured to facilitate the communication with the search server 130. In an embodiment, the agent 115 is realized as an application (mobile app), where instructions of such an application are saved in a memory and executed by a processor of the user device 110. It should be noted that the one user device 110 is illustrated in FIG. 1 only for the sake of simplicity and without limitation on the generality of the disclosed embodiments.
FIG. 2 depicts an exemplary and non-limiting schematic diagram 200 of the IDU 140 according to an embodiment. The IDU 140 includes a network interface 142, a tokenizer 144, a plurality of engines 146-1 through 146-N, an analyzer 148, and a memory 149. The network interface 142 provides connectivity to the network 120 and is configured to receive queries from the search server 130 or directly from a user device 110. The network interface 142 may further be used to communicate with the database 150 to retrieve information therefrom. The elements of the IDU 140 are communicatively coupled using a communication bus 143.
The tokenizer 144 is configured to tokenize an input query to units of information (tokens). The tokenizer 144 arranges the tokens in tokenized paths to enable efficient processing by the engine 146. Each token may be, but is not limited to, a word or a series of words, or a number or a series of numbers. According to one embodiment, the tokenizer 144 may also include a filtering unit (not shown) for filtering the input query. The input queries can be classified into three different types of queries: definitive, fuzzy, and noisy. A definitive query is short and mapped to known entities or keywords. A fuzzy query contains a combination of known entities and keywords that are not correlated to the known entities. Noisy queries cannot be mapped to known entities, or are long and complex. According to the disclosed embodiments, an entity is an “object” in the world that can be defined with known types and attributes. Entities may be, for example, products, people, locations, companies, music bands, popular keywords, applications, zip codes, and query components. Each entity can be associated with one or more classifications describing its essence. For example, an entity ‘Madonna’ can be associated with the classifications singer, actor, and celebrity.
The filtering process is designed to simplify at least fuzzy and noisy queries. The filtering process may include removing one or more unnecessary tokens (such as preposition words) from the query. As an example, if the received query is “where there in Tolsa”, the word “in” may be removed from the query if the token is determined to be unnecessary. A list of unnecessary tokens is defined in a semantic dictionary maintained in the database 150 or the memory 149.
The tokenized paths created by the tokenizer 144 are based on the fact that the coherent query typically includes a set of tokens (map to entities as defined above) that represent similar intents. According to one embodiment, any ambiguity between paths is resolved by using the most coherent and probable path among all possible tokenized paths. In one embodiment, a graph of connections between entities (e.g., singers connected to their songs) is utilized to evaluate the likelihood of a certain tokenized paths yielding the user's intended search result based on the connection of tokens (mapped to entities) in the same query. For example, the input query “madonna vogue” includes two tokens: “madonna” and “vogue”, where the tokenized path is that the entire query deals with music, rather than a Vogue magazine article (“Vogue” is both the name of a Madonna song and the title of a magazine).
Each engine of the plurality of engines 146 is configured to handle different one or more topics of interest. In one embodiment, a set of engines 146 are configured to map input tokenized paths or tokens (hereinafter tokenized queries) to entities. As noted above, entities are objects that can be defined using a set of attributes such as consumer goods, locations, keywords, mobile applications (apps), person names, questions, URLs, and so on.
As a non-limiting example, an engine 146 that is configured to handle locations, search for place names (cities, states, countries) in the tokenized query, and compute the probability that the user added a location to his or her input query. As another non-limiting example, an engine 146 that handles the names of people computes the probability that a given n-gram in the tokenized query is the name of an unknown person. Such an engine uses a frequency dictionary for common names versus common words, and common last name suffixes. In the fields of computational linguistics and probability, an n-gram is a contiguous sequence of n items from a given sequence of text or speech.
As another non-limiting example, an engine 146 that handles URLs is configured to include a list of URLs, domain names, and websites, and to compute the probability that the tokenized query includes a website name. As another non-limiting example, an engine 146 computes the probability that the tokenized query includes a question word, thereby determining the probability that the entire input query is a question. This is performed using pattern matching.
According to one embodiment, the probability may be computed based on at least one of: the frequency of appearance of the tokenized query within the entities by the engines, the correlation of the tokenized query to the entities, the matching between each of the tokens to the entities, the matching of the tokenized query to a plurality of search results received from an external search engine, the correlation to trend reports, and combinations thereof. As noted above, entities represent topics of interests.
The engines 146 are periodically updated with relevant content and are therefore consistent with the trends related to the respective topics. As a non-limiting example, the entities are updated by periodically downloading an index of entities from external sources (e.g., freebase.org) and names related mobile apps that can be periodically downloaded from central repositories of such applications, e.g., AppStore®.
In one embodiment, trends or popularity reports of certain keywords or queries are retrieved from external sources. Such reports can be input to engines 146 and can be utilized in part to compute the probability of a certain entity. For example, a trend report shows that a keyword “JFK airport” is currently trendy, so the probability computed for the location JFK airport would be higher than the probability computed for the person President John F. Kennedy.
Each engine of the plurality of engines 146 then provides an output respective of the tokenized query. Such output includes the mapped entity from the engine 146 and a certainty score for the tokenized query based on the probability computed for the entity handled by a respective engine. That is, each certainty score reflects the matching of the tokenized query to the topic which the corresponding engine handles. In an exemplary embodiment, the certainty score is an integer number between 0 and 10. In one embodiment, a certainty score that does not exceed a predefined threshold is not output by the engine 146.
The outputs of the engines 146 are then analyzed by an analyzer 148 and the search intent is determined respective to the analysis. The analysis of the analyzer 148 may include: a statistical analysis, a semantic analysis, analysis of the user experience, and combinations thereof. The statistical analysis determines the co-occurrence of the tokens within the topics of interest of the engine. The semantic analysis determines at least one of: the type of each of the one or more tokens, the correlation between each of the tokens and the topic of interest of the engine, and a combination thereof.
The statistical analysis is performed to determine, based on the certainty scores, which entities would best describe the search intent of an input query. This may include statistically combining the outputs from engines 146. In another embodiment, the statistical analysis including computing an average over the received certainty scores and considering entities with certainty scores over the computed average. The semantic analysis determines which of the combination of tokens mapped to entities describes a coherent query (or phrase).
The user intent is then sent to the search server 130 in order to provide the user with appropriate search results. It should be noted that each of the units may include a processor coupled to a memory (both are not shown).
As a non-limiting example, the words “March madness” are received as a query by the network interface 142. The query is tokenized by the tokenizer 144 to the tokenized queries “March”, “madness” and “March madness”. The tokenized queries are then sent to a plurality of engines 146. An engine (e.g., engine 146-1) that handles dates will provide a high certainty score (e.g., 10) for the word “March” and the certainty of this word as the 3rd Month of the year, but this engine 146-1 will not provide an output for the tokenized queries “madness” and “March Madness” (or otherwise provide a certainty score below a predefined threshold). An engine (e.g., engine 146-2) that handles a music entity will provide a high certainty score (e.g., 7) for the word “madness” and the certainty of this word as the name of a Music band, but engine 146-2 will not provide an output for the tokenized queries “March” and “March Madness.” An engine (e.g., engine 146-3) that handles basketball will output a high certainty score (e.g., 10) for the tokenized query “March Madness” and the certainty of this combination of words as a basketball related phrase. Respective thereto the search intent is determined to be basketball, as a coherent query is comprised of entities that best represent the intent.
FIG. 3 depicts an exemplary and non-limiting flowchart 300 of a method for detecting a search intent of a user submitting a search query according to one embodiment. In S310, a query, or a portion thereof, is received from a user device, for example the user device 110. The input query can be a text query or a voice query, wherein a text query would include a free text query and a structured query. In an embodiment, the user device is a hand held device. Therefore, in that embodiment, the user tends to type shorter queries as it is often inconvenient to type long phrases using hand held devices.
In S320, the received query is tokenized to one or more tokenized queries. A tokenized query may be any combination of tokens broken from the input query. A token may be a word or phrase that appears in the input query. In an embodiment, S320 is performed by the tokenizer 146. In S330, the tokenized queries are input to the plurality of engines 146-1 through 146-N. In S335, each engine computes the probability that a tokenized query is mapped to at least entity that the engine is configured with. An entity represents a topic of interest. Various examples of engines and their entities are discussed above. The probability computation is realized by a certainty score. In S340, each of the engines 146-1 through 146-N provides at least one entity together with a certainty score. As an example, the tokenized query ‘madonna’ can be mapped to the entities: ‘musician’ and ‘religious figure.’ As noted above, in an embodiment, certainty scores below a predefined threshold are not output by the engines. In S350, at least a statistical analysis, a semantic analysis, or both is performed on at least the certainty scores and entities received from the engines to determine the search intent of the user. In S360, the determined search intent is returned to a search server. In an embodiment, the tokenized queries and the search intent are saved in the memory 149. In S370, it is checked whether a new query is received, and if so execution continues with S310; otherwise, execution terminates.
It should be understood that any reference to an element herein using a designation such as “first,” “second,” and so forth does not generally limit the quantity or order of those elements. Rather, these designations are generally used herein as a convenient method of distinguishing between two or more elements or instances of an element. Thus, a reference to first and second elements does not mean that only two elements may be employed there or that the first element must precede the second element in some manner. Also, unless stated otherwise, a set of elements comprises one or more elements.
As used herein, the phrase “at least one of” followed by a listing of items means that any of the listed items can be utilized individually, or any combination of two or more of the listed items can be utilized. For example, if a system is described as including “at least one of A, B, and C,” the system can include A alone; B alone; C alone; A and B in combination; B and C in combination; A and C in combination; or A, B, and C in combination.
The various embodiments may be implemented as hardware, firmware, software, or any combination thereof. Moreover, the software is preferably implemented as an application program tangibly embodied on a program storage unit or tangible computer readable medium consisting of parts, or of certain devices and/or a combination of devices. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units (“CPUs”), a memory, and input/output interfaces. The computer platform may also include an operating system and microinstruction code. The various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU, whether or not such computer or processor is explicitly shown. In addition, various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit. All or some of the servers maybe combined into one or more integrated servers. Furthermore, a non-transitory computer readable medium is any computer readable medium except for a transitory propagating signal.
All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the principles and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions. Moreover, all statements herein reciting principles, aspects, and embodiments, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
supplying the determined search intent of the user to a search server for use in developing search results for the user submitted search query.
2. The method of claim 1, wherein each received certainty score is above a predetermined threshold.
statistically analyzing the received entities and certainty scores, wherein the statistical analysis includes determining a co-occurrence of the at least one tokenized query within the at least one entity of each engine, wherein the search intent of the user is determined further based on the determined co-occurrences.
semantically analyzing the at least one tokenized query, wherein the semantic analysis includes determining a combination of the at least one tokenized query that describes a coherent query.
5. The method of claim 1, wherein the search query is any of: a definitive query, a fuzzy query, and a noisy query.
filtering, based on a list of unnecessary tokens, at least one unnecessary token from the search query, when the search query is a fuzzy query or a noisy query.
7. The method of claim 1, wherein the tokenizing is based on a graph of connections between entities of the plurality of engines.
deriving, based on the correlation, at least a category of interest, wherein the search intent is determined based further on the category of interest.
9. The method of claim 1, wherein each engine is configured to compute the probability that each tokenized query of the at least one tokenized query is mapped to the at least one entity of the engine.
supply the determined search intent of the user to a search server for use in developing search results for the user submitted search query.
12. The intent detector of claim 11, wherein each received certainty score is above a predetermined threshold.
statistically analyze the received entities and certainty scores, wherein the statistical analysis includes determining a co-occurrence of the at least one tokenized query within the at least one entity of each engine, wherein the search intent of the user is determined further based on the determined co-occurrences.
semantically analyze the at least one tokenized query, wherein the semantic analysis includes determining a combination of the at least one tokenized query that describes a coherent query.
15. The intent detector of claim 11, wherein the search query is any of: a definitive query, a fuzzy query, and a noisy query.
filter, based on a list of unnecessary tokens, at least one unnecessary token from the search query, when the search query is a fuzzy query or a noisy query.
17. The intent detector of claim 11, wherein the tokenizing is based on a graph of connections between entities of the plurality of engines.
derive, based on the correlation, at least a category of interest, wherein the search intent is determined based further on the category of interest.
19. The intent detector of claim 11, wherein each engine is configured to compute the probability that each tokenized query of the at least one tokenized query is mapped to the at least one entity of the engine.
"Categories App Helps Organize iPhone Apps on your iPhone's Home Screen," iPhoneHacks, url: http://www.phonehacks.com/2008/10/categoriesapp.html, pp. 1-4, date of publication: Oct. 5, 2008.
"iOS 4.2 for iPad New Features: Folders," Purcell, url: http://notebooks.com/2010/11/22/ios-4-2-foripad-new-features-folders/, pp. 1-5, date of publication Nov. 22, 2010.
Alice Corp V. CLS Bank International, 573 US___, 134 S. CT. 2347 (2014).
Chinese Foreign Action dated Mar. 13, 2017 from the State Intellectual Property of the P.R.C. for Chinese Patent Application: 201280004301.0, China.
Chinese Foreign Action dated Sep. 3, 2018 from the State Intellectual Property of the P.R.C. for Chinese Patent Application: 201280004301.0, China.
Foreign Office Action for JP2015-537680 dated Dec. 6, 2016 from the Japanese Patent Office.
Foreign Office Action for Patent Application No. 201380000403.X dated Jun. 2, 2017 by the State Intellectual Property Office of the P.R.C.
Kurihara, et al., "How to Solve Beginner's Problem, Mac Fan Supports" Mac Fan, Mainichi Communications Cooperation, Dec. 1, 2009, vol. 17, 12th issue, p. 92, Translated.
Notice of the First Office Action for Chinese Patent Application No. 201280004300.6, State Intellectual Property Office of the P.R.C., dated Oct. 26, 2016.
Second Office Action for Chinese Patent Application No. 201280004300.6 dated Aug. 23, 2017, SIPO.
The Second Office Action for Chinese Patent Application No. 201280004301.0 dated Jan. 19, 2018, SIPO.
Speer et al. 2012 Representing General Relational Knowledge in ConceptNet 5.

References: application No. 61
 application No. 61
 application No. 61
 application No. 61
 V. 
 Application No. 201380000403
 Application No. 201280004300
 Application No. 201280004300
 Application No. 201280004301