identifying ambiguous queries in web search
It is widely believed that some queries submitted to search engines are by nature ambiguous (e.g., java, apple). However, few studies have investigated the questions of "how many queries are ambiguous?" and "how can we automatically identify an ambiguous query?" This paper deals with these issues. First, we construct the taxonomy of query ambiguity, and ask human annotators to manually classify queries based upon it. From manually labeled results, we find that query ambiguity is to some extent predictable. We then use a supervised learning approach to automatically classify queries as being ambiguous or not. Experimental results show that we can correctly identify 87\% of labeled queries. Finally, we estimate that about 16\% of queries in a real search log are ambiguous.
ambiguous query ambiguities queries queries web search search search engine paper taxonomies human predict use supervised learning experimentation estimates log web user study broad topics query classification query