Abstract:
A method for automatically determining an Internet home page corresponding to a named entity identified by a specified descriptor including building a trained machine-learning model, generating candidate matches from the specified descriptor, wherein each candidate match includes an Internet address, extracting content-based features from websites associated with the Internet addresses of the candidate matches, determining a model score for each candidate match based on the content-based features using the trained machine-learning model, and determining a match from among the candidate matches according to the scores, wherein the match is returned as the Internet home page corresponding to the named entity.

Description:
BACKGROUND OF THE INVENTION 
     1. Technical Field 
     The present disclosure relates to a system and method of using machine learning to automatically discover the home page of an entity (e.g., a company, an organization, or a person) based on a specified descriptor such as the name of the entity. 
     2. Discussion of Related Art 
     It can be a challenge to discern whether a company has a website and to identify the correct home page if the company has a website. A URL (Uniform Resource Locator) is the unique address for a file that is accessible on the Internet. The term “website” (alternatively, web site or Web site) refers to a related collection of World Wide Web (WWW) files that includes a main file called a home page. 
     There are instances where it is useful to know the Internet home page or URL for a specified set of companies. If the companies are large, such as Fortune 500 companies, the task of finding their home pages can be accomplished by submitting each company name to an Internet search engine and selecting from returned results. This approach is less reliable for smaller companies because the returned results will not reliably include the home page address. The smaller a company&#39;s Internet presence, the more difficult it becomes to identify the home page. 
     Registration of Internet top-level domains is managed by the Internet Corporation for Assigned Names and Numbers (ICANN). A top-level domain (TLD), sometimes referred to as a top-level domain name (TLDN), can be registered through domain-name registrars that have been accredited by ICANN. A number of companies have been accredited by ICANN to act as registrars in one or more TLDs, including, for example, .biz, .com, .info, .net and .org. 
     It is known that TLD registration lists can be used to determine the home page address for a given company. Using TLD registration lists, it is possible to determine if a specified domain is currently registered, and if so, the name of the entity that registered the domain. 
     However, the conventional method of domain lookup can lead to incorrect results for companies with a small Internet presence. Many of these companies rely on other companies to build, host, and maintain their company websites. The company that develops the website may register the domain under their company name, rather than the name of the requesting company. For this reason, the use of domain registration data does not reliably determine a correct match of a company name to its website. For example, the company Michigan Capital Finance has a home page associated with a given domain name. If this domain name is matched to a domain registration list (there are websites that support such a query), the named registrant is an entity ZWBALLCO, which is a different company that offers website hosting services to other companies. Hence, domain lookup cannot be relied on to lead to correct results. 
     Therefore, a need exists for a system and method of matching an Internet home page to a specified entity. 
     SUMMARY OF THE INVENTION 
     According to an exemplary embodiment of the present invention, a method for automatically determining an Internet home page corresponding to a named entity identified by a specified descriptor including building a trained machine-learning model, generating candidate matches from the specified descriptor, wherein each candidate match includes an Internet address, extracting content-based features from websites associated with the Internet addresses of the candidate matches, determining a model score for each candidate match based on the content-based features using the trained machine-learning model, and determining a match from among the candidate matches according to the scores, wherein the match is returned as the Internet home page corresponding to the named entity. 
     According to an exemplary embodiment of the present invention, a program storage device readable by machine tangibly embodies a program of instructions executable by the machine to perform method steps for automatically determining an Internet home page corresponding to a named entity identified by a specified descriptor. 
     According to an exemplary embodiment of the present invention, a system for automatically determining an Internet home page corresponding to a specified company name includes a memory system for storing a program code and a processor in communication with the memory system, wherein the processor executes the program code to implement method steps of constructing a first training set comprising a set of potential company homepages, constructing a second training set comprising a set of potential company name, URL matches, extracting content-based features from the first training set to build a first set of extracted features and extracting content-based features from the second training set to build a second set of extracted features, training a company-website model to distinguish actual company websites from non-company pages using at least one of the first set of extracted features or the first training set, applying the trained company-website model to generate a score, training a company-match model using at least one of the score, the second set of extracted features, or the second training set, and determining if a candidate match is correct using the company-match model. 
     The present invention will become readily apparent to those of ordinary skill in the art when descriptions of exemplary embodiments thereof are read with reference to the accompanying drawings. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  is a block diagram of a data processing system, which may be used to implement an exemplary embodiment of the present invention. 
         FIG. 2  is a schematic diagram of a machine-learning system for identifying a home page corresponding to a specified entity (e.g., company), according to an exemplary embodiment of the present invention. 
         FIG. 3  is table of exemplary features for training a machine-learning model processor, according to an exemplary embodiment of the present invention. 
         FIG. 4  is a schematic diagram showing a method of training a machine-learning system, according to an exemplary embodiment of the present invention. 
         FIG. 5  is a flowchart illustrating a method to automatically determine an Internet home page corresponding to a specified descriptor, according to an exemplary embodiment of the present invention. 
     
    
    
     DESCRIPTION OF EXEMPLARY EMBODIMENTS 
     Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings. As used herein, the term “descriptor” refers to a word or phrase (i.e., a string of words, such as a company name), which the user might submit to a search engine to find a Web site or page. 
     According to an exemplary embodiment of the present invention, a system and method match specified descriptors to home pages and output matched results to a repository. Each selected home page corresponds to a most-likely correct search result (or best match) for the specified descriptor. The matched results may be stored in various tables of a database structure. In various exemplary embodiments of the present invention, the descriptor identifies businesses, organizations, public agencies, or persons. 
     It is to be understood that the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof. In one embodiment, the present invention may be implemented in software as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a computer system comprising any suitable architecture. 
     Referring to  FIG. 1 , according to an embodiment of the present invention, a computer system  101  for implementing a method to automatically determine an Internet home page for a specified entity can comprise, inter alia, a central processing unit (CPU)  102 , a memory  103  and an input/output (I/O) interface  104 . The computer system  101  is generally coupled through the I/O interface  104  to a display  105  and various input devices  106  such as a mouse and keyboard. The support circuits can include circuits such as cache, power supplies, clock circuits, and a communications bus. The memory  103  can include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combination thereof. The present invention can be implemented as a routine  107  that is stored in memory  103  and executed by the CPU  102  to process the signal from the signal source  108 . As such, the computer system  101  is a general purpose computer system that becomes a specific purpose computer system when executing the routine  107  of the present invention. 
     The computer platform  101  also includes an operating system and micro instruction code. The various processes and functions described herein may either be part of the micro instruction code or part of the application program (or a combination thereof) which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device. 
     It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures may be implemented in software, the actual connections between the system components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings of the present invention provided herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention. 
     It will be appreciated that the hardware depicted in  FIG. 1  may vary depending on the implementation. Other internal hardware or peripheral devices, such as flash memory, equivalent non-volatile memory, or optical disk drives and the like, may be used in addition to or in place of the depicted hardware. 
     It is to be understood that a program storage device can be any computer readable storage medium that can contain or store a program of instructions for use by or in connection with an instruction execution system, apparatus or device. The computer readable storage medium can be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device). Examples of a computer readable storage medium include a semiconductor or solid state memory, magnetic tape, removable computer diskettes, RAM (random access memory), ROM (read-only memory), rigid magnetic disks, and optical disks such as a CD-ROM, CD-R/W and DVD. Alternatively, the program of instructions may be embodied in a propagation medium for communicating or propagating the program of instructions. 
     A data processing system suitable for storing and/or executing a program of instructions may include one or more processors coupled directly or indirectly to memory elements through a system bus. The memory elements can include local memory employed during execution of the program code, bulk storage, and cache memories that provide temporary storage of at least some program code to reduce the number of times code must be retrieved from bulk storage during execution. 
       FIG. 2  is a schematic diagram of a machine-learning system for identifying a home page corresponding to a specified descriptor, according to an exemplary embodiment of the present invention. 
     Referring to  FIG. 2 , the machine-learning system  200  includes a candidate generation processor  210 , a feature extraction processor  220 , and a machine-learning processor  230 . The system  200  receives input  205  including a set of descriptors, such as, for example, company names. The input  205  may include various data. For example, the input  205  may include a street address of a plant or facility or company headquarters corresponding to a named company. 
     The system  200  may be communicatively coupled to a repository for storing the set of descriptors. For example, the set of company names may be stored in a database  240 . Although one database  240  is shown in  FIG. 2 , it is to be understood that the machine-learning system  200  may be implemented using any number of databases. It will be appreciated that the input  205  may include data from various databases. The system  200  may include a graphical user interface (not shown). For example, the graphical user interface may allow a user to enter the input  205 . The graphical user interface may enable a user to monitor operations of the system  200 . 
     In an exemplary embodiment of the present invention, the input  205  includes a list of company names. The system  200  matches each company name to a home page, and outputs the matched results as output  215  to a repository  250 . The selected home page corresponds to a most-likely correct search result (or best match) for a specified company. The matched results may be stored in various tables of a database structure. It will be appreciated that various data structures may be used to store the matched results. For example, the matched results may be stored in a linked list or other data structure. 
     The candidate generation processor  210  receives the input  205  that includes the set of company names. For each company name, the candidate generation processor  210  generates a preliminary set of home pages that may contain the correct match to the company name. In an exemplary embodiment of the present invention, the candidate generation processor  210  generates the preliminary set of home pages by submitting a company name to one or more Internet search engines, and automatically parsing the search-engine output to determine a set of domains that may be the home page for the submitted company name. The submission to the Internet search engine(s) may be preceded by a filtering step to eliminate semantically less-significant words (e.g., “company”) or widely used abbreviations (e.g., “Inc.”) from the company name. 
     In an exemplary embodiment of the present invention, the generation processor  210  outputs the preliminary set of homepages as potential candidate &lt;company name, home page&gt; matches, also referred to herein as candidates matches. 
     The feature extraction processor  220  receives the set of potential candidate &lt;company name, home page&gt;. For each candidate match, the feature extraction processor  220  generates a set of attributes or features that are relevant to predicting a correct match. For example, these features may be obtained by crawling and scraping the content of a candidate home page, and then analyzing it to determine a set of content-based attributes. Features can include, but are not limited to, (a) whether the company name appears in the title, meta-tags, or HTML code of the Web page, (b) whether terms similar to the company name appear anywhere on the site, (c) whether there are online ads on the site, etc.  FIG. 3  illustrates a list of exemplary features. It will be appreciated that additional features can be used for this analysis. The set of features extracted for each candidate match are outputted to the machine-learning model processor  230 . 
     The machine-learning model processor  230  receives the set of features for each candidate home page and generates a score for each candidate match based on analysis of the features. The processor  230  can use any classification algorithm, such as for example, a decision tree, neural network, or statistical model. It will be appreciated that different classifiers can be used without loss of generality. In an exemplary embodiment of the present invention, the score is proportional to the probability that the candidate home page is the correct match. The candidate match with the best score is selected as the best match. For example, on a scale of 0 to 1, where 0 represents the lowest probability score and 1 is the highest probability score, the candidate match with a score closest to 1 would be selected as the best match. 
     In an exemplary embodiment of the present invention, if no candidate match meets a preset lower threshold on the score, the system  200  returns no match for the specified company. For example, a lower threshold of 0.25 may be used in the case when the model score is a continuous output between 0 and 1. When the model score is a continuous output between 0 and 1, small variations in the lower threshold may not detrimentally affect the performance of the model. For example, in the case when the model score is a continuous output between 0 and 1 and a lower threshold of 0.25 is used, variations up to about ±0.05 in the lower threshold (i.e., 0.255 to 0.245) do not detrimentally affect the performance of the model. Training of the machine learning model processor  230  is discussed below. 
       FIG. 4  is a schematic diagram showing a method of training a machine-learning system, according to an exemplary embodiment of the present invention. For example, a machine-learning system may be trained to predict whether a &lt;company name, home page&gt; candidate is correct based on analysis of features, as described above. To train the machine-learning system, examples of &lt;company name, home page&gt; matches that are known to be either correct or incorrect may be used. 
     Referring to  FIG. 4 , in modules  415 - 1  and  415 - 2 , training sets are constructed for the two distinct models shown in this figure. The construct training set module  415 - 1  specifies a set of potential company home pages that are labeled, e.g., by human experts, as either (i) home page for a company, or (ii) NOT home page for a company. Examples of class (ii) include Internet directories, such as those provided by YELLOWPAGES.COM_LLC, that may mention the company for which a match is sought, but are not the actual home page for that company. In an exemplary embodiment of the present invention, &lt;URL&gt; examples are chosen for the purpose of training a model to estimate the probability that a given Internet page is indeed a home page of some (as yet unspecified) company. 
     The construct-training-set module  415 - 2  specifies a set of potential &lt;company name, URL&gt; matches are specified that are labeled (e.g., by human experts) as either (i) Correct or (ii) Incorrect matches. Here, examples of class (ii) include home pages that are indeed the home page for some company, but not the home page for a specified company name. In an exemplary embodiment of the present invention, &lt;company name, URL&gt; examples are chosen for the purpose of training a model to predict whether a potential candidate &lt;company name, home page&gt; match is indeed correct. 
     The feature extraction module  430  involves the extraction of attributes or explanatory features which are likely to help a predictive model distinguish between the classes of examples described in blocks  415 - 1  and  415 - 2 . Feature extraction  430  may be embodied as the feature extraction processor  220  shown in  FIG. 2 . The home page of each example from blocks  415 - 1  and  415 - 2  is crawled, and attributes or features are defined based on the analysis of the content on this page. These features can include the number of words from the company name that appear on the page, in the meta-tags, and in the title. Features can include whether the page contains online ads, as well as the number of links from this page to other Internet pages. 
     The feature extraction module  430  may implement exemplary features described in  FIG. 3 . For example, the feature extraction module  430  may implement a feature named “titleInHtmlNormed” (number 1 in the table of  FIG. 3 ) to check that various key words in the company title are in the HTML code (normalized by length) and may implement a feature named “levDistTitleTag” (number 6 in the table of  FIG. 3 ) to determine the Levenstein distance of the title tag to the company name. For example, the Levenstein distance between two strings is given by the minimum number of operations needed to transform one string into the other, where an operation is an insertion, deletion, or substitution of a single character. Feature number 5 in the table of  FIG. 3  is the model score determined by the Company Website Model (module  440  in  FIG. 4 ). The features numbered 25 and 26 in the table of  FIG. 3  introduce the concept of “blacklisted” sites that are known by human experts to always be inadmissable as company home pages. Examples of such blacklisted sites include company directories like those provided by YELLOWPAGES.COM_LLC and so on. Features 25 and 26 hence capture the likelihood that the candidate URL is a known blacklisted site. 
     In block  440 , the predictive company-website model is trained to distinguish actual company websites from non-company pages, using the features extracted in feature extraction module  430  and the training examples defined in block  415 - 1 . This model can be any classification algorithm, which can be applied to the features of any candidate website. For example, the company-website model may be a decision tree, neural network or statistical model. 
     In block  450 , the predictive company-match model is trained to determine if a candidate &lt;company name, home page&gt; match is correct. The company-match model receives as input the output score produced by the company-website model in block  440 . In addition to the score, text-based features identified by the company-website model can also be used as inputs. Such features are represented as feature numbers 23 and 24 in the table of  FIG. 3 . The company-match model can be any classification algorithm, such as for example, a decision tree, neural network, or statistical model. The resulting model includes an algorithm which can be applied to the features of any candidate &lt;company name, home page&gt; match. This algorithm may be embodied in the machine learning processor  230  shown in  FIG. 2 . 
       FIG. 5  is a flowchart illustrating a method to automatically determine an Internet home page corresponding to a specified descriptor, according to an exemplary embodiment of the present invention. In module  510 , a set of training that includes pairs of labeled matches is built, wherein some pairs are known to be correct &lt;company name, URL&gt; matches, and others are known to be incorrect. The correct and incorrect labels may be generated by human inspection. In module  520 , features are extracted for each match in the training set. For example, module  520  may be implemented using feature extraction module  430  of  FIG. 4 , based on the exemplary features shown in  FIG. 3 . 
     Using the features for the set of training examples, a machine-learning model is trained, in module  530 . For example, the machine-learning model can be implemented using any classification algorithm. In module  580 , the trained machine-learning model is deployed. For example, deploying the trained machine-learning model may include implementing the specifics of the trained model in computer code, and running this code against the features extracted in module  570 . 
     In module  580 , the trained machine-learning model is used to predict the home pages corresponding to a set of descriptors (module  550 ) for which Internet homepage matches are sought. The descriptors may identify entities such as businesses, organizations, public agencies, or persons. For example, the descriptors may identify company names. For each descriptor, a list of potential URL matches is generated by submitting the descriptor to an Internet search engine, and capturing the top N returns, where N=10 in the exemplary embodiment. 
     In module  570 , features are extracted for each candidate match. For example, features may be extracted in module  570  for each candidate match using the same procedure as used in module  520  for the training set. In module  580 , each of these candidate matches is evaluated (e.g., scored) by the trained model. In module  590 , the candidate URL is selected as the best match to the specified company name based on score. For example, the candidate URL with the highest score may be selected as the best match to the specified company name. 
     In an exemplary embodiment of the present invention, a system uses machine learning to identify the Internet home page (URL) for a set of companies when only the company name is known. The system may involve training a machine-learning model to distinguish correct matches of home pages to company names, based on a large number of explanatory features characterizing the content of the candidate website. The model may be trained against labeled examples of correct and incorrect matches. The model may be applied in a system that accepts as input a large number of companies for which home pages are sought, and produces as output the most likely home page for each company in the input. 
     Although exemplary embodiments of the present invention have been described in detail with reference to the accompanying drawings for the purpose of illustration and description, it is to be understood that the inventive processes and apparatus are not to be construed as limited thereby. It will be apparent to those of ordinary skill in the art that various modifications to the foregoing exemplary embodiments may be made without departing from the scope of the disclosure.