Patent Publication Number: US-11023438-B2

Title: System and method for exposing internal search indices to internet search engines

Description:
FIELD OF THE INVENTION 
     The invention generally relates to a system and method for exposing search indices and, more particularly, a system and method for exposing internal search indices to Internet search engines. 
     BACKGROUND 
     Applications accessible via networks such as the World Wide Web (WWW) typically incorporate internal search indices to allow users to find content when performing searches, for example, on topical subjects or keywords. Content from the applications are often incorporated by outside search engines, thus enabling potential users that do not know about the application to find and utilize the application. 
     The use of Internet search engines has become both a boon and a hindrance to Internet users. Many topics can be researched via these search engines, but they have limitations. These limitations are becoming increasingly apparent as Internet content becomes more dynamic. By example, search engines normally discover content by following links and generating indices from the textual content contained within the content. This technique does not work properly with certain controlled applications such as, for example, an Information Marketplace due to the interface people use to discover subject matter or intellectual property (IP). 
     Since modem web applications often hinder the ability for search engines to discover content because of their level of dynamic information, new content is often undiscovered in a timely fashion when a user searches. For example, information that is frequently changing or undergoing frequent updates may be prone to fewer hits by search engines. Further, content that is protected or restricted in certain fashions by the content owners may be unreachable or unpresentable to users in a proper context as intended by the content&#39;s owner. Thus, both search engines and users may each have undesirable limitations that may adversely influence discovery or proper use of the content. 
     Therefore, there is a need to present IP or other content within a web site such as an Information Marketplace in a manner such that search engines can effectively and reliably index the internal search indices. At the same time, users who enter the marketplace through a search engine should be presented with the same interface that a user entering the marketplace normally would see, which currently does not occur. 
     SUMMARY 
     In an aspect of the invention, a method of facilitating on-line searching is provided. The method comprises the steps of generating one or more metadata files having keyword value pairs from indices to intellectual property at a web site and storing the one or more metadata files as hyper-text markup files (HTML) in a directory accessible through the Internet. The method also includes creating a master index file containing one or more links to each of the one or more metafiles and accessing at least one of the one or more metafiles via the one or more links to locate the intellectual property for commercial or private use. 
     In another aspect of the invention, a method of exposing search indices is provided. The method comprises the steps of creating one or more metadata files having keyword value pairs from the indices of an information marketplace having intellectual property and storing the one or more metadata files in a directory accessible through a network. The method also includes the steps of creating a master index file containing one or more links to each of the one or more metafiles and accessing at least one of the one or more metafiles via the one or more links to locate the intellectual property for a transaction, commercial use or a private use. 
     In another aspect of the invention, a system for facilitating on-line searching is provided. The system comprises means for generating one or more metadata files having keyword value pairs from indices to intellectual property at a web site and means for storing the one or more metadata files in a directory accessible on-line. The system also comprises means for creating a master index file containing one or more links to each of the one or more metafiles and means for accessing at least one of the one or more metafiles via the one or more links to locate the intellectual property for at least any one of a transaction, a commercial use and a private use. 
     In another aspect, a computer program product comprising a computer usable medium having readable program code embodied in the medium is provided. The computer program product includes at least one component to create one or more metadata files having keyword value pairs from the indices of an information marketplace having intellectual property. The component may also store the one or more metadata files in a directory accessible through a network, create a master index file containing one or more links to each of the metafiles and access at least one of the metafiles via the one or more links to locate the intellectual property for at least any one of a transaction, commercial use, and a private use. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  is an exemplary overview of an embodiment of an Information Marketplace (IM). 
         FIG. 2A  is an illustrative embodiment of indices to IP typically stored in the vault of the Information Marketplace. 
         FIG. 2B  is an illustrative embodiment of a searchable directory. 
         FIG. 3  is a swim lane diagram of an embodiment showing steps of creating IP metadata files for outside search engines. 
         FIG. 4  is a swim lane diagram of an embodiment showing steps of processing search agents requests. 
         FIGS. 5A and 5B  are swim lane diagrams of an embodiment showing steps of a user entering the Information Marketplace through an outside search site. 
     
    
    
     DETAILED DESCRIPTION 
     This invention is generally directed to a system and method for exposing internal search indices to Internet search engines. The internal search indices are exposed to external search engines in such a way that the data may be segregated into at least two types including: one layer of search data specifically for the search engines, and another for potential users of the application. This significantly improves the probability of discovery by search engines and also provides for presentation of discovered content to users in a manner consistent with the content, itself, or consistent with the intended controls or presentations established by the content&#39;s owner. 
     The system of the invention also includes one or more components that reproduce information about IP in a format that search engines can recognize and locate. The component(s) also forwards users coming through the search engines to the actual IP graphical user interface (GUI), instead of the files that the search engine discovered. This allows control over the information that search engines see/view, while ensuring that a user&#39;s interface to the system stays constant. 
     The system and method of the invention is explained in relation to an Information Marketplace (IM) for which the internal search indices are to be exposed in accordance with the invention. However, the system and method may also be applicable to other information distribution systems, as well, such as webs sites that wish to provide enhanced exposure of internal content. An IM may also provide for the owner of the IP to receive compensation for the use or sale of IP, thus, in effect, the IP becomes a valuable commodity. 
     IP producers may create information like digital photographs, music, movies, eBooks, composition, research, or the like. The IM provides for the IP producer to bring their creations to an IM that provides ability for IP producers to advertise and sell their material. The IM provides for the safety and security of the IP, and manages the interaction of a buyer and seller by facilitating finding information (i.e., IP) by the buyer. The IM may also handle the financial transaction between the IP owner and the buyer, and may also facilitate transport of the IP product to the buyer/consumer. In this way, the system and method of the invention enables IP producers to sell their own intellectual wares. 
     By identifying search agents that connect to the IM, the system segregates what information agents receive and what actual users of the system see and use. Requests from search agents may be forwarded to a separate directory with metadata about information in the marketplace. The IM is configured to disallow search agents from searching any directory other than this directory, which contains a set of files. There is a file for each IP stored in the system, and it contains keyword information on the IP. There is also an index file that contains links to each of the IP metadata files in the directory. This allows search agents to include the IP keyword data in their own indices. 
     When a person uses a search agent that has indexed the marketplace, there is a chance that a search may result in a hit on an item in the system. The link that the search agent provides to the user is the link to the metafile that the search agent indexed originally. To ensure that the user is given a proper interface to see items within the marketplace, the page automatically forwards the user to the real (dynamic) page describing the IP satisfying the search. At this point, the user may be asked to log into the Information Marketplace. 
       FIG. 1  is an exemplary overview of an embodiment of an Information Marketplace (IM). An IM, generally denoted by reference numeral  100 , provides for an information infrastructure to secure and conditionally provide access to stored IP information. The IM  100  employs data storage  105  and security technologies to provide a secure storage mechanism for a user&#39;s IP, such as for example, books, movies, articles, music, research, photographs, inventions, software, or the like. The data storage  105  may be one or more physical databases and, in embodiments, may include the databases protected by layered security measures such as firewalls. This secured storage mechanism and structure and associated services are known as an information vault, or simply, a vault. The data storage  105  may also include various indices  145  which provide pointers to the IP within the vault. A computer system  120  (e.g., a personal computer) may be employed by a user to read or remove IP from the vault or to deposit IP information to the vault over a network  125 . 
     A set of vault of services  110  may be built on the IM&#39;s secure storage, to allow users to create accounts, deposit information in any electronic form, and read or remove the information. Information may be stored in the vault  105  and encrypted by the vault  105 . In addition, the ™ vault services  110  are provided to allow a user (e.g., an IP producer) to specify conditions, in a secure way via technologies of the existing public key infrastructure (PKI), so that a second party  125  (e.g., a consumer of IP) may have read access to certain, sharable portions of the user&#39;s IP. 
     Using this approach, the first party  120  may provide the second party  125  permission to read an agreed upon set of IP such as articles, research, books, music, video, data or the like. As a trusted third party for information, then, the vault  105  of ™  100  significantly contributes to the elimination of the escalating dangers of theft, and significantly increases commercial availability of the IP overall. The IM  100  may also provide for financial transactions and payment collection upon sale of the IP, as denoted by reference numeral  130 . 
     Also included are vault services  110  for accessing and updating the vault  105 , one or more data objects  115  such as files containing research, music, movies, books, contact management control data, telephone numbers, birthday information, family names, email addresses, or other personal data. The system may also include devices used by users of the vault who may employ computers, personal digital assistants (PDAs), telephones, or the like. 
     A certificate authority  140  may create an authorized certificate (e.g., a digital certificate) for any user of the system which may be presented during transactions to facilitate authenticating a user. Accesses to the vault typically use the first and/or second party&#39;s public keys as identification along with the authorized certificate. To share information with a second party, a contract data token specifying the two parties&#39; public keys may be created and digitally signed by the first party&#39;s private key to ensure that access to private information is not propagated beyond the second party. This dual key mechanism is a typical way to authenticate a transaction, of which an example of an implementation may be found in U.S. Pat. No. 7,587,366, incorporated by reference herein. 
       FIG. 2A  is an illustrative embodiment of indices (e.g., indices  145 ) to IP typically stored in the vault of the IM, generally denoted as reference numeral  200 . The one or more indices for the information marketplace may be collections of key/value pairs and pointer(s) to IP stored within the IM  100  vault. For example, metadata key X,  205 , may link to associated values  210   a - 210   c , each value  210   a - 210   b  reflecting a distinctive type of data such as, for example, movies, plain text, music, pictures, or the like. Further, the values  210   a - 210   c  may also categorize IP by genre such as “jazz’, “classical”, “rock and roll”, or other types of music, for example. Each value  210   a - 210   c  may link to a list of one or more pointers  215   a - 215   c  to individual IP objects. In embodiments, the order of the list may reflect the popularity of IP within the list (e.g., consumption statistics, such as the number of sells and views for a particular IP, may promote the IP higher in the list). 
     The individual indices may have a core set of metadata, or a template that pertains to a type of data. The template may map to standard metadata that the IP may have within the vault. In addition to the core templates, additional metadata pairs may be created to specify individual IP more thoroughly. 
       FIG. 2B  is an illustrative embodiment of a searchable directory, denoted by reference humeral  250 . The searchable directory includes one or more metadata files  260 A- 260 C that may be created for each IP (e.g., “A”, “B”, “C”, respectively) for access by web search engine crawlers, or the like. A master index file  255  may be created to link to all the IP metadata files to facilitate search engine crawlers in finding the metadata about each IP in the vault of the Information marketplace  100 . This searchable directory  250  may be an Internet accessible web site managed by or associated with the Information Marketplace  100 . 
       FIG. 3  is a swim lane diagram of an embodiment showing steps of creating IP metadata files for outside search engines, starting at step  305 . “Swim lane” diagrams may be used to show the relationship between the various “actors” in the processes and to define the steps involved in the processes.  FIG. 3  (and all the other Figures employing swim lane diagrams) may equally represent a high-level block diagram of components of the invention implementing the steps thereof. The steps of  FIG. 3  (and all the other Figures employing swim lane diagrams) may be implemented on computer program code in combination with the appropriate hardware. This computer program code may be stored on storage media such as a diskette, hard disk, CD-ROM, DVD-ROM or tape, as well as a memory storage device or collection of memory storage devices such as read-only memory (ROM) or random access memory (RAM). Additionally, the computer program code can be transferred to a workstation over the Internet or some other type of network. The steps of  FIG. 3  (and the other swim lane diagrams) may also be implemented by the embodiment of  FIG. 1 . 
     At step  305 , a periodic process begins that searches the IM indexes. At step  310 , metadata may be retrieved from the IP metadata indices (e.g. indices  145 ) for all or portions of the IP in the IM. At step  315 , individual metadata files may be generated for each IP. This may include collating all keyword data pairs for each IP and creating a separate hyper-text markup language (HTML) file for each IP. The HTML file may contain a meta tag for notifying search robots not to follow and index (e.g., META name=“robots”), and another meta tag containing the keyword pairs (e.g., META name=“keyword”). These HTML files may be written to a specific directory that may be accessible through the Internet. 
     At step  320 , a master index file may be generated having individual links to each metadata file created. A meta tag “ROBOTS” entry in this master file informs search agents to follow the links, but not to index the master file, itself (e.g., a CONTENT entry of “FOLLOW,NOINDEX”). At step  325 , all master index files may be saved into a searchable directory on an appropriate web server. 
       FIG. 4  is a swim lane diagram of an embodiment showing steps of processing search agents requests, starting at step  405  where a search agent requests a root directory of the IM. At step  410 , the request may be redirected to the searchable directory (e.g., the one or more master index files) containing metadata files of the indexed IP in the IM, which is typically not the primary page(s) that consumers use. The directory typically contains an HTML file for each IP in the IM containing metadata. The directory may also contain the master index file with links to each of the metadata documents thereby permitting search engines to discover meta information for all IP in the IM. 
     At step  415 , the master index file containing links to the metadata files in the searchable directory may be retrieved. At step  420 , the search agent may retrieve the metadata files specified in the searchable directory of the IM. At step  425 , the search agent may store the metadata information into internal indices (e.g., indices  145 ) for user searches. URLs to individual metadata documents may also be added to the search engine index of searchable files. 
       FIGS. 5A and 5B  are swim lane diagrams of an embodiment showing steps of a user entering the Information Marketplace through an outside search site. Beginning at step  505 , a user enters search criteria into a search engine. At step  510 , the search engine searches internal indices (e.g., indices  145 ) that it had previously indexed, for metadata that matches the criteria. At step  515 , the search engine may return matches (or “hits”) to the user usually via a browser; some or all of which may be IP in the IM. At step  520 , the user may select (e.g., by clicking on a link) an item within the IM. Instead of displaying the metadata file, the user may be forwarded to one of two pages, using known methods. At optional step  525 , the user may be forwarded to the login screen page if the user is not currently logged into the IM, and optional step  530 , the user logs into the IM. At step  535 , the IM displays dynamic graphical user interface (GUI) of the IP for which the user originally selected. In this manner, the intellectual property may be located for commercial, private use or for a transaction. 
     While the invention has been described in terms of embodiments, those skilled in the art will recognize that the invention can be practiced with modifications and in the spirit and scope of the appended claims.