Abstract:
A method and a system applying data mining techniques and artificial intelligence algorithms, namely neural networks, operating via an Internet data exchange site, allowing portfolio management companies to access an on-line, standardized questionnaire (Request for Proposal) and present their capabilities. The method then analyses a large number of these questionnaires and classifies managers, categorizing them and ranking their capabilities. In addition, sponsors such as pension funds, endowments, and private clients can submit their offer for the management of their assets. The site provides a Request for Proposal that is modular and continuously adapted to new financial market conditions, legal considerations and Sponsors needs. Once completed by each manager, the questionnaire is maintained in a central database allowing each manager to have an up-to-date and on-line version of questionnaire. The site allows the manager to have access to offers for new mandates in an easier and more efficient way than the old approach that involves approaching each potential Sponsor individually in a time and money consuming manner. The site provides Sponsors the opportunity to request proposals for their mandate from a much higher number of management companies, thus increasing dramatically the efficiency and rationality of their final choice of managers.

Description:
RELATED DOCUMENTS  
         [0001]    Applicants have filed a document under the disclosure document program, DD No. 474412, and a U.S. Provisional patent application No. 60/334,698, filed Nov. 1, 2001, the content of which are incorporated herein by reference hereto.  
         BACKGROUND OF THE INVENTION  
         [0002]    The invention relates to an evaluation method, in particular, to a method of selecting an investment manager.  
           [0003]    Traditionally, the process of selecting an investment manager includes several steps. In a first step, a “long list” of Managers invited to bid for the mandate is established. The length of the list is limited because of the cost involved in processing even superficially. In a second step, questionnaires are sent to each potential manager. Questionnaires are not standardized and the risk of misinterpretation is high. In a third step, the numerical and textual answers to the questionnaire are analyzed to identify a short list of finalist managers. The analysis is partly computerized and partly performed by human analysts and thus influenced by subjective interpretations. Therefore, it is often not clear exactly why some managers do not appear on the short list. In a fourth step, the shortlisted managers are interviewed. In a fifth step, the decision is made as to which Manager is the most appropriate given all the particularities of the Sponsor.  
           [0004]    Investorforce, a company based in Wayne, Pa, operates a website (investorforce.com) which offers the state of the art in manager search. It is one of a number of new providers that use Internet technology to streamline the process and enhance some aspect of the search process. According to their website, through InvestorForce&#39;s service called SEARCH EXCHANGE™, institutional investors can “submit customized RFPs online to which investment managers can respond . . . The institutional investor then narrows the candidates to a group of finalists . . . Throughout the process, the investor can compare performance data through side-by-side charts and graphs and can analyze responses to customized inquiries from investment managers to reach a decision.” 
           [0005]    Thanks to these new providers, the cost of due diligence (applying the above-mentioned points) in the search for managers (in particular, the analysis of answers phase) has been considerably reduced. At the same time, a much larger number of potential managers can compete for a given mandate, and thus the likelihood of selecting better managers has improved. Furthermore, from the standpoint of the investment management industry, the cost of searching for new clients has been reduced. Although it is not yet used universally, this type of Internet-based manager search is growing rapidly.  
           [0006]    In order to decide which manager(s) is the most appropriate, the investor still needs to go beyond the analysis offered by the new providers. For example, let&#39;s assume that “CalPERS”, the largest US pension find, decides to utilize the search exchange capability of Wayne, Pa.&#39;s InvestorForce.com to complete the competitive search process online in early January. A selection is not expected to be made final before late March. Thus, in order to appoint 5 to 10 managers in such a case, 3 further months of analysis are necessary to complete the search.  
           [0007]    The new providers have been able to improve the manager selection process each time numerical data was involved. However, as experts familiar with this industry well know, the selection of investment managers cannot solely depend on the analysis of pure data.  
           [0008]    Recognizing this fact, several new providers also provide non-numerical information in a somewhat standardized format. But the information still has to be screened, analysed and compared by traditional mostly human approaches. The drawbacks of this approach are, among others, the limited number of managers that can be analyzed and compare, the high cost of human analysis, the time it takes to perform the analysis and the risks associated with the subjectivity of the process. What is needed therefore is a method that can reveal the similarities between a large sample of competing firms in a more scientific, objective manner.  
         SUMMARY OF THE INVENTION  
         [0009]    A computerized system is provided, based on an Internet data exchange site where portfolio management companies can access an on-line, standardized questionnaire and present their capabilities and Sponsors (as defined hereafter under “3. Technical and Functional Overview”) such as pension funds, endowments, and private clients can submit their offer for the management of their assets. The site provides an on-line questionnaire (Request For Proposal or “RFP”) that is modular and continuously adapted to new financial market conditions, legal considerations and sponsor needs. The questionnaire, completed by each manager, will be maintained in a central database allowing each manager to have an up-to-date and on-line version of questionnaire. The site allows the manager to have access to offers for new mandates in an easier and more efficient way than the prior art method which involves approaching each potential Sponsor individually (which is tine consuming and expensive).  
           [0010]    The System provides the opportunity for Sponsors to request proposals for their mandate from a much higher number of pre-qaulified management companies thus increasing dramatically the efficiency and rationality of their final choice of managers.  
           [0011]    The design of the on-line questionnaire is such that the method of the invention can automatically analyse the responses. This software, based on data mining techniques and artificial intelligence algorithms namely neural networks, is capable of analysing a large number of questionnaires and of classifying managers in different categories with a ranking of their capabilities. These categories and ranking are then presented in comprehensive, mostly graphical form to the Sponsor.  
           [0012]    The method of the invention processes a large number of data contained in the questionnaire and generates a set of tracable categories that bring together the most important information and therefore, render the process of final decision-making much faster, more efficient and less subjective.  
           [0013]    In an advantage of the invention, the method ensures that the selection process is rapid and made on a transparent, objective, sound and scientific basis. Therefore the invention tends to improve the logic and coherence of the final choice considering the predefined selection criteria of the investor as well as the criteria that cannot be readily expressed quantitatively.  
           [0014]    In a second advantage, the invention highlights all the reasons (pros &amp; cons) involved in a decision which translates into a level of transparency impossible to achieve trough traditional, mostly subjective human methods. This is especially so when a large number of possible managers are involved in the selection process. Thus, the method of the invention helps avoid making a final decision without adequate consideration of an important selection criteria. The method also helps avoid decisions that might conflict with the best interest of the investor.  
           [0015]    In a third advantage, the invention highlights the different selection criteria among managers participating in a selection process.  
           [0016]    In a fourth advantage, the invention provides a tool to ensure that the reasons for the hiring of a Manager are objective and remain valid over time. For the portfolio management industry, this objectivity also guarantees a fair treatment for every bidder. At the same time, a more open market will translate into improved quality for the consumer, in this case the investor. 
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0017]    [0017]FIG. 1A is a flow chart showing the dynamic generation of a webpage using a servlet.  
         [0018]    [0018]FIG. 1B is a schematic diagram showing the dynamic generation of a webpage using a servlet.  
         [0019]    [0019]FIG. 2 is an example of XML syntax in which XSL scripts are used to transform XML descriptions into web pages subsequently sent to a manager.  
         [0020]    [0020]FIG. 3 is a screen print of a web page interface of the invention.  
         [0021]    [0021]FIG. 4 shows a web menu of the invention which describes modules by name.  
         [0022]    [0022]FIG. 5 shows an XML sequence of the invention that describes the different modules in the menu of FIG. 4.  
         [0023]    [0023]FIG. 6 is an example of atomic questions having only one answer.  
         [0024]    [0024]FIG. 7 is an example of vector questions, meaning that the question can have a set of possible answers.  
         [0025]    [0025]FIG. 8 is an example of matrix questions meaning that the user has to complete a bi-dimensional structure.  
         [0026]    [0026]FIGS. 9 and 10 presents the actors and the data flow of the System of the invention.  
         [0027]    [0027]FIG. 11 presents data flow subsequent to the stage described in FIGS. 9 and 10.  
         [0028]    [0028]FIG. 12 shows RFP processing in order to transform the raw data it contains into higher-level concepts corresponding to dimensions.  
         [0029]    [0029]FIG. 13 shows an artificial neuron used in the System of the invention.  
         [0030]    [0030]FIG. 14 shows the output of the neuron y as the average sum of the inputs (or the dot product of the input and the synaptic vectors) processed through the sigmoid function s.  
         [0031]    [0031]FIG. 14 a  shows a sigmoid function having specific properties.  
         [0032]    [0032]FIG. 14 b  shows a Format Filter of the invention.  
         [0033]    [0033]FIG. 15 is a schematic of the dimension calculation carried out by the neural network of the DPM  
         [0034]    [0034]FIG. 16 shows the processing carried out for the totality of RFPs received by the System of the invention.  
         [0035]    [0035]FIG. 17 shows a Dimension Matrix representing Dimension Vectors.  
         [0036]    [0036]FIG. 18 shows a simplified version of the concept of a Dimension Matrix in 3-dimensional space.  
         [0037]    [0037]FIG. 19 shows a simplication of the PCA method used in the invention.  
         [0038]    [0038]FIG. 20 shows the projection of firm Feature Map information on two dimensions.  
         [0039]    [0039]FIG. 21 shows an example correlation circle used in the invention.  
         [0040]    [0040]FIG. 22 shows another example of a correlation circle used in the invention.  
         [0041]    [0041]FIG. 23 shows the labelling process of the invention.  
         [0042]    [0042]FIG. 24 shows a labelled feature map used in the invention.  
         [0043]    [0043]FIG. 25 a overview of the process of the invention is shown. 
     
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT  
       [0044]    This description is best understood in light of definitions of the terms “Sponsor” and “Manager”, which have the following meaning, unless expressly stated otherwise herein:  
         [0045]    “Sponsor” refers to a sponsor of the selection process and includes, but is not be limited to, pension funds, foundations, endowments, institutions, insurance companies, family funds, portfolio management firms, private persons which desire to have their funds be invested by portfolio managers.  
         [0046]    “Portfolio management firms” include those who use the services of outside portfolio managers to manage part or all of their client&#39;s assets.  
         [0047]    “Manager” includes, but is not limited to, banks, independent asset managers, asset management companies, insurance companies that provide asset management capabilities to their clients.  
         [0048]    The present invention is implemented by a computerized, Internet based method permitting a secure communications and secure information exchange. The method enables a Sponsor to submit a “mandate” and request a proposal from a number of managers by means of an on-line questionnaire or request for proposal (RFP). The method allows the Sponsor to qualify the best managers that correspond to his requirements and ultimately leads to the appointment of one or several managers. The invention is referred to herein as a “method”, or a “system” and the use of one term and not the other is not to be taken as an exclusion of the other.  
         [0049]    The system and method of the invention provide various functions to the users. The principal functions are described below.  
         [0050]    On the Manager&#39;s Side  
         [0051]    On the manager side, the system is preferably accessed via an Internet connection and a web browser. Of course, the method of the invention operates on other networks as well. For example, the method is capable of operating on a virtual private network, a LAN/intranet and an extranet. Upon input of the proper URL, access to the functional interface of the System is subject to validation through the input of a correct username and password. Upon the entry of the correct login information, a secure port is opened and all communications between the manager and the system are encrypted.  
         [0052]    The secure connection to the site and identification of the manager enables the system to send to the manager secure, targeted information concerning the mandates that have been submitted by the Sponsors. Such information is usually in the form of a hypertext link list to further detailed information about each mandate. Further, the list leads directly or indirectly to a corresponding RP that the manager can complete.  
         [0053]    The web pages presented to the user via their web browser are dynamically regenerated by the server. This means that periodic refresh commands are generated on the server side, to ensure that the manager has the latest information available concerning the mandate. This means that any change in the RFP structure will automatically be visible for the users. In its preferred version, the generation of the pages is based on the XML/XSL technology, although HTML or any other suitable markup language could be used.  
         [0054]    Referring now to FIGS. 1A and 1B, the method is enabled through communication via the Internet. The routine Internet communication involved in the invention is as follows. In a first step  12 , the user asks that a page of the RFP be presented. In a second step  14 , the request is interpreted by an associated “servlet” (i.e., an applet that runs on the server side—without a face which is server- and platform-independent), initiating the necessary queries in order to retrieve the next questions from the database. In this step, the server generates XML code by following a predefined XML syntax, which is processed through an XSL script. In a third step  16 , an HTML page is consequently generated from the XML/XSL data and sent by the servlet to the client.  
         [0055]    Live Mandates:  
         [0056]    With the function referred to as “live mandates”, the manager is provided with a mechanism allowing him to access a web page on which are found descriptions of all the mandates that are proposed by Sponsors who are subscribers to the system. The manager can therefore study every mandate description in order to choose those to whom he can offer his portfolio management services. Each time a mandate is chosen, the manager can access an on-line questionnaire (RFP) which corresponds to the selected mandate.  
         [0057]    The mandates are stored in the central database. The RFP is presented to the manager in the same way as described in FIGS. 1A and 1B. The list of mandates is described in XML syntax.  
         [0058]    Referring to FIG. 2, an example of XML syntax  20  is provided. XSL scripts are used to transform XML description into web pages, which are sent to the manager.  
         [0059]    Referring to FIG. 3, an example of a web page interface  22  sent to a manager is shown. In this example, the page presents a list  24  of actual RFPs or mandates in the system. By pushing the “select” button  26 , the RFP related to this mandate will be retrieved and presented to the user.  
         [0060]    On-Line RFP:  
         [0061]    The on-line RFP is comprised of a set of Sponsor-proposed questions concerning the mandate. The manager must answer each question and this data will be used by the System as input for the analysis resulting in the choice of the “best” candidates.  
         [0062]    The RFP is composed of several modules. Each of these modules corresponds to a logically independent portion of the RFP. For example, one module deals with the costs of management, another module concerns the investment style and a third one addresses performance and so on.  
         [0063]    Referring now to FIG. 4, these modules are presented to the manager as a web menu  30  where each module  32  is described by its name. This menu  30  is typically a vertical list  34  of names, with each name reacting to mouse-clicks (e.g., hypertext links).  
         [0064]    Referring now to FIG. 5, an XML sequence  40  is shown which describes the different modules m the menu.  
         [0065]    Referring again to FIG. 4, the parsing of this XML by a specific XSL script gives the dynamic HTML menu  30  on the left of the figure. The manager can select each module  32  independently. When selected, the site displays the RFP  36  in the form of a list of questions associated with the module  32 . The menu  30  presenting the module list  34  remains visible at all times.  
         [0066]    The manager can either work on a single module  32  until all questions are answered or select several modules sequentially and work on them in parallel. In fact, each module  32  can even be answered by a different person in the same organization.  
         [0067]    Once a module  32  is selected, the manager can work on the questions displayed on the web page. The questions can solicit different types of responses such as free text numbers, Booleans, grids, etc. A response area adapted to the response type is associated with each question.  
         [0068]    Each individual question  38  has a specific XML syntax that describes all the related information. By parsing this XML through a specific XSL script, the HTML code for a question is generated. Further, there are three different types of questions displayed on the web pages:  
         [0069]    (1) Atomic questions  50 , “atomic” meaning that the question has one answer (See FIG. 6);  
         [0070]    (2) Vector questions  60 , “vector” meaning that the question can have a set of possible answers (See FIG. 7); and  
         [0071]    (3) Matrix questions  70 , “matrix” meaning that the user has to complete a bi-dimensional structure (Sec FIG. 8).  
         [0072]    In many cases, the method proposes a set of possible answers to a question (i.e., multiple choice). These suggested answers can be accessed by activating a user-interface icon or device such as by hovering the mouse arrow over the text of the questions. The suggestions are then displayed in a small, pop-down menu. The manager then scrolls through these possibilities and chooses one of them via a mouse-click, the answer being automatically submitted as a response.  
         [0073]    This pop-down response capability is very important as many of the questions of requests for proposals (RFPs) arc designed to have standard responses. The use of these suggested responses allows an important gain of time for the managers and a more efficient processing by the System.  
         [0074]    Further, it is very important that all managers responding to the RFP have a proper understanding of the questions. Therefore, each of the technical or financial concepts appearing in a question is accompanied by a precise definition. For example, each of these concepts may appear in a particular font on the screen (e.g. italic) indicating to the manager that a precise definition is available. By mouse-clicking on each of these concepts, a pop-up menu containing the explanation and examples appears. Once the manager is finished reading the definition, he can close the pop-up menu and continue his work on the RFP.  
         [0075]    Most questions appearing in the modules are completed in this way. Once all questions of a module are answered, an “OK” symbol appears next to the module name in the menu  30 . In this way, a manager can track progress of his work in one glance.  
         [0076]    Storing RFP:  
         [0077]    The answering to an RFP can be a unpleasant, arduous work. Ways that the System can ease this burden have already been described, for example, by proposing standard responses whenever possible.  
         [0078]    In another advantage, the System allows a manager to store his RFP together with his answers. To do so, he chooses the storing functionality available in the Site&#39;s menu, needing only give a name to his RFP (the Site will automatically add the mandate type, the name of the manager organization and all other important information to RFP). By doing so, the RFP is securely transmitted to the Site center (the database shown in FIG. 1B) where it is stored for later retrieval by the manager.  
         [0079]    This storing function is an important time saver for the manager. In fact, many mandates proposed by different sponsors are very similar. Hence, many of the questions are common to all mandates and therefore, the manager will give the same answers to those common questions. By storing the RFP and the responses, the manager is able to use it for more than one mandate and gain valuable time.  
         [0080]    If the manager is engaged in the answering process to RFPs concerning different types of mandates, he can also store more than one RFP. Typically, he will store an RFP for each type of mandate. Further, the saved responses can be stored according to a published taxonomy and be published as a standard response to a type A, B, or C (etc) Sponsor questionnaire, for example.  
         [0081]    The manager can store the RFP at any stage of his work. He can therefore store an unfinished RFP temporarily. In this way, he can adapt work on the RFP to his availability for such purpose. Moreover, this provides the opportunity to share the work between several employees within the same organization. In fact, as soon as two or more people in the same organization are provided with access rights to the System, they can access and work on the RFP separately, each one completing a different module for example.  
         [0082]    Loading RFP:  
         [0083]    At any time, the manager can load an RFP he has stored on the system. To do so, he activates a “load RFP” function. A list of RFPs stored by himself or his organization appears. This list contains the name and the mandate type of each RFPs. The manager can then choose one of them. In this case, the RFP is made available in a new window. The manager can therefore work on an empty RFP and consult the RFP that he has uploaded at the same time.  
         [0084]    The manager can modify information in the uploaded RIP and then store it, updating it in this way or changing its name and creating a new copy of the RFP.  
         [0085]    Submitting RFP:  
         [0086]    The manager can store his RFP at any tune even when the latter is not completed. By submitting a RFP, the manager indicates that the RFP is completed and that it can be processed by the system in order to find the best manager for the Sponsor. In other words, once the RFP is submitted, the manager enters the race for selection.  
         [0087]    To submit his RFP, the manager activates the corresponding function in a system menu and requests submission. The site generates then a timestamp and a virtual receipt indicating the precise date on which the RFP is submitted.  
         [0088]    Sponsor Side  
         [0089]    To specify the type of mandate he would like to place, the Sponsor is provided with a custom interface allowing him to specify the characteristics of the mandate he intends to offer.  
         [0090]    Once the site has received all the RFPs submitted by managers, the System processes this information in order to select the best candidates.  
         [0091]    The Sponsor then accesses another interface presented by the system allowing him to review the results, including a classification of the managers who have bid for the mandate.  
         [0092]    The system presents the sponsor with a number of 2-dimensional, radar-type graphics in which each manager or portfolio management firm is represented by a point. The Sponsor can easily access the definition and the interpretation of each category. He can also easily switch between one graphic and another. Through such manipulation, he can easily see where each manager stands compared to other bidders.  
         [0093]    Data Flow  
         [0094]    Now referring to FIGS. 9 and 10, the actors and the data flow of the System  84  of the invention are presented.  
         [0095]    As mentioned above, the actors include the Sponsor  80  and manager or portfolio management firm  82 . The Sponsor  80  specifies a mandate type concerning the management of financial assets and is in search of the best candidates to manage this mandate. The portfolio management firms  82  are interested in the management of the above mandate.  
         [0096]    Referring again to FIG. 10, data flow between these actors and the System  84  is shown. The web-based interface  22  plays a major role in this data flow. For example, via the web-based interface  22 , the Sponsor  80  accesses the System  84  in order to submit one or several different mandates. By using a custom web interface  22 , he is able to specify such information as the currency, the size of the portfolio to be managed, and the type of mandate, etc.  
         [0097]    Managers  82  can request the presentation of an overview of the mandates currently being offered via a mouse click. When a manager  82  chooses a particular mandate, the corresponding RFP is transmitted to him via his secure Internet connection.  
         [0098]    The manager  82  completes the RFP as described above, using the modular properties of the RFP as well as the storage or caching fictions of the system until his work is finished. The completed RFP is then sent back to the System where it is stored in a central database.  
         [0099]    Referring to FIG. 11, the data flow after this first stage  90  is presented. When all RFPs are submitted for a given mandate (determined by a time deadline or by a minimum number of bids, for example), the System  84  processes them and automatically analyses them using the artificial intelligence and data mining algorithms of the invention.  
         [0100]    The result of this analysis is stored by the System  84  and sent to the Sponsor  80 . He can then use a Data Analysis Application (“DAA”) that allows him to review the analysis by using simple and graphical tools. The DAA presents a basic classification of the managers  82  in different categories with a ranking of their capabilities. These categories and ranking are then presented as output in comprehensive, mostly graphical form.  
         [0101]    Methodology of Manager Selection  
         [0102]    The Request For Proposal (RFP)  
         [0103]    The RFP contains an large number of questions (more than 200) concerning important aspects that might interest the Sponsor in his selection of a portfolio manager. These aspects are for example, history of the organization, number of employees, management style, technical management tools used, costs, historical performances etc.  
         [0104]    Benefiting from significant experience and how-how of its authors in the field of portfolio manager search, the FP of the invention has several impost characteristics. The RFP is structured in separate chapters, each one concerning an independent aspect of the portfolio management organization and techniques. The logical independence of these chapters allows the parallel completion of the RFP by the managers and provides a logical structure and modularity to the RFP. The RFP is designed for global balanced mandates, specialist mandates in equities or bonds or hedge finds for domestic as well as international assets. Open questions are avoided by design, in order to “guide” the manager toward providing two types of responses:  
         [0105]    quantified information: in this case, the question has an quantified response (number, percentage . . . ) or an answer in the form of Yes/No; and  
         [0106]    Non-quantified information: When the response in not quantifiable, a set of possible answers in proposed to the manager (multiple choice).  
         [0107]    Finally, in some cases, the expected answer will be purely textual with the manager providing an ad hoc response. However, a majority of the questions are quantified or multiple choice, thus allowing standardization of the responses which is an important condition for the further processing of the RFP by the System.  
         [0108]    It is important to note that the portfolio management industry is constantly in development and mutation. Therefore, the RFP and its questions are naturally susceptible to evolution with addition of new questions or deletion of existing ones designed, for example, to consider new trends in this industry.  
         [0109]    Dimensions and Sub-Dimensions  
         [0110]    Each question in the RFP concerns a precise piece of information concerning the portfolio management organization and techniques. For example, the year of foundation of the organization, the cost structure, the qualifications of the CEO, the usage of a particular type of investment vehicle etc. are examples of the information solicited.  
         [0111]    The RFP draws a broad picture of the organization using important bits of elementary information that is very difficult to synthesize by merely reading it.  
         [0112]    In practice, the choice of a portfolio management organization is carried out by taking into account high-level concepts such as the “security of the organization”, “professionalism”, “transparency”, etc.  
         [0113]    We call each of these concepts a “dimension”. This term is chosen because each of these concepts represents a particular dimension of the analysis of the RFP. For the choice of the portfolio manager, a value must be given to each dimension and their combination leads to the qualification of the portfolio management organization.  
         [0114]    Therefore, each dimension corresponds to a high level concept used in the choice of the portfolio managers. Some of these concepts ale easier to define than others that are more complex. Hence, some particular concepts are made of sub-concepts that provide a more precise description. In the same way, some dimensions are composed of sub-dimensions. In other words, these dimensions are defined by the combination of several sub-dimensions.  
         [0115]    The following example can illustrate this fact. We have defined the dimension “Professionalism of the portfolio manager”. Clearly, the concept of professionalism is a complex one and comprises various aspects. We have therefore designed the 5 sub-dimensions for this dimension that follow:  
         [0116]    Years of experience  
         [0117]    Academic background  
         [0118]    Financial specialization  
         [0119]    Hierarchical responsibility  
         [0120]    Reasonable workload  
         [0121]    The dimensions and sub-dimensions of the System of the invention are the following:  
                                                                 Dimensions   Sub-dimensions                                    D 1     Perennity   Participation in other companies               Years of history               Rating               Number of different activities               Insurance               Number of employees               Assets under management       D 2     Cost       D 3     Transparency       D 4     Security   Volatility measurement       D 5     Historical success (marketing)   Variation in number of mandates               Variation in assets under               management       D 6     Performance of composite   Performance of the composite               Reliability of the composite       D 7     Professionalism of organization   Volatility measurement       D 8     Stability of organization       D 9     Professionalism of   Years of experience           portfolio manager   Academic background               Financial specialization               Hierarchical responsibility               Reasonable work load       D 10     Non conflict of interest                  
 
         [0122]    Of course, the number of dimensions or sub-dimensions in the System may be increased or decreased in the future.  
         [0123]    Each dimension is normalized, i.e. it can have a value between 0 and 1. As each dimension corresponds to a “positive” type of concept, the higher the value of a dimension, the better. For example, a value of 0.8 for D 4  represents a higher security than a value of 0.2.  
         [0124]    Referring now to FIG. 12, the RFP  36  is processed in order to transform the raw data it contains into higher-level concepts corresponding to dimensions. The data processing step in this figure is carried out by a neural network.  
         [0125]    Data Processing Module  
         [0126]    Artificial Neuron  
         [0127]    Neural networks are one of systems that belong to the artificial intelligence domain. They are designed to model the structure and behaviour of human intelligence.  
         [0128]    Referring now to FIG. 13, an artificial neuron  90  is shown as used in the System  84  of the invention. Here, x 1 , x 2  . . . x n  are the inputs of the neuron  90 . They can be grouped in the vector x which is called the input vector of the neuron  90 .  
         [0129]    Variables m 1 , m 2  . . . m n  are called the synaptic weights of the neuron  90 . Their collection is named the synaptic vector m. Now referring to FIGS. 13 and 14, the output of the neuron y, is the average sum of the inputs (or the dot product of the input and the synaptic vectors) processed through the sigmoid function s.  
         [0130]    The sigmoid function  100  of FIG. 14 a  has the following properties:  
         [0131]    for x smaller than s 1  (the first threshold), the output y is zero;  
         [0132]    for x between s 1  and s 2  (the second threshold), the output is equal to x; and  
         [0133]    for x larger than s 2 , the output is equal to 1  
         [0134]    Therefore, the sigmoid function  100  normalizes the output of the neuron  90  between 0 and 1. Moreover, the output of the neuron  90  is equal to the weighted sum of the inputs if the latter is between the two thresholds s 1  and s 2 .  
         [0135]    The role of the synaptic vector is of significant importance. The synaptic weight of each input x 1  defines the influence of his input in the final output of the neuron. When the synaptic weight of a given input is small, the value of this input does not import much in the output of the neuron. When this weight is large, his input influences the output of the neuron much more.  
         [0136]    The thresholds in the sigmoid functions in the neurons are also important. The value of the thresholds depends on the range of the dot product of the synaptic and the input.  
         [0137]    Filtering the RFP Responses  
         [0138]    The inputs of the neurons  90  used in our DPM are the responses in the RFP. However, in some cases, the responses cannot be input as such but must first go through the Format Filter  110  as represented in FIG. 14 b.    
         [0139]    The Format filter  110  has a role of formatting the response in order to provide a purely quantitative input to neurons  90  of the DPM.  
         [0140]    Mainly, the filtering involves translating the responses in the form of Yes or No into 1 or 0. in some cases, the filtering can be more complex but these cases are rare.  
         [0141]    Calculation of Dimensions  
         [0142]    Referring now to FIG. 15, a schematic of the dimension calculation carried out by the neural network  120  of the DPM is shown.  
         [0143]    The neural network  120  is composed of two layers  122  and  124 . The first layer  122  contains neurons  126  that are responsible for the calculation of the sub-dimensions  124 . The neurons  130  of the second layer  124  calculate the value of the dimensions.  
         [0144]    The input of each neuron  130  of the second layer  124  is either the output of a neuron  126  of the first layer  122  or directly a response on the RFP. The inputs of the neurons  126  of the first layer  122  are only the responses on the RFP.  
         [0145]    Each neuron  90  is characterized by a synaptic vector and, because of the sigmoid function  100 , the output of all neurons takes a value between 0 and 1.  
         [0146]    As is apparent, each dimension (and sub-dimension) captures a high level concept such as “Security” or “Professionalism of the organization”. The value given to any dimension depends on the responses to various questions in the RFP. For example, the dimension capturing “Security” is linked to questions regarding the existence or non-existence of insurance, the methodology of risk calculation, the decision making process in the organization, etc. The combination of responses given to each of these questions must be used to calculate a value for the dimension “Security”.  
         [0147]    For these reasons, the neuron  90  dedicated to the calculation of this dimension “Security” has inputs comprising responses to this type of question. The synaptic weights chosen for this neuron  90  represent the relative importance given to each answer and the way to combine them to calculate the value of the dimension. For example, if the existence of insurance in our example is perceived to be very important, the synaptic weight assigned to this input will be higher than the synaptic weight of the input concerning the methodology of risk calculation.  
         [0148]    Hence, there are two levels of knowledge in each neuron  90 . First the characterization of its inputs corresponds to those questions (and their answers) that must be taken into account for calculating a value for a given dimension. Second, the synaptic weightings assigned to the neuron  90  correspond to the relative importance given to each piece of information contained in the inputs of the neuron.  
         [0149]    When a neuron  90  is dedicated to a sub-dimension, its output is calculated in the same way as mentioned above. The output of this neuron  126  is then considered as an input for the neuron  130  assigned to the calculation of the dimension to which this sub-dimension belongs. Therefore, the neuron  130  dedicated to the dimension has inputs coming not only directly from the RFP but also from an input that is the output of another neuron  126 . This input coming from another neuron  126  is also associated with a synaptic weight that represents the relative importance of the sub-dimension compared to the other inputs of the neuron calculating the dimension.  
         [0150]    Finally, referring again to FIG. 15, a simplified image of the data processing neural network  120  is shown. This neural network  120  is defined by the type of connections existing between, on the one hand, the neurons  90  and, on the other hand between each neuron and the questions on the RFP. This connection scheme is the first level of knowledge used in the processing of the RFP. This neural network  120  is also defined by the synaptic vectors associated with each neuron  90 . The synaptic weightings represent the calculation made on the responses in order to produce sub-dimensions and dimensions. Therefore, these synaptic vectors represent the second level of knowledge.  
         [0151]    The connection scheme and the synaptic vectors of the neural network transform an RFP which is long list of questions into ten values between 0 and 1, each representing a dimension. The higher the value of a dimension, the more vivid the corresponding concept.  
         [0152]    The collection of these 10 dimensions composes a vector that we call the Dimension Vector.  
         [0153]    The Firm Space  
         [0154]    Processing of Multiple RFPs  
         [0155]    The transformation of a single RFP processed by the DPM into a Dimension Vector has been shown. In our System we are dealing with a large number of RFPs, each one generated by a portfolio management organization. Referring now to FIG. 16, the processing carried out for the totality of RFPs  36  received by the System  84  is shown.  
         [0156]    Each RFP is processed in the same way as explained above, namely, the neural network  120  of the DPM is “plugged into” the RFP  36  to produce a Dimension Vector  140 . Naturally, the RFPs  36  are identical so far as the questions are concerned because the same RFP is sent to each organization. The differences between RFPs  36  is dependent purely on the responses received.  
         [0157]    The connection scheme and the synaptic weightings of the neurons of the Data Processing module are constant as they do not change from one RFP  36  to another. The network  120  is sequentially plugged into each RFP  36  to produce a Dimension Vector  140 .  
         [0158]    The only difference between the processing of two RFPs  36  is the fact that because the responses are different, the inputs of the neurons  90  in the network  120  change from one case to another. The Dimension Vector  140  produced is therefore different for each RFP  36 .  
         [0159]    Referring again to FIG. 16, the sequential treatment of the RFPs produces n Dimension Vectors  140 . The set of n RFPs  36  received is therefore transformed into a set of n Dimension Vectors  140 .  
         [0160]    Referring now to FIG. 17, these Dimension Vectors  140  can be represented in the Dimension Matrix  150  shown.  
         [0161]    Dimension Matrix  
         [0162]    In this matrix  150 , each competing firm is displayed in rows  152  and the dimensions are presented in the columns  154 .  
         [0163]    The sub-dimensions are not displayed at this stage as they are used only for the calculation of the dimensions. It is however possible to access the sub-dimensions calculated for each RFP  36  and compare them if desired. In other words, a sub-Dimension Matrix can also be produced.  
         [0164]    The last row  152  and column  154  of tie Dimension Matrix  150  contains average values. The last column  154  concerns the average dimension value obtained for a given firm and the last row  152  contains the average value of each dimension for all the firms that have submitted their RFP  36 .  
         [0165]    Thus, the Dimension Matrix  150  provides a first insight into the analysis made by the System  84 . It allows a visual comparison between furs  82  for a given dimension. For example, one can observe the value of the dimension “Security” for each of the firms  82  in the sample. One can also compare the average value of dimensions over the sample. This type of comparison can lead to the establishment of a ranking among firms.  
         [0166]    Limitations of the Dimension Matrix  
         [0167]    The Dimension Matrix  150  is an intermediate tool. It has the advantage of presenting the results of the dimension analysis in a simple way and allows simple comparisons between competing firms.  
         [0168]    The main disadvantage of the Dimension Matrix  150  is the fact that it cannot easily capture the similarity of the firms&#39; characteristics. In fact, when the number of firms  82  is higher than 4 or 5, it is very difficult to draw a conclusion by making comparisons between the firms. In fact, one can observe easily that usually the superiority of a firm  82  in a particular dimension disappears when another dimension is considered. Therefore, ranking of the firms  82  becomes very difficult if not contradictory when all the dimensions are considered.  
         [0169]    These disadvantages are less important when the number of dimensions is small. In these cases, one can easily establish a ranking system. However, as soon as the number of dimensions are large (as is the case in the selection of managers), the ranking systems prove to be of low utility.  
         [0170]    The limitation of the Dimension Matrix  150  is due to the fact that it can not reveal all similarities or differences between the firms  82  in the sample. This is precisely the problem that is solved in our System  84 .  
         [0171]    Tie Spatial Representation of the Firms  
         [0172]    We have seen that each RFP  36  and hence each firm  82  is represented by a Dimension Vector with 10 components. At this point the notion of dimension takes its plain meaning when one considers that each firm corresponds to a point in a 10-dimensional space.  
         [0173]    Each of the components of the Dimension Vector of a firm  82  corresponds to a coordinate in this 10-dimensional space. Hence, the Dimension Vector of each firm  82  becomes the result of the 10 coordinates of this firm, the result defining the positioning of the firm in this space.  
         [0174]    Referring now to FIG. 18, a simplified version of this concept is shown in 3-dimensional space. In this simplified view, each firm  82  is characterized as a point  160  in 3 dimensions and not 10. This simplification is convenient because is it difficult to imagine spaces with dimensions greater than 3. It should be noted that FIG. 18 represents each firm  82  by a point  160  in the firm space and that some firms can agglomerate into separate “clouds” or groups  162 , also referred to as a cluster.  
         [0175]    The existence of these clusters  162  means that there are similarities between some of the firms  82  in the sample. In other words, some firms  82  are topologically close to each other whereas some others are topologically far from each other.  
         [0176]    When the sample of RFPs  36  is processed through the prism of dimensions, clusters  162  emerge, each one representing a group of similar firms  
         [0177]    The existence of clusters  162  is made possible by the representation of the RFP  36  in the space based on multiple dimensions. The Dimension Matrix  150  and, a fortiori, the RFPs  36  alone cannot reveal these clusters  162 .  
         [0178]    The problem of qualifying portfolio management firm  82  is made easier and especially more rational by considering these clusters  162 . The method  10  of the invention therefore has the following three steps:  
         [0179]    (1) mapping competing firms  82  into multidimensional space;  
         [0180]    (2) detection of the groups  162  in the multi-dimensional space (these groups corresponding to similar firms), and  
         [0181]    (3) characterization or “labelling” of each group  162 .  
         [0182]    Once a group  162  is detected, it is given a label in order to differentiate it from other groups. This label describes the characteristics of the firms  82  which are members of this cluster  162 .  
         [0183]    Once these three steps are executed, the choice of the portfolio managers or firms  82  can be based on various strategic criteria. The important point is that the detection of groups  162  and their labelling lead to a choice based on a better knowledge of the firms&#39; sample.  
         [0184]    Detection of Clusters  
         [0185]    The difficulty of the detection arises from the fact that visual treatment such as shown in FIG. 18 is not possible. In fact, in this figure, a 3-dimensional space is represented. Unfortunately, one cannot clearly represent a space with a number of dimension higher than 3 and, as already mentioned, the firm space is multi dimensional, involving 10 or more dimensions. Therefore, visual detection of the clusters  162  in this case is not possible.  
         [0186]    This problem is solved using mathematical techniques which involve “projecting” a 10-dimensional space on a 2-dimensional space. We have chosen to use one of these methods called the Principal Component Analysis or PCA.  
         [0187]    Principal Component Analysis  
         [0188]    Referring now to FIG. 19, a simplified explanation of the PCA method is provided. We can observe on this figure our original firms space. Once more, this space is represented as a 3-dimensional space for simplification. The PCA method defines a plane that we call the Feature Map  170 . Each point  172  representing a firm is then orthogonally projected on the Feature Map  170 . Of course, this projection is carried out with loss of information. Points  172  that are originally far away from each other may find themselves close to each other on the Feature Map  170 . However, the PCA method tries to resolve best orientation of the Feature Map  170  so that this loss of information is minimized.  
         [0189]    Mathematically, the PCA tries to maximize the statistical dispersion of the points  172  after their projection. This statistical dispersion is also called the statistical inertia of the points  172 . This means that if the dispersion of the points  172  is preserved, one can assume that the loss of information which is unavoidable in a projection is minimized.  
         [0190]    The calculation of the orientation of the projection plan is based on the Eigenvalues of the covariance matrix of the firms&#39; points in the 10-dimensional space. The PCA is a well known methodology and more ample information about it can be found in the scientific literature.  
         [0191]    Referring now to FIG. 20, once the Feature Map  170  is defined, the firms  82  are projected on it as shown. Therefore, the firms  82  are now presented in 2-dimensional space (a plane) and the visual detection of groups  162  is now possible.  
         [0192]    However, a new problem arises at this stage. The horizontal and the vertical axis of the Feature Map  170  are combinations of the 10 original dimensions (this combination which is linear is calculated by the PCA). Therefore, it is not easy to express the significance of the axes referred to as meta-dimensions. The problem now is the characterization of the groups  162  that are detected on the Feature Map  170 .  
         [0193]    Labeling of the Feature Map  
         [0194]    There ale two principal ways of handling this problem:  
         [0195]    Centroid Method  
         [0196]    In this method, the sample contains firms that are well known to the Sponsor  80 . When one of these firms  82  is a member of a group  162  on the Feature Map  170 , we call it a centroid. As the firms  82  in a same group  162  are similar to each other, we will characterize the whole group by its centroid which is well known. In other words, a group  162  is labelled by one of its known members.  
         [0197]    This method, although very simple, bas an important caveat. Clearly, its success depends on several conditions. First, well known firms  82  must be among the sample. Second, each group  162  must contain one of these firms  82 . This second condition is not required of the method of the invention.  
         [0198]    Correlation Circle  
         [0199]    This method starts with the consideration that each meta-dimension is a linear combination of the original dimensions. For each of these dimensions, we have the values taken by each film  82  (a column in the Dimension Matrix  150 ). For each meta-dimension, the values taken by each firm  82  is also available (calculated by the PCA method). The correlation circle method involves the calculation of the correlation coefficient between these two sets of values.  
         [0200]    If the correlation between a dimension, say “Security”, is high and positive with the meta-dimension 1, then it is clear that a high value of meta-dimension 1 means high Security. If the correlation between, for example Transparency, is high and negative with meta-dimension 2, then a high value of meta-dimension 2 means low Transpancy, and so forth.  
         [0201]    The result of these calculations can best be represented on a circle, called the correlation circle. Referring now to FIG. 21, an example of a correlation circle  180  is shown. The correlation coefficient resolves to between −1 and +1. Therefore, the correlation of each dimension with meta-dimension 1 and 2 can be described by a point in the correlation circle  180 .  
         [0202]    The closest a point to the border of the circle  180 , the better. In fact, when a dimension is close to a boundary of the circle  180 , its correlation with the two meta-dimensions is close to +1 or −1, hence having a high significance. On the contrary, those dimensions which are placed close to the center of the circle  180  have low correlation with the meta-dimensions and have little influence on the meta-dimensions.  
         [0203]    Referring now to FIG. 22, another correlation circle  180  is shown. In this example, dimensions “Non conflict of interest” and “Transparency” show high positive correlation with meta-dimension 1. The dimensions “Perennity”, “Security”, and “Professionalism of PM” have a negative correlation with meta-dimension 1.  
         [0204]    Positive correlation is observed with meta-dimension 2 for “Performance” and “Historic Success” and negative correlation with “Cost” and “Professionalism of Organization”.  
         [0205]    In this example, the correlation circle  180  can be described by four regions named A, B, C and D. Each region is defined by the correlation of dimension with meta-dimensions. For example, the region A is characterized by high “non conflict of interest” and “transparency” but low “Security”, “Perennity” and “Professionalism of PM”.  
         [0206]    The Feature Map  
         [0207]    The regions A-D defined by the correlation circle  180  can be placed on the Feature Map  170 . In this way, we now have a map which, like a geographical map, presents regions with characteristic properties.  
         [0208]    The firms  82  that are placed on this map can now be described by the characteristics of the regions in which they appear. Referring now to FIG. 23, an illustration of the labelling process is shown. It is important to note that thanks to the correlation circle  180 , the properties of the regions A-D and hence those of the competing firms are expressed in terms of the dimensions.  
         [0209]    Referring now to FIG. 24 an example of a labelled feature map  170  is shown.  
         [0210]    Referring now to FIG. 25, the whole process described in the previous pages is summarized. The RFPs, which are long lists of responses, are transformed into a map on which each firm appears. These firms may then be described by the properties of the regions to which they belong. Because this description is expressed in terms of dimensions, the choice to be made is much easier than the examination of the RFPs.  
         [0211]    Quality of the Feature Map  
         [0212]    Referring again to FIG. 24, the Feature Map  170  is the most useful when the projection of the dimensions leads to a number of distinct clusters  162  as the latter define well separated groups. Moreover, this also means that the firms in the same group are similar to each other.  
         [0213]    On the contrary, if the Feature Map  170  displays clusters  162  with no clear borders between them, the choice of the firms  82  by the sponsor  80  is less efficient.  
         [0214]    The separation of clusters  162  on the Feature Map  170  is warranted by the existence of such clusters in the original 10-dimensional space and a good projection of these data on the Feature Map.  
         [0215]    A measure of the separation of the clusters  162  in the 10-dimensional space is the statistical inertia of the data.  
         [0216]    Learning and Plasticity  
         [0217]    As already explained, the calculation of dimensions is carried out by a neural network  120  characterized by the synaptic weightings of its neurons  90  (Data Processing Module or DPM). These weightings are essential because they define the way each response is considered in the calculation of dimensions.  
         [0218]    These weightings are determined heuristically, based upon human experience in the area of qualifying portfolio managers. However, these weightings can be modified in order to change the relative importance of responses in the dimension calculation process. Naturally, these modifications will lead to new values for the dimensions and therefore, a different Feature Map  170 .  
         [0219]    The properties of the adaptation of synaptic weightings in a neural network  120  is called plasticity. This property allows neural networks  120  to demonstrate learning abilities.  
         [0220]    In the method of the invention, the learning process can be carried out in two ways. Either it is Sponsor driven or by automatic leaning. These concepts are discussed in more detail below:  
         [0221]    Sponsor-driven: The weightings of neurons  90  in the DPM can be modified through discussions with the Sponsor  80 . The Sponsor  80  can be particularly sensitive to some aspects of the RFP. For example, he can be very interested in aspects linked with security. In this case, some related weights will be modified in order to give higher importance to these aspects. For doing so, we will set higher weightings to those questions related to these aspects. In this case, the weightings are modified heuristically. One can say that the neural network  120  is changed so as to place a particular accent on some aspects of the choice.  
         [0222]    Automatic learning: In this case, we use learning algorithms by which the neural networks weightings are adjusted automatically. The objective of the learning is set to enhance the quality of the Feature Map  170 . This quality is linked to the statistical inertia of the dimension values in the firm&#39;s space.  
         [0223]    Inertia plays the role of an optimization criteria. The learning process can be described as follows: With a original set of weightings, the overall process illustrated in FIG. 25 is carried out and the inertia of the dimensions is calculated. A learning algorithm called the “back-propagation algorithm” is then used to modify the weightings of the neural network and the process is repeated in order to calculate a new inertia.  
         [0224]    This process is carried out until the value of the inertia is stabilized and does not change. The set of the weightings obtained after this learning process is the one which optimizes the inertia of the dimensions. The “back-propagation algorithm” is very well known and a large amounts of literature can be found on this subject.  
         [0225]    Use of Kohonen Network  
         [0226]    Finally, an alternative method is useful in calculation of the Feature Map  170 . Already disclosed is the calculation of this map by PCA analysis. Another method is based on the use of a neural network  120  called the Kohonen network.  
         [0227]    Referring again to FIG. 25, the Kohonen network replaces the PCA method in the “projection” step. Dimensions are input to this network which will produce a 2-dimensional Feature Map  170 . The principal of this calculation is based as well on maximum preservation of topological relationships between the dimensions in the 10-dimensional input space. However, the Kohonen network is essentially a neural network  120  and it functions on a non-algorithmic basis  
         [0228]    In sum, the use of the Kohonen network produces basically a Feature Map  170  just as the PCA method. This map is then labelled by the correlation circle  180  in the same way as described in previous paragraphs.  
         [0229]    In an advantage of the invention, the system and method provides Sponsors the opportunity to request proposals for their mandate from a much higher number of management companies, thus increasing dramatically the efficiency and rationality of their final choice of managers.  
         [0230]    In another advantage of the invention, groups  162  of competing firms  82  with similar attributes are mapped and identified by association with other similar firms. Thus, the selection of firms meeting a Sponsor&#39;s criteria is greatly simplified.  
         [0231]    It should be noted that multiple variations and modifications are possible in the embodiments of the invention described here. Although certain illustrative embodiments of the invention have been shown and described here, a wide range of modifications, changes, and substitutions is contemplated in the foregoing disclosure. In some instances, some features of the present invention may be employed without a corresponding use of the other features. Accordingly, it is appropriate that the foregoing description be construed broadly and understood as being given by way of illustration and example only, the spirit and scope of the invention being limited only by the appended claims.