Abstract:
A knowledge management database system and method for building such a system relies on input from various subject matter experts to review and validate the structure of the database (in terms of substantive subject matter areas included in the database, their definitions, focus) and the various items stored in the database. The review and validation renders the database as “easy to use” by a novice in the particular situation, allowing that user to easily navigate through the database system and find a response to a particular issue or problem. Such a database management system is particularly useful in a large organization, or one with rapid turnover in certain jobs, allowing a user who may be unfamiliar with various aspects of a particular issue to readily find the relevant information.

Description:
TECHNICAL FIELD  
         [0001]    The present invention relates to a methodology for building a learning organization using knowledge management in an iterative process of creating, updating and utilizing a knowledge database.  
         BACKGROUND OF THE INVENTION  
         [0002]    Organizational learning can be defined as the development of “new knowledge” or insights that have the potential to influence all elements of an organization (e.g., business, school, firm, virtually any “organized” structure that creates and utilizes information), from the individual to the organization as a whole. Knowledge management can be defined as the processing (i.e., acquisition, learning and application) of information to benefit an organization. More than just receiving and acting on information, knowledge management assumes what is gathered and learned is communicated to others. All organizations are exposed to information; it is the organization&#39;s ability to facilitate the reception, processing, storing and distributing of knowledge that provides a competitive advantage.  
           [0003]    Organizational learning is one particular “knowledge management” opportunity. Some learning is always a product of the interaction between new knowledge and the organization. In general, some organizations will be better at capturing, utilizing or benefiting from the “knowledge opportunities” than others. Information (i.e., potential knowledge) is shaped by the organization&#39;s culture. A culture can be defined in terms of internal structure, policies, routines, “ability to learn”, sense of urgency, “learning styles”, and can include external factors such as time constraints, partnerships, competitors, or new employees. Importantly, organization learning is also shaped by the quantity and quality of its existing knowledge.  
           [0004]    New knowledge or information enters the existing organization either by plan or by accident. New knowledge may be the result of interaction with others (for example, contractors, joint venture participants), research, new technologies, or some combination of these channels.  
           [0005]    In general, “knowledge management” is the process of putting information to work; to use knowledge management to improve the organization&#39;s profitability, productivity, quality and new processes (improved competitiveness), as well as to be better prepared to handle future knowledge opportunities when then come along.  
           [0006]    Information can be both expensive and difficult for an organization to manage. In day-to-day activities important information can be overlooked, insufficient information can result in missed opportunities or incomplete information can lead to decisions based on incomplete or questionable assumptions. Costs associated with successful knowledge management have their benefits. The process of knowledge creation leads to an increase in the organization&#39;s intellectual assets. Sadly, however, current practices in most organization&#39;s means that such knowledge is often left in the head of the creator where it cannot be easily shared or, worse, is easily lost. Interest in capturing this important strategic resource has added importance to the study of “knowledge management.” 
           [0007]    Various tools are being developed to aid in the process of building a knowledge management system. U.S. Pat. No. 5,355,445 issued to K. Shibao et al. on Oct. 11, 1994 discloses a knowledge-based management system and method for managing a knowledge based system which includes a primary data storage section for storing received primary data. A change registration section records and indicates if and when the primary data have been changed. A data conversion section converts the primary data into secondary data that is compatible with the knowledge base system. This system also contains a secondary data storage section which stores the secondary data, and a reasoning calculation section to access the secondary data based on a received retrieval inquiry. A knowledge management section also controls the conversion section. Specifically, the knowledge management section controls the conversion section in order to convert the primary data corresponding to the secondary data that will be accessed by the reasoning calculating section, when the recorded change data indicates that the primary data corresponding to the second data to be accessed by the reasoning calculating section have been changed.  
           [0008]    U.S. Pat. No. 5,924,072 issued to C. Havens on Jul. 13, 1999, discloses a knowledge management system which receives submitted knowledge items, maintains and provides access to the knowledge items, updates knowledge items as appropriate, prompts for and receives feedback relating to knowledge items, monitors various activity concerning knowledge items, and generates a variety of incentives to encourage desirable activities associated with knowledge items. A value may be determined for a knowledge item in accordance with a quantitative or qualitative evaluation of the usefulness, influence, or other impact of the knowledge item on the ability of users to perform their specified functions within an organization. U.S. Pat. No. 5,905,989 issued to D. Biggs on May 18, 1999 discloses a knowledge manager that relies on a hierarchical default expert system. This system includes a class hierarchical data base which may be appended without effecting the class hierarchy and which will address appended matter first (to supersede any previous knowledge in the class hierarchy data base of the system). In addition, the system&#39;s parameters of assets are appended to the system and are instantiated into objects that are then treated with an object-oriented paradigm. Thus, specific assets that are found throughout a plant may be defined as objects. These objects may be appended to the system without the proprietary information which they contain being disclosed to unauthorized personnel without them overriding, adding or deleting information to the class hierarchical database.  
           [0009]    In each illustration of prior art discussed, the validity of knowledge data is not questioned. Thus, situations may arise where the retrieved data is incomplete or, worse, incorrect.  
         SUMMARY OF THE INVENTION  
         [0010]    The need remaining in the prior art is addressed by the present invention, which relates to a methodology for building a learning organization using knowledge management in an iterative process of creating, updating and utilizing a knowledge database.  
           [0011]    In accordance with the present invention, considerable time and effort is first spent building the knowledge data base based on a logical methodology and using teams of experts in each field to study, analyze and provide editorial comment to data entered in the data base. The data base model is structured to correspond to the archetypal stages, events or processes that shape the beginning and terminal activities associated with the organized complexity of business processes. Moreover, since the general patterns and functions that define these activities are the same from culture to culture the model is designed for application across situations, conditions or locations. Further, during each step of the process of using the database, an individual may pass through a series of evaluation steps to audit each particular step in the process. Further, the process is not considered as being a “straight line”, or circular process that has an initial step and a final conclusion. Rather, the process is considered to be a “spiral” type of iterative process that is descriptive rather than prescriptive, that may be entered at any step, and the audit results of each step used to improve that step for the next user. In short, the database allows the user to move among elements of a cross-referenced but disintegrated grid structured to reflect the database subject. The system&#39;s goal is to facilitate the user&#39;s self-organizing responses to situations, regardless of the user&#39;s needs and competencies at different points in time or the issue at hand (from routine to complex). A general set of “best known method” audits appear at a concluding step to document the effort for historical, to maximize future, related knowledge management applications or, simply, to be used to re-work the process in general. 
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0012]    Referring now to the drawings,  
         [0013]    [0013]FIGS. 1A and 1B are a flowchart illustrating the utilization of a knowledge management database system, as a continuous process, in accordance with the present invention;  
         [0014]    [0014]FIG. 2 contains a more detailed diagram illustrating the flow through a selected portion of a knowledge database created in accordance with the present invention;  
         [0015]    [0015]FIG. 3 includes a table with an example of the categories included in a database system, with a breakdown of three activity areas for each category;  
         [0016]    [0016]FIG. 4 is graph illustrating the relationship between the “experience” level of the database system user and the “urgency” level of the problem/issue being researched;  
         [0017]    [0017]FIG. 5 contains a diagram illustrating an exemplary process of building a knowledge database in accordance with the present invention;  
         [0018]    [0018]FIG. 6 is an example of a page from a database built using the methodology of FIG. 5;  
         [0019]    [0019]FIG. 7 contains a summary of library products, in terms of tools, strategies and maneuvers, associated with a subset of the category listing of FIG. 3;  
         [0020]    [0020]FIG. 8 is a table illustrating the distribution of glossary terms for an exemplary database category across the three activity areas defined in FIG. 3;  
         [0021]    [0021]FIG. 9 illustrates an exemplary rating guide to be used by subject matter experts in evaluating the definition and focus of the database categories;  
         [0022]    [0022]FIG. 10 contains a form used for expert review of glossary terms in the database system;  
         [0023]    [0023]FIG. 11 illustrates an exemplary template that may be used for adding a book or article to the database system;  
         [0024]    [0024]FIG. 12 illustrates the format in which the information in FIG. 11 will be displayed to the user; and  
         [0025]    [0025]FIG. 13 illustrates an example of forms used to add “tips, tools and examples” to a database category. 
     
    
     DETAILED DESCRIPTION  
       [0026]    A preferred embodiment of the process flow for the knowledge management application of the present invention is illustrated in FIGS. 1A and 1B. As shown, the process begins with a user positing an issue or a problem (step  10 ) that requires resolution through the application of information. A protostrategy (step  12 ), developed around preliminary estimates of the issue/problem, is used to identify priorities and possible courses of action given estimates of risk, time investment and the knowledge needed/possessed (at a high level assessment) to solve the problem or address the issue. This marks the first decision point in the process (step  14 ): whether or not to go through the effort to respond to the issue/problem.  
         [0027]    Several factors (e.g., cost and time-constraints or relative priority) can result in a decision to terminate the process (“take no action,” step  16 ) at this point. Alternatively, the user may decide to generate a response based, simply, on prior experience or knowledge of the issue and ways to manage it (step  18 ). Again the user also chooses not to continue using the invention&#39;s knowledge management application letting perceptions of personal skills or experience serve as a foundation for formulating a response. As shown in FIG. 1B, action based on “prior knowledge” still brings the user to an evaluation step  20 , which can be used to assess how successful the user was in resolving the issue/problem based, in this instance, on prior knowledge.  
         [0028]    Learnings that are summarized in the evaluation can then be added to the knowledge, experience and familiarity repertoire for that issue/problem (step  22 ) and any “best known methods” (BKMs) can be updated (step  24 ) for communication to and use by others. Users acting on prior knowledge complete the evaluation step and exit the program.  
         [0029]    Referring back to FIG. 1A, there remain two other alternative paths a user may take and use the invention&#39;s knowledge management application. In the first instance, the user uses another&#39;s knowledge, (“proxy knowledge”), to develop a solution. In the second, the user delays action until the needed knowledge is personally attained. Regardless of the choice, each can result in use of the expert data base system that has been developed. Regarding the first of these alternatives (shown in response to query step  14 ), a user may determine, as part of the protostrategy, that someone else (defined as a “proxy”, as shown in step  26 ) is better suited to deal with the issue or problem. In this instance, determining to use a proxy&#39;s “subject matter expertise” provides a response to the issue/problem and, theoretically, increases the likelihood that appropriate action will be taken (step  28 ).  
         [0030]    For example, if a particular hazardous chemical has been spilled at a construction site the project manager (the original user) who needs to provide for proper hazardous waste removal, may design a protostrategy that includes use of a haz-mat specialist (a proxy) to actually deal with the problem. Returning to the flow of FIG. 1A, the proxy then becomes involved in the process and, assuming the proxy needs no additional information/knowledge, proceeds to evaluation step  20 . Before exiting and when appropriate the proxy completes their involvement with an evaluation of their effort and the addition of knowledge to the database and/or the generation of BKM&#39;s for future reference.  
         [0031]    If the proxy does not immediately have a response to the problem/issue, the proxy may still be better suited to seek out the relevant information required to formulate the response (step  30 ) by using the invention&#39;s expert-created database system. If no proxy is used, the original user also may decide to use the database to develop a response but this is at the expense of a “quick response” since the prudent user must acquire knowledge before proceeding. (step  32 ). Taking either step  30  (proxy) or step  32  (user) enters the user (or user&#39;s proxy) into the flow of the actual knowledge management database system, which will now be described in considerable detail.  
         [0032]    For the purposes of this example, it is presumed that the expert database system is a “human resources” database system, used by a large corporation, a multi-location company or any company/organization that has a relatively large number of employees and/or employee-related issues/problems. Moreover, since different individuals in the company may, at any given time, be responding to various issues, the use of the knowledge management data base system of the present invention allows for a more consistent and accurate response on the part of the database users.  
         [0033]    Referring to FIG. 1A, and as will be discussed in detail below, a knowledge management database system  40  formed in accordance with the present invention comprises four major segments. These segments include a common language segment  42 , comprised of definitions for terms associated with the problem/issue, alternative terminology related to the input terms, a glossary of terms, and the like; a tools and examples segment  44 , which may include certain “forms” used in each particular aspect of the business, series of questions that may lead the user to a solution, examples of similar issues/problems and their responses, and the like; an articles and books segment  46 , including references of interest to the subject matter at hand; and, a rules and regulations segment  48 , which may include both internal “corporate” rules and regulations, as well as local, state and federal regulations and laws that are applicable to the subject matter.  
         [0034]    Presuming that a “proxy” or user has utilized the knowledge management database system to collect additional information to form a response to the issue/problem, the user/proxy (hereinafter simply defined as the “user”) may then decide to “take action” and implement a developed strategy, based on this collected information (step  50 ). Subsequent to this step, the user then enters the evaluation process, step  20 , followed by adding to the knowledge base (step  22 ) and/or BKMs (step  24 ). As a result of the first search through database system  40 , the user may decide to “delay” taking action for a variety of reasons as illustrated in steps  52 ,  54  and  56 . These include (1) the need to acquire additional knowledge (step  52 ); (2) the need to verify that information is relevant and valid (step  54 ); or, (3) need to adapt the acquired information and build a strategy (step  56 ). In any case, the user in these “delay” examples will then re-search database  40 , as shown in FIG. 1B. Additionally, the user may decide to search a supplemental database  60 , where supplemental database  60  is still part of the original invention it is not designed to be in database  40  since it may be quite large, take a long time to search and, for most cases, not contain information that is immediately relevant for an initial database query. As shown in FIG. 1B, some of the source information contained in supplemental database  60  may be outside business services, consultants, professional associations, government agencies, and the like. It is presumed that the results of the first search database  40  will allow the user to refine the search for information on this pass, and provide the sufficient information needed to form a response to the issue/problem. A third alternative that the user may select at this point, illustrated in step  62 , is to “go it alone”, and while involving other internal/external resources the knowledge management database  60  is by-passed.  
         [0035]    Regardless of the resource used to this point, the user then assimilates all of the accumulated information to implement a strategy and “take action” (step  64 ). As with the other action steps discussed above, after the user has taken the action, the process enters the evaluation step  20 , leading the user to add to the organization&#39;s accumulated knowledge, experience and, familiarity repertoire (step  22 ) and/or to develop BKMs (step  24 ). Once all of this is accomplished, the flow reaches the ultimate conclusion and the process is exited (step  66 ).  
         [0036]    The flow through an exemplary database  40  formed in accordance with the present invention is illustrated, in terms of a diagram, in FIG. 2. In this particular illustration, as noted above, a “human resources”/HR database will be used as a concrete example to aid in understanding the details of the database system of the present invention. As shown, an exemplary HR database  40  comprises a set of  10  different categories that will be “searchable” when the user enters database  40 : staffing, compensation, benefits, training and development, environment, employee relations, organization development, separation, information management, and compliance. The user will select the category most applicable to the issue/problem at hand (or the category that seems most relevant at this time) which, in turn expand into a number of information “folders” that the user can search for more detailed the information. (It is to be understood that the “categories” and “folders”, as the other steps along the database flow, will be visible on the computer screen or other device used to retrieve the desired information).  
         [0037]    Referring back to FIG. 2, the “organization development” category has been selected, opening up a set of folders defined as “business services”, “government and compliance”, “library”, “educational services”, and “survey”. The user then determines, using his best judgment, the most likely area to research to find relevant information for the problem/issue at hand. Each folder contains an index that provides additional information regarding the types of data contained in that folder, with the content of the folders (by headings) also listed in FIG. 2. In one example, if the user was looking for training information for new hires in a secretarial pool position, the user would search through “educational services”, looking through the “trainers” index and reviewing the profiles stored in this part of the database until appropriate training information was found.  
         [0038]    [0038]FIG. 3 illustrates, in general terms, a table including a sample of the ten HR categories defined above, a “category focus” for each category, and a set of activities, processes, events, ideas, laws, sciences or conditions associated with each category, broken down into three major areas: (1) strategy and plans (who/why/what); (2) design and development (when/where/how); and (3) implementation and evaluation. This breakdown of activities into three major areas will be referred to again during the discussion of building the database, such as in determining the number of glossary items to include in each area of each category.  
         [0039]    In general, manager&#39;s are charged with making the day more productive for all workers and to do things that grow the business while reducing time spent in non-value-adding activities: for example, chasing problems or pushing bureaucracy and paperwork. The present invention&#39;s information management system helps users manage their environment by helping them accurately identify the risk in the environment, assign the proper orientation or “sense of urgency” to their problems and to develop the skills needed to take appropriate action once risk and orientations are established. The dynamic balance among these three states reflect the theoretical foundation of this invention and are described in FIG. 4.  
         [0040]    The abscissa of FIG. 4 contains three “rough” levels of worker experience or competence: “novice”, “intermediate”, and “expert”. A “novice” worker can be defined as having little technical knowledge or practical experience in a current job assignment. Such a worker may need direct, sometimes continuous, guidance or coaching. A “novice” may be unable to act alone, except on the most mundane matters. At the next level, a worker with “intermediate-level” competencies is a mixture of skills and competencies. The “intermediate” skill level worker may be capable of handling a variety of situations on his own or can learn quickly, almost on the spot, and with greater accuracy and less risk than the novice. This is due, in part, to the fact that those at the intermediate level have something to build off of, be it past experiences, education, or even a mentor.  
         [0041]    Thus, an individual with intermediate-level skills and competencies needs limited supervision, and then more of a consultative nature. By virtue of time spent in a particular assignment, an “intermediate” worker may acquire an expertise in one or more areas. Advancing beyond the intermediate level the individual moves into the highest category of worker, the “expert.” An “expert” is expected to possess the technical knowledge, know how and/or practical experience needed to address the issue/problem in question.  
         [0042]    Typically the expert is able to take a detached view, minimizing personal biases and preferences, associated with the problem under review. He is also able to synthesize and conceptualize key issues defining the matter at hand and is often able to take a “holistic” or system view of the situation. All of this makes the expert better able to perceive emerging themes associated with events, data, and another&#39;s opinions, attitudes or beliefs.  
         [0043]    Finally, experts are communicators in the truest sense of the word. They may not speak as well as others but they can transfer meaning and carry out a dialogue with other experts, including representatives of different disciplines or opinions. Importantly, the experts are prepared to admit ignorance, uncertainty or error in their own personal knowledge base.  
         [0044]    The ordinate of the graph in FIG. 4 similarly lists three separate “urgency states” (“low”, “medium” and “high”) that reflect orientations a manager can assign or take to problems or issues faced. A manager might assign a “low urgency” rating (rightly or wrongly) to an issue when the time or money resources are low, the issue is just seen as a low priority and/or the manager believes someone else should handle the issue (“It&#39;s not my problem!”). Responding to a problem with a “moderate” sense of urgency might reflect an orientation defined by available resources, the desire to act but the sense someone else might be better qualified or it&#39;s a “relatively important” issue—something that merits attention.  
         [0045]    Lastly, shaping an orientation to respond around a “high” sense of urgency implies that the issue, often in and of itself, is perceived as one of great, immediate importance. The rating may be mis-assigned, however, especially by one with limited experience or one with, for example, a bias for this type of issue. As in the case of someone who is particularly skilled at handling the issue so, in this instance, the sense of urgency is “inflated” vis a vis the costs of inaction or a poor response. On average, however, recognizing something as meriting a “high sense of urgency” is reserved for situations demanding an emphasis on action—something needs to be done right away and if the worker does not know how to do it, someone will be found to help. The minimal contribution of the knowledge management database system of the present invention is linked to its use as a means for augmenting, supplementing and/or improving on the resources currently available in an organization. More significant are the contributions to the user. Users can improve skills and competencies needed to manage a given issue, to identify the risk associated with a situation and, to better assess the orientation or “sense of urgency” that is most appropriate to respond to a situation.  
         [0046]    As mentioned above, a significant aspect of the present invention relates to the creation of the knowledge management database, and in particular, the use of expert review of each item that is compiled, catalogued and added to the database system. FIG. 5 illustrates, in a general flowchart, the steps involved in building an exemplary expert database in accordance with the present invention. The first step (step  70  in FIG. 5) is to design the information needs for the particular database being constructed. Identifying the database&#39;s information needs influences the user&#39;s information acquisition strategies, processing/learning styles and knowledge management practices. During this step, a set of task flow lists are developed for data base products: (1) information tools and their content (i.e., the distribution of content in terms of strategy and planning, design and development; implementation, operation and evaluation tools; (2) glossary content (similar boundaries); and (3) general library content.  
         [0047]    Once the task flow lists for tool, glossary and library content have been developed, the database building process moves on to the “information generation” step (denoted as step  72  in FIG. 5). Various methods may be used to generate the initial, “raw” information that may ultimately be included in the database. For example, field data from surveys and reviews of the pertinent literature may be gathered as may published data and reviews from select articles, books, and government documents. These are primary research channels for the database. “Secondary channels” also are available, including reports from professional meetings or from professional associations or trade associations.  
         [0048]    Where applicable, an organization&#39;s own proprietary data also can be incorporated into the database. This, as well as information from “external resources” such as affiliates, government sites and educational services helps “personalize” the database for an organization should that be part of their information management strategy.  
         [0049]    Once all of the “raw” data is collected, it may be compiled and cataloged according to various formats, with one format used for “field data”, another for “second channels”, and a third for “published, proprietary or solicited data”. Importantly, collection and compilation of information is completed by subject matter experts (step  74 ), using established protocols and agreed-upon procedures each designed to use and manage information that can facilitate learning. Moreover, the resulting compilation can be rendered as a micro-set of protocols for the “tools,” the “glossary,” and the “library”.  
         [0050]    With the various rules and protocols established, raw data are then catalogued (step  76 ), again using a set of defined procedures. Information is catalogued using a template that prescribes the distribution of the “tools,” a content specific “glossary” and, finally, the make-up of the “library” across predetermined subject categories that correspond to the resource field (in this case Human Resources) being used.  
         [0051]    The information is then prepared for the knowledge management process, step  78 . In this step, the information is added to the database by category with relevant cross-referencing across other categories and information. This is an important, needed step to maximize the user&#39;s ability to search the database.  
         [0052]    Once the database is populated with the information, validity and reliability testing is required (step  80 ), using a set of pre-defined validity and reliability testing procedures, forms and materials. The result of this testing produces a set of statistics rating the database&#39;s overall quality. If evaluation ratings are sufficiently high the information may be approved for addition to the database for use.  
         [0053]    In general, various distribution channels may be used for the created database system. One channel would comprise a world wide web version, available through an external data link. This arrangement would allow for links to other external databases or sources of information to be included in the database. Alternatively, an organization may elect to utilize an “intranet” version of the database personalized for that organization and only accessible by those affiliated with the organization.  
         [0054]    [0054]FIG. 6 illustrates an exemplary page from an “HR” database built using the above-described process of the present invention. This particular page is associated with the category of “staffing” and includes a “category focus,” allowing the user to double-check that this particular category is indeed relevant to the current issue/problem. In this illustration elements of the glossary related to the “staffing category” are presented along with a more detailed description of the category&#39;s scope.  
         [0055]    A summary of the library products in terms of tools, strategies and maneuvers, and forms associated with a subset of the above-defined database categories is shown in FIG. 7. For each category, a listing of library products is included. These products are broken down into three different subsets: (1) tools and tips (best known methods for getting things done); (2) strategies, plans and maneuvers (building a knowledge management approach to problems or issues); and (3) guides, examples or illustrations for common business needs.  
         [0056]    A useful measure of the completeness of the database system can be determined by evaluating the “current” number of glossary terms in a category relative to the “minimum” number of terms that were pre-defined as being required. FIG. 8 illustrates a table associated with this concept. In particular, it has been found through separate analysis that approximately 40% of the total number of glossary terms should be found in the area of “strategy and planning”, 30% of the total in the area of “design and development”, and the remaining 30% in the area of implementation and evaluation. Thus, with 70% of the glossary terms associated with the “up front” elements of dealing with an issue or problem, the database is more likely to have the information required to provide an adequate response to the user.  
         [0057]    As mentioned above, a significant aspect of the present invention is the process of utilizing a substantial amount of expert critiquing of the database structure and data items during the building process. In particular, various subject matter experts are used to review and evaluate each aspect of the database, thus improving the accuracy and reliability of both the data items and search results. In contrast, many knowledge management systems of the prior art allow for the users to self-enter information to the database, where this information may not always be accurate and may, in fact, give the wrong results during subsequent use of the knowledge management system. FIG. 9 illustrates an exemplary rating guide that may be used in accordance with the present invention. This particular sample is also associated with the HR example discussed above, and includes a partial listing of the  10  categories and the “focus” defined for each category.  
         [0058]    During review by an expert in the field, each category and its focus are reviewed and assessed. This particular grid uses a set of four rankings for each category and focus: “very good”, “good”, “poor”, and “very poor”. The definitions given here are exemplary only, and other standards for ranking may also be used (such as a scale from 1-5, 1 being the poorest quality and 5 the best). Having a number of different experts review and evaluate the 10 categories enables the builder of the database to refine and modify (if necessary) category content and/or focus. This, in turn, helps improve the database&#39;s accuracy and reliability and, importantly, the database organization—a significant feature needed for users interested in searching the database.  
         [0059]    Similarly, it is also important that for category glossary items to be useful they must be properly defined and have sufficient clarity. Again, a set of proper subject matter experts may be used to review and provide feedback on the glossary terms and definitions gathered from the raw data. FIG. 10 illustrates a rating form that may be used for the expert review of glossary items associated with the category of “separation”. In this example, each glossary item definition is evaluated in terms of “accuracy”, “clarity”, and “appropriateness”, using (in this particular example) a ranking between “10” and “1” (a “10” being the best rank and “1” the worst). The database builder can then use this information to modify any definitions, particularly if a large number of reviewing experts consistently give a particular item a low ranking.  
         [0060]    [0060]FIG. 11 illustrates an exemplary template that may be used for adding an article or book to the database. The use of a common template will allow for database users to consistently find relevant information, presented in a systematic manner throughout the database. Besides requiring the bibliographical information, the template includes a set of (in this example) nine commentaries, allowing the reviewer to add substantive information to the bibliographic data. There is also a space for an “example” from the article/book, if appropriate.  
         [0061]    [0061]FIG. 12 illustrates the format in which this information will be displayed to the user of the database system. FIG. 13 includes an exemplary format for adding “tips, tools and examples” to a database category, in this case, the “staffing” category. The worksheet is divided into the three issue/problem areas of “strategy and planning”, “design and development”, and “implementation and evaluation”. Representative questions and objects may be proposed for the process steps associated with each category, as shown.  
         [0062]    In summary, the inventive knowledge management application, program and database is a system that provides information related to situations particular to an organization, or one aspect of an organization. The example discussed above in terms of an “HR” database for use by a company is considered to be exemplary only, and used to describe the mechanics of the system, not to limit the substantive elements of the system. From the user&#39;s point of view, the system allows for those of various skill and knowledge levels to find relevant information for the issue/problem at hand. Indeed, a virtual encyclopedia of knowledge and information, as well as a directory of business and professional resources is put at everyone&#39;s fingertips, resulting in an more efficient managing of the day-to-day business and working environments.