Abstract:
This invention describes a method for providing a subsequently revised input form, in which a prediction system selects at least one input form out of a number of input forms and displays them for the user to select.

Description:
[0001]    Computer systems are an important part of data acquisition by humans. On the one hand computerized data acquisition is used for documentation and storage; on the other hand further processing of the collected data is essential. If this processing is to be done completely and automatically by computer systems, it is vital to acquire data while conserving semantic meaning. 
         [0002]    For this, computer systems usually use highly structured input forms with embedded semantic information. This approach reaches its limits when applied to complex and heavily variable fields like e.g. medicine. To be able to use semantic forms in these fields, current systems are either based on tree view selection masks to find relevant forms, or on concatenated entry masks. Nevertheless, the complexity of data in these fields regularly exceeds the capacity of classic form approaches: 
         [0003]    If the masks get too extensive, the user has to spend an considerable amount of time to find the specific entry mask or position for the next data entry. On the other hand, if the forms are kept simple and user-friendly, important detail information is lost or the mask is completely insufficient for a special case. 
         [0004]    Furthermore, such an entry system cannot automatically consider individual preferences of different users. For this purpose, the system and its forms have to be customized to different needs with considerable resources of time and expert knowledge. 
         [0005]    Because of these issues, computerized documentation has to be done with loss of semantic information in many applications, using—for example—unstructured, narrative free texts. These data are not entirely process-able by computer systems and/or have to be interpreted manually with considerable effort. 
         [0006]    In summary this leads to ineffective work flows with extensive loss of time, since full computer automation is not available or very limited. 
     
    
     DESCRIPTION 
       [0007]    The aim of this invention is to provide an immediate and fast documentation of all data while upholding its semantic information. 
         [0008]    The invention refers to a method that, depending on a given situation and using methods of machine learning, predicts following documentation steps. A system of software implemented agents adapts predictions to requirements and preferences of persons or entities directly or indirectly involved in the documentation process. This information is then used to adapt a user interface, incorporating semantic information such as the entering person has faster access to relevant components in every situation. 
       Modules 
       [0009]    The system uses entry form or mask components that are referred to as Modules in the following. 
         [0010]    These Modules may contain single entry components. 
         [0011]    These Modules may represent a data structure including semantic information. 
         [0012]    These Modules may represent simple or complex documentation scenarios. 
         [0013]    These Modules may consist of system-internal or external masks. 
         [0014]    These Modules may be intended for data entry. 
         [0015]    These Modules may be intended for data visualization. 
         [0016]    These Modules may contain elements that trigger procedural command chains. 
       Entry Situation 
       [0017]    The system uses an Entry Situation that may represent a collection of Modules already filled in by the user. 
         [0018]    The Modules may be described by their corresponding resulting data. 
         [0019]    In the Entry Situation the order of already filled in Modules may be considered. 
         [0020]    In the Entry Situation the time of usage may be considered. 
         [0021]    In the Entry Situation the place of usage may be considered. 
         [0022]    In the Entry Situation the identity of participating persons and instances or the data resulting thereof may be considered. 
       Prediction System 
       [0023]    A Prediction System determines a prediction set V={v i }, i=0, . . . , n with v i εX=(M,R) based on the Entry Situation, where M is the set of Modules and R is the computed relevance of a Module. 
         [0024]    The Prediction System may store data that is relevant to predictions in a data store. 
         [0025]    The Prediction System may process Entry Situations time-delayed to the entry execution by processing Module data stored in the data store. 
         [0026]    The Prediction System may evaluate all possible Entry Situations to adjust its decision algorithm or store data as a basis for decision making. 
         [0027]    The decision algorithm of the Prediction System may use a single or a combination of the following mechanisms:
       Specifications that may be defined as a meta language   Methods of machine learning which may contain:
           Association analysis   Neural networks   Decision trees   Bayesian networks   Decision networks   Inductive logical programming   Heuristic algorithms   
               
 
         [0037]    The decision algorithm may consider data semantic of Modules and their data structures. 
       Agent System 
       [0038]    The Prediction System may delegate the situation analysis to Agents ( FIGS. 1 and 2 ). The Prediction System may use the same strategies for analysis and integration of the predictions of Agents as for its own predictions. 
         [0039]    An Agent System may consist of arbitrary many Agents. 
         [0040]    The inclusion of an Agent by the Prediction System may be dependent on the Entry Situation. 
         [0041]    An Agent may represent the interests and requirements of a person or institution concerning the documentation process. 
         [0042]    Based on the Entry Situation, an Agent determines the prediction set V={v i }, with v i εX=(M,R), where M is the set of Modules and 
         [0043]    R is the computed relevance of a Module. Every Agent may use the same methods as the Prediction System to generate its prediction. 
         [0044]    The predictions of all Agents are transferred back to the Prediction System. The Prediction System aggregates all prediction sets V i =(m i,j ,r i,j ) with j=1, . . . , n into a single prediction V=(m j ,r j ) with i−1, . . . , n where the relevance r j  results from the relevance of the predictions of Agents r i,j . Additionally, the Agent prediction may be weighted to modify their impact on relevance r j . 
         [0045]    The weighting of an Agent by the Prediction System may be computed by a learning algorithm. Here, every prediction made by an Agent caused by a change of the Entry Situation may be compared to the prediction success to increase weighting of specific Agents with more than average correct predictions, or decrease weighting of Agents with less than average predictions. 
         [0046]    The aggregated prediction is then transferred back to the querying process, usually a graphical user interface (GUI). 
       Graphical User Interface 
       [0047]    In a graphical user interface (GUI), a user can interact with Modules and, for example, enter and/or evaluate data. Modification of Module content by the user can lead to a new Entry Situation. 
         [0048]    As soon as a new Entry Situation arises, it can be send to the Prediction System, and a prediction can be made by the Prediction System for use of further Modules. 
         [0049]    Depending on this prediction, suitable Modules can be presented in such a way, that the user can select increasingly relevant modules with decreasing effort. 
         [0050]    The Prediction System, as well as the respective Agents, can determine the quality of a prediction from the successively generated and sent Entry Situations. 
       Example for an Implementation 
       [0051]    The following example describes a possible implementation for use in medical documentation. 
       Module 
       [0052]    Individual medical statements are modeled using XML schema, and a data model is designed which can store data about every fact in an XML structure. Semantic information provided by a medical nomenclature (e.g. SNOMED CT) is added within the structure. 
         [0053]    XSLT definitions are provided for flexible display of data. A visual component is defined using XAML (Microsoft WPF) for use of the module at the client-side (GUI). A code generator connects XML data model with XAML visual components programmatically. Live transfer of data and modules take place via web services. 
         [0054]    In this example, the following modules, among others, were defined, each of which represents the individual components in the framework of a colonoscopy. 
         [0000]    
       
         
               
             
               
               
             
           
               
                 TABLE 1 
               
             
             
               
                   
               
               
                 SELECTION OF RELEVANT MODULES IN THIS EXAMPLE 
               
             
          
           
               
                 MODULE 
                 DESCRIPTION 
               
               
                   
               
               
                 intestinal polyp 
                 Documentation module for finding of an intestinal 
               
               
                   
                 polyp within a colonoscopy. It documents, among 
               
               
                   
                 others, size, consistency of surface, quantity and 
               
               
                   
                 localization. 
               
               
                 polypectomy 
                 Documentation module for removal of an intestinal 
               
               
                   
                 polyp. It documents, among others, form of 
               
               
                   
                 removal, therapeutic success and recovery of 
               
               
                   
                 removed tissue. 
               
               
                 chromoendoscopy 
                 Documentation module for usage of diagnostic 
               
               
                   
                 chromoendoscopy. It documents, among others, used 
               
               
                   
                 dye and dye enhancement on applied tissue 
               
               
                 biopsy 
                 Documentation module for a biopsy. It documents, 
               
               
                   
                 among others, type of biopsy, localization and 
               
               
                   
                 questions for a pathologist. 
               
               
                 QA intestinal 
                 Documentation module for quality assurance. 
               
               
                 polyp 
               
               
                 polyposis 
                 Documentation module for polyposis syndrome 
               
               
                 syndrome 
                 diagnosis. 
               
               
                   
               
             
          
         
       
     
       Entry Situation 
       [0055]    The client forwards the current entry situation to the prediction system via a web service. The entry situation comprises the currently used module “intestinal polyp”, including its data, as well as the identification number of the user (Dr. Meier) and patient data (John Doe, born Jan. 1, 1965) such as size, gender, etc. 
       Prediction System 
       [0056]    The prediction system consults subordinate agents to generate the prediction. It determines which agents to consult on the basis of information contained in the entry situation: the user&#39;s agent, his superior&#39;s agent, the treated patient&#39;s agent, the medical controller&#39;s agent. The entry situation is transmitted to all of the aforementioned agents. 
       Agent System 
       [0057]    Each agent makes a prediction based on its data pool and algorithms, and transmits it back to the prediction system. By means of an association analysis of its data store, the User Agent determines the relevance for the user of further modules in the entry situation. Since Dr. Meier has not worked with the system yet, this agent cannot make any predictions in this example. 
         [0000]    
       
         
               
             
               
               
             
           
               
                 TABLE 2 
               
             
             
               
                   
               
               
                 AGENT LIST 
               
             
          
           
               
                 AGENT 
                 DESCRIPTION 
               
               
                   
               
               
                 Patient 
                 Specific agent of current patient John Doe. 
               
               
                   
                 With previous documentation of the patient&#39;s 
               
               
                   
                 encounters, this agent has learned the encounter 
               
               
                   
                 path via an association analysis. Among others, 
               
               
                   
                 information about about a polyposis syndrome 
               
               
                   
                 diagnosis is contained. 
               
               
                   
                 This agent learns, whenever patient John Doe&#39;s 
               
               
                   
                 encounters are documented. 
               
               
                 User 
                 Specific agent of physician Dr. Meier. 
               
               
                   
                 Mr. Meier is new in the department. This 
               
               
                   
                 documentation process is his first entry in the 
               
               
                   
                 system. 
               
               
                   
                 The agent learns when Dr. Meier enters data 
               
               
                   
                 himself. 
               
               
                 Head Physician 
                 Specific agent of head physician Dr. Mueller. 
               
               
                   
                 Dr. Mueller has worked with the system for many 
               
               
                   
                 months. His agent has integrated Dr. Mueller&#39;s 
               
               
                   
                 specific requirements and usage scenarios via an 
               
               
                   
                 association analysis and a artificial neural 
               
               
                   
                 network using the study documentation already 
               
               
                   
                 entered by him. 
               
               
                   
                 This agent learns when Dr. Mueller personally 
               
               
                   
                 enters data. 
               
               
                 Medical 
                 Common agent of medical controlling in the 
               
               
                 controller 
                 hospital. 
               
               
                   
                 Fixed specifications about documentation paths and 
               
               
                   
                 requirements are provided in the agent using an 
               
               
                   
                 XML-based meta language. Thereby defining, among 
               
               
                   
                 others, that during documentation of an intestinal 
               
               
                   
                 polyp, the documentation module “QA intestinal 
               
               
                   
                 polyp” has to be completed. 
               
               
                   
                 This common agent does not learn since the medical 
               
               
                   
                 controlling never takes part in data entry 
               
               
                   
                 directly. 
               
               
                 System agent 
                 Common system agent 
               
               
                   
                 This agent was configured with aggregated 
               
               
                   
                 information from previous documentation processes. 
               
               
                   
                 It incorporates an aggregation of the relevant 
               
               
                   
                 documentation steps by means of an association 
               
               
                   
                 analysis and an artificial neural network. 
               
               
                   
                 Additionally, fixed guidelines are included 
               
               
                   
                 specifying which module combinations are possible 
               
               
                   
                 and which are not. For example, it is ruled out, 
               
               
                   
                 that a “polypectomy” module can be followed by a 
               
               
                   
                 subordinate “chromoendoscopy” module. 
               
               
                   
                 This agent does not learn. However, it is possible 
               
               
                   
                 to further develop the learning algorithm and its 
               
               
                   
                 data pool through specific system maintenance. 
               
               
                   
               
             
          
         
       
     
         [0058]    The head physician&#39;s agent proceeds accordingly and computes its prediction: In consideration of the information from “Size of the intestinal polyp” it allocates a relevance of 0.8 for a “chromoendoscopy”, 0.1 for “biopsy” and 0.1 for “polypectomy”. 
         [0059]    The prediction of the medical controller&#39;s agent indicates that module “QA intestinal polyp” has to be filled out. 
         [0060]    The patient&#39;s agent integrates the modules for “polyposis syndrome” based on an association analysis and a neural network algorithm and its data store. 
       Feedback to the Prediction System 
       [0061]    The consulted agents send their predictions back to the prediction system. This integrates the individual predictions considering the weighting of the individual agents by means of a neural network. 
       Transfer to the Client GUI 
       [0062]    The integrated prediction is transmitted to the requester system, a GUI client. The client evaluates the prediction and adjusts its interfaces, by means of the transmitted modules, to their relevance and the additional information contained. Possible further documentation modules are displayed differently based on their relevance for the further process:
       The module with highest relevance is placed directly at the nearest documentation position. (“Chromoendoscopy”)   The two modules with the nearest lower relevance are displayed below minimized. (“Polypectomy”, “Biopsy”)   Modules whose relevance is low are displayed in the command bar of the GUI ordered by their semantic information. (“Polyposis syndrome”)   Modules that were not included in the prediction can be found by a search function with semantic support.   Compulsory modules are highlighted in a different color. (“QA intestinal polyp”)       
 
         [0068]    The user finds required user interface elements immediately, and carries on with the documentation. 
       Feedback and Learning 
       [0069]    The next entry situation is analyzed for adjustment of gents and their weighting and is sent to each agent as feedback. 
         [0070]    In this example, Dr. Meier has decided to document a biopsy. Via feedback, his agent is trained and thus later predictions for Dr. Meier modulated. Additionally, patient John Doe&#39;s agent integrates the feedback. Since owners of all other agents are only indirectly involved in the current documentation, they do not learn. 
         [0071]    Upon Dr. Meier&#39;s next entry, the prediction system will calculate the documentation of a biopsy with a higher probability. 
       GLOSSARY AND LEGEND FIG.  1   
     Performance Standard 
       [0072]    Fixed weighting criteria for a situation in an environment. 
       Sensor Element 
       [0073]    Observes processes/the situation in the environment and redirects them as impressions. 
       Decision Element 
       [0074]    Decides in favor of an action based on the impressions received. 
       Performance Element 
       [0075]    Executes an action proposed by the decision element. 
       Critic Element 
       [0076]    Supplies feedback about how successfully the agent behaves. 
       Learning Element 
       [0077]    Decides how the decision element should be adjusted, based on the feedback of the critique element, in order to make decisions more successfully. 
       Problem Generator 
       [0078]    Generates proposals of actions that procure new and informative experiences, without pretension to be instantaneously optimum.