Abstract:
A system and method for automatically setting image viewing context. The system and method perform the steps of extracting image references and body parts associated with the image references from a report, mapping each of the body parts to an image viewing context so that image references associated are also associated with the image viewing context, receiving a user selection indicating an image to be viewed, determining whether the user selection is one of the image references associated with the image viewing context and displaying the image of the user selection

Description:
BACKGROUND 
       [0001]    Radiologists must routinely work with an increasing number of studies to diagnose and treat patients in an optimal manner. Patients, especially ones with cancers, frequently undergo imaging exams and over time accumulate many studies and reports in their medical records. Each time a new study needs to be read, the radiologist would typically open one or more prior reports to understand the status of the patient&#39;s findings and establish clinical context. Oftentimes, in the report text, the findings are associated with reference to images along with the body part or anatomy in which the finding is located. The report may include text such as, for example, “partially calcified right heart border reference lesion measures 2.4×1.6 cm (series 11 image 65).” Generally, findings on the image references are best viewed in a setting corresponding to the anatomy. According to the above example, the findings in the referenced image may best be viewed in the image setting for window width/level of the mediastinum. 
         [0002]    When a radiologist or other user wants to look at images of a prior study to better understand the progression of a finding, the radiologist may first open the prior study, open the series of interest (e.g., series 11), navigate to the corresponding image slice (e.g., image 65), and then set the image viewing context (e.g., window width/level corresponding to the anatomy). Manually setting each image view context is a time consuming and inefficient process which may prevent users from navigating to referenced images, resulting in a possible compromise in quality. 
       SUMMARY OF THE INVENTION 
       [0003]    A method for automatically setting image viewing context. The method including extracting image references and body parts associated with the image references from a report, mapping each of the body parts to an image viewing context so that image references associated are also associated with the image viewing context, receiving a user selection indicating an image to be viewed, determining whether the user selection is one of the image references associated with the image viewing context and displaying the image of the user selection. 
         [0004]    A system for automatically setting image viewing context. The system including a memory storing a set of instructions, a processor executing the instructions which case the processor to perform operations, including extracting image references and body parts associated with the image references from a report and mapping each of the body parts to an image viewing context so that image references associated are also associated with the image viewing context, a user interface receiving a user selection indicating an image to be viewed, the processor determining whether the user selection is one of the image references associated with the image viewing context and a display displaying the image of the user selection. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0005]      FIG. 1  shows a schematic drawing of a system according to an exemplary embodiment. 
           [0006]      FIG. 2  shows a flow diagram of a method according to an exemplary embodiment. 
           [0007]      FIG. 3  shows a table of associations between image references and body parts according to an exemplary embodiment. 
       
    
    
     DETAILED DESCRIPTION 
       [0008]    The exemplary embodiments may be further understood with reference to the following description and the appended drawings, wherein like elements are referred to with the same reference numerals. The exemplary embodiments relate to a system and method for reviewing a medical image. In particular, the exemplary embodiments describe a system and method for extracting imaging context information from free-text radiology reports and applying the imaging context information to an associated image so that a user is not required to manually set the image viewing context (e.g., a window width/level in which the associated image is to be viewed). Automatically setting image viewing context based on extracted information facilitates workflow automation and eliminates unnecessary trivial tasks currently performed by the radiologist. Although the exemplary embodiments are specifically described in regard to reviewing images of cancer patients within a radiology department, it will be understood by those of skill in the art that the system and method of the present disclosure may be utilized for patients having any of a variety of diseases or conditions within any of a variety of hospital departments. 
         [0009]    It is noted that the exemplary embodiments are described with reference to sentences. However, those skilled in the art will understand that the same principles and functionalities described herein may be applied to text structures that have more or less context than a sentence. For example, the exemplary embodiments may be applied to a text structure that has less context such as a phrase or a text structure that has more context such as the entirety of a multi-sentence paragraph (e.g., a paragraph that is not broken into its constituent sentences). 
         [0010]    As shown in  FIG. 1 , a system  100  according to an exemplary embodiment of the present disclosure extracts body part/anatomy information from a report to automatically set image viewing context for an associated image. The system  100  comprises a processor  102 , a user interface  104 , a display  106  and a memory  108 . The processor  102  includes a Natural Language Processing (NLP) module  110  that extracts the most specific body part/anatomy surrounding an image reference in a text report of a patient stored in the memory  108 . The processor  102  also includes a control module  112  which, when the user selects an image to view on the display  106 , determines whether the selected image is associated with a body part/anatomy extracted by the NLP module  110 . Based on the extracted image information, the processor  102  can automatically select a window width/level in which a finding (e.g., mass) in the image should be viewed. The window/width level may be selected from, for example, a look-up table  114  stored in the memory  108  which maps body parts/anatomy to window width/level settings. Thus, a user-selected image is automatically displayed on the display  106  using the window width/level settings mapped to the body part/anatomy extracted from the report in association with the selected image. It will be understood by those of skill in the art that the memory  108  may be any computer-readable storage medium. User selections may be made via the user interface  104 , which may include input devices such as, for example, a keyboard, mouse and/or touch display on the display  106 . It will be understood by those of skill in the art that the system  100  may be a personal computer, a server or any other known processing arrangement. 
         [0011]    Furthermore, the exemplary system  100  relates to the display of an image and particularly, to the display of a selected image using optimal display settings (e.g., image viewing context) determined by the processor  102 . These display settings can be transmitted to the display  106  and can be used to control the display operation of the system  100 . It will be understood by those of skill in the art that the display  106 , which displays the selected image, can be implemented in part or as a whole as a subsystem of the system  100 . 
         [0012]      FIG. 2  shows a method  200  via which the system  100  extracts image references from narrative text reports to automatically set an image viewing context (e.g., window width/level). In a step  210 , the NLP module  110  extracts image references and body parts/anatomy associated with the image references from a narrative report. The NLP module  110  may analyze the report to identify sections, paragraphs and sentences therein. Once the sentences have been identified, image references may be extracted from each sentence. For example, the NLP module will extract series=11 and image=79 from the sentence “The left hepatic reference lesion (series number 11, image number 79) measure approximately 6.4×5.4 cm.” The NLP module  110  may then extract the body part that the image reference refers to from a surrounding area within the report (e.g., the same sentence and/or a header of the anatomical subsection). In the above example, the NLP module  110  would recognize the term “hepatic region” and would thus associate the image reference (e.g., image 79 in series 11) to the liver. 
         [0013]    In a step  220 , the processor  102  looks up the extracted body parts in the look-up table  114  so that the extracted image reference associated with each of the extracted body parts is also associated with a corresponding image viewing context (e.g., window width/level). The look-up table  114  may also map the body parts to image viewing context based on a modality (e.g., CT, MRI, X-ray) of the image. For example, a window width/level for the same body part may be different for a CT image and an MRI image.  FIG. 3  shows a table of examples of different ways in which image references may be associated with body parts and image viewing context. It will be understood by those of skill in the art that  FIG. 3  is exemplary only and does not show a comprehensive list of all possible body part/image viewing context combinations. Using the above example in which image 79 in series 11 is associated with the liver, the processor  102  may look up the liver in the look-up table  114  to determine the window width/level (e.g., 200/50) to which it is mapped. Image 79 in series 11 is then associated with the window width/level 200/500 so that when this particular image is selected to be viewed, the image is automatically displayed using these display settings. The processor  102  will attempt to map the most specific body part in the look-up table  114 . However, where a body part is not mapped in the look-up table  114 , the processor  102  will automatically map to a more general part of the body. For example, where the NLP module  110  has extracted the bowel as the body part associated with an image reference, but the bowel is not mapped in the look-up table  114 , the processor  102  will automatically look-up the body part of the abdomen, in which the liver is located. The image references and associated body parts and image viewing context may be stored to the memory  108  so that the image references and their associated content may be quickly and easily accessed. 
         [0014]    In a step  230 , the user selects an image to be viewed from the report via the user interface  104 . In a step  240 , control module  112  determines whether the selected image is one that is associated with an image viewing context based on the extracted body parts in step  210 . For cases in which the selected image is one that is associated with corresponding image viewing context, the method  200  may proceed to a step  250  in which the selected image is displayed on the display  106  using the associated image viewing context. For example, where the user has selected image 79 in series 11 for viewing, the image is displayed using window width/level 200/50. For cases in which the selected image is not associated with corresponding image viewing context, the method  200  proceeds to a step  260  in which the selected image is displayed on the display  106  using default settings. The default setting may be, for example, predetermined window width/level values. In another example, the default setting may be determined by whether a key image has been identified in the study and setting the default image viewing context to correspond to a body part shown in the key image. A key image is an image noted by a radiologist or other user as being of particular relevance or importance within the clinical context of the patient. It will be understood by those of skill in the art that the user may adjust the default setting, as desired. It will also be understood by those of skill in the art that the default setting may automatically adjust to correspond to a body part extracted from surrounding image references within the report. 
         [0015]    In a further embodiment, once the selected image has been displayed, the user may update the image viewing context of the displayed image, as desired, via the user interface  104 . For example, the user may override the automatically set window width/level and adjust the view settings according to his/her preference. The updated image viewing context may be stored to the memory  108  so that the image reference is now associated with the updated image viewing context. It will be understood by those of skill in the art, however, that this is not a required step. Image viewing context preferences may be user-specific so that the updated image viewing context may be stored to specific user profiles. 
         [0016]    It is noted that the claims may include reference signs/numerals in accordance with PCT Rule 6.2(b). However, the present claims should not be considered to be limited to the exemplary embodiments corresponding to the reference signs/numerals. 
         [0017]    Those skilled in the art will understand that the above-described exemplary embodiments may be implemented in any number of manners, including, as a separate software module, as a combination of hardware and software, etc. For example the NLP module  110  and the control module  112  may be programs containing lines of code that, when compiled, may be executed on a processor. 
         [0018]    It will be apparent to those skilled in the art that various modifications may be made to the disclosed exemplary embodiment and methods and alternatives without departing from the spirit or scope of the disclosure. Thus, it is intended that the present disclosure cover the modifications and variations provided that they come within the scope of the appended claims and their equivalents.