Patent ID: 12205709

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, a preferred embodiment of the present invention will be described in accordance with the appended drawings.

Summary of Medical Image Processing System

FIG.1is a block diagram illustrating a summary of a configuration and an operation of a medical image processing system10according to the embodiment. The medical image processing system10includes a medical information system20constructed inside each medical institution of a plurality of medical institutions and a central processing server30installed on a network outside the medical institutions. The description of “medical institution1”, “medical institution2”, . . . , “medical institution N” illustrated inFIG.1represents that N medical institutions are present. For example, the medical institution is a hospital, a clinic, a medical research center, or a medical check-up center.

The medical information system20of each medical institution includes one or more utilization terminals22, an image processing distributor24, a medical institution internal image processing server25, and an image management server26. The utilization terminal22is a terminal with which a medical image processing service provided using the medical institution internal image processing server25and the central processing server30can be utilized. Client software for utilizing functions of a medical image processing server group including the medical institution internal image processing server25and the central processing server30is constructed in the utilization terminal22.

Here, the utilization terminal22refers to a calculation resource present in a network in which data inside the medical institution can be safely accessed. The terminal may not be physically present inside the medical institution. The utilization terminal22may be a workstation, a personal computer, a tablet terminal, or the like. In addition, the “client software” may be software with which a medical image processing server cluster can be utilized, regardless of a form thereof. The client software may be a dedicated application or a general-purpose web browser or the like. For example, the utilization terminal22may be an interpretation terminal such as a medical image viewer. It is preferable that the medical information system20is configured to include a plurality of utilization terminals22. The utilization terminal22is an example of a “terminal” according to the embodiment of the present disclosure.

The image processing distributor24includes a processing reception portion241, a waiting time calculation portion242, and a processing distribution portion244. The image processing distributor24receives a request to perform image processing on a medical image from the utilization terminal22, calculates a processing waiting time of each of the medical institution internal image processing server25and the central processing server30, and decides a transmission destination of a processing request by determining which server performs processing earlier (has a shorter processing waiting time). In addition, the image processing distributor24acquires a processing target image from the image management server26as needed and transmits the processing target image to the medical institution internal image processing server25or to the central processing server30. A function (image processing distribution function) of the image processing distributor24will be described in detail later.

The image processing distributor24may be an environment in which software providing the image processing distribution function operates, regardless of a form of a server in which the software is loaded. The software is synonymous with a program.

An image processing program for processing the medical image is constructed on each server of the medical institution internal image processing server25of each medical institution and the central processing server30. Each server may be an environment in which the image processing program operates, and may be a physical machine or a virtual machine. The image processing program loaded into the medical institution internal image processing server25and the image processing program loaded into the central processing server30may be server programs providing the same medical image processing service.

The medical institution internal image processing server25is a server that may be exclusively used by the medical institution for each medical institution, and is installed inside a facility of the medical institution. The medical institution internal image processing server25includes a processing reception portion251and an image processing portion252, receives the processing request transmitted from the image processing distributor24, and performs the image processing on a target medical image in accordance with the received processing request. The processing reception portion251includes a waiting matrix (queue) in which the received processing request is queued.

The image processing portion252may include a processing module that performs a plurality of types of image processing. The description of “image processing A” and “image processing B” inFIG.1represents processing modules that perform different types of image processing. The medical institution internal image processing server25is an example of a “first server” according to the embodiment of the present disclosure.

The central processing server30is a server that is shared and used by the plurality of medical institutions. The central processing server30is installed on the network (for example, on the cloud) outside the medical institutions. The central processing server30includes a processing reception portion301and an image processing portion302like the medical institution internal image processing server25. The central processing server30receives the processing request transmitted from the image processing distributor24of each medical institution, performs the image processing on the target medical image in accordance with the received processing request, and outputs a processing result. The central processing server30is an example of a “second server” according to the embodiment of the present disclosure.

That is, the medical image processing system10provides the medical image processing service via a hybrid configuration in which the on-premises medical institution internal image processing server25and the central processing server30on the cloud are combined. Here, the on-premises means an apparatus installed inside each medical institution. On the other hand, the cloud means arrangement on a network for utilization from the plurality of medical institutions.

The image management server26is a server for storing the medical image. The processing result of the image processing by the medical institution internal image processing server25or by the central processing server30may be transmitted to the image management server26inside the medical institution of a processing request source and may be stored in the image management server26by linking the processing result to the processing target image.

Description of Medical Image Processing Method

The operation of the medical image processing system10will be schematically described using a flow of Procedure [1] to Procedure [10] illustrated inFIG.1as an example.

Procedure [1]: First, the processing request for the medical image is transmitted from the utilization terminal22inside the medical institution toward the processing reception portion241of the image processing distributor24. The processing request includes information for specifying the processing target image and information for providing an instruction for the content of processing.

Procedure [2]: The processing reception portion241of the image processing distributor24receives the processing request from the utilization terminal22and transmits received information to the waiting time calculation portion242.

Procedure [3]: The waiting time calculation portion242calculates a waiting time for the processing. At this point, the waiting time calculation portion242may calculate the waiting time after the processing request for the medical image is actually received, that is, after a need to calculate the waiting time occurs, or, for example, may periodically calculate the waiting time in advance even in a case where the actual processing request is not received.

The waiting time calculation portion242calculates each of the waiting time in a case of performing the processing using the medical institution internal image processing server25and the waiting time in a case of performing the processing using the central processing server30. At this point, it is desirable that a required time required for executing the image processing on each medical image is not a fixed value and, for example, can be set such that the required time is increased in proportion to a file size of the processing target image. In addition, since a time required to transmit and receive the processing target image dynamically changes in accordance with a network connecting situation of each medical institution, a program for measuring the required time by actually transmitting and receiving the image is operated in the background to periodically obtain a time required for the image processing. A specific example of a calculation flow in the waiting time calculation portion242will be described later (FIG.2andFIG.3).

In addition, the waiting time obtained by the waiting time calculation portion242may be displayed on the utilization terminal22or the like so that a utilizer perceives how long the waiting time is.

Procedure [4]: A calculation result of the waiting time calculation portion242is transmitted to the processing distribution portion244. The processing distribution portion244decides the transmission destination of the processing request by determining whether to perform the processing in the medical institution internal image processing server25or perform the processing in the central processing server30based on the calculation result of the waiting time calculation portion242.

Procedure [5]: As a result of calculating the waiting time, in a case where performing the processing in the medical institution internal image processing server25completes the processing earlier, the processing distribution portion244transmits the processing request to the medical institution internal image processing server25.

Procedure [6]: In a case where the processing request is received from the processing distribution portion244, the processing reception portion251of the medical institution internal image processing server25causes the image processing portion252to execute the image processing. The image processing portion252starts the image processing in accordance with an instruction from the processing reception portion251. In a case where an input image (processing target image) necessary for the processing needs to be acquired, the medical institution internal image processing server25acquires the processing target image from the image management server26. In a case where the processing target image is stored in a cache of the medical institution internal image processing server25, the acquisition of the image from the image management server26is not necessary.

Procedure [7]: The image processing portion252executes the image processing corresponding to the processing request and stores the processing result in the image management server26. The processing result may be an image (processing result image) obtained by the image processing, information other than an image, or a combination thereof. Examples of the information other than the image include classification information, labeling information, positional information of a region of interest, or a candidate of a medical opinion corresponding to the medical image.

Here, in a case where a plurality of types of processing A-1, A-2, . . . , A-n need to be internally executed in order to output a result of a certain processing request A received in Procedure [1], the calculation of the waiting time and the determination of to which of the medical institution internal image processing server25or the central processing server30the processing request is transmitted may be performed for each of the plurality of types of processing A-1, A-2, . . . , A-n. For example, the waiting time of each of the n types of processing A-1, A-2, . . . , A-n may be calculated, and a determination may be made such that in a case where a result indicating that transmission to the central processing server30finishes the processing earlier is obtained for at least a majority of n, the processing request A is transmitted to the central processing server30, and conversely, in a case where a result indicating that transmission to the medical institution internal image processing server25finishes the processing earlier is obtained for at least a majority, the processing request A is transmitted to the medical institution internal image processing server25.

On the other hand, as a result of calculating the waiting time in the waiting time calculation portion242, in a case where performing the processing in the central processing server30completes the processing earlier based on the determination in Procedure [4], Procedures [8] to [10] are applied instead of Procedures [5] to [7].

Procedure [8]: As a result of calculating the waiting time, in a case where performing the processing in the central processing server30completes the processing earlier, the processing distribution portion244transmits the processing request to the central processing server30. At this point, in a case where the processing target image needs to be transmitted to the central processing server30, the processing distribution portion244acquires the processing target image from the image management server26as needed and transmits the processing request to the central processing server30together with the processing target image. In a case where the processing target image is stored in a cache of the central processing server30, the transmission of the image from the processing distribution portion244is not necessary.

Procedure [9]: In a case where the processing request is received from the processing distribution portion244, the processing reception portion301of the central processing server30causes the image processing portion302to execute the image processing in accordance with the received processing request. The image processing portion302starts the image processing based on an instruction from the processing reception portion301.

Procedure [10]: The image processing portion302executes the image processing corresponding to the processing request and stores the processing result in the image management server26. The processing result is transmitted to the image management server26as soon as the processing on the central processing server30is completed.

The processing result of the central processing server30or of the medical institution internal image processing server25can be displayed on the utilization terminal22of the processing request source and can further be displayed on other utilization terminals22inside the same medical institution.

Example of Calculation Flow of Waiting Time: In Case of Performing Processing Inside Medical Institution Internal Image Processing Server25

FIG.2is a flowchart illustrating an example of waiting time calculation processing executed in the waiting time calculation portion242of the image processing distributor24. The flowchart inFIG.2illustrates a calculation flow of the waiting time in a case of performing the processing inside the medical institution internal image processing server25. Here, a case will be illustratively described where the input image as the processing target image is an image (hereinafter, referred to as an input image ID1) specified by ID number=1, and the requested type of image processing is processing referred to as image processing A.

In step S11, the waiting time calculation portion242receives a request to execute the image processing A on a certain input image ID1.

The waiting time calculation portion242that receives the request to execute the image processing A on the input image ID1adds a time (hereinafter, referred to as a “first image processing execution required time”) required to execute the image processing A on a certain input image ID1to a processing waiting time Pwt1as a processing time in step S12. A symbol “+=” in an expression represents addition of a right-side value to a current value of a left-side value.

For the first image processing execution required time, in a case of image processing in which processing takes more time as an input image size is increased as described in Procedure [3], a configuration in which the processing time is dynamically calculated in accordance with the image size is desired. The first image processing execution required time is an example of a “required time” according to the embodiment of the present disclosure. The first image processing execution required time may be construed as an expected processing time estimated as a time required to execute the image processing.

Next, in step S13, the waiting time calculation portion242determines whether or not the input image ID1is present inside the medical institution internal image processing server25. In a case of performing the processing by the medical institution internal image processing server25, an input image ID of the processing target needs to be present inside the medical institution internal image processing server25. In a case where the input image ID1is not present inside the medical institution internal image processing server25, the input image ID1needs to be transmitted to the medical institution internal image processing server25from the image management server26.

In a case where this transmission is necessary, that is, in a case where a determination result of step S13is a No determination, the waiting time calculation portion242transitions to step S14.

In step S14, the waiting time calculation portion242adds a time (hereinafter, referred to as a “first input image reception required time”) required for the medical institution internal image processing server25to receive the input image ID from the image management server26, to the processing waiting time Pwt1as the waiting time. The first input image reception required time is a time required for transmitting the input image ID. At this point, the time required for transmission dynamically changes in accordance with a congestion situation of the network at the moment of transmission, and the congestion situation also varies depending on a utilizing facility.

Accordingly, it is desirable that the waiting time calculation portion242can calculate how long it takes to perform the transmission and how large a size of data is as a value of waiting time calculation at a time of the subsequent transmission or later, by measuring the actual time required to complete the transmission. After step S14, the waiting time calculation portion242transitions to step S15.

On the other hand, in a case where the determination result of step S13is a Yes determination as in a case where the input image ID is stored in the cache of the medical institution internal image processing server25, the waiting time calculation portion242transitions to step S15.

In step S15, since all processing already in a processing waiting state inside the medical institution internal image processing server25needs to be processed before the currently received processing request is processed, the waiting time calculation portion242adds a time (hereinafter, referred to as a “first existing processing completion waiting time”) from processing of all processing in the processing waiting state inside the medical institution internal image processing server25to a processing start of the present processing, to the processing waiting time Pwt1. At this point, a time until all existing processing requests in the processing waiting state are processed may be obtained by adding up a waiting time of each processing request currently in the processing waiting state at each moment of processing, or a total waiting time value of a processing waiting queue may be updated each time a new processing request arrives in the processing waiting queue. The first existing processing completion waiting time is calculated by reflecting the number of processing requests in the processing waiting state inside the medical institution internal image processing server25. After step S15, the waiting time calculation portion242transitions to step S16.

The result image may need to be downloaded to the image management server26so that the processing result of the medical institution internal image processing server25can be viewed using the utilization terminal22inside the medical institution. In step S16, the waiting time calculation portion242also adds a time (hereinafter, referred to as a “first result reception required time”) required for the download to the processing waiting time Pwt1. For the first result reception required time, the waiting time can be dynamically calculated by periodically measuring a time required for the download, as in a case of transmitting the processing target image to the medical institution internal image processing server25. The first result reception required time is calculated by reflecting the network connecting situation inside the medical institution. After step S16, the waiting time calculation portion242finishes the flowchart inFIG.2.

According to the calculation flow illustrated inFIG.2, the processing waiting time Pwt1finally calculated by passing through a processing path of a case where the determination result of step S13is a Yes determination is first image processing execution required time+first existing processing completion waiting time+first result reception required time. On the other hand, the processing waiting time Pwt1finally calculated by passing through a processing path of a case where the determination result of step S13is a No determination is first image processing execution required time+first input image reception required time+first existing processing completion waiting time+first result reception required time.

A configuration in which whether or not to add the “first input image reception required time” is controlled in accordance with the determination result of step S13is an example of an aspect “calculate a processing waiting time based on whether or not transmission and reception of a medical image are necessary” according to the embodiment of the present disclosure. The processing waiting time Pwt1calculated in accordance with the calculation flow illustrated inFIG.2is an example of a “first processing waiting time” according to the embodiment of the present disclosure.

Example of Calculation Flow of Waiting Time: In Case of Performing Processing Inside Central Processing Server30

FIG.3is a flowchart illustrating an example of the waiting time calculation processing executed in the waiting time calculation portion242of the image processing distributor24. The flowchart inFIG.3illustrates a calculation flow of the waiting time in a case of performing the processing inside the central processing server30. Here, a case where the input image as the processing target image is the input image ID1, and where the requested type of image processing is processing referred to as the image processing A will be illustratively described as inFIG.2.

In step S21, the waiting time calculation portion242receives a request to execute the image processing A on a certain input image ID1. The waiting time calculation portion242that receives the request to execute the image processing A on the input image ID1obtains a time (hereinafter, referred to as a “second image processing execution required time”) required to execute the image processing A on the input image ID1and adds the obtained time to a processing waiting time Pwt2as the waiting time in step S22.

As in step S12inFIG.2, a configuration in which the second image processing execution required time is dynamically calculated in accordance with the image size is desired. The second image processing execution required time is an example of the “required time” according to the embodiment of the present disclosure. The second image processing execution required time may be construed as the expected processing time estimated as a time required to execute the image processing.

Next, in step S23, the waiting time calculation portion242determines whether or not the input image ID1is present inside the central processing server30. In a case where a determination result of step S23is a No determination, the waiting time calculation portion242transitions to step S24.

In step S24, the waiting time calculation portion242determines whether or not the input image ID1is present inside the image processing distributor24. In a case where a determination result of step S24is a No determination, the waiting time calculation portion242transitions to step S25. In step S25, the waiting time calculation portion242adds a time (hereinafter, referred to as a “second input image reception required time”) required for the image processing distributor24to receive the input image ID from the image management server26, to the processing waiting time Pwt2. After step S25, the waiting time calculation portion242transitions to step S26.

The reason why step S24and step S25are necessary is as follows. That is, in the present embodiment, in transmitting the processing target image to the central processing server30, the image is transmitted to the central processing server30from the image processing distributor24. However, in order to transmit the image, first, the image of a transmission target has to be present inside the image processing distributor24of a transmission source. Otherwise, the transmission cannot be performed. Accordingly, the determination in step S24is performed, and in a case where the processing target image is not present in the image processing distributor24, the processing target image needs to be transmitted to the image processing distributor24from the image management server26. Thus, this waiting time for transmission (second input image reception required time) is added to the processing waiting time Pwt2.

On the other hand, in a case where the determination result of step S24is a Yes determination as in a case where the input image ID is stored in a cache of the image processing distributor24, the processing target image does not need to be transmitted to the image processing distributor24from the image management server26. Thus, the waiting time calculation portion242transitions to step S26.

In step S26, the waiting time calculation portion242adds a time (hereinafter, referred to as an “input image transmission required time”) required for transmitting the input image ID1to the central processing server30from the image processing distributor24, to the processing waiting time Pwt2. This time required for transmission dynamically changes depending on the congestion situation of the network of each facility. Thus, even in obtaining the input image transmission required time, as in the example described in step S14inFIG.2, it is desirable that the time required for the transmission is dynamically obtained by periodically measuring a network speed using dummy data or the like.

After step S26, the waiting time calculation portion242transitions to step S27. In addition, in a case where the determination result of step S23is a Yes determination as in a case where the input image ID is stored in the cache of the central processing server30, the waiting time calculation portion242transitions to step S27.

In step S27, the waiting time calculation portion242adds a waiting time (hereinafter, referred to as a “second existing processing completion waiting time”) from completion of all processing already in the processing waiting state inside the central processing server30until processing of the current processing request to be transmitted can be started, to the processing waiting time Pwt2. The second existing processing completion waiting time is calculated by reflecting the number of processing requests in the processing waiting state inside the central processing server30.

Next, in step S28, as in step S16inFIG.2, the waiting time calculation portion242adds a time (hereinafter, referred to as a “second result reception required time”) required for downloading the processing result to the image management server26so that the processing result can be viewed using the utilization terminal22inside the medical institution in a case of performing the image processing via the central processing server30. For this time required for the download, it is desirable that the waiting time can be dynamically calculated by periodically measuring a time required for the download as in a case of transmitting the processing target image to the central processing server30. After step S28, the waiting time calculation portion242finishes the flowchart inFIG.3.

According to the calculation flow illustrated inFIG.3, the processing path is divided into three patterns depending on the determination result of each of step S23and step S24, and the finally calculated processing waiting time Pwt2varies in accordance with the three patterns of the processing path. That is, the processing waiting time Pwt2finally calculated by passing through a processing path of a case where the determination result of step S23is a Yes determination is second image processing execution required time+second existing processing completion waiting time+second result reception required time.

The processing waiting time Pwt2finally calculated by passing through a processing path of a case where the determination result of step S23is a No determination and where the determination result of step S24is a Yes determination is second image processing execution required time+input image transmission required time+second existing processing completion waiting time+second result reception required time. The processing waiting time Pwt2finally calculated by passing through a processing path of a case where the determination result of step S23is a No determination and where the determination result of step S24is a No determination is second image processing execution required time+second input image reception required time+input image transmission required time+second existing processing completion waiting time+second result reception required time.

The configuration in which whether or not to add the “first input image reception required time” is controlled in accordance with the determination result of step S13is an example of the aspect “calculate the processing waiting time based on whether or not the transmission and reception of the medical image are necessary” according to the embodiment of the present disclosure. A configuration in which whether or not to add the “second input image reception required time” is controlled in accordance with the determination result of step S23, and a configuration in which whether or not to add the “input image transmission required time” is controlled in accordance with the determination result of step S24are an example of the aspect “calculate the processing waiting time based on whether or not the transmission and reception of the medical image are necessary” according to the embodiment of the present disclosure. The processing waiting time Pwt2calculated in accordance with the calculation flow illustrated inFIG.3is an example of a “second processing waiting time” according to the embodiment of the present disclosure.

Calculation results of the flowcharts inFIG.2andFIG.3are transmitted to the processing distribution portion244, and a server that executes the image processing is determined.

Example of Processing Flow in Processing Distribution Portion244

FIG.4is a flowchart illustrating an example of processing executed by the processing distribution portion244of the image processing distributor24. In step S31, the processing distribution portion244acquires the processing waiting time Pwt1in a case of using the medical institution internal image processing server25and the processing waiting time Pwt2in a case of using the central processing server30from the waiting time calculation portion242.

In step S32, the processing distribution portion244compares magnitudes of Pwt1and Pwt2. In a case where Pwt1≤Pwt2is satisfied, the processing distribution portion244transitions to step S33. In step S33, the processing distribution portion244transmits a request to execute the processing to the medical institution internal image processing server25.

On the other hand, in a case where the determination in step S32results in Pwt1>Pwt2, the processing distribution portion244transitions to step S34, and the processing distribution portion244transmits the request to execute the processing to the central processing server30.

After step S33or step S34, the processing distribution portion244finishes the flowchart inFIG.4.

The request (processing request) to execute the processing is transmitted from the processing distribution portion244to a server having a shorter processing waiting time out of the medical institution internal image processing server25and the central processing server30based on the calculation results of the processing waiting time Pwt1and the processing waiting time Pwt2. Accordingly, the processing waiting time as a whole system is minimized.

System Configuration Example

FIG.5is a diagram schematically illustrating a system configuration example of the medical image processing system10. InFIG.5, while an example in which the medical information system20having the same configuration is constructed in each of the plurality of medical institutions is illustrated for simplification of illustration, a medical information system having different configurations for each medical institution may be constructed.

The medical information system20illustrated inFIG.5may include an electronic medical record system27and one or more modalities28in addition to the plurality of utilization terminals22, the image processing distributor24, the medical institution internal image processing server25, and the image management server26described usingFIG.1. These elements are connected to a local area network29inside the medical institution. The local area network29is an example of a “first network” according to the embodiment of the present disclosure.

The modality28is an apparatus that captures an examination image. The modality28includes an apparatus that images an examination target part of a subject to generate an examination image representing the part and that outputs the image by adding accessory information defined by digital imaging and communication in medicine (DICOM) standard to the image. Specific examples of the modality28include a computed tomography (CT) apparatus, a magnetic resonance imaging (MRI) apparatus, an angiography X-ray diagnostic apparatus, a positron emission tomography (PET) apparatus, an ultrasonic apparatus, a computed radiography (CR) apparatus using a flat X-ray detector (flat panel detector: FPD), a mammography apparatus, and an endoscope apparatus.

The medical information system20may include a plurality of types of modalities28. Various combinations of the types and the number of modalities28are available for each medical institution.

For example, the image management server26may be a server that operates in accordance with DICOM specifications. The image management server26is a computer that stores and manages various data including the image captured using the modality28and comprises a high-capacity external storage device and a database management program. The image management server26communicates with other apparatuses through the local area network29and transmits and receives various data including image data. The image management server26receives the image data generated by the modality28and other various data via the local area network29and manages the data by storing the data in a storage medium such as the high-capacity external storage device.

The image processing distributor24included in the medical information system20of each medical institution is communicably connected to the central processing server30through a wide area network120such as the Internet. The wide area network120is an example of a “network outside a medical institution” and of a “second network” according to the embodiment of the present disclosure.

Configuration Example of Image Processing Distributor24

The image processing distributor24can be implemented by a computer system configured using one or a plurality of computers. The function of the image processing distributor24is implemented by installing a program on the computer.

FIG.6is a block diagram illustrating a configuration example of the image processing distributor24. The image processing distributor24includes a processor202, a computer-readable medium204that is a non-transitory tangible object, a communication interface206, an input-output interface208, and a bus210. The image processing distributor24may comprise an input device214and a display device216. The input device214and the display device216are connected to the bus210through the input-output interface208.

The image processing distributor24is communicably connected to the utilization terminal22, the image management server26, the medical institution internal image processing server25, and the central processing server30through the communication interface206.

The processor202includes a central processing unit (CPU). The processor202may include a graphics processing unit (GPU). The processor202is connected to the computer-readable medium204, the communication interface206, and the input-output interface208through the bus210.

The computer-readable medium204includes a memory that is a main memory, and a storage that is an auxiliary storage device. For example, the computer-readable medium204may be a semiconductor memory, a hard disk drive (HDD) device, a solid state drive (SSD) device, or a combination of a plurality thereof. The computer-readable medium204is an example of a “storage device” according to the embodiment of the present disclosure.

The computer-readable medium204stores a plurality of programs including an image processing distribution program240and a display control program248, data, and the like. The processor202functions as the processing reception portion241, the waiting time calculation portion242, and the processing distribution portion244by executing an instruction of the image processing distribution program240. That is, the processor202executes the steps of the flowcharts described usingFIG.2toFIG.4.

The computer-readable medium204includes a cache portion246. The cache portion246stores a cache file of data such as the image acquired by the image processing distributor24. The cache portion246may store cache files of a plurality of medical images received by the image processing distributor24in the past. The cache files may be automatically deleted sequentially from the oldest cache file. In calculating the processing waiting time, the waiting time calculation portion242determines whether or not the processing target image is held in the cache portion246.

The display control program248generates a display signal necessary for a display output for displaying the calculation results and the like of the waiting time calculation portion242on the display device216and/or on the utilization terminal22or the like, and performs a display control of the display device216or the like.

For example, the display device216is composed of a liquid crystal display, an organic electro-luminescence (OEL) display, a projector, or an appropriate combination thereof. For example, the input device214is composed of a keyboard, a mouse, a touch panel, other pointing devices, a voice input device, or an appropriate combination thereof. The input device214receives various inputs from an operator. The display device216and the input device214may be configured to be integrated using a touch panel.

Configuration Example of Medical Institution Internal Image Processing Server25

The medical institution internal image processing server25can be implemented by a computer system configured using one or a plurality of computers. A processing function of the medical institution internal image processing server25is implemented by installing a program on the computer.

FIG.7is a block diagram illustrating a configuration example of the medical institution internal image processing server25. The medical institution internal image processing server25includes a processor222, a computer-readable medium224that is a non-transitory tangible object, a communication interface226, an input-output interface228, and a bus230. The medical institution internal image processing server25may comprise an input device234and a display device236. The input device234and the display device236are connected to the bus230through the input-output interface228.

A hardware configuration of the medical institution internal image processing server25may be the same as a hardware configuration of the image processing distributor24described usingFIG.6. That is, a hardware configuration of each of the processor222, the computer-readable medium224, the communication interface226, the input-output interface228, the bus230, the input device234, and the display device236illustrated inFIG.7may be the same as a corresponding element thereof illustrated inFIG.6.

The computer-readable medium224stores a plurality of programs including a processing reception program250, an image processing program253, and a display control program258, data, and the like. The processor222functions as the processing reception portion251and as the image processing portion252by executing instructions of the processing reception program250and of the image processing program253. The image processing program253may be configured to include a plurality of types of programs for performing a plurality of types of image processing. For example, the image processing program253includes a plurality of types of programs for image processing including an image processing A program PGa for performing the image processing A and an image processing B program PGb for performing the image processing B.

Specifically, for example, one or more programs including an organ segmentation program, a vascular region extraction program, a fracture CAD program, a bone labeling program, a lung nodule detection program, a lung nodule characteristics analysis program, a pneumonia CAD program, a lung segment labeling program, a mammary gland CAD program, a liver CAD program, a brain CAD program, a colon CAD program, and a report creation support program may be included as the program for image processing. These various programs may be AI processing modules including a trained model that is trained to obtain an output of a target task by applying machine learning such as deep learning.

For example, an AI model for CAD can be configured using various convolutional neural networks (CNNs) having a convolutional layer. For example, input data for the AI model may include the medical image such as a two-dimensional image, a three-dimensional image, or a motion picture image, and an output from the AI model may be information indicating a position of a disease region (lesion part) in the image, information indicating a classification such as a disease name, or a combination thereof.

A combination of the processing reception program250and the image processing program253is an example of a “server program” according to the embodiment of the present disclosure.

The computer-readable medium224includes the cache portion246. The cache portion246stores a cache file of data such as the image acquired by the medical institution internal image processing server25. A cache function using the cache portion246is the same as the cache function described usingFIG.6. In calculating the processing waiting time, the image processing distributor24determines whether or not the processing target image is stored in the cache portion246.

The display control program258generates a display signal necessary for a display output for displaying a processing result and the like of the image processing program253on the display device236and/or on the utilization terminal22or the like, and performs a display control of the display device236or the like.

Configuration Example of Central Processing Server30

The central processing server30can be implemented by a computer system configured using one or a plurality of computers. A processing function of the central processing server30is implemented by installing a program on the computer.

FIG.8is a block diagram illustrating a configuration example of the central processing server30. The central processing server30includes a processor312, a computer-readable medium314that is a non-transitory tangible object, a communication interface316, an input-output interface318, and a bus320. The central processing server30may comprise an input device324and a display device326. The input device324and the display device326are connected to the bus320through the input-output interface318. A hardware configuration of the central processing server30may be the same as the hardware configuration of the medical institution internal image processing server25described usingFIG.7. That is, a hardware configuration of each of the processor312, the computer-readable medium314, the communication interface316, the input-output interface318, the bus320, the input device324, and the display device326illustrated inFIG.8may be the same as a corresponding element thereof illustrated inFIG.7.

In addition, as inFIG.7, the computer-readable medium314stores a plurality of programs including the processing reception program250, the image processing program253, and a display control program308, data, and the like. The processor312functions as the processing reception portion301and as the image processing portion302by executing the instructions of the processing reception program250and of the image processing program253.

The computer-readable medium314includes a cache portion306. The cache portion306stores a cache file of data such as the image acquired by the central processing server30. A cache function using the cache portion306is the same as the cache function described usingFIG.6. In calculating the processing waiting time, the image processing distributor24(refer toFIG.1) of each medical institution determines whether or not the processing target image is stored in the cache portion306.

The display control program308generates a display signal necessary for a display output for displaying the processing result and the like of the image processing program253on the display device326and/or on the utilization terminal22or the like, and performs a display control of the display device326or the like.

Modification Example 1

In the embodiment, while an example in which each of the image processing distributor24, the medical institution internal image processing server25, and the central processing server30has the cache function is described, a configuration in which some or all of the image processing distributor24, the medical institution internal image processing server25, and the central processing server30do not have the cache function is also possible.

In a case where the image processing distributor24does not have the cache function, a configuration not including the cache portion246illustrated inFIG.6is provided. Similarly, in a case where the medical institution internal image processing server25does not have the cache function, a configuration not including a cache portion256illustrated inFIG.7is provided. In a case where the central processing server30does not have the cache function, a configuration not including a cache portion306illustrated inFIG.8is provided.

In a case where the medical institution internal image processing server25does not have the cache function, the waiting time calculation portion242executes the flowchart inFIG.9instead of the flowchart inFIG.2. InFIG.9, steps identical toFIG.2are designated by the identical step numbers, and duplicate description will be omitted. In the flowchart inFIG.9, step S13inFIG.2is deleted, and the processing path transitions to step S14after step S12. Other steps are the same as inFIG.2.

FIG.10is a flowchart illustrating a calculation example of the waiting time executed in the waiting time calculation portion242in a case where any of the image processing distributor24and the central processing server30does not have the cache function.

InFIG.10, in a case where any of the image processing distributor24and the central processing server30does not have the cache function, the waiting time calculation portion242executes the flowchart inFIG.10instead of the flowchart inFIG.3. InFIG.10, steps identical toFIG.3are designated by the identical step numbers, and duplicate description will be omitted. In the flowchart inFIG.10, step S23and step S24inFIG.3are deleted, and the processing path transitions to step S25after step S22. Other steps are the same as inFIG.3.

Modification Example 2

In the embodiment, while an example in which the image processing distributor24is constructed as a server separated from the medical institution internal image processing server25is described, the image processing distributor24may be constructed on the same server as the medical institution internal image processing server25.

Program Operating Computer

A program causing a computer to implement a part or all of at least one processing function of various processing functions in the medical image processing system10described in the embodiment and the modification examples can be recorded on a computer-readable medium that is an optical disc, a magnetic disk, a semiconductor memory, or another tangible non-transitory information storage medium, and the program can be provided through the information storage medium.

In addition, instead of an aspect of providing the program by storing the program in the tangible non-transitory computer-readable medium, a program signal can be provided as a download service by utilizing an electric communication line such as the Internet.

Hardware Configuration of Each Processing Unit

For example, a hardware structure of a processing unit executing various processing of the processing reception portion241, the waiting time calculation portion242, the processing distribution portion244, the processing reception portion251, the image processing portion252, the processing reception portion301, the image processing portion302, and the like in the medical image processing system10include the following various processors.

The various processors include a CPU that is a general-purpose processor functioning as various processing units by executing a program, a GPU that is a processor specialized in image processing, a programmable logic device (PLD) such as a field programmable gate array (FPGA) that is a processor of which a circuit configuration can be changed after manufacturing, a dedicated electric circuit such as an application specific integrated circuit (ASIC) that is a processor having a circuit configuration dedicatedly designed to execute specific processing, and the like.

One processing unit may be composed of one of the various processors or may be composed of two or more processors of the same type or different types. For example, one processing unit may be composed of a plurality of FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU. In addition, a plurality of processing units may be composed of one processor. Examples of the plurality of processing units composed of one processor include, first, as represented by a computer such as a client or a server, a form in which one processor is composed of a combination of one or more CPUs and software, and this processor functions as the plurality of processing units. Second, as represented by a system on chip (SoC) or the like, a form of using a processor that implements functions of the whole system including the plurality of processing units via one integrated circuit (IC) chip is included. Accordingly, various processing units are configured using one or more of the various processors as a hardware structure.

Furthermore, the hardware structure of the various processors is more specifically an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined.

Advantages of Medical Image Processing System10According to Embodiment

According to the medical image processing system10, the following advantages are achieved.[1] The processing waiting time of the image processing by each server of the medical institution internal image processing server25and of the central processing server30is calculated in accordance with a situation of the medical institution internal image processing server25for each medical institution, a network connecting situation inside and outside the medical institution, and a situation of the central processing server30. Accordingly, the processing waiting time can be appropriately predicted in accordance with a dynamically changing situation.[2] In addition, the processing waiting time until the processing result is output with respect to the received processing request can be suppressed by distributing the processing request such that a server having a shorter calculated processing waiting time executes the image processing.[3] According to the medical image processing system10, the processing request can be distributed to the medical institution internal image processing server25or to the central processing server30to minimize the waiting time in accordance with a situation.
Other

The present disclosure is not limited to the contents of the embodiment and of the modification examples, and various modifications can be made without departing from the gist of the technical idea of the present disclosure.

EXPLANATION OF REFERENCES

10: medical image processing system20: medical information system22: utilization terminal24: image processing distributor25: medical institution internal image processing server26: image management server27: electronic medical record system28: modality29: local area network30: central processing server120: wide area network202: processor204: computer-readable medium206: communication interface208: input-output interface210: bus214: input device216: display device222: processor224: computer-readable medium226: communication interface228: input-output interface230: bus234: input device236: display device240: image processing distribution program241: processing reception portion242: waiting time calculation portion244: processing distribution portion246: cache portion248: display control program250: processing reception program251: processing reception portion252: image processing portion253: image processing program256: cache portion258: display control program301: processing reception portion302: image processing portion306: cache portion308: display control program312: processor314: computer-readable medium316: communication interface318: input-output interface320: bus324: input device326: display devicePGa: image processing A programPGb: image processing B programPwt1: timePwt2: timeS11to S15: step of processing waiting time calculation flow in case of performing image processing in medical institution internal image processing serverS21to S28: step of processing waiting time calculation flow in case of performing image processing in central processing serverS31to S34: step of processing executed by processing distribution portion