Patent Description:
A medical image including an ultrasound tomographic image of a blood vessel is generated by an intra vascular ultrasound (IVUS) method using a catheter, and an ultrasound examination inside the blood vessel is performed. In the intra vascular ultrasound method, an intravascular diagnosis catheter moves an ultrasound sensor from a distal position to a proximal position of the blood vessel, and scans the blood vessel and surrounding tissues thereof.

Meanwhile, for a purpose of assisting a doctor to perform diagnosis, a technique of adding information to the medical image by image processing or machine learning is developed.

However, there is a problem in that it is difficult to recognize an image of a lumen boundary of a bifurcated portion of the blood vessel in one tomographic image and discriminate between a main trunk and a side branch of the blood vessel, and useful information cannot be added to the medical image.

An object of the present disclosure is to provide a computer program and an information processing device capable of analyzing a medical image obtained by scanning a lumen organ, and recognizing a main trunk and a side branch of a blood vessel.

This problem is solved by a computer program according to independent claim <NUM> and an information processing device according to independent claim <NUM>. The dependent claims relate to advantageous embodiments.

According to the present disclosure, a medical image obtained by scanning a lumen organ can be analyzed and a main trunk and a side branch of a blood vessel can be recognized.

Specific examples of a computer program and an information processing device according to embodiments of the invention will be described below with reference to the drawings.

<FIG> is an explanatory diagram showing a configuration example of a diagnostic imaging apparatus <NUM>. The diagnostic imaging apparatus <NUM> is an apparatus for generating a medical image including an ultrasound tomographic image of a blood vessel (lumen organ) by an intra vascular ultra sound (IVUS) method, and performing an ultrasound examination and diagnosis inside the blood vessel. In particular, the diagnostic imaging apparatus <NUM> according to the first embodiment is an apparatus that analyzes a bifurcating structure of the blood vessel to discriminate between a main trunk A and a side branch B branched from the main trunk A, and superimposes and displays guide images G1 and G2 (see <FIG>) showing the bifurcating structure on the medical image.

The diagnostic imaging apparatus <NUM> includes a catheter <NUM>, a motor drive unit (MDU) <NUM>, an image processing device (information processing device) <NUM>, a display device <NUM>, and an input device <NUM>. The diagnostic imaging apparatus <NUM> generates the medical image including the ultrasound tomographic image of the blood vessel by the IVUS method using the catheter <NUM>, and performs the ultrasound examination inside the blood vessel.

The catheter <NUM> is a diagnostic imaging catheter for obtaining the ultrasound tomographic image of the blood vessel by the IVUS method. The catheter <NUM> includes, at a distal end portion thereof, an ultrasound probe for obtaining the ultrasound tomographic image of the blood vessel. The ultrasound probe includes an ultrasound transducer that emits an ultrasound in the blood vessel, and an ultrasound sensor that receives a reflected wave (ultrasound echo) reflected by a biological tissue of the blood vessel or a medical equipment. The ultrasound probe is configured to move forward and backward in a longitudinal direction of the blood vessel while rotating in a circumferential direction of the blood vessel.

The MDU <NUM> is a drive apparatus to which the catheter <NUM> is detachably attached, and controls, by driving a built-in motor according to an operation of a health care worker, an operation of the catheter <NUM> inserted into the blood vessel. The MDU <NUM> rotates the ultrasound probe of the catheter <NUM> in the circumferential direction while moving the ultrasound probe from a distal end (distal position) side to a proximal end (proximal position) side (see <FIG>). The ultrasound probe continuously scans the inside of the blood vessel at a predetermined time interval, and outputs reflected wave data of a detected ultrasound to the image processing device <NUM>.

The image processing device <NUM> generates, in a chronological order, a plurality of medical images including the tomographic image of the blood vessel based on the reflected wave data output from the ultrasound probe of the catheter <NUM> (see <FIG>). Since the ultrasound probe scans the inside of the blood vessel while moving from the distal end (distal position) side to the proximal end (proximal position) side in the blood vessel, the plurality of medical images in the chronological order are tomographic images of the blood vessel observed at a plurality of locations from the distal position to the proximal position.

The display device <NUM> is a liquid crystal display panel, an organic EL display panel, or the like, and displays the medical image generated by the image processing device <NUM>.

The input device <NUM> is an input interface such as a keyboard or a mouse that receives an input of various setting values when an inspection is performed, an operation on the image processing device <NUM>, and the like. The input device <NUM> may be a touch panel, a soft key, a hard key, or the like provided in the display device <NUM>.

<FIG> is a block diagram showing a configuration example of the image processing device <NUM>. The image processing device <NUM> is a computer, and includes a control unit <NUM>, a main storage unit <NUM>, an input and output I/F <NUM>, and an auxiliary storage unit <NUM>.

The control unit <NUM> is implemented by using an arithmetic processing device such as one or more central processing units (CPUs), micro-processing units (MPUs), graphics processing units (GPUs), general-purpose computing on graphics processing units (GPGPUs), tensor processing units (TPUs), or the like.

The main storage unit <NUM> is a temporary storage area such as a static random access memory (SRAM), a dynamic random access memory (DRAM), or a flash memory, and temporarily stores data necessary for the control unit <NUM> to perform arithmetic processing.

The input and output I/F <NUM> is an interface through which the catheter <NUM>, the display device <NUM>, and the input device <NUM> are connected. The control unit <NUM> acquires the reflected wave data output from the ultrasound probe via the input and output I/F <NUM>. The control unit <NUM> outputs a medical image signal to the display device <NUM> via the input and output I/F <NUM>. Further, the control unit <NUM> receives, via the input and output I/F <NUM>, information input to the input device <NUM>.

The auxiliary storage unit <NUM> is a storage device such as a hard disk, an electrically erasable programmable ROM (EEPROM), or a flash memory. The auxiliary storage unit <NUM> stores a computer program P performed by the control unit <NUM> and various types of data required for processing of the control unit <NUM>. In addition, the auxiliary storage unit <NUM> stores a learning model <NUM>.

The learning model <NUM> is a model that recognizes a predetermined object included in the medical image. For example, the learning model <NUM> can classify an object in units of pixels by using an image recognition technique using semantic segmentation, and can recognize a lumen boundary of a blood vessel included in the medical image.

The auxiliary storage unit <NUM> may be an external storage device connected to the image processing device <NUM>. The computer program P may be written in the auxiliary storage unit <NUM> at a stage of manufacturing the image processing device <NUM>, or the image processing device <NUM> may acquire the computer program P, which is distributed by a remote server apparatus, through communication and store the computer program P in the auxiliary storage unit <NUM>. The computer program P may be in a state of being recorded readably in a recording medium 3a such as a magnetic disk, an optical disk, or a semiconductor memory.

The control unit <NUM> reads and performs the computer program P stored in the auxiliary storage unit <NUM> to acquire the medical image generated by the diagnostic imaging apparatus <NUM> and perform processing of detecting the lumen boundary of the blood vessel included in the medical image. Specifically, the control unit <NUM> detects an image region of the lumen boundary in the medical image using the learning model <NUM>. In particular, the control unit <NUM> according to the first embodiment has a function of discriminating between the main trunk A and the side branch B at a bifurcated portion of the blood vessel. Then, the image processing device <NUM> outputs a recognition result of the lumen boundary to the diagnostic imaging apparatus <NUM>, and displays the guide images G1 and G2 (see <FIG>) indicating positions and regions of the main trunk A and the side branch B in order to enable the health care worker to easily recognize the lumen boundaries of the main trunk A and the side branch B which are results.

<FIG> is an explanatory diagram showing an image recognition method using the learning model <NUM>. The learning model <NUM> is trained such that the region of the lumen boundary of the blood vessel in the medical image can be recognized in units of pixels.

The learning model <NUM> is, for example, a convolutional neural network (CNN) that is trained by deep learning. The learning model <NUM> recognizes an object in units of pixels by an image recognition technique using so-called semantic segmentation.

The learning model <NUM> includes an input layer 341a which receives the medical image, an intermediate layer 341b that extracts and restores feature data of the image, and an output layer 341c that outputs a label image showing the object included in the medical image in units of pixels. The learning model <NUM> is, for example, U-Net.

The input layer 341a of the learning model <NUM> includes a plurality of neurons that receive an input of a pixel value of a pixel included in the medical image, and transmits the received pixel value to the intermediate layer 341b. The intermediate layer 341b includes a convolutional layer (CONV layer) and a deconvolutional layer (DECONV layer). The convolutional layer is a layer that performs dimensional compression on image data. The feature data of the object is extracted by the dimensional compression. The deconvolutional layer performs deconvolution processing to reconstruct to an original dimension. By the reconstruction processing in the deconvolutional layer, a binarized label image indicating whether the pixels in the image are an object is generated. The output layer 341c includes one or more neurons that output the label image. The label image is, for example, an image in which pixels corresponding to the lumen boundary of the blood vessel are of class "<NUM>" and pixels corresponding to the other images are of class "<NUM>".

The learning model <NUM> can be generated by preparing training data including a medical image including the main trunk A, a label image showing pixels and a center position of a lumen boundary of the main trunk A in the medical image, a medical image including the main trunk A and the side branch B which are completely separated from each other, a label image showing pixels and center positions of the lumen boundaries of the main trunk A and the side branch B in the medical image, a medical image including the bifurcated portion of the main trunk A and the side branch B, and a label image showing pixels of a lumen boundary of the bifurcated portion in the medical image, and performing machine learning on an untrained neural network using the training data. In the medical image including the bifurcated portion, a main trunk cross-section and a side branch cross-section are combined to each other.

As shown in <FIG>, according to the learning model <NUM> trained in this way, a label image showing a region of the lumen boundary of the main trunk A in units of pixels is obtained by inputting the medical image including the main trunk A into the learning model <NUM>. A label image showing regions of the main trunk A and the side branch B in units of pixels is obtained in the learning model <NUM> by inputting the medical image including both the main trunk A and the side branch B into the learning model <NUM>. Further, a label image showing a region of the bifurcated portion in units of pixels is obtained in the learning model <NUM> by inputting the medical image including the bifurcated portion of the main trunk A and the side branch B into the learning model <NUM>. In the label images obtained here, the main trunk A and the side branch B are output without being discriminated.

<FIG> is an explanatory diagram showing a branched blood vessel, and <FIG> is an explanatory diagram showing tomographic images of the blood vessel obtained by scanning the branched blood vessel. The tomographic images on planes denoted by reference numerals a to f in <FIG> are as shown in <FIG>. When the main trunk A and the side branch B branched from the main trunk A are completely separated from each other (a cross-section indicated by the reference numeral f), the main trunk A and the side branch B in the medical image can be easily understood. However, in the bifurcated portion of the blood vessel (cross-sections indicated by the reference numerals c, d, and e), structures of the main trunk A and the side branch B cannot be easily understood.

The image processing device <NUM> according to the first embodiment performs processing of recognizing the structures of the main trunk A and the side branch B in the bifurcated portion and displaying the guide images G1 and G2 for supporting the health care worker to recognize the bifurcating structure.

<FIG> is a flowchart showing a procedure of the information processing method, <FIG> is a side view of the blood vessel showing a method for specifying the bifurcating structure of the blood vessel, and <FIG> is a cross-sectional view of the blood vessel showing the method for specifying the bifurcating structure of the blood vessel.

The control unit <NUM> acquires the plurality of medical images in the chronological order from the diagnostic imaging apparatus <NUM> (step S11). The plurality of medical images in the chronological order acquired here are, for example, images of the tomographic images observed from the distal position to the proximal position of the blood vessel.

The control unit <NUM> selects a plurality of medical images in a distal portion (step S12). The control unit <NUM> may select at least two medical images each including the main trunk A and the side branch B that are completely separated from each other. For example, as shown in <FIG>, the control unit <NUM> may select a medical image on a cutting plane f and a medical image on a cutting plane g.

Then, the control unit <NUM> detects the lumen boundaries and the center positions of the main trunk A and the side branch B included in the medical image by inputting the medical images selected in step S12 into the learning model <NUM> (step S13).

Next, the control unit <NUM> specifies the bifurcating structure of the blood vessel based on a detection result of step S13 as shown in <FIG> (step S14). A time difference in capturing the two images selected in step S12 corresponds to a length of the main trunk A in the longitudinal direction. Specifically, a product of a moving speed of the ultrasound probe during blood vessel scanning and the time difference corresponds to a length between locations at which the two medical images are captured. In <FIG>, a straight line (broken line) passing through centers of the main trunks A included in the two medical images indicates a center line of the main trunk A. A straight line (broken line) passing through centers of the side branches B included in the two medical images indicates a center line of the side branch B.

When center coordinates of the main trunk A imaged at a scanning time point t1 are (x1, y1) and center coordinates of the main trunk A imaged at a scanning time point t2 = t + Δt are (x2, y2), center coordinates (xN, yN) of the main trunk A at the bifurcated portion imaged at a scanning time point tN = t + NΔt are expressed by the following equations (<NUM>) and (<NUM>). <MAT> <MAT>.

When a diameter of the main trunk A imaged at the scanning time point t1 is r1 and a diameter of the main trunk A imaged at the scanning time point t2 = t + Δt is r2, a center coordinate rN of the main trunk A at the bifurcated portion imaged at the scanning time point tN = t + NΔt is expressed by the following equation (<NUM>).

The above equation (<NUM>) describes one diameter, and a long diameter and a short diameter of the main trunk A can be calculated in the same way.

Although an example in which the above equations (<NUM>) to (<NUM>) are used to estimate the center position and the diameter of the blood vessel in the bifurcated portion by linear interpolation based on the center positions and the diameters of the present case obtained from the two medical images has been described, the center position and the diameter of the blood vessel in another medical image may be calculated by polynomial interpolation based on the center positions of the blood vessel in three or more medical images.

Similarly, the diameter of the lumen boundary of the main trunk A may be estimated. In addition, the center position and the diameter of the side branch B in the medical image can also be calculated by the same method.

The control unit <NUM> specifies a region in which straight lines indicating the lumen boundary of the main trunk A and straight lines indicating the lumen boundary of the side branch B intersect with each other as the bifurcated portion.

The control unit <NUM> that finishes the processing of step S14 selects the medical image in the bifurcated portion (step S15), and detects the lumen boundaries of the main trunk A and the side branch B included in the medical image (step S16). The region of the lumen boundary of the main trunk A and the region of the lumen boundary of the side branch B in the bifurcated portion are recognized as regions that are partially combined.

Then, the control unit <NUM> specifies, based on information indicating the structure of the bifurcated portion specified in step S14, a main trunk A portion and a side branch B portion in the regions of the lumen boundaries detected in step S16 (step S17). The center position and the diameter of the main trunk A in the medical image of the bifurcated portion can be obtained based on the information on the structure of the bifurcated portion specified in step S14. That is, the control unit <NUM> can obtain an elliptical line indicating the main trunk A in the medical image. The control unit <NUM> can recognize, as the lumen boundary of the main trunk A, a region in the vicinity of the elliptical line of the main trunk A obtained based on the information on the structure of the bifurcated portion in the lumen boundary detected in step S16. Similarly, the control unit <NUM> can recognize, as the lumen boundary of the main trunk A, a region in the vicinity of an elliptical line of the side branch B obtained based on the information on the structure of the bifurcated portion in the lumen boundary detected in step S16.

Next, the control unit <NUM> selects the medical image in the proximal portion which is proximal of the bifurcated portion (step S18). If the number of branches is one, only the main trunk A is included in the medical image selected in step S18. The control unit <NUM> detects the lumen boundary and the center position of the main trunk A included in the medical image in the proximal portion (step S19).

Then, the control unit <NUM> superimposes the guide images G1 and G2 indicating the main trunk A portion and the side branch B portion in the medical image onto the medical image, and displays the superimposed image (step S20).

<FIG> is an explanatory diagram showing a display example of the guide images G1 and G2. In the medical image of the bifurcated portion, as shown in <FIG>, cross-sections of the main trunk A and the side branch B are partially combined, and it is difficult to clearly discriminate between the lumen boundary of the main trunk A portion and the lumen boundary of the side branch B portion. Therefore, the control unit <NUM> superimposes the guide image G1 corresponding to the region of the lumen boundary of the main trunk A onto the medical image and displays the superimposed image. The guide image G1 is an image having substantially the same shape as the region of the lumen boundary of the main trunk A.

Further, the control unit <NUM> superimposes the guide image G2 corresponding to the region of the lumen boundary of the side branch B onto the medical image and displays the superimposed image. The guide image G2 is an image having substantially the same shape as the region of the lumen boundary of the side branch B.

The control unit <NUM> may display the guide images G1 and G2 in different modes for the guide image G1 and the guide image G2. For example, the guide images G1 and G2 having different line types and colors may be displayed. An original image on which the guide images G1 and G2 are not superimposed may be displayed adjacently with an image obtained by superimposing the guide images G1 and G2 onto the medical image. Further, the image on which the guide images G1 and G2 are superimposed and the original image on which the guide images G1 and G2 are not superimposed may be selectively switched and displayed.

In addition, the control unit <NUM> may display the guide images G1 and G2 such that the lumen boundary of the main trunk A or the side branch B that does not appear in the medical image is complemented. For example, in the example shown in <FIG>, a part of the lumen boundary that is to be annular is missing, but the lumen boundary of the main trunk A and the lumen boundary of the side branch B may be displayed by estimating the missing part.

According to the computer program P, the image processing device <NUM>, and a information processing method configured in this way, the medical image obtained by scanning the blood vessel can be analyzed and the main trunk A and the side branch B of the blood vessel can be recognized.

In addition, the guide images G1 and G2 showing the lumen boundaries of the main trunk A and the side branch B of the blood vessel are displayed, and the health care worker can be supported to recognize the lumen boundaries of the main trunk A and the side branch B.

The image processing device <NUM> and the computer program P described in the first embodiment are examples, and are not limited to the configuration of the first embodiment.

For example, in the first embodiment, although the blood vessel is exemplified as an observation target or a diagnosis target, the invention can also be applied to a case in which a lumen organ such as a bowel other than the blood vessel is observed.

The ultrasound image has been described as an example of the medical image, and the medical image is not limited to the ultrasound image. The medical image may be, for example, an optical coherence tomography (OCT) image.

An image processing device according to a second embodiment is different from that of the first embodiment in that a lumen boundary and a plaque of the blood vessel are recognized, diameters, cross-sectional areas, volumes, and the like of the main trunk A and the side branch B can be calculated and displayed, and a model image in which a bifurcating structure is reproduced can be generated and displayed, and thus the differences will be mainly described below. Since other configurations, and operations and effects are the same as those of the first embodiment, corresponding portions are denoted by the same reference numerals and detailed descriptions are omitted.

The learning model <NUM> according to the second embodiment is, for example, a model that recognizes the lumen boundary and the plaque of the blood vessel included in the medical image.

<FIG> is a flowchart showing a procedure of an information processing method not falling under the scope of the claims. The control unit <NUM> according to the second embodiment performs the same processing as that of steps S11 to S20 of the first embodiment, and detects the lumen boundary and the plaque of the blood vessel in steps S33, S36, and S39.

Next, the control unit <NUM> superimposes a guide image showing the plaque onto the medical image, and displays the superimposed image (step S40). A health care worker can select whether the guide image showing the plaque is necessary by using the input device <NUM>. The control unit <NUM> does not display the guide image when receiving information indicating that the guide image is unnecessary, and displays the guide image when receiving information indicating that the guide image is necessary.

Next, the control unit <NUM> calculates the cross-sectional diameter, the cross-sectional area, or the volume per unit length of a lumen of the main trunk A, and displays, on the display device <NUM>, the calculated cross-sectional diameter, the calculated cross-sectional area, and the calculated volume of the lumen of the main trunk A in a superimposed manner (step S41).

Similarly, the control unit <NUM> calculates the cross-sectional diameter, the cross-sectional area, or the volume per unit length of a lumen of the side branch B based on the bifurcating structure specified in step S34, and displays, on the display device <NUM>, the calculated cross-sectional diameter, the calculated cross-sectional area, and the calculated volume of the lumen of the side branch B (step S42). However, as shown in <FIG>, a tomographic image of the side branch B scanned by the catheter <NUM> inserted through the main trunk A is a tomographic image (hereinafter, referred to as an oblique tomographic image) obtained by obliquely cutting the side branch B. Therefore, the control unit <NUM> converts a cross-sectional diameter, a cross-sectional area, or a volume of a lumen of the side branch B in the oblique tomographic image into a cross-sectional diameter, a cross-sectional area, or a volume of a lumen in a tomographic image (hereinafter, referred to as an axial tomographic image) obtained by cutting the side branch B substantially perpendicularly, that is, a tomographic image obtained by cutting the side branch B along a plane substantially perpendicular to a center line of the side branch B. For example, an angle θ formed by a center line of the main trunk A and a center line of the side branch B may be calculated, the oblique tomographic image may be converted into the axial image using the angle θ, and the cross-sectional diameter, the cross-sectional area, or the volume per unit length of the lumen of the side branch B may be calculated.

Next, the control unit <NUM> reproduces the model image representing the bifurcating structure of the blood vessel based on the bifurcating structure calculated in step S34 and a recognition result of the lumen boundary and the plaque detected based on the medical image, and displays the reproduced model image on the display device <NUM> (step S43).

<FIG> are explanatory diagrams showing model images of the main trunk A and the side branch B. For example, as shown in upper parts of <FIG>, the control unit <NUM> may generate a cross section of the blood vessel as the model image. The model image shows a blood vessel wall portion, the lumen boundary, and the plaque portion of the blood vessel.

Further, as shown in lower parts of <FIG>, the control unit <NUM> may generate cross-sectional images of the main trunk A and the side branch B as the model images. The model images also show the blood vessel wall portion, the lumen boundary, and the plaque portion of the blood vessel. Further, when generating a cross-sectional image of the side branch B, the control unit <NUM> may generate a model image converted into the axial image.

According to the computer program P, the image processing device <NUM>, and the information processing method configured in this way, the guide image showing the plaque formed on the blood vessel wall can be displayed and the health care worker can be guided to recognize the plaque portion.

The cross-sectional diameters, the areas, and the volumes of the lumens of the main trunk A and the side branch B can be calculated and displayed.

The model image representing the bifurcating structure can be generated and displayed, and the health care worker can be guided to recognize the bifurcated portion of the blood vessel. In particular, by displaying the model image of the cross section displaying the lumen boundaries and plaques of the main trunk A and the side branch B, the plaque formed in the blood vessel can be recognized more easily.

Further, by displaying the axial cross-sections of the main trunk A and the side branch B, the plaque formed as a result can be recognized more easily.

<FIG> is an explanatory diagram showing a configuration example of a diagnostic imaging system. The diagnostic imaging system according to a third embodiment is different from that of the first embodiment in that an information processing device <NUM>, which is a server, performs processing of analyzing a medical image, and the above difference will be mainly described later. Since other configurations and effects are the same as those of the first embodiment or the second embodiment, the corresponding portions are denoted by the same reference numerals and detailed descriptions are omitted.

The diagnostic imaging system according to the third embodiment includes the information processing device <NUM> and a diagnostic imaging apparatus <NUM>. The information processing device <NUM> and the diagnostic imaging apparatus <NUM> are communicably connected to each other via a network N such as a local area network (LAN) or the Internet. The information processing device <NUM> and the diagnostic imaging apparatus <NUM> are communicably connected to each other via a network N such as a local area network (LAN) or the Internet.

<FIG> is a block diagram showing a configuration example of the information processing device <NUM>. The information processing device <NUM> is a computer, and includes a control unit <NUM>, a main storage unit <NUM>, a communication unit <NUM>, and an auxiliary storage unit <NUM>. The communication unit <NUM> is a communication circuit for performing transmission and reception of data to and from the image processing device <NUM> via the network N. Hardware configurations of the control unit <NUM>, the main storage unit <NUM>, the communication unit <NUM>, and the auxiliary storage unit <NUM> are the same as those of the image processing device <NUM> described in the first embodiment. The computer program P, a learning model <NUM>, and a recording medium 6a stored in the auxiliary storage unit <NUM> are also the same as various programs, models, and the like of the first or second embodiment. The information processing device <NUM> may be a multi-computer including a plurality of computers, or may be a virtual machine virtually constructed by software. The information processing device <NUM> may be a local server installed in the same facility (hospital or the like) as the diagnostic imaging apparatus <NUM>, or may be a cloud server communicably connected to the diagnostic imaging apparatus <NUM> via the Internet or the like.

<FIG> is a flowchart showing a method for generating the learning model <NUM>. The control unit <NUM> collects a plurality of medical images each including a main trunk cross-section (step S51). For example, the control unit <NUM> collects the medical images from the diagnostic imaging apparatus <NUM>.

Next, the control unit <NUM> collects a plurality of medical images each including the main trunk cross-section and a side branch cross-section (step S52). Similarly, the control unit <NUM> collects a plurality of medical images each including a bifurcated portion cross-section (step S53).

Then, the control unit <NUM> collects a plurality of medical images each including the main trunk cross-section in which a plaque is formed (step S54). Then, the control unit <NUM> collects a plurality of medical images each including the main trunk cross-section and the side branch cross-section in which the plaques are formed (step S55). Similarly, the control unit <NUM> collects a plurality of medical images each including a bifurcated portion cross-section in which the plaques are formed (step S56).

Next, the control unit <NUM> generates training data in which label images are correlated with the medical images collected in steps S51 to S56 (step S57). A label image of the medical image including the main trunk cross-section is an image showing pixels of the lumen boundary and pixels of the plaque in the main trunk A. A label image of the medical image including the main trunk cross-section and the side branch cross-section is an image showing pixels of the lumen boundaries and pixels of the plaques in the main trunk A and the side branch B. A label image of the medical image including the bifurcated portion cross-section is an image showing pixels of the lumen boundaries and pixels of the plaques in the main trunk A and the side branch B at the bifurcated portion. A label image of the medical image including the main trunk cross-section in which the plaque is formed is an image showing pixels of the lumen boundary and pixels of the plaque in the main trunk A, and pixels of the plaque. A label image of the medical image including the main trunk cross-section and the side branch cross-section in which the plaques are formed is an image showing pixels of the lumen boundaries and pixels of the plaques in the main trunk A and the side branch B, and pixels of the plaque. A label image of the medical image including the bifurcated portion cross-section in which the plaque is formed is an image showing pixels of the lumen boundaries and pixels of the plaques in the main trunk A and the side branch B at the bifurcated portion, and pixels of the plaque.

Then, the control unit <NUM> generates the learning model <NUM> by performing machine learning on an untrained neural network using the generated training data (step S58).

According to the learning model <NUM> trained in this way, the label image showing a region of the lumen boundary of the main trunk A and a region of the plaque portion in units of pixels is obtained by inputting the medical image including the main trunk A into the learning model <NUM>. The label image showing regions of the main trunk A and the side branch B and regions of the plaque portions in units of pixels is obtained in the learning model <NUM> by inputting the medical image including both the main trunk A and the side branch B into the learning model <NUM>. The label image showing a region of the lumen boundaries and a region of the plaque portions at the bifurcated portion in units of pixels is obtained by inputting the medical image including bifurcated portion of the main trunk A and the side branch B into the learning model <NUM>.

The information processing device <NUM> configured in this way acquires the medical images from the image processing device <NUM> via the network N, performs processing similar to that of the image processing device <NUM> according to the first embodiment based on the acquired medical images, and transmits a recognition result of an object to the image apparatus. The image processing device <NUM> acquires the recognition result of the object transmitted from the information processing device <NUM>, superimposes the guide images G1 and G2 indicating the regions of the main trunk A and the side branch B of the blood vessel onto the medical image, and displays the superimposed image on the display device <NUM>, as shown in <FIG>.

In the information processing device <NUM> and the computer program P according to the third embodiment, similarly to the first embodiment, a medical image obtained by scanning the blood vessel can be analyzed and the main trunk A and the side branch B of the blood vessel can be recognized.

Claim 1:
A computer program (P) causing a computer to perform processing of:
generating a plurality of medical images based on signals detected by a catheter (<NUM>) inserted into a lumen organ while the catheter (<NUM>) is moving a sensor along a longitudinal direction of the lumen organ, the lumen organ including a main trunk (A), a side branch (B) branched from the main trunk (A), and a bifurcated portion of the main trunk (A) and the side branch (B); and
recognizing a main trunk cross-section, a side branch cross-section, and a bifurcated portion cross-section by inputting the acquired medical images into a learning model (<NUM>) configured to recognize the main trunk cross-section, the side branch cross-section, and the bifurcated portion cross-section,characterized by
recognizing at least the main trunk cross-section or the side branch cross-section by inputting an acquired first medical image into the learning model (<NUM>);
recognizing the bifurcated portion cross-section by inputting an acquired second medical image into the learning model (<NUM>); and
discriminating between a main trunk portion and a side branch portion constituting the bifurcated portion cross-section based on a recognition result based on the first medical image.