Patent Description:
In the related art, in a medical field, diagnosis and the like using an image obtained by imaging a subject have become widespread. For example, a radiation image obtained by imaging a patient who is a subject using radiation such as X-rays can visualize the inside of the subject non-invasively, and is therefore widely used for diagnosis and the like.

In the diagnosis using the radiation image or the like, it is important to arrange the subject with respect to an imaging unit (for example, a radiographic unit) that captures the radiation image or the like. This is for observing changes over time in the same subject, or for comparison with past cases.

For this reason, in recent years, a medical imaging apparatus that supports positioning of the subject with respect to the imaging unit has been known. For example, in a dental X-ray imaging apparatus that images a dentition or a jawbone, in a case where a face of a subject is optically imaged in a case of X-ray imaging of the dentition, and then X-ray imaging of the dentition is performed for the same subject, the subject can be positioned in the same position as that in the previous imaging by superimposing and displaying a ghost image showing a contour of the face in the case of the previous imaging on a monitor that shows the face part of the subject. There has been known a device that supports such a method (<CIT>). Medical imaging systems are disclosed in <CIT> and <CIT>.

In order to support positioning of a subject in capturing a medical image such as a radiation image, for example, there is a method of displaying a position where the subject is to be arranged in an image or a video of the subject or the like.

However, it may not be easy to position the subject with an accuracy required for the radiation image or the like simply by displaying the position where the subject is to be arranged in the image or the video of the subject or the like.

For example, in a case of obtaining a radiation image of a knee joint, the knee joint may move in a complicated manner with respect to a flexion angle, a turning angle with respect to a hip joint, and the like. Therefore, it is necessary to perform imaging by comprehensively and accurately determining not only the overall position (distance) with respect to the imaging unit but also the arrangement related to these plurality of parameters. In this case, in two-dimensional arrangement support display as described above, it is difficult to accurately grasp three-dimensional arrangement of the knee joint related to these plurality of parameters.

In principle, ideal three-dimensional arrangement of the subject can be obtained by performing the two-dimensional arrangement support display in two directions such as front and side surfaces of the knee joint. However, since it is necessary to consider the two-dimensional arrangement support display in two directions in combination, it is still difficult to accurately grasp the three-dimensional arrangement of the knee joint.

Therefore, an object of the present invention is to provide a medical imaging system capable of supporting more accurate and easy positioning of a subject than in a case of performing two-dimensional arrangement support display of the subject.

A medical imaging system of an aspect of the present invention is as defined by claim <NUM>.

It is preferable that the positioning data three-dimensionally specifies a position, a posture, and a shape of the subject.

It is preferable that in a case where the positioning data is the data relating to the subject, the positioning data is data representing the arrangement of the subject with respect to the imaging unit in past imaging.

It is preferable that the display unit displays the arrangement of the subject in a mode showing a three-dimensional position, posture, and shape of the subject.

It is preferable that the display unit displays the three-dimensional shape of the subject in a mode showing unevenness of the subject.

It is preferable that the processor determines a difference between the subject and the arrangement of the subject displayed by the display unit, and in a case where determination is made that there is the difference, prohibits the imaging unit from imaging the subject.

It is preferable that the processor determines the difference by using a distance, an angle, or a volume between the subject and the arrangement of the subject displayed by the display unit.

It is preferable that the processor detects the subject with respect to the imaging unit from a plurality of locations in a case where the subject is imaged using the imaging unit, and generates the positioning data by using a result of the detection.

According to the medical imaging system of the aspects of the present invention, it is possible to support more accurate and easy positioning of a subject than in a case of performing two-dimensional arrangement support display of the subject.

As shown in <FIG>, a medical imaging system <NUM> comprises an imaging unit <NUM> and a medical imaging processing apparatus <NUM>.

By imaging a subject Obj, the imaging unit <NUM> obtains a medical image or data used for generating the medical image (hereinafter, referred to as a medical image or the like). The medical image is an image used for medical observation, examination, and/or diagnosis, and is, for example, a radiation image obtained by imaging the subject Obj using radiation such as X-rays. The data used for generating the medical image is, for example, imaging data used for generating a tomographic image. That is, the data used for generating the medical image is a precursor image or other data acquired to obtain a medical image used for diagnosis or the like in a case where the medical image cannot be directly obtained by simple imaging.

The imaging unit <NUM> can be configured by using an optional device that obtains the medical image or the like by positioning and imaging the subject Obj. For example, the imaging unit <NUM> is a radiographic apparatus that images the subject Obj using X-rays or other radiation.

Positioning of the subject Obj means adjusting and positioning a position of the subject Obj with respect to one or a plurality of specific objects (hereinafter, simply referred to as an "imaging unit <NUM>") constituting the imaging unit <NUM>, and includes adjusting a posture of the subject Obj with respect to these objects. The posture of the subject Obj means information regarding an angle for determining a spatial orientation of the whole or a part of the subject Obj, and is information regarding an angle for determining a spatial orientation of a state in which the subject Obj has a specific shape in a case where the whole or a part of the subject Obj can be deformed.

The medical imaging processing apparatus <NUM> performs processing for providing information relating to the positioning of the subject Obj to a user <NUM> such as a doctor or a technician who operates the imaging unit <NUM> in capturing the medical image or the like using the imaging unit <NUM>. As a result, the medical imaging processing apparatus <NUM> supports the positioning of the subject Obj by the user <NUM>.

In the present embodiment, the imaging unit <NUM> is a radiographic apparatus that obtains a fluoroscopic image of the subject Obj by imaging the subject Obj using radiation. Therefore, the imaging unit <NUM> comprises a radiation source <NUM>, a radiographic unit <NUM>, and a console <NUM>.

The radiation source <NUM> is a device that generates radiation Ra necessary for imaging, and includes a radiation tube for generating the radiation Ra, a high-voltage generation circuit for generating a high voltage required for the radiation tube to generate the radiation Ra, and the like. The radiation source <NUM> can generate a plurality of types of radiation having different radiation qualities (so-called energy distribution) by adjusting the tube voltage and the tube current of the radiation tube. The energy of the radiation generated by the radiation source <NUM> is one of imaging conditions. In the present embodiment, the radiation source <NUM> is an X-ray source that generates X-rays. Therefore, the imaging unit <NUM> is an X-ray imaging apparatus that acquires an X-ray image of the subject Obj by imaging the subject Obj using X-rays. The subject Obj is, for example, a human body or a part of the human body. The radiation source <NUM> adjusts the position with respect to the radiographic unit <NUM> that receives the radiation Ra. This is to obtain an appropriate radiation image that can be used for diagnosis and the like at least with respect to a relative positional relationship between the radiation source <NUM> and the radiographic unit <NUM>.

The radiographic unit <NUM> images the subject Obj using the radiation Ra generated by the radiation source <NUM>. Therefore, the radiographic unit <NUM> has one or a plurality of radiation detection panels for imaging the subject Obj using the radiation Ra. The radiographic unit <NUM> is a so-called flat panel detector (FPD). Therefore, the radiographic unit <NUM> outputs a radiation image of the subject Obj by detecting the radiation Ra transmitted through the subject Obj by the radiation detection panel and converting the detected radiation into an electric signal. This radiation image is one of the medical images. In the imaging using the radiographic unit <NUM>, a grid (not shown) can be used in combination as needed. The grid is a device that removes scattered radiation components of radiation, for example, a static type Lysholm blende, a mobile type Bucky blende, or the like. The subject Obj is positioned with respect to the radiographic unit <NUM>. This is to obtain an appropriate radiation image that can be used for diagnosis and the like with respect to the subject Obj or a part of the subject Obj to be imaged.

The console <NUM> is a control device (computer) that controls operations of the radiation source <NUM>, the radiographic unit <NUM>, and the like, and comprises a display unit <NUM>, an operation unit <NUM>, an image generation unit <NUM>, and the like. The display unit <NUM> is, for example, a liquid crystal display, and displays a long radiation image or other radiation image captured, and displays other necessary operations or settings. The operation unit <NUM> is, for example, a keyboard and/or a pointing device used for setting input of the imaging conditions and the like and for operating the radiation source <NUM> and the radiographic unit <NUM>. The display unit <NUM> and the operation unit <NUM> can be constituted by a touch panel. The image generation unit <NUM> generates a radiation image using the output of the radiographic unit <NUM>.

As shown in <FIG>, the medical imaging processing apparatus <NUM> comprises an information acquisition unit <NUM>, a storage unit <NUM>, a display unit <NUM>, and a camera <NUM>. In the medical imaging processing apparatus <NUM>, programs relating to the information acquisition unit <NUM>, the storage unit <NUM>, a determination unit <NUM> (see <FIG>), a control unit <NUM> (see <FIG>), a subject detection unit <NUM> (see <FIG>), a positioning data generation unit <NUM> (see <FIG>), and a display control unit <NUM> (see <FIG>) are incorporated in a memory (not shown). In a case where the programs are operated by a comprehensive control unit (not shown) composed of a processor, functions of the information acquisition unit <NUM>, the storage unit <NUM>, the determination unit <NUM> (see <FIG>), the control unit <NUM> (see <FIG>), the subject detection unit <NUM> (see <FIG>), the positioning data generation unit <NUM> (see <FIG>), and the display control unit <NUM> (see <FIG>) are realized.

The information acquisition unit <NUM> is directly or indirectly connected to, for example, the console <NUM> to acquire subject information for specifying the subject Obj, such as a name or identifier (ID) and a physique (for example, the size and thickness of an imaging part), and imaging information regarding an imaging part, an imaging direction, and other imaging forms. As a result, the medical imaging processing apparatus <NUM> cooperates with the imaging unit <NUM>. The term "imaging part" refers to a part of the subject Obj to be imaged, and is, for example, a head, a chest, an abdomen, a thigh, a lower leg, a wrist joint, a knee joint, or the like. The term "imaging direction" refers to a general direction of the subject Obj in imaging, such as posterior-anterior (PA) or anterior-posterior (AP). The "other" imaging form refers to a general posture and/or shape of the subject Obj in imaging, such as standing or lying down.

The storage unit <NUM> stores one or a plurality of pieces of positioning data <NUM>. The positioning data <NUM> is information for specifying the arrangement of the subject Obj with respect to the imaging unit <NUM>. Specifically, the positioning data <NUM> three-dimensionally specifies the position, posture, and shape of the subject Obj in a case where the subject Obj is imaged using the imaging unit <NUM>. The term "three-dimensionally specify" means to specify a relative relationship with a reference object in a case of imaging (here, the radiographic unit <NUM>) in a three-dimensional space such as an imaging room in which the imaging unit <NUM> is located. In the present embodiment, since the medical imaging processing apparatus <NUM> cooperates with the imaging unit <NUM> which is a radiographic apparatus, the storage unit <NUM> stores information for three-dimensionally specifying the position, posture, and shape of the subject Obj with respect to the radiographic unit <NUM> as the positioning data <NUM>.

The storage unit <NUM> stores the positioning data <NUM> for each subject Obj or for each imaging part of the subject Obj. For example, the storage unit <NUM> stores, as the positioning data <NUM>, two types of information of positioning data of a wrist joint, which is one of imaging parts of the specific subject Obj, and positioning data of a knee joint, which is one of the other imaging parts of the subject Obj. Therefore, the medical imaging processing apparatus <NUM> can appropriately select and use the positioning data <NUM> related to the imaging to be performed by using the subject information and the imaging information acquired by the information acquisition unit <NUM>.

The positioning data <NUM> is data relating to the subject Obj, data relating to another subject different from the subject Obj to be imaged, or schematic model data. The data relating to the subject Obj is data representing the arrangement of the subject Obj with respect to the imaging unit <NUM> (or an imaging apparatus of the same type as the imaging unit <NUM> (an apparatus that may have the same imaging form as the imaging unit <NUM>)) in the past imaging. That is, the data relating to the subject Obj is information for specifying the position, posture, and shape of the subject Obj itself in the past imaging. The data relating to the other subject is information for specifying the position, posture, and shape, in the past imaging, of a person different from the subject Obj currently being imaged. The schematic model data is information for generally determining the ideal position, posture, and shape of the subject Obj, which is not related to actual imaging results of the specific subject, and is, for example, a three-dimensional model by computer graphics. The data related to the subject Obj and the data related to the other subject can be made into a three-dimensional model by computer graphics. In this case, although it is a three-dimensional model, data relating to the subject Obj and data relating to the other subject are used.

In the present embodiment, the positioning data <NUM> is data relating to the subject Obj, that is, information for specifying the position, posture, and shape of the subject Obj itself in the past imaging. This is to support the reproduction of the same position, posture, and shape as in the past imaging. In addition, in the present embodiment, the positioning data <NUM> is a three-dimensional model of the position, posture, and shape of the subject Obj in the past imaging (see <FIG>).

In a case where the positioning data <NUM> is the data relating to another subject different from the subject Obj to be imaged or the schematic model data, the positioning can be appropriately supported even in a case where the subject Obj to be imaged has never imaged in the past, that is, in a case where the subject Obj is imaged for the first time. Therefore, in a case where the positioning data <NUM> is the data relating to the other subject, the storage unit <NUM> stores the positioning data relating to the other subject similar in shape and size to the subject Obj in association with the subject Obj. In addition, in a case where the positioning data <NUM> is the schematic model data, model data similar in shape and size to the subject Obj is stored in association with the subject Obj. The term "stored in association" means to make it possible to smoothly select, from among the plurality of pieces of positioning data <NUM>, data having high relevance such as being similar in shape and size to the subject Obj by using the subject information and/or the imaging information of the subject Obj to be imaged.

In a case where the subject Obj is imaged using the imaging unit <NUM>, the display unit <NUM> three-dimensionally displays the arrangement of the subject with respect to the imaging unit <NUM> by using the positioning data <NUM>. Specifically, the display unit <NUM> displays the arrangement of the subject Obj with respect to the imaging unit <NUM> in a mode showing the three-dimensional position, posture, and shape of the subject Obj. As a result, the display unit <NUM> guides the user <NUM> to arrange the subject Obj as a target of the positioning.

The mode showing the three-dimensional position means a mode in which the user <NUM> can recognize a position where the subject Obj is to be arranged with respect to the imaging unit <NUM> from the display contents of the display unit <NUM>. The mode showing the three-dimensional posture means a mode in which the user <NUM> can recognize a relative posture to be taken by the subject Obj with respect to the imaging unit <NUM> from the display contents of the display unit <NUM>. The mode showing the three-dimensional shape means a mode in which the user <NUM> can recognize a specific three-dimensional shape (for example, an overall shape such as a bending angle of a joint) to be taken by the subject Obj from the display contents of the display unit <NUM>. In particular, in the present embodiment, the display unit <NUM> displays the three-dimensional shape of the subject Obj in a mode that not only shows the overall shape but also shows the unevenness (such as the degree of muscle or fat sticking) of the subject Obj. This is to enable the user <NUM> to more accurately recognize the three-dimensional shape of the subject Obj.

The display unit <NUM> is, for example, a display (liquid crystal display device or the like) that displays, on a screen, a component that serves as a reference for positioning the subject Obj in the imaging unit <NUM> and the subject Obj, a projector that displays the arrangement of the subject Obj by projecting the arrangement of the subject Obj, or an augmented reality (AR) display that recognizes the arrangement of the subject Obj superimposed on reality. The AR display constituting the display unit <NUM> is, for example, a see-through type head-mounted display.

The camera <NUM> images a component (here, the radiographic unit <NUM>) that at least serves as a reference in the positioning of the subject Obj in the imaging unit <NUM> and the subject Obj, by using visible light, infrared light, or the like. The video or image (hereinafter, referred to as a camera image) output by the camera <NUM> may be used by the display unit <NUM> depending on its specific configuration. In a case where the display unit <NUM> is a liquid crystal display device, the display unit <NUM> displays the camera image and displays the arrangement of the subject Obj with respect to the imaging unit <NUM> by superimposing it on the camera image.

In addition, as shown in <FIG>, the camera <NUM> can move in, for example, a direction of an arrow <NUM> with respect to the imaging unit <NUM>, and can image the imaging unit <NUM> and the subject Obj from a plurality of directions while capturing the imaging unit <NUM> and the subject Obj in an imaging range <NUM>. In a case where the imaging direction of the camera <NUM> is changed, the orientations of the imaging unit <NUM> and the subject Obj in the camera image are changed. Therefore, the display unit <NUM> adjusts the display of the arrangement of the subject Obj in accordance with the orientation of the imaging unit <NUM> captured in the camera image.

Hereinafter, the operations of the medical imaging system <NUM> and the medical imaging processing apparatus <NUM> configured as described above will be described. As shown in <FIG>, it is assumed that, for example, the subject Obj is a wrist joint and a radiation image of the side surface of the wrist joint is obtained. In this case, the subject Obj is usually arranged to be inclined at an angle of about <NUM> degrees with respect to the radiographic unit <NUM>. Assuming that an X direction is a direction along the side of the radiographic unit <NUM> that directs the longitudinal direction of the subject Obj, a Y direction is a direction along the side of the radiographic unit <NUM> perpendicular to the X direction, and a Z direction is a direction perpendicular to the X direction and the Y direction (normal direction of the radiographic unit <NUM>), it is ideal arrangement of the subject Obj that a plane <NUM> on which the subject Obj is shown for convenience is inclined at an angle of about <NUM> degrees in the Y direction with respect to the normal line (not shown) of the radiographic unit <NUM>. This is because in a case where the inclination is ± <NUM> degrees or more with the angle as a reference, the obtained radiation image of the side surface of the wrist joint is treated as an imaging failure (so-called imaging loss) and re-imaging is required. In addition, in a case where the same subject Obj has been imaged in the past, since the imaging is also performed in the past imaging as described above, it is necessary to comply with the above reference in order to properly perform comparison with the radiation image obtained in the past imaging. Further, it is desirable that the newly captured radiation image is taken in the same position, posture, and shape as possible as in the past, within a range where imaging loss is not caused. This is to enable particularly accurate comparison with the radiation image obtained in the past imaging.

However, in a case where the subject Obj is actually positioned, the subject Obj may deviate from the ideal arrangement. For example, as shown in <FIG>, in a case of being viewed from the X direction, the actual subject Obj may deviate by an angle θx (degrees) around the X direction with ideal arrangement <NUM> of the subject Obj as a reference. In a case where the angle θx is large and the subject Obj is largely inclined from the ideal arrangement <NUM> to such an extent that the imaging loss is obvious, the positioning directionality of the subject Obj is clear. However, as described above, since the allowable inclination is as small as less than ± <NUM> degrees from the ideal arrangement <NUM>, it is difficult to make a determination on the accuracy of positioning (hereinafter, referred to as positioning determination) as to whether the imaging loss is caused or whether a radiation image that can be compared with the radiation image captured in the past can be obtained, in a case where the subject Obj is positioned with a certain degree of accuracy and the angle θx is relatively small. In particular, in a case where the subject Obj is viewed from the Y direction, a difference ΔZ in height (length in the Z direction) between the ideal arrangement <NUM> and the actual subject Obj is hardly recognized in a case where the angle θx is relatively small. Therefore, it is difficult to determine the positioning even in a case where the subject Obj is viewed from the Y direction.

In addition, as shown in <FIG>, an ulnar side of a palm of the subject Obj is attached to the radiographic unit <NUM>, but the actual subject Obj may be rotated in the Y direction from the ideal arrangement <NUM> depending on the pressing force thereof or the like. An angle θy (degrees) of rotation around the Y direction also causes imaging loss and the like. In a case where the subject Obj is positioned with a certain degree of accuracy and the angle θy is relatively small, the positioning determination is difficult, and in particular, the positioning determination regarding the angle θy is difficult even in a case of being viewed from the X direction.

Therefore, as shown in <FIG>, the medical imaging system <NUM> and the medical imaging processing apparatus <NUM> three-dimensionally display, on the display unit <NUM>, the ideal arrangement <NUM> of the subject Obj with respect to the radiographic unit <NUM> that serves as a reference for positioning in the imaging unit <NUM> by using the positioning data <NUM>. According to the arrangement support display by the display unit <NUM>, the user <NUM> can accurately grasp the position, posture, and shape in which the subject Obj is to be arranged at a glance. That is, according to the arrangement support display of the display unit <NUM>, not only perception of any one of the position, the posture, or the shape in which the subject Obj is to be arranged but also comprehensive perception of these can be made. As a result, even after the subject Obj is positioned with a certain degree of accuracy, the positioning determination can be performed accurately and the subject Obj can be easily positioned in the ideal arrangement <NUM>.

For example, in consideration of a case where the ideal arrangement <NUM> of the subject Obj is shown by two-dimensional (planar) display in which a contour <NUM> of the ideal arrangement <NUM> is superimposed on the subject Obj viewed from the X direction and the Y direction as in the related art, the subject Obj may deviate from the ideal arrangement <NUM> in a case of being viewed from the Y direction after positioning the subject Obj closer to the ideal arrangement <NUM> in a case of being viewed from the X direction. Then, in consideration of this point, after positioning the subject Obj closer to the ideal arrangement <NUM> in a case of being viewed from the Y direction, the subject Obj may deviate from the ideal arrangement <NUM> in a case of being viewed from the X direction again. Therefore, in the two-dimensional presentation method of the ideal arrangement <NUM> in the related art, it is not easy to accurately position the subject Obj even though information is included enough to perceive the ideal arrangement <NUM>. On the other hand, according to the three-dimensional display of the ideal arrangement <NUM> on the display unit <NUM> of the medical imaging system <NUM> and the medical imaging processing apparatus <NUM>, the position, posture, and shape in which the subject Obj is to be arranged can be comprehensively recognized without individually being aware of a plurality of parameters relating to positioning, such as the angle θx and the angle θy. Therefore, by positioning the subject Obj by viewing the arrangement support display of the display unit <NUM>, accurate and easy positioning of the subject Obj can be supported.

The arrangement support display of the display unit <NUM> shows not only the contour <NUM> of the subject Obj in the ideal arrangement <NUM> but also the unevenness thereof by a wire frame <NUM>. Therefore, it is easy to recognize the position, posture, and shape particularly accurately. As a result, the subject Obj can be positioned in the ideal arrangement <NUM> particularly easily and accurately.

In the first embodiment, a case where the subject Obj is a wrist joint is taken as an example, but the subject Obj is optional. For example, as shown in <FIG>, a knee joint can be the subject Obj. Then, according to the arrangement support display for three-dimensionally displaying the ideal arrangement <NUM> of the display unit <NUM>, even in a case where the subject Obj is a knee joint, the position, posture, and shape in which the subject Obj is to be arranged can be comprehensively recognized. Specifically, in a case where the subject Obj is a knee joint and a radiation image of the side surface of the knee joint is captured (<FIG>), the radiation image is captured by making not only a knee joint portion <NUM> but also a thigh <NUM> and a lower leg <NUM> continuing in front of and behind the knee joint portion <NUM> abut on the radiographic unit <NUM>. In a case where the subject Obj is positioned in this manner, for example, rotation (twisting) of the knee joint portion <NUM>, the thigh <NUM>, and/or the lower leg <NUM> occurs around an axis <NUM> parallel to the side of the radiographic unit <NUM> depending on the manner in which the body weight is placed or the degree of force. That is, an angle α of rotation around the axis <NUM> is one of parameters for determining the success or failure of positioning.

As shown in <FIG>, since a positional relationship between a bone and a cartilage of the knee joint portion <NUM> changes depending on an angle β formed by the thigh <NUM> and the lower leg <NUM>, the angle β is also one of the parameters for determining the success or failure of positioning of the subject Obj. Further, since the lower leg <NUM> is usually imaged in parallel to the side of the radiographic unit <NUM>, an angle γ formed by the lower leg <NUM> and the axis <NUM> parallel to the side of the radiographic unit <NUM> is also a parameter for determining the success or failure of positioning.

In a case where the subject Obj is a knee joint, a plurality of parameters such as the angle α, the angle β, and the angle γ need to be considered in the positioning as described above, but the accurate grasp thereof is not easy. Therefore, as in the first embodiment, in a case where the ideal arrangement (not shown) for capturing a radiation image of the side surface of the knee joint is three-dimensionally displayed on the display unit <NUM>, the position, posture, and shape in which the knee joint as the subject Obj is to be arranged can be comprehensively recognized without considering the plurality of parameters individually. As a result, the subject Obj can be positioned in its ideal arrangement easily and accurately. The same applies to joints other than the wrist j oint and the knee j oint, and other subject Obj.

In the first embodiment, the display unit <NUM> may display contour lines or the like in place of the wire frame <NUM> in the arrangement support display. In a case where the ideal arrangement <NUM> is displayed by a so-called solid model in place of the wire frame <NUM>, the unevenness of the subject Obj can be shown by the color of the texture.

The positioning data <NUM> can include information for three-dimensionally specifying the position and posture of the radiation source <NUM> with respect to the radiographic unit <NUM>. Similarly to the display of the ideal arrangement <NUM> of the subject Obj, the display unit <NUM> displays the ideal arrangement of the radiation source <NUM>, thereby supporting the positioning of the radiation source <NUM>.

In the first embodiment, the arrangement support display is performed on the display unit <NUM> by using the positioning data <NUM>, but the positioning data <NUM> can also be used for other controls. For example, as shown in <FIG>, the medical imaging processing apparatus <NUM> may be provided with the determination unit <NUM> and the control unit <NUM>.

The determination unit <NUM> determines a difference between the actual subject Obj and the ideal arrangement <NUM> of the subject Obj displayed by the display unit <NUM>. The difference between the subject Obj and the ideal arrangement <NUM> is, for example, a distance between the corresponding parts of the subject Obj and the ideal arrangement <NUM> or an average thereof, an angle formed by the subject Obj and the ideal arrangement <NUM>, or a volume of overlapping parts (or non-overlapping parts) between the subject Obj and the ideal arrangement <NUM>. Therefore, the determination unit <NUM> determines the difference by using the distance, angle, and/or volume between the subject Obj and the ideal arrangement <NUM> of the subject Obj displayed by the display unit <NUM>. The determination unit <NUM> can obtain the position, posture, and shape of the actual subject Obj by calculating, for example, the position, posture, and shape of the subject Obj using a plurality of camera images captured from different directions. In addition, the determination unit <NUM> can obtain the position, posture, and shape of the subject Obj in the ideal arrangement <NUM> from the positioning data <NUM> used by the display unit <NUM> for the arrangement support display. Therefore, the determination unit <NUM> can determine the difference. In addition, for example, the determination unit <NUM> compares the difference with a predetermined threshold value, and determines that "there is a difference" in a case where the difference is larger than the threshold value and the actual subject Obj and the ideal arrangement <NUM> deviate from each other.

In a case where the determination unit <NUM> determines that "there is a difference", the control unit <NUM> prohibits the imaging unit <NUM> from imaging the subject Obj. The term "prohibits imaging" means to forcibly prevent the execution of imaging even though the user <NUM> gives an instruction by measures such as interlocking the exposure to the radiation Ra.

As described above, the positioning data <NUM> can be used for determining the difference from the ideal arrangement <NUM>. This determination simply and automatically performs the positioning determination performed by the user <NUM>. Therefore, as described above, in a case where the difference is large as a result of the determination of the difference from the ideal arrangement <NUM> using the positioning data <NUM>, the imaging loss can be reduced by prohibiting the imaging. As a result, it is possible to prevent useless exposure of the subject Obj due to re-imaging.

In the first embodiment and the second embodiment, the storage unit <NUM> stores the positioning data <NUM>, but the positioning data <NUM> can be generated by the medical imaging processing apparatus <NUM>. In this case, as shown in <FIG>, the medical imaging processing apparatus <NUM> comprises the subject detection unit <NUM> and the positioning data generation unit <NUM>.

In a case where the subject Obj is imaged using the imaging unit <NUM>, the subject detection unit <NUM> detects the subject Obj with respect to the imaging unit <NUM> from a plurality of locations. Detection of the subject Obj means obtaining the position, posture, and shape of the subject Obj with respect to the imaging unit <NUM>, or an image or other information for specifying the position, posture, and shape. The subject detection unit <NUM> is, for example, any one or a combination of a camera for imaging, using visible light, infrared light, or the like, a component (here, the radiographic unit <NUM>) that at least serves as a reference in the positioning of the subject Obj in the imaging unit <NUM> and the subject Obj, a pressure sensor provided on the imaging surface of the radiographic unit <NUM>, a time-of-flight (TOF) camera for measuring a distance by the flight time of infrared light, and other instrument for measuring a distance or the like. The camera <NUM> can be used as the subject detection unit <NUM>. In this case, the subject detection unit <NUM> and the camera <NUM> are identical.

The positioning data generation unit <NUM> generates the positioning data <NUM> using a result of the detection of the subject detection unit <NUM>. For example, in a case where the positioning data <NUM> is data relating to the subject Obj and is a three-dimensional model, the positioning data generation unit <NUM> specifies the position, posture, and shape of each part of the subject Obj in a case where the imaging is successful, using an image or the like (camera image or the like) obtained from the subject detection unit <NUM>, and generates a three-dimensional model thereof. Then, this data is associated with the subject information and the imaging information and stored in the storage unit <NUM> as the positioning data <NUM>.

As described above, in a case where the medical imaging processing apparatus <NUM> itself generates the positioning data <NUM>, it is not necessary to separately generate the positioning data <NUM> by a three-dimensional model creating device or the like, and the positioning data <NUM> can be automatically accumulated only by imaging the subject Obj using the imaging unit <NUM> cooperating with the medical imaging processing apparatus <NUM>. As a result, a burden on the user <NUM> or the like in a case of creating the positioning data <NUM> can be reduced, and the medical imaging system <NUM> and the medical imaging processing apparatus <NUM> are favorable in usability.

In the first embodiment, the second embodiment, and the third embodiment, the medical imaging processing apparatus <NUM> includes the display unit <NUM> that three-dimensionally displays the ideal arrangement <NUM>, but the medical imaging processing apparatus <NUM> can use a display or the like constituting another device or system as the display unit <NUM>. In this case, as shown in <FIG>, the medical imaging processing apparatus <NUM> can omit the display unit <NUM> and provide the display control unit <NUM> in place of the display unit <NUM>. In a case where the subject Obj is imaged using the imaging unit <NUM>, the display control unit <NUM> three-dimensionally displays the arrangement of the subject Obj with respect to the imaging unit <NUM> on a display unit constituting another device by using the positioning data <NUM>. In this example, the display unit <NUM> of the medical imaging processing apparatus <NUM> of the third embodiment is replaced with the display control unit <NUM>, thereby omitting the configuration of the display unit <NUM> from the medical imaging processing apparatus <NUM>, but also in the medical imaging processing apparatus <NUM> of the first embodiment and the second embodiment, the display unit <NUM> can be omitted and the display control unit <NUM> can be provided.

In the first embodiment, the second embodiment, the third embodiment, and various modification examples, the medical imaging processing apparatus <NUM> includes the camera <NUM>, but the medical imaging processing apparatus <NUM> can use a camera constituting another device or system as the camera <NUM>. In this case, the configuration of the camera <NUM> can be omitted from the medical imaging processing apparatus <NUM> and replaced with a camera control unit (not shown) that controls a camera constituting another device or system, or a camera image acquisition unit (not shown) that acquires a camera image from a camera constituting another device or system. For example, in a case where the subject detection unit <NUM> is composed of the camera <NUM>, the medical imaging processing apparatus <NUM> is preferably provided with a camera control unit that automatically moves the camera <NUM> to perform imaging from a plurality of locations and obtains a camera image necessary for generating the positioning data <NUM>. This is because, by automatically obtaining the necessary camera image, the positioning data <NUM> can be automatically generated, and no explicit operation for generating the positioning data <NUM> is required. In particular, in a case where a camera and a display unit constituting another device or system are used, the configuration of the camera <NUM>, the camera control unit, and the camera image acquisition unit can be omitted from the medical imaging processing apparatus <NUM>. This is because another device or system performs these functions.

In the first embodiment, the second embodiment, the third embodiment, and various modification examples, the camera <NUM> is movable, but a plurality of cameras can be provided in place of making the camera <NUM> movable. In this case, among the plurality of cameras, the required camera is appropriately activated to capture a camera image.

The first embodiment, the second embodiment, the third embodiment, and various modification examples can be combined optionally (for example, partially) to constitute the medical imaging system <NUM> and the medical imaging processing apparatus <NUM>.

In the above embodiment, for example, the hardware structure of a processing unit that executes various kinds of processing, such as the information acquisition unit <NUM>, the determination unit <NUM>, the control unit <NUM>, the positioning data generation unit <NUM>, and the display control unit <NUM>, is various processors as shown below. The various processors include a central processing unit (CPU) that is a general-purpose processor that executes software (programs) to function as various processing units, a graphical processing unit (GPU), a programmable logic device (PLD) that is a processor capable of changing a circuit configuration after manufacture, such as a field programmable gate array (FPGA), and an exclusive electric circuit that is a processor having a circuit configuration exclusively designed to execute various kinds of processing.

One processing unit may be constituted by one of these various processors, or may be a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). In addition, a plurality of processing units may be constituted by one processor. As an example in which the plurality of processing units are constituted by one processor, first, as represented by a computer such as a client or a server, one processor is constituted by a combination of one or more CPUs and software and this processor functions as the plurality of processing units. Second, as represented by a system on chip (SoC) or the like, a processor that realizes the functions of the entire system including the plurality of processing units by using one integrated circuit (IC) chip is used. As described above, the various processing units are constituted by using one or more of the above-described various processors as the hardware structure.

Claim 1:
A medical imaging system comprising:
an imaging unit (<NUM>) that obtains a medical image or data used for generating the medical image by imaging a subject;
a camera (<NUM>) that is configured to image the imaging unit (<NUM>) and the subject, and outputs a camera image;
a processor (<NUM>) configured to store positioning data for specifying an arrangement of the subject with respect to the imaging unit (<NUM>); and
a display unit (<NUM>) that is configured to display the camera image and three-dimensionally display the arrangement of the subject with respect to the imaging unit by superimposing the arrangement on the camera image in a case where the subject is imaged using the imaging unit (<NUM>), wherein the display unit is a liquid crystal display device;
wherein the positioning data is data relating to the subject, data relating to another subject different from the subject, or schematic model data, and
wherein, in a case where the positioning data is the data relating to another subject, the processor (<NUM>) is configured to store positioning data relating to another subject similar in shape and size to the subject in association with the subject,
the camera (<NUM>) is movable with respect to the imaging unit (<NUM>) such that the imaging unit and the subject can be imaged from a plurality directions, and
the display unit (<NUM>) is configured to, in response to a direction having been changed, adjust displaying of the arrangement of the subject in accordance with an orientation of the imaging unit (<NUM>) captured in the camera image.