Medical diagnostic-imaging apparatus and medical-image processing apparatus

A medical diagnostic-imaging apparatus according to an embodiment includes processing circuitry. The processing circuitry acquires three-dimensional medical image data in which a subject is imaged. The processing circuitry extracts a movable range of a probe based on a structure of the subject shown in the three-dimensional medical image data. The processing circuitry sets a target scan region to be a subject to scanning by the probe based on the extracted movable range. The processing circuitry displays the target scan region in the three-dimensional medical image data.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2017-225953, filed on Nov. 24, 2017; and Japanese Patent Application No. 2018-206363, filed on Nov. 1, 2018, the entire contents of all of which are incorporated herein by reference.

FIELD

Embodiments described herein relate generally to a medical diagnostic-imaging apparatus and a medical-image processing apparatus.

BACKGROUND

In heart valve treatment, an ultrasonic diagnostic apparatus and an X-ray computed tomography (CT) apparatus have conventionally been used in combination. For example, a doctor uses a CT image data that has been acquired by an X-ray CT apparatus before the operation to create a treatment plan while referring to desired multiplanar reconstruction (MPR) images. During the operation, a doctor give treatment, referring to the treatment plan created prior to the operation and real-time ultrasound images that are acquired by an ultrasonic diagnostic apparatus. It is preferable that a scan region (scanning section) of ultrasonic images to be displayed at this time be the same cross section as that of the MPR images referred in the treatment planning.

When imaging a heart valve by an ultrasonic diagnostic apparatus, a transesophageal echocardiography (TEE) probe can be used. The TEE probe is an ultrasound probe to be inserted from the mouth to an upper digestive canal, such as the esophagus and the stomach, to image a heart and the like by ultrasound. However, it is difficult to scan a desired area by using the TEE probe.

DETAILED DESCRIPTION

An object of the present embodiment is to provide a medical diagnostic-imaging apparatus and a medical-image processing apparatus in which a desirable scan region can be easily set.

A medical diagnostic-imaging apparatus according to an embodiment includes processing circuitry. The processing circuitry acquires three-dimensional medical image data in which a subject is imaged. The processing circuitry extracts a movable range of a probe based on a structure of the subject shown in the three-dimensional medical image data. The processing circuitry sets a target scan region to be a subject to scanning by the probe based on the extracted movable range. The processing circuitry displays the target scan region in the three-dimensional medical image data.

The medical diagnostic-imaging apparatus and the medical-image processing apparatus according to the embodiment are explained below, referring to the drawings. The embodiment explained below is one example, and the medical diagnostic-imaging apparatus and the medical-image processing apparatus according to the embodiment are not limited to the explanation below.

First Embodiment

A configuration example of an ultrasonic diagnostic apparatus1according to a first embodiment is explained, usingFIG. 1.FIG. 1is a block diagram showing a configuration example of the ultrasonic diagnostic apparatus1according to the first embodiment. As shown inFIG. 1, the ultrasonic diagnostic apparatus1according to the first embodiment includes an apparatus main unit100, an ultrasound probe101, an input device102, and a display103. The ultrasound probe101, the input device102, and the display103are communicably connected to the apparatus main unit100.

The ultrasound probe101has multiple piezoelectric transducers, and these piezoelectric transducers generate ultrasonic waves based on a driving signal provided by transceiving circuitry110included in the apparatus main unit100. Moreover, the ultrasound probe101receives a reflected wave from the subject P and converts it into an electrical signal. The ultrasound probe101further includes a matching layer that is provided for the piezoelectric transducers, a backing material to prevent transmission of ultrasonic waves to the backward direction from the piezoelectric transducers, and the like. The ultrasound probe101is detachably connected to the apparatus main unit100.

When ultrasonic waves are transmitted from the ultrasound probe101to the subject P, the transmitted ultrasonic waves are sequentially reflected by discontinuous surfaces of acoustic impedance in a body tissue of the subject P, and received by the piezoelectric transducers in the ultrasound probe101as a reflected-wave signal. The amplitude of the received reflected-wave signal is dependent on differences in the acoustic impedance on the discontinuous surface by which the ultrasonic waves are reflected. Reflected-wave signals when transmitted ultrasonic wave pulses are reflected by a surface of a moving blood flow, a cardiac wall, and the like are subjected to frequency deviation dependent on a velocity component of a moving body relative to a direction of transmission of ultrasonic waves by the Doppler effect.

The ultrasound probe101according to the first embodiment is, for example, a transesophageal echocardiography (TEE) probe capable of collecting volume data. The TEE probe is the ultrasound probe101that is inserted to an upper digestive canal, such as esophagus and stomach, to image a heart and the like by ultrasound. As one example, the ultrasound probe101is a three-dimensional (3D) TEE probe that has a two-dimensional array in which multiple transducers are arranged in a lattice shape. The TEE probe that has the two-dimensional array can rotate and swing a transducer surface that scans a section (plane) by electronic control. Moreover, for example, the TEE probe that has the two-dimensional array can collect volume data by rotating the scanning plane by 180°. The TEE probe is also known as transesophageal probe.

A structure of the ultrasound probe101according to the first embodiment is explained, usingFIG. 2AandFIG. 2B.FIG. 2AandFIG. 2Bare diagrams showing one example of the structure of the ultrasound probe101according to the first embodiment.FIG. 2Ashows an external view of the ultrasound probe101that is a TEE probe.FIG. 2Bexplains rotation and tilt of a scan region (scanning section) scanned by the ultrasound probe101, which is a TEE probe.

As shown inFIG. 2A, the ultrasound probe101being a TEE probe includes a distal end portion101A, a guide tube101B, and a bending portion101C. The distal end portion101A is a portion that is brought into contact with an interior wall of the esophagus of the subject, and includes a transducer array101D of a two-dimensional array. The guide tube101B is a portion to insert the distal end portion101A into an esophagus, and is constituted of a wiring and a tubular member that connect the distal end portion101A and the apparatus main unit100(or a portion of the ultrasound probe101positioned outside a body). The bending portion101C is a portion that connects the distal end portion101A and the guide tube101B, and has a mechanism of tilting the distal end portion101A relative to the guide tube101B. For example, the bending portion101C tilts the distal end portion101A in a front-and-back direction or in a left-and-right direction relative to the guide tube101B. The front-and-back direction herein is a direction perpendicular to a surface of the transducer array101D, and the left-and-right direction is a direction perpendicular to an axial direction of the guide tube101B and to the front-and-back direction. A tilt angle of the distal end portion101A (end portion angle) can be arbitrarily specified by an operator.

Furthermore, as shown inFIG. 2B, the ultrasound probe101being a TEE probe is structured to be able to rotate and tilt a scan region10in an arbitrary direction. For example, as shown in an illustration on the left inFIG. 2B, when the scan region10is set to an initial position, a center line11of the scan region10is perpendicular to the transducer array101D, and an azimuth direction of the scan region10is perpendicular to the axial direction of the guide tube101B. When the scan region10is rotated by 90°, for example, as shown in an illustration in the upper right inFIG. 2B, the azimuth direction of the scan region10becomes parallel to the axial direction of the guide tube101B while the center line11staying perpendicular to the transducer array101D. Moreover, when the scan region10is tilted, for example, as shown in an illustration in the lower right inFIG. 2B, the center line11is tilted while the azimuth direction of the scan region10staying perpendicular to the axial direction of the guide tube101B. This rotation angle and the tilt angle can be arbitrarily specified by the operator.

Note that what has been explained with reference toFIG. 2AandFIG. 2Bis only an example, and it is not limited to cases illustrated therein. For example, the ultrasound probe101can be a TEE probe that has a one-dimensional array in which multiple transducers are arranged in a single line. Furthermore, the ultrasound probe101can be a mechanical 4D (mecha4D probe) in which multiple piezoelectric transducers arranged in one line can be swung in a predetermined angle (swing angle).

The input device102includes a mouse, a keyboard, a button, a panel switch, a touch command screen, a foot switch, a trackball, a joystick, and the like, and accepts various kinds of setting requests from the operator of the ultrasonic diagnostic apparatus1, and transfers the accepted various kinds of setting requests to the apparatus main unit100.

The display103displays a graphical user interface (GUI) for the operator of the ultrasonic diagnostic apparatus1to input various kinds of setting requests by using the input device102, or displays ultrasonic image data that is generated by the apparatus main unit100, and the like. Furthermore, the display103displays various kinds of messages to notify the operator of processing states of the apparatus main unit100. Moreover, the display103includes a speaker, and can output a sound also. For example, the speaker of the display103outputs predetermined sounds, such as a beep, to notify the operator of a processing state of the apparatus main unit100.

The apparatus main unit100is an apparatus that generates ultrasonic image data based on a reflected-wave signal received by the ultrasound probe101. The apparatus main unit100shown inFIG. 1is an apparatus that can generate two-dimensional ultrasonic image data based on two-dimensional reflected-wave data received by the ultrasound probe101.

The apparatus main unit100includes, as shown inFIG. 1, the transceiving circuitry110, B-mode processing circuitry120, doppler processing circuitry130, image generating circuitry140, storage circuitry150, processing circuitry160, and a communication interface170. The transceiving circuitry110, the B-mode processing circuitry120, the doppler processing circuitry130, the image generating circuitry140, the storage circuitry150, the processing circuitry160, and the communication interface170are communicably connected to each other. Furthermore, the apparatus main unit100is connected to a network5.

The transceiving circuitry110includes a pulse generator, a transmission delaying unit, a pulser, and the like, and provides a driving signal to the ultrasound probe101. The pulse generator repeatedly generates rated pulses to generate transmission ultrasonic waves at a predetermined rate frequency. Moreover, the transmission delaying unit converges ultrasonic waves emitted from the ultrasound probe101into a beam, and gives delay time for each piezoelectric transducer necessary to determine a transmission directivity to each rated pulse generated by the pulse generator. Furthermore, the pulser applies a driving signal (driving pulse) to the ultrasound probe101in timing based on the rated pulse. That is, the transmission delaying unit arbitrarily adjusts a transmission direction of an ultrasonic wave transmitted from the surface of the piezoelectric transducer by varying the delay time to be given to each rated pulse.

The transceiving circuitry110has a function of instantaneously changing a transmission frequency, a transmission driving voltage, and the like to perform a predetermined scan sequence based on an instruction of the processing circuitry160described later. Particularly, the change of the transmission driving voltage is achieved by a linear amplifier transmission circuitry that can change the value instantaneously, or by a mechanism of electrically switching power source units.

Furthermore, the transceiving circuitry110includes a preamplifier, an analog/digital (A/D) converter, a reception delaying unit, an adder, and the like, and generates reflected-wave data by subjecting a reflected-wave signal received by the ultrasound probe101to various kinds of processing. The preamplifier amplifies the reflected-wave signal per channel. The A/D converter A/D converts the amplified reflected-wave signal. The reception delaying unit gives delay time necessary to determine a reception directivity. The adder generates reflected-wave data by performing addition processing of the reflected-wave signal processed by the reception delaying unit. By the addition processing of the adder, a reflection component from a direction according to the reception directivity of the reflected-wave signal is emphasized, a combined beam of transmission and reception of ultrasonic waves by the reception directivity and the transmission directivity.

The transceiving circuitry110causes the ultrasound probe101to transmit a two-dimensional ultrasonic beam when performing two-dimensional scanning of the subject P. The transceiving circuitry110then generates two-dimensional reflected-waved data from two-dimensional reflected-waved signal received by the ultrasound probe101.

The form of an output signal from the transceiving circuitry110can take various forms, such as a signal including phase information called radio frequency (RF) signal, and an amplitude information subjected to envelope detection.

The B-mode processing circuitry120receives reflected-wave data from the transceiving circuitry110, and performs logarithmic amplification, envelope detection processing, and the like to generate data (B-mode data) in which a signal intensity is expressed by a brightness level.

The doppler processing circuitry130performs frequency analysis on speed information in the reflected-wave data received from the transceiving circuitry110, extracts, according to the Doppler effect, blood flow, tissue, and contrast agent echo components, and generates data (doppler data) obtained by extracting moving object information, such as speed, dispersion, and power at multiple points.

The image generating circuitry140generates ultrasonic image data from data that is generated by the B-mode processing circuitry120and the doppler processing circuitry130. That is, the image generating circuitry140generates two-dimensional B-mode image data in which an intensity of reflected wave is expressed by brightness from the two-dimensional B-mode data generated by the B-mode processing circuitry120. Furthermore, the image generating circuitry140generates two-dimensional doppler image data expressing the moving object information from the two-dimensional doppler data generated by the doppler processing circuitry130. The two-dimensional doppler image data is an image in which a speed image, a dispersion image, a power image, or an image of combination of these. The image generating circuitry140is also capable of generating M-mode image data from chronological data of B-mode data on one scanning line generated by the B-mode processing circuitry120. Moreover, the image generating circuitry140can generate a doppler waveform in which speed information of blood flow and tissues are plotted chronologically based on the doppler data generated by the doppler processing circuitry130.

Generally, the image generating circuitry140converts (scan converts) a scanning line signal string of ultrasound scanning into a scanning signal string of a video format typified by television and the like, and generates ultrasonic image data for display. Specifically, the image generating circuitry140performs coordinate conversion according to a scanning mode of ultrasonic waves by the ultrasound probe101, and thereby generates ultrasonic image data for display. Moreover, as various types of image processing processes other than the scan convert process, the image generating circuitry140performs, for example, image processing (smoothing processing) to re-generate a brightness average-value image using multiple image frames subjected to the scan conversion, image processing (edge enhancement processing) by using a differential filter in an image, and the like. Furthermore, the image generating circuitry140adds character information of various parameters, a scale, a body mark, and the like to the ultrasonic image data.

That is, the B-mode data and the doppler data are ultrasonic image data before subjected to the scan conversion, and data that is generated by the image generating circuitry140is ultrasonic image data for display after subjected to the scan conversion. The B-mode data and the doppler data are also called raw data. The image generating circuitry140generates “two-dimensional B-mode image data and two-dimensional doppler image data” that are two-dimensional ultrasonic image data for display from “two-dimensional B-mode data and two-dimensional doppler data” that are two-dimensional ultrasonic image data before subjected to scan conversion.

Furthermore, the image generating circuitry140performs rendering processing on ultrasonic volume data to generate various kinds of two-dimensional image data to display the ultrasonic volume data on the display103. The rendering processing performed by the image generating circuitry140includes processing of generating MPR image data from ultrasonic volume data by performing an MPR method. Moreover, the rendering processing performed by the image generating circuitry140includes processing of performing “curved MPR” on ultrasonic volume data, and processing of performing “maximum intensity projection” on ultrasonic volume data. Furthermore, the rendering processing performed by the image generating circuitry140includes volume rendering (VR) processing and surface rendering (SR) processing to generate two-dimensional image data in which three-dimensional information is reflected.

The storage circuitry150is a memory that stores image data for display that is generated by the image generating circuitry140. Moreover, the storage circuitry150can store data that is generated by the B-mode processing circuitry120and the doppler processing circuitry130also. The B-mode data and the doppler data stored in the storage circuitry150are arranged to be retrievable by the operator after diagnosis, and are to be ultrasonic image data for display via the image generating circuitry140.

Furthermore, the storage circuitry150stores various kinds of data, such as a control program to perform transmission and reception of ultrasonic waves, image processing and display processing, diagnosis information (for example, patient identification (ID), doctor's findings, and the like), diagnostic protocols, and various kinds of body marks. Moreover, data stored in the storage circuitry150can be transferred to an external device through an interface not shown. The external device is, for example, a personal computer (PC) that is used by a doctor performing diagnostic imaging, a storage medium such as a compact disk (CD) and a digital versatile disk (DVD), a printer, and the like.

The processing circuitry160controls overall processing of the ultrasonic diagnostic apparatus1. Specifically, the processing circuitry160controls processing of the transceiving circuitry110, the B-mode processing circuitry120, the doppler processing circuitry130, and the image generating circuitry140based on various kinds of setting requests input by the operator through the input device102, and various kinds of control programs and various kinds of data read from the storage circuitry150. Furthermore, the processing circuitry160controls to display the ultrasonic image data for display that is stored in the storage circuitry150on the display103.

Moreover, the processing circuitry160performs an acquiring function161, a setting function162, a positioning function163, and an output control function164. The acquiring function161is one example of an acquiring unit. The setting function162is one example of a setting unit. Furthermore, the positioning function163is one example of a positioning unit. The output control function164is one example of an output control unit. Details of processing of the acquiring function161, the setting function162, the positioning function163, and the output control function164performed by the processing circuitry160are described later.

Respective processing functions performed by the acquiring function161, the setting function162, the positioning function163, and the output control function164that constitute the processing circuitry160shown inFIG. 1are stored in the storage circuitry150in a form of computer-executable program. The processing circuitry160is a processor that implements functions corresponding to the respective programs by reading and executing the programs from the storage circuitry150. In other words, the processing circuitry160that has read the respective programs is to have the respective functions shown in the processing circuitry160inFIG. 1.

The communication interface170is an interface to communicate with various kinds of devices in a hospital through the network5. The processing circuitry160communicates with an external device by the communication interface170. For example, the processing circuitry160receives medical image data (CT image data, magnetic resonance imaging (MRI) image data, and the like) that is acquired by the medical diagnostic imaging apparatus other than the ultrasonic diagnostic apparatus1through the network5. The processing circuitry160then stores the received medical image data in the storage circuitry150. Furthermore, the processing circuitry160displays the received medical image data on the display103together with ultrasonic image data that is acquired by itself. The medical image data to be displayed can be an image that is subjected to image processing (rendering processing) by the image generating circuitry140. Furthermore, the medical image data to be displayed together with the ultrasonic image data can be acquired through a storage medium, such as a CD read-only memory (ROM), an MO, and a DVD.

In heart valve treatment, the ultrasonic diagnostic apparatus1and an X-ray CT apparatus are used in combination. For example, a doctor creates a treatment plan using CT image data (volume data) that is acquired by the X-ray CT apparatus before the operation, while referring to desired MPR images. During the operation, the doctor gives treatment, referring to the treatment plan created prior to the operation and real-time ultrasound images that are acquired by the ultrasonic diagnostic apparatus1. It is preferable that the ultrasonic image to be displayed at this time be of the same cross section as that of the MPR images referred in the treatment planning.

However, it is difficult to acquire an ultrasonic image of the same cross section as that of the MPR images acquired before the operation. For example, because the TEE probe that is used in imaging a heart valve has limiting conditions in a part on which the probe can abut or in a movable range of the distal end portion101A, it is difficult to image the same scan region (scanning section) as that MPR image generated arbitrarily from CT image data.

Therefore, the ultrasonic diagnostic apparatus1according to the first embodiment has the following processing functions to set a desired scan region easily. In the following, explanation is given with an imaging method using the ultrasound probe101of a TEE probe as an example, but embodiments are not limited thereto. For example, the following embodiment is widely applicable to imaging methods with limiting conditions, such as an imaging method using an enteral probe or a transvaginal probe, and an imaging method called apical approach in which imaging is performed between ribs.

Furthermore, in the following, setting processing of an objective scan region, and guiding processing to guide to an objective scan region are explained sequentially. The setting processing is processing to set an objective scan region to be a target of ultrasonic scanning on CT image data that is acquired prior to the operation. The guiding processing (navigation) is processing to bring a scan region that is actually scanned by the ultrasonic diagnostic apparatus1closer to the objective scan region set by the setting processing.

Setting Processing

First, the setting processing of an objective scan region is explained. The ultrasonic diagnostic apparatus1performs a following processing function as the setting processing. The acquiring function161acquires three-dimensional medical image data in which the subject P is imaged. Moreover, the setting function162sets an objective scan region to be a target of ultrasonic scanning in the three-dimensional medical image data based on limiting conditions relating to the ultrasonic scanning. Specifically, the setting function162extracts a three-dimensional area corresponding to a movable range from the three-dimensional medical image data based on the limiting conditions including a movable range of the ultrasound probe101with respect to the subject P, and sets an objective scan region according to the extracted three-dimensional region. In other words, the setting function162serving as the extracting unit extracts a movable range of the probe based on a structure of the subject shown in the three-dimensional medical image data. The setting function162serving as the setting unit sets a target scan region to be a target of scanning by the probe based on the extracted movable range. The objective scan region is also referred to as target scan region.

The limiting conditions include, for example, a “movable range” in a scan region with respect to a contact surface of the ultrasound probe101, a “tiltable range of the ultrasound probe101with respect to the subject P, and a “scannable range” in a scan region. For example, in the imaging method using a TEE probe, the movable range is the interior wall of the esophagus. This interior wall of the esophagus differs per subject P (patient), and can be extracted from three-dimensional medical image data that is acquired in advance. Moreover, the tiltable range is determined by a limit value of a rotation angle and a limit value of a tilt range of a scan region with respect to an interior wall of an esophagus. The limit value of the rotation angle and the limit value of the tilt angle vary according to a type of the TEE probe, and can be acquired from product information of the TEE probe. Furthermore, the scannable range is determined by an azimuth direction and a length (distance) in a depth direction of a scan region, and can be acquired from product information of the TEE probe. There is a limiting condition that the shallowest part in the scannable range (hereinafter, described as “shallowest part”) is a position in contact with a transducer and is included in the movable range. The limiting conditions are stored in advance in the storage circuitry150or a storage device that can be connected through the network5. The stored limiting conditions can be arbitrarily changed as appropriate by the operator. Moreover, the movable range of the TEE probe is not limited to the interior wall of an esophagus. For example, a lumen of the esophagus can be extracted based on CT values. That is, the movable range of the TEE probe is only required to be a range including at least the lumen of the esophagus.

Note that the limiting conditions described above are one example in the case of using a TEE probe, and it is not limited thereto. For example, when an enteral probe or a transvaginal probe is used, the movable range is to be an interior wall of an intestine or a vagina. Moreover, in the case of the apical approach, the movable range is to be a portion between ribs. The tiltable range and the scannable range can be acquired from product information and the like, similarly to the case of a TEE probe.

The setting processing in the ultrasonic diagnostic apparatus1according to the first embodiment is specifically explained, usingFIG. 3.FIG. 3is a flowchart showing a procedure of the setting processing in the ultrasonic diagnostic apparatus1according to the first embodiment. The procedure shown inFIG. 3is started when an input instructing start of the setting processing is accepted from the operator. InFIG. 3, explanation is given, referring toFIG. 4andFIG. 5.FIG. 4andFIG. 5are diagrams for explaining the setting processing in the ultrasonic diagnostic apparatus1according to the first embodiment.

In the following explanation of the setting processing, a case in which an objective scan region is set in CT image data is explained, but embodiments are not limited thereto. For example, the ultrasonic diagnostic apparatus1can set an objective scan region in three-dimensional medical image data in which the subject P is imaged by any medical diagnostic imaging apparatus, not limited to CT image data. For example, the ultrasonic diagnostic apparatus1can set an objective scan region in MR image data that is acquired by an MRI apparatus or three-dimensional image data that is acquired by the ultrasonic diagnostic apparatus1.

At step S101, the processing circuitry160determines whether an input indicating start of the setting processing is accepted. For example, the operator inputs an instruction to start the setting processing by using the input device102. The input device102outputs information indicating start of the setting processing input by the operator to the processing circuitry160. The processing circuitry160determines that an input indicating start of the setting processing is received (step S101: YES) when information indicating start of the setting processing is accepted from the input device102, and starts processing from step S102and later. The processing circuitry160is in a standby state, suspending start of the processing at step S102and later until an input indicating start of the setting processing is received (step S101: NO).

At step S102, the acquiring function161reads out CT image data. For example, the acquiring function161acquires the CT image data from the storage circuitry150. The CT image data is, for example, image data in which a region (for example, chest) including the heart of the subject P is imaged by the X-ray CT apparatus. When CT image data is not stored in the storage circuitry150, the acquiring function161can acquire it from an X-ray CT apparatus connected through the network5, an external storage device for medical image data storage, or the like also.

At step S103, the setting function162extracts a region corresponding to the esophagus from the CT image data. For example, the setting function162performs segmentation processing on the CT image data acquired by the acquiring function161, and thereby extracts a region corresponding to the esophagus of the subject P.

For example, as shown inFIG. 4, the setting function162displays VR image20, MPR images21,22,23in a display region103A of the display103. The VR image20is a rendering image in which the heart and peripheral organs of the subject P are drawn. Moreover, the MPR images21,22,23are tomograms of a sagittal section, a coronal section, and an axial section of the chest of the subject P. The VR image20and the MPR images21,22,23are generated by various kinds of rendering processing on the CT image data acquired by the acquiring function161.

For example, the operator specifies one point included in the region of the esophagus in the MPR images21,22,23inFIG. 4. In the example shown inFIG. 4, a part of the esophagus is drawn in the MPR image21. Therefore, the operator brings a cursor to the region of the esophagus in the MPR image21, and presses a button to specify one point. Thus, the setting function162recognizes that the point specified by the operator is a point included in the region of the esophagus. The setting function162then extracts an extraction region30corresponding to the esophagus from the CT image data by performing the segmentation processing to extract an image region having a CT value similar to that of the point specified by the operator. The setting function162displays (highlighting) the extraction region30on the VR image20and the MPR image21.

As described, the setting function162extracts a three-dimensional region (the extraction region30) corresponding to the movable range from three-dimensional medical image data. What is illustrated inFIG. 4is only one example, and it is not limited to the illustration therein. For example, the case in which one point in the esophagus is specified in the MPR image21has been explained inFIG. 4. This is because the esophagus is drawn in the MPR image21. Therefore, for example, when the esophagus is drawn in the MPR image22or the MPR image23, the operator can specify one point in the esophagus in the MPR image22or the MPR image23. Furthermore, when the esophagus is not drawn in any of the MPR images21,22,23, the operator can search for a tomogram in which the esophagus is drawn by changing positions of respective tomograms to specify one point in the esophagus.

Moreover, the case in which the extraction region30is extracted manually has been explained inFIG. 4, but embodiments are not limited thereto, and the extraction region30can be extracted automatically. For example, the setting function162can extract the region of the esophagus automatically from three-dimensional medical image data based on the movable range, “the interior wall of the esophagus”. In this case, the setting function162can extract the extraction region30automatically, by using CT values of the esophagus, physical characteristics, positional relationship with respect to other organs, such as the heart and the lung. Furthermore, the setting function162can prompt the operator to do the operation to specify one point in the esophagus by outputting a message of “please specify a region of esophagus” by an image or a voice.

At step S104, the setting function162accepts an input of a position of tomographic section. For example, the operator browses tomograms, to search for an appropriate tomogram to set an objective scan region. As a specific example, the operator inputs an instruction to tilt the MPR images21,22,23shown inFIG. 4.

At step S105, the setting function162changes the position of tomographic section of a display target within a range of the limiting conditions. For example, the setting function162changes the position of tomographic section to be displayed in the three-dimensional medical image data within a range satisfying the movable range and the tiltable range.

For example, the setting function162determines whether the position of tomographic section input at step S104satisfies the limiting conditions. Specifically, the setting function162determines whether the tomogram at the input position of tomographic section includes the extraction region30, and whether the angle of the position of tomographic section relative to the interior wall of the esophagus is included in the tiltable range. When the both conditions are satisfied, that is, when the tomogram includes the extraction region30and the angle of the position of tomographic section is included in the tiltable range, the setting function162determines that the limiting conditions are satisfied. When the limiting conditions are satisfied, the setting function162changes the position of tomographic section to be displayed. When the limiting conditions are not satisfied, the setting function162does not change the input position of tomographic section.

As described, the setting function162changes the position of tomographic section in which the objective scan region is set in the three-dimensional medical image data within the range satisfying the limiting conditions.

At step S106, the setting function162displays the tomogram corresponding to the position of tomographic section. For example, the setting function162displays a tomogram corresponding to the position of tomographic section changed at step S105in the display region103A.

For example, as shown inFIG. 5, the setting function162displays an MPR image24instead of the MPR images21,22,23shown inFIG. 4. The MPR image24is a tomogram corresponding to the position of tomographic section that is specified by the operator to set an objective scan region40. In the MPR image24, the extraction region30is drawn. In this case, the objective scan region40and a center line41are not drawn in the MPR image24yet.

At step S107, the setting function162determines whether a position of tomographic section is decided. For example, when the operator views the MPR image24and determines to be appropriate as a cross section in which the objective scan region40is set, the operator presses a confirmation button. Thus, the setting function162determines that the position of tomographic section is decided (step S107: YES), and shifts to processing at step S108. When the position of tomographic section is not decided (step S107: NO), the setting function162repeats the processing at step S104to step S106until the position of tomographic section is decided. That is, the operator can change the position of tomographic section to an arbitrary position within the range of the limiting conditions until the position of tomographic section is decided.

At step S108, the setting function162displays the preset objective scan region40on the tomogram. For example, when the position of tomographic section is decided by the operator, the setting function162displays the objective scan region40on the MPR image24and the VR image20as shown inFIG. 5. For the preset objective scan region40, for example, the direction of the center line41, the length (width) of in the azimuth direction, and the length in the depth direction are defined, and the shallowest part is positioned to be included in the extraction region30. The setting function162displays MPR images25,26. The MPR image25is a perpendicular cross section that is perpendicular to the MPR image24passing through the center line41. Moreover, the MPR image26is a perpendicular cross section that is perpendicular to the center line41and the MPR image24. The setting function162displays a broken line indicating the position of the objective scan region40on the MPR images25,26also.

At step S109, the setting function162accepts an input of a position, a direction, or a size of the objective scan region40. For example, the operator translates the objective scan region40on the MPR image24. Furthermore, the operator rotates the center line41about the shallowest part. Moreover, the operator changes the width in the azimuth direction and the length in the depth direction. Thus, the setting function162accepts an input of a position change, rotation, a change in the size of the objective scan region40.

At step S110, the setting function162changes the position, direction, or size of the objective scan region40within the range of the limiting conditions. For example, the setting function162sets the objective scan region40such that the shallowest part of the objective scan region40is included in a three-dimensional region (the extraction region30). Furthermore, for example, the setting function162sets the shallowest part, the scanning direction, the width in the azimuth direction, and the length in the depth direction of the objective scan region40within the range satisfying the scannable range.

For example, the setting function162determines whether the position, the direction, or the size of the objective scan region40input at step S109satisfies the limiting condition. Specifically, the setting function162determines whether the input shallowest part of the objective scan region40is included in the extraction region30. When the shallowest part is included in the extraction region30, the setting function162determines that the position of the objective scan region40satisfies the limiting conditions, and changes it to the input position of the objective scan region40. Moreover, the setting function162determines whether the input azimuth direction and size (length) in the depth direction of the objective scan region40satisfy the scannable range. When the azimuth direction and the length in the depth direction satisfy the scannable range, the setting function162changes them to the input azimuth direction and size in the depth direction of the objective scan region40.

As described, the setting function162sets the objective scan region40on a position of tomographic section within a range satisfying the limiting conditions. That is, the setting function162extracts at least a lumen of the esophagus of the subject P as a three-dimensional region, and sets a region in which a transesophageal probe positioned in the lumen can perform ultrasonic scanning based on the extracted lumen, the tiltable range, and the scannable range. In this case, the region in which the ultrasonic scanning can be performed is a scannable region by a TEE probe that is inserted to the lumen of the esophagus, and is a region in a substantially cylindrical shape (a cylindrical shape warped along the esophagus) wider than the lumen of the esophagus. Furthermore, the setting function162can display the region in which ultrasonic scanning can be performed on the display103. For example, the setting function162can display the region in which ultrasonic scanning can be performed on the VR image20, or can display a tomographic section of the region in which ultrasonic scanning can be performed on the MPR images21,22,23.

What is illustrated inFIG. 5is only an example, and it is not limited the illustration. For example, the case in which the MPR images21,22,23are not displayed has been explained inFIG. 5, but it is not limited thereto. For example, the setting function162can display, when setting the objective scan region40, the VR image20and the MPR images21,22,23,24,25,26at the same time in the display region103A. Furthermore, the operator can arbitrarily set which image to display each time.

At step S111, the setting function162determines whether to readjust the position of tomographic section. For example, when the operator views the objective scan region40and determines that the position of tomographic section of the objective scan region40is inappropriate, the operator inputs an instruction to readjust the position of tomographic section. Thus, the setting function162determines to readjust the position of tomographic section (step S111: YES), and shifts to processing at step S104. When the position of tomographic section is not readjusted (step S111: NO), the setting function162shifts to processing at step S112.

At step S112, the setting function162determines whether the objective scan region40is decided. For example, when the operator views and determines that the objective scan region40is appropriate, the operator presses the confirmation button. Thus, the setting function162determines that the objective scan region40is decided (step S112: YES), and ends the setting processing of the objective scan region40. When the position of tomographic section is not decided (step S112: NO), the setting function162repeats the processing at step S109to S11until the objective scan region40is decided. That is, the operator can change the position of tomographic section and the objective scan region40within the range of the limiting conditions until the objective scan region40is decided.

The procedure shown inFIG. 3is only an example, and embodiments are not limited thereto. For example, the procedure described above can be changed appropriately within a range not causing contradictions in the processing.

Moreover, the case in which the setting processing is performed in the ultrasonic diagnostic apparatus1has been explained inFIG. 3, but embodiments are not limited thereto. For example, the setting processing shown inFIG. 3can be performed in other medical-image processing apparatuses, such as a work station and a console device of an X-ray CT apparatus. In this case, information indicating the position of the objective scan region40set on CT image data is output to the ultrasonic diagnostic apparatus1together with the CT image data, and is used in the guiding processing explained later.

Furthermore, the case in which the position of tomographic section and the objective scan region40are set within the range satisfying the limiting conditions by excluding a position of tomographic section and the objective scan region40out of the range of the limiting conditions from the display has been explained inFIG. 3, but embodiments are not limited thereto. For example, the setting function162can display a position of tomographic section and the objective scan region40desired by the operator regardless of the limiting conditions, and can determine whether the limiting conditions are satisfied at the point of time when the position of tomographic section and the objective scan region40are confirmed to be decided. That is, when the position of tomographic section and the objective scan region40set by the operator do not satisfy the limiting conditions, the fact is informed, and the operator repeats re-setting a position of tomographic section and the objective scan region40until the limiting conditions are satisfied.

Guiding Processing

Next, the guiding processing to the objective scan region40is explained. The ultrasonic diagnostic apparatus1performs a following processing function as the guiding processing. That is, the positioning function163performs positioning of ultrasonic image data that is collected by ultrasonic scanning and three-dimensional medical image data. Furthermore, the output control function164outputs guiding information to bring a scan region corresponding to the ultrasonic image data closer to the objective scan region40based on a difference between a scan region corresponding to the ultrasonic image data subjected to the positioning and the objective scan region40set in the three-dimensional medical image data subjected to positioning.

The guiding processing in the ultrasonic diagnostic apparatus1according to the first embodiment is specifically explained, usingFIG. 6.FIG. 6is a flowchart of a procedure of the guiding processing in the ultrasonic diagnostic apparatus1according to the first embodiment. The procedure shown inFIG. 6is started when an input indicating start of the guiding processing is accepted. Explanation is given inFIG. 6, referring toFIG. 7.FIG. 7is a diagram for explaining the guiding processing in the ultrasonic diagnostic apparatus1according to the first embodiment. Note that when the guiding processing is performed, the information set in the setting processing is displayed in advance in the display region103A of the display103. For example, inFIG. 7, the VR image20, the MPR images24,25,26are displayed, and the extraction region30, the objective scan region40, and the center line41are displayed on these images.

At step S201, the processing circuitry160determines whether an input indicating start of the guiding processing is accepted from the operator. For example, the operator inputs an instruction for start of the guiding processing by using the input device102. The input device102outputs information indicating start of the guiding processing input by the operator to the processing circuitry160. The processing circuitry160determines that an input indicating start of the guiding processing is accepted when the information indicating start of the guiding processing is accepted from the input device102, and starts processing at step S202and later. The processing circuitry160is in a standby state without starting the processing at step S202and later until an input indicating start of the guiding processing is accepted.

At step S202, the processing circuitry160collects ultrasonic image data. For example, the processing circuitry160controls the transceiving circuitry110to cause the ultrasound probe101to perform ultrasonic scanning, and collects B-mode image data of a current frame.

At step S203, the processing circuitry160displays an ultrasonic image. For example, the processing circuitry160displays an ultrasonic image50in the display region103A of the display103as shown inFIG. 7.

At step S204, the positioning function163performs positioning of the ultrasonic image data and the CT image data. For example, the positioning function163performs the positioning by pattern matching between the ultrasonic image data and the CT image data. Specifically, the positioning function163extracts characteristic regions from each of the ultrasonic image data and the CT image data, and searches for similar regions among the extracted regions, thereby performing the positioning of the ultrasonic image data and the CT image data. The positioning function163can perform the positioning using any conventional technique, not limited to pattern matching. For example, when a position sensor (magnetic sensor, or the like) is mounted on the ultrasound probe101, the positioning can be performed by using position information.

At step S205, the output control function164displays a current scan region60on the VR image20and the MPR images24,25,26. For example, as shown inFIG. 7, the output control function164displays the scan region60corresponding to current B-mode image data, and a center line61thereof on the VR image20and the MPR images24,25,26as shown inFIG. 7. That is, the output control function164serving as the display control unit displays a target scan region in three-dimensional medical image data.

At step S206, the output control function164calculates a difference between the current scan region60and the objective scan region40. For example, the output control function164calculates a difference in the depth direction as “−10 mm”, a difference in an element rotation angle expressing the rotation angle of the scan region60as “+10°”, a difference in a distal end angle (front-back) being an angle in the front-and-back direction of the distal end portion101A as “5°”, and a difference in a distal end angle (left-right) being an angle in the left-and-right direction of the distal end portion101A as “+3°”.

At step S207, the output control function164determines whether the objective scan region40is imaged. For example, the output control function164determines whether positions, directions, and sizes of the current scan region60and the objective scan region40are matching with each other. When not matching (step S207: NO), the output control function164shifts to processing at step S208. On the other hand, when matching (step S207: YES), the output control function164shifts to processing at step S210. “Matching” herein is not limited to complete matching without the least difference, but can include an allowable level of errors.

At step S208, the output control function164displays guiding information based on the differences. For example, as shown inFIG. 7, the output control function164displays guiding information70in the display region103A. In the guiding information70, difference information calculated at step S″06is given. The guiding information70is not limited to the illustrated example. For example, items given in the guiding information70can be changed arbitrarily. Moreover, the guiding information70is not necessarily required to be output as numeric value information, and can be output, for example, as an image of arrows according to a difference, or can be output as a voice reading the difference.

At step S209, the operator adjusts an imaging position. For example, the operator operates the ultrasound probe101of a TEE probe such that the difference described in the guiding information70decreases. Thus, the operator brings the current scan region60closer to the objective scan region40. The processing circuitry160then shifts to the processing at step S202, and repeats the processing at step S202to S209until the current scan region60and the objective scan region40match with each other (step S207: YES).

At step S210, the output control function164informs of completion of adjustment of the imaging position. For example, the output control function164informs, when the current scan region60and the objective scan region40become matching with each other, the completion of adjustment of the imaging position by highlighting the current scan region60. The processing circuitry160then ends the guiding processing. After the guiding processing is ended, the ultrasonic diagnostic apparatus1performs collection of ultrasonic image data for diagnosis (or operation) of the subject P as appropriate.

The procedure shown inFIG. 6is only an example, and embodiments are not limited thereto. For example, the procedure described above can be changed appropriately within a range not causing contradictions in the processing.

For example, the case in which the operator manually adjusts an imaging position has been explained at step S209inFIG. 6, but embodiments are not limited thereto. For example, when it is electronically adjustable, the output control function164can adjust an imaging position automatically. For example, when ultrasonic scanning is performed by a two-dimensional array probe or a mecha4D probe, the output control function164can bring the scan region60closer to the objective scan region40by controlling an electronic scanning of the two-dimensional array probe, or a swinging direction of the mecha4D probe.

As described above, in the ultrasonic diagnostic apparatus1according to the first embodiment, the acquiring function161acquires three-dimensional medical image data in which the subject P is imaged. Moreover, the setting function162sets the objective scan region40to be a subject of ultrasonic scanning in the three-dimensional medical image data based on limiting conditions relating to the ultrasonic scanning. According to this arrangement, the ultrasonic diagnostic apparatus1according to the first embodiment can set a desired scan region easily. For example, because the objective scan region40is set, even when there are limiting conditions in an imaging method as in the case of a TEE probe, within a range of the limiting conditions in an abuttable portion or in a movable range of the distal end portion101A, the ultrasonic diagnostic apparatus1can image a scan region same as that of an MPR image that is arbitrarily generated from CT image data easily.

Moreover, in the ultrasonic diagnostic apparatus1according to the first embodiment, the positioning function163performs positioning of ultrasonic image data collected by ultrasonic scanning and three-dimensional medical image data. Furthermore, the output control function164outputs the guiding information to bring a scan region corresponding to the ultrasonic image data closer to the objective scan region40based on a difference between the scan region corresponding to the ultrasonic image data subjected to the positioning and the objective scan region40set in the three-dimensional medical image data subjected to the positioning. According to this arrangement, even when there are limiting conditions in an imaging method as in the case of a TEE probe, the ultrasonic diagnostic apparatus1according to the first embodiment can acquire a scan region same as that of an MPR image that is arbitrarily generated from CT image data easily.

Second Embodiment

The case in which the single objective scan region40is set has been explained in the first embodiment, but embodiments are not limited thereto. For example, the ultrasonic diagnostic apparatus1is applicable also to a case in which more than one objective scan region40is set.

The ultrasonic diagnostic apparatus1according to a second embodiment has a structure similar to that of the ultrasonic diagnostic apparatus1shown inFIG. 1, but a part of the processing of the setting function162and the output control function164is different therefrom. Therefore, points that differ from the first embodiment are mainly explained in the second embodiment, and explanation about points having functions similar to those in the structure explained in the first embodiment is omitted.

The setting function162according to the second embodiment sets the multiple objective scan regions40. For example, the operator sets the objective scan region40for the middle of operation and the objective scan region40for post-operation individually. The objective scan region40for the middle of operation corresponds to, for example a scan region to observe a heart valve. Moreover, the objective scan region40for post-operation corresponds to, for example, a scan region to observe blood flow conditions (whether regurgitation is observed). As the setting function162basically performs the same processing as the processing explained in the first embodiment except a point that more than one objective scan region40is set, detailed explanation is omitted.

When the multiple objective scan regions40are set, the output control function164according to the second embodiment sequentially outputs respective guiding information for the respective objective scan regions40. For example, the operator selects the objective scan region40for the middle of operation as a subject of guiding during an operation. The output control function164calculates a difference between the selected objective scan region40for the middle of operation and the scan region60corresponding to the current ultrasonic image data. The output control function164then outputs the guiding information based on the calculated difference. Thus, the operator performs an operation after moving the current scan region60to the position of the objective scan region40for the middle of operation.

Furthermore, when the operation is finished, the operator selects the objective scan region40for post-operation as a subject of guiding. The output control function164calculates a difference between the selected objective scan region40for post-operation and the scan region corresponding to the current ultrasonic image data. The output control function164then outputs the guiding information based on the calculated difference. Thus, the operator observes post-operation blood flow after moving the current scan region60to the position of the objective scan region40for post-operation.

As described, the ultrasonic diagnostic apparatus1according to the second embodiment sets the multiple objective scan regions40, and outputs the guiding information based on a difference between a subject scan region selected from among the objective scan regions40and a scan region corresponding to ultrasonic image data. Thus, for example, the operator can perform imaging easily even when the multiple objective scan regions40are present.

The above explanation is only an example, and it is not limited to what is explained above. For example, the case in which the two objective scan regions40are set for the middle of operation and for post-operation has been explained in the example described above, embodiments are not limited thereto. For example, not limited to uses (timing) such as the middle of operation and post-operation, the objective scan region40can be set in the arbitrary number.

Moreover, the case in which the guiding processing is performed sequentially one by one for the multiple objective scan regions40has been explained in the example described above, but embodiments are not limited thereto. For example, the guiding processing for the multiple objective scan regions40can be parallelly performed at the same time. That is, the output control function164can output multiple pieces of the guiding information to bring a scan region of an ultrasound probe closer to the respective objective scan regions based on differences between the respective objective scan regions and the scan region corresponding to the ultrasonic image data. IN this case, for example, the same number of pieces of the guiding information70as the number of the objective scan regions40are displayed in the display region103A.

Third Embodiment

Moreover, the case in which a single piece of three-dimensional image data is used has been explained in the embodiments described above, but embodiments are not limited thereto. For example, the ultrasonic diagnostic apparatus1can use more than one piece of three-dimensional image data.

For example, in an operation of a heart valve, a technique called rapid pacing in which blood flow is temporarily suppressed by stimulating a heart with high frequency can be used. In this case, different from normal beats, the heart is convulsed. Accordingly, it is impossible to estimate what type of heart makes what type of convulsion in the rapid pacing and, therefore, it is difficult to determine a cardiac phase of three-dimensional medical image data acquired in advance to one time phase.

Therefore, in the third embodiment, three-dimensional medical image data of multiple cardiac phases are acquired in advance, and the objective scan region40for reference is set to each piece of the three-dimensional medical image data. In an operation, data of a cardiac phase similar to the state of the heart during the rapid pacing is selected from among the three-dimensional medical image data of multiple cardiac phases to use as a reference.

That is, the acquiring function161according to the third embodiment acquires multiple pieces of three-dimensional medical image data in which a region including the heart of the subject P is imaged at multiple cardiac phases different from each other. The operator sets the objective scan region40in each of the acquired multiple pieces of the three-dimensional medical image data.

The setting function162uses, when a cardiac phase for which the objective scan region40has already been set is present among the multiple cardiac phases, the objective scan region40already set as an initial position to set the objective scan region40for other cardiac phases. That is, when the multiple pieces of the three-dimensional medical image data include three-dimensional medical image data in which an objective scan region has been set and three-dimensional medical image data in which an objective scan region has not been set, the setting function162uses information about the objective scan region already been set as the initial position to set an objective scan region in three-dimensional medical image data in which an objective scan region has not been set yet.

For example, there is a case in which four pieces of CT image data of a first to a fourth cardiac phases are acquired as three-dimensional medical image data of multiple cardiac phases. In this case, the setting function162sets the objective scan region40for the CT image data of the first cardiac phase similarly to the setting processing explained in the first embodiment. The setting function162then uses information about the objective scan region40set for the first cardiac phase as an initial position to set the objective scan region40for the CT image data of the second to the fourth cardiac phases.

Specifically, the objective scan region40already been set includes information, such as a position of tomographic section, a direction of the center line41relative to the esophagus (the extraction region30), and a size of the objective scan region40. Therefore, the setting function162sets an initial position of the objective scan region40by applying the information such as the position of tomographic section, the direction of the center line41relative to the esophagus (the extraction region30), and the size of the objective scan region40to the CT image data of the second to the fourth cardiac phases. Thus, the operator can set the objective scan region40easily.

The positioning function163performs positioning of three-dimensional medical image data selected from among data of the multiple cardiac phases and ultrasonic image data. For example, when the first cardiac phase is selected by the operator from among the first to the fourth cardiac phases, the positioning function163performs positioning of the CT image data of the first cardiac phase and current B-mode image data.

Sequentially, the output control function164outputs the guiding information70based on a difference between the objective scan region40of a cardiac phase selected from among the multiple cardiac phases and a scan region corresponding to ultrasonic image data. For example, when the first cardiac phase is selected by the operator from among the first to the fourth cardiac phases, the output control function164outputs the guiding information70based on a difference between the objective scan region40of the first cardiac phase and the current scan region60. Thus, the operator can select a cardiac phase similar to a state of a heart during the rapid pacing appropriately to user as a reference.

Other Embodiments

In addition to the embodiments described above, it can be implemented by various different embodiments.

Application to Medical Image-Processing Apparatus

Among the processing explained in the embodiments described above, the setting processing can be implemented similarly in a medical image-processing apparatus also.

FIG. 8is a block diagram showing a configuration example of a medical image-processing apparatus200according to another embodiment. The medical image-processing apparatus200corresponds to, for example, an information processing apparatus, such as a personal computer and a workstation, or a control device of a medical diagnostic imaging apparatus, such as a console device included in an X-ray CT apparatus.

As shown inFIG. 8, the medical image-processing apparatus200includes input circuitry201, a display202, storage circuitry210, and processing circuitry220. The input circuitry201, the display202, the storage circuitry210, and the processing circuitry220are communicably connected to each other.

The input circuitry201is an input device, such as a mouse, a keyboard, and a touch panel, to accept various kinds of instructions and setting requests from the operator. The display202is a display device that displays medical images, and that displays a GUI for the operator to input various kinds of setting requests by using the input circuitry201.

The storage circuitry210is, for example, a NAND (Not And) flash memory or a hard disk drive (HDD), and stores various kinds of programs to display medical image data and a GUI, and information used by the programs.

The processing circuitry220is an electronic device (processor) to control the overall processing in the medical image-processing apparatus200. The processing circuitry220performs an acquiring function221and a setting function222. The respective processing functions performed by the processing circuitry220are stored in the storage circuitry210in a form of computer-executable program. The processing circuitry220implements functions corresponding to the respective programs by reading and executing the programs.

For example, the acquiring function221can perform basically the same processing as the acquiring function161shown inFIG. 1. That is, the acquiring function221acquires three-dimensional medical image data in which a subject is imaged. Moreover, the setting function222can perform basically the same processing as the setting function162shown inFIG. 1. That is, the setting function222sets an objective scan region to be a subject of ultrasonic scanning in three-dimensional medical image data. According to this arrangement, the medical image-processing apparatus200can set a desired scan region easily.

Although it is explained that the respective processing functions explained below are implemented by a single unit of the processing circuitry160in the present embodiment, the processing circuitry can be configured by combining multiple independent processors to implement the functions by the respective processors executing the programs.

Application to Other Medical Diagnostic-Imaging Apparatuses

In the above embodiments, the case in which the functions according to the embodiments are applied to the ultrasonic diagnostic apparatus1has been explained, but it is not limited thereto. For example, the functions according to the embodiments are also applicable to other medical diagnostic-imaging apparatuses. For example, the other medical diagnostic-imaging apparatuses include an intravascular ultrasoundscan (IVUS), an optical coherence tomography (OCT), an endoscope, and the like.

IVUS is a technique in which a micro-ultrasonic transducer is guided into a blood vessel lumen, ultrasonic waves are transmitted and received in a 360 degree direction from the transducer, to acquire a tomogram in a disk shape corresponding to a minor axis direction of the blood vessel. In IVUS, a probe to be guided into a blood vessel lumen is used, and the blood vessel of a subject corresponds to a movable range. Moreover, a target scan region in IVUS is defined based on a position on a core line of the blood vessel, a distance from the position (corresponding to a radius of the disk shape).

OCT is a technique of acquiring a precise tomogram of a tissue under noninvasive condition based on the principle of interferometer using reflected light of near infrared ray that passes well through a tissue of a living body. IN OCT, a probe that performs scanning by near infrared rays is used, when the probe of OCT is inserted into a body of a subject to perform imaging, a lumen, such as an esophagus and an intestine, corresponds to a movable range. Furthermore, a target scan region in OCT is defined based on a position on a core line of a lumen region, an irradiation direction of near infrared rays from the position, an irradiation range, and the like.

The endoscope is an optical device to observe the inside of a subject body, such as a lumen region of an esophagus and an intestine and an incised portion on a body surface. The endoscope corresponds to a probe that is inserted into the body of a subject. Moreover, in the endoscope, an insertion portion corresponds to a movable range. Furthermore, in the endoscope, a field of view to be a subject of observation corresponds to a target scan region.

That is, in a medical diagnostic-imaging apparatus, such as IVUS, OCT, and an endoscope, a processing circuitry acquires three-dimensional medical image data (for example, CT image data) in which a subject is imaged. Moreover, the processing circuitry extracts a movable range of a probe based on a structure of the subject shown in the three-dimensional medical image data. Furthermore, the processing circuitry sets a target scan region to be a subject of scanning by the probe based on the extracted movable range. Accordingly, also in a medical diagnostic-imaging apparatus, such as IVUS, OCT, and an endoscope, a desired scan region can be set easily.

Automatic Extraction of Structure of Subject

For example, the processing circuitry160can extract a structure of a subject automatically.

For example, the processing circuitry160serving as the extracting unit extracts a structure of a subject based on a type of a probe. For example, the storage circuitry150stores relation information in which a type of probe and a structure of a subject are associated with each other. The type of probe is information indicating, for example, a TEE probe, an enteral probe, a transvaginal probe, or the like. Moreover, the structure of a subject is information indicating, for example, an interior wall of esophagus, an interior wall of an intestine, an interior wall of a vagina, or the like. That is, the relation information stores that a subject to extraction is “interior wall of esophagus” if the type of probe is “TEE probe”. Furthermore, the relation information stores that a subject to extraction is “interior wall of intestine” if the type of probe is “enteral probe”. Furthermore, the relation information stores that a subject to extraction is “interior wall of vagina” if the type of probe is “transvaginal probe”. Moreover, the relation information stores characteristic information to extract various kinds of subjects of extraction by segmentation or pattern matching.

The processing circuitry160then automatically extracts a structure of a subject corresponding to the type of probe based on the relation information. For example, when the operator specifies “TEE probe” as the type of probe, the processing circuitry160refers to the relation information and identifies a subject to extraction, “interior wall of esophagus” corresponding to the type of probe, “TEE probe”. The processing circuitry160then extracts an interior wall of the esophagus from three-dimensional medical image data by using characteristic information of an interior wall of esophagus.

The type of probe can also be identified by automatically recognizing product information, and the like from a probe connected to the ultrasonic diagnostic apparatus1. For example, the processing circuitry160acquires product information from the probe connected to the ultrasonic diagnostic apparatus1. Subsequently, the processing circuitry160extracts the type of probe from the acquired product information. The processing circuitry160then identifies the subject to extraction, “interior wall of esophagus” from the relation information based on the extracted type of probe.

Automatic Setting of Target Scan Region

For example, the processing circuitry160can set a target scan region automatically.

For example, the processing circuitry160serving as the setting unit sets a target scan region based on the type of probe. For example, the storage circuitry150stores the relation information in which a type of probe and a typical target scan region are associated with each other. The type of probe is information indicating, for example, a TEE probe, an enteral probe, a transvaginal probe, or the like. Moreover, the typical target scan region is information indicating a target scan region that is typically set according to a type of probe. For example, the typical target scan region is information including a typical position on a core line in a lumen region, a typical scanning direction from the position, and a typical scan range (lateral direction) based on the scanning direction as a center, and a typical depth from the position.

The processing circuitry160automatically extracts a typical target scan region corresponding to a type of probe based on the relation information. For example, when the operator specifies the type of probe, “TEE probe”, the processing circuitry160refers to the relation information, and identifies information of a typical target scan region corresponding to the type of probe, “TEE probe”, to set the typical target scan region. The type of probe can be identified by automatically recognizing product information and the like from a probe connected to the ultrasonic diagnostic apparatus1.

A term “processor” used in the above explanation signifies, for example, a circuit such as a central processing unit (CPU), a graphical processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (for example, a simple programmable logic device (SPLD), and a complex programmable logic device (CPLD)), and a field programmable gate array (FPGA). The processor reads and executes a program stored in the storage circuitry150, and thereby implements a function. Instead of storing the program in the storage circuitry150, the program can be directly installed in a circuitry of the processor. In this case, the processor reads and executes the program installed in the circuitry of the processor to implement the function. Each of the processors of the embodiments is not limited to be structured as a single circuitry per processor, but can be structured by combining multiple independent processors to form a single processor to implement the function. Furthermore, more than one component in each diagram can be integrated to a single processor to implement the functions.

Moreover, the respective components of the respective devices illustrated are of functional concept, and it is not necessarily required to be configured physically as illustrated. That is, specific forms of distribution and integration of the respective devices are not limited to the ones illustrated, and all or a part thereof can be configured to be distributed or integrated functionally or physically in arbitrary units according to various kinds of loads, usage conditions, and the like. Furthermore, as for the respective processing functions performed by the respective devices, all or an arbitrary part thereof can be implemented by a CPU and a computer program that is analyzed and executed by the CPU, or can be implemented as hardware by wired logic.

Moreover, all or a part of the processing explained as to be performed automatically out of the respective processing explained in the above embodiments can be performed manually also, while all or a part of the processing explained as to be performed manually can be performed automatically also by a publicly-known method. In addition, the processing procedures, the control procedures, the specific names, and the information including various kinds of data and parameters indicated in the above document and the drawings can be arbitrarily modified unless otherwise specified.

Furthermore, the medical image-processing method explained in the above embodiments can be implemented by a computer, such as a personal computer and a workstation, executing a medical image-processing program prepared in advance. This medical image-processing program can be distributed through a network, such as the Internet. Moreover, this medical image-processing program can be stored in a computer-readable recording medium, such as a hard disk, a flexible disk (FD), a CD-ROM, a magneto optical disk (MO), and a digital versatile disk (DVD), and can be executed by being read by a computer from the recording medium.

Furthermore, in the above embodiments, “current” means to perform the respective processing soon after generation of each data, each time data to be processed is generated. For example, the processing of collecting current B-mode image data is a concept including a case in which an image is displayed with little delay caused due to time necessary for the respective processing, such as image processing, not limited to a case in which a time at which the subject P is imaged and a time at which the image is displayed completely coincide with each other.

According to at least one of the embodiments explained above, a desired scan region can be easily set.