Patent Description:
Hitherto, in a medical field, an ultrasound diagnostic apparatus using an ultrasound image has come into practical use. In general, this kind of ultrasound diagnostic apparatus has an ultrasound probe that incorporates a transducer array, and an apparatus body connected to the ultrasound probe. The ultrasound probe transmits ultrasonic waves toward a subject and receives ultrasound echoes from the subject, and the apparatus body electrically processes reception signals to generate an ultrasound image.

In such an ultrasound diagnostic apparatus, usually, a monitor on which the ultrasound image is often disposed at a position away from the ultrasound probe, such as a bedside, and thus, an operator needs to alternately move a line of sight between the ultrasound probe at hand and the monitor. Accordingly, to reduce the movement of the line of sight of the operator, for example, an ultrasound diagnostic apparatus comprising a so-called head-mounted display as disclosed in <CIT> has been developed. Document <CIT> for example describes an ultrasound probe comprising a housing; an acoustic module disposed inside the housing, and configured to transmit an ultrasound signal to an object and receive an echo signal reflected from the object; an image processor disposed in a rear direction of the acoustic module inside the housing, electrically connected to the acoustic module, and configured to generate ultrasound image data from the echo signal received from the acoustic module; a first insulating wall disposed between the acoustic module and the image processor inside the housing; a first heat sink member disposed in a rear direction of the image processor inside the housing; and at least one anisotropic heat conductive member passing through the first insulating wall to connect the acoustic module with the first heat sink member, and configured such that a heat conductivity thereof in a lengthwise direction of the housing is greater than a heat conductivity thereof in a direction perpendicular to the lengthwise direction of the housing to transfer heat of the acoustic module to the first heat sink member.

In general, it is known that, in ultrasound diagnosis using an ultrasound diagnostic apparatus as disclosed in <CIT>, a given level or higher of skill is needed to accurately recognize a part in a subject rendered in an ultrasound image by confirming the ultrasound image. Furthermore, it is known that the image quality of the generated ultrasound image significantly depends on the skill involving the hands of an operator.

Here, for example, in a case where an ultrasound image is captured at a remote location other than a hospital, such as home care, an operator who operates an ultrasound probe to capture an ultrasound image may be different from an observer who observes the captured ultrasound image to perform diagnosis.

In this case, since the operator normally needs to operate the ultrasound probe to capture an ultrasound image of an intended part in a subject while confirming the obtained ultrasound image personally, in particular, in a case where the level of skill of the operator is low, the operator may hardly determine whether or not the intended part of the subject is accurately observed. The operator having a low level of skill may not operate the ultrasound probe using appropriate skill involving the hands, and an ultrasound image with low image quality is obtained. The observer confirms the ultrasound image captured by the operator of the ultrasound diagnostic apparatus to perform diagnosis; however, since the observer cannot recognize a state in which the operator captures the ultrasound image, in particular, in a case where the ultrasound image is captured by the operator having a low level of skill, the observer may hardly accurately determine whether or not the captured ultrasound image is captured by appropriate skill involving the hands.

The present invention refers to ultrasound systems and to methods of controlling an ultrasound system with the features of the present independent claims. The present invention has been accomplished to solve such a problem in the related art, and an object of the present invention is to provide an ultrasound system and a method of controlling an ultrasound system capable of obtaining an appropriate ultrasound image and improving accuracy of ultrasound diagnosis even though an ultrasound image is captured at a remote location.

To achieve the above-described object, there is disclosed a first ultrasound system comprising an ultrasound probe, a head-mounted display, and an external apparatus, in which the ultrasound probe includes a transducer array, a transmission and reception circuit that transmits an ultrasonic wave from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array, an ultrasound image generation unit that generates an ultrasound image based on the sound ray signal generated by the transmission and reception circuit, and a probe-side wireless communication unit that wirelessly transmits the ultrasound image, the head-mounted display includes a camera unit that acquires a view image obtained by imaging a scanning point of the ultrasound probe in a subject, and a head-mounted display-side wireless communication unit that wirelessly transmits the view image acquired by the camera unit, and the external apparatus includes an external wireless communication unit that is wirelessly connected to at least the head-mounted display-side wireless communication unit, an external monitor, and a display controller that displays the ultrasound image wirelessly transmitted from the ultrasound probe and the view image wirelessly transmitted from the head-mounted display on the external monitor.

The external wireless communication unit may be wirelessly connected to both the probe-side wireless communication unit and the head-mounted display-side wireless communication unit, and the probe-side wireless communication unit may wirelessly transmit the ultrasound image to both the head-mounted display and the external apparatus.

The probe-side wireless communication unit may wirelessly transmit the ultrasound image to the head-mounted display, and the head-mounted display-side wireless communication unit may wirelessly transmit the ultrasound image wirelessly transmitted from the probe-side wireless communication unit and the view image acquired by the camera unit to the external apparatus.

The external apparatus includes an image synchronization unit that synchronizes the ultrasound image and the view image with each other.

The head-mounted display may include a head-mounted display-side monitor, and the ultrasound image may be displayed on the head-mounted display-side monitor.

In this case, it is preferable that the head-mounted display includes an image synchronization unit that synchronizes the ultrasound image and the view image with each other.

The external apparatus may include an input device, the external wireless communication unit may wirelessly transmit external input information input through the input device, to the head-mounted display-side wireless communication unit, and the external input information is displayed on the head-mounted display-side monitor.

Wireless communication of voice data may be performed between the head-mounted display-side wireless communication unit and the external wireless communication unit in two directions.

There is disclosed a method of controlling an ultrasound system including an ultrasound probe, a head-mounted display, and an external apparatus, the method comprising, at the ultrasound probe, transmitting an ultrasonic wave from the transducer array of the ultrasound probe and generating a sound ray signal based on a reception signal acquired by the transducer array, generating an ultrasound image based on the generated sound ray signal, and wirelessly transmitting the ultrasound image; at the head-mounted display, acquiring a view image obtained by imaging a scanning point of the ultrasound probe in a subject, and wirelessly transmitting the acquired view image, and at the external apparatus, displaying the ultrasound image wirelessly transmitted from the ultrasound probe and view image wirelessly transmitted from the head-mounted display on the external monitor.

There is disclosed a second ultrasound system comprising an ultrasound probe, a head-mounted display, and an external apparatus, in which the ultrasound probe includes a transducer array, a transmission and reception circuit that transmits an ultrasonic wave from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array, a reception data generation unit that generates reception data before imaging by executing signal processing on the sound ray signal generated by the transmission and reception circuit, and a probe-side wireless communication unit that wirelessly transmits the reception data, the head-mounted display includes a camera unit that acquires a view image obtained by imaging a scanning point of the ultrasound probe in a subject, and a head-mounted display-side wireless communication unit that wirelessly transmits the view image acquired by the camera unit, and the external apparatus includes an external wireless communication unit that is wirelessly connected to at least the head-mounted display-side wireless communication unit, an external monitor, and a display controller that displays an ultrasound image generated based on the reception data wirelessly transmitted from the ultrasound probe and the view image wirelessly transmitted from the head-mounted display on the external monitor.

The external wireless communication unit may be wirelessly connected to both the probe-side wireless communication unit and the head-mounted display-side wireless communication unit, and the probe-side wireless communication unit may wirelessly transmit the reception data to both the head-mounted display and the external apparatus.

The probe-side wireless communication unit may wirelessly transmit the reception data to the head-mounted display, and the head-mounted display-side wireless communication unit may wirelessly transmit the reception data wirelessly transmitted from the probe-side wireless communication unit and the view image acquired by the camera unit to the external apparatus.

The external apparatus may include an image processing unit that generates the ultrasound image based on the reception data wirelessly transmitted from the probe-side wireless communication unit.

The probe-side wireless communication unit may wirelessly transmit the reception data to the head-mounted display, the head-mounted display may include an image processing unit that generates the ultrasound image based on the reception data wirelessly transmitted from the probe-side wireless communication unit, and the head-mounted display-side wireless communication unit may wirelessly transmit the ultrasound image generated by the image processing unit and the view image acquired by the camera unit to the external apparatus.

There is disclosed a method of controlling an ultrasound system including an ultrasound probe, a head-mounted display, and an external apparatus, the method comprising, at the ultrasound probe, transmitting an ultrasonic wave from the transducer array of the ultrasound probe and generating a sound ray signal based on a reception signal acquired by the transducer array, generating reception data before imaging by executing signal processing on the generated sound ray signal, and wirelessly transmitting the reception data, at the head-mounted display, acquiring a view image obtained by imaging a scanning point of the ultrasound probe in a subject, and wirelessly transmitting the acquired view image, and at the external apparatus, displaying an ultrasound image generated based on the reception data wirelessly transmitted from the ultrasound probe and the view image wirelessly transmitted from the head-mounted display on the external monitor.

The ultrasound probe includes the ultrasound image generation unit that generates the ultrasound image, and the probe-side wireless communication unit that wirelessly transmits the ultrasound image, the head-mounted display includes the camera unit that acquires the view image obtained by imaging the scanning point of the ultrasound probe, and the head-mounted display-side wireless communication unit that wirelessly transmits the view image acquired by the camera unit, and the external apparatus includes the external wireless communication unit that is wirelessly connected to at least the head-mounted display-side wireless communication unit, the external monitor, and the display controller that displays the ultrasound image wirelessly transmitted from the ultrasound probe and the view image wirelessly transmitted from the head-mounted display on the external monitor. Therefore, it is possible to obtain an appropriate ultrasound image and to improve accuracy of ultrasound diagnosis even in a case where an ultrasound image is captured at a remote location.

Hereinafter, embodiments of the present invention will be described referring to the accompanying drawings.

The description of components described below is provided based on a representative embodiment of the present invention, but the present invention is not limited to such an embodiment.

In the specification, a numerical range represented using "to" means a range including numerical values before and after "to" as a lower limit value and an upper limit value.

In the specification, the terms "same" and "identical" include an error range allowed in the technical field.

<FIG> shows the configuration of an ultrasound system <NUM> according to Embodiment <NUM> of the present invention. The ultrasound system <NUM> comprises an ultrasound probe <NUM>, a head-mounted display (HMD) <NUM>, and an external apparatus <NUM>. The HMD <NUM> and the external apparatus <NUM> are connected to the ultrasound probe <NUM> by wireless communication, and the HMD <NUM> and the external apparatus <NUM> are connected to each other by wireless communication.

The ultrasound probe <NUM> comprises a transducer array <NUM>, and a transmission and reception circuit <NUM>, a signal processing unit <NUM>, and a probe-side wireless communication unit <NUM> are sequentially connected to the transducer array <NUM>. The probe-side wireless communication unit <NUM> is connected to the HMD <NUM> and the external apparatus <NUM> by wireless communication. Though not shown, the signal processing unit <NUM> configures a reception data generation unit.

A probe controller <NUM> is connected to the transmission and reception circuit <NUM>, the signal processing unit <NUM>, and the probe-side wireless communication unit <NUM>. The signal processing unit <NUM>, the probe-side wireless communication unit <NUM>, and the probe controller <NUM> configure a probe-side processor <NUM>.

The HMD <NUM> comprises an HMD-side wireless communication unit <NUM> that is connected to the ultrasound probe <NUM> and the external apparatus <NUM> by wireless communication, and an image processing unit <NUM>, a display controller <NUM>, and an head-mounted display-side monitor (HMD-side monitor) <NUM> are sequentially connected to the head-mounted display-side wireless communication unit (HMD-side wireless communication unit) <NUM>. Furthermore, the HMD <NUM> comprises a camera unit <NUM>, and the camera unit <NUM> is connected to the HMD-side wireless communication unit <NUM>.

Ahead-mounted display controller (HMD controller) <NUM> is connected to the HMD-side wireless communication unit <NUM>, the image processing unit <NUM>, the camera unit <NUM>, and the display controller <NUM>. The HMD-side wireless communication unit <NUM>, the image processing unit <NUM>, the display controller <NUM>, and the HMD controller <NUM> configure a head-mounted display-side processor (HMD-side processor) <NUM>.

The external apparatus <NUM> comprises an external wireless communication unit <NUM> that is connected to the ultrasound probe <NUM> and the HMD <NUM> by wireless communication, and an image processing unit <NUM> and an image synchronization unit <NUM> are connected to the external wireless communication unit <NUM>. The image processing unit <NUM> is connected to the image synchronization unit <NUM>. A display controller <NUM> and an external monitor <NUM> are sequentially connected to the image synchronization unit <NUM>.

An external controller <NUM> is connected to the external wireless communication unit <NUM>, the image processing unit <NUM>, the image synchronization unit <NUM>, and the display controller <NUM>. An input device <NUM> is connected to the external controller <NUM>. The external wireless communication unit <NUM>, the image processing unit <NUM>, the image synchronization unit <NUM>, the display controller <NUM>, and the external controller <NUM> configure an external apparatus-side processor <NUM>.

The transducer array <NUM> of the ultrasound probe <NUM> has a plurality of transducers arranged in a one-dimensional or two-dimensional manner. Each transducer transmits an ultrasonic wave in response to a drive signal supplied from the transmission and reception circuit <NUM>, receives an ultrasound echo from a subject, and outputs a reception signal based on the ultrasound echo. Each transducer is constituted by forming electrodes at both ends of a piezoelectric body made of, for example, piezoelectric ceramic represented by lead zirconate titanate (PZT), a polymer piezoelectric element represented by poly vinylidene di fluoride (PVDF), piezoelectric single crystal represented by lead magnesium niobate-lead titanate (PMN-PT), or the like.

The transmission and reception circuit <NUM> transmits an ultrasonic wave from the transducer array <NUM> and generates a sound ray signal based on the reception signal acquired by the transducer array <NUM> under the control of the probe controller <NUM>. As shown in <FIG>, the transmission and reception circuit <NUM> has a pulser <NUM> that is connected to the transducer array <NUM>, and an amplification unit <NUM>, an analog-digital (AD) conversion unit <NUM>, and a beamformer <NUM> connected in series from the transducer array <NUM>.

The pulser <NUM> includes, for example, a plurality of pulse generators, and adjusts a delay amount of each drive signal based on a transmission delay pattern selected in response to a control signal from the probe controller <NUM> such that the ultrasonic waves transmitted from a plurality of transducers of the transducer array <NUM> form an ultrasonic beam, and supplies the drive signals to a plurality of transducers. In this way, in a case where a pulsed or continuous-wave voltage is applied to the electrodes of the transducers of the transducer array <NUM>, the piezoelectric body expands and contracts to generate a pulsed or continuous-wave ultrasonic wave from each of the transducers. An ultrasonic beam is formed from a combined wave of the ultrasonic waves.

The transmitted ultrasonic beam is reflected by, for example, a target, such as a part of the subject, and propagates toward the transducer array <NUM> of the ultrasound probe <NUM>. The ultrasound echo propagating toward the transducer array <NUM> is received by each transducer configuring the transducer array <NUM>, and each transducer expands and contracts with reception of the propagating ultrasound echo to generate a reception signal as an electrical signal, and outputs the reception signal to the amplification unit <NUM>.

The amplification unit <NUM> amplifies the signal input from each transducer constituting the transducer array <NUM> and transmits the amplified signal to the AD conversion unit <NUM>. The AD conversion unit <NUM> converts the signal transmitted from the amplification unit <NUM> into digital reception data and transmits the reception data to the beamformer <NUM>. The beamformer <NUM> executes so-called reception focus processing by giving a delay to each piece of reception data converted by the AD conversion unit <NUM> conforming to a sound speed or a distribution of a sound speed based on a reception delay pattern selected in response to a control signal from the probe controller <NUM> and performing addition. With the reception focus processing, each piece of reception data converted by the AD conversion unit <NUM> is phased and added, and a sound ray signal in which the focus of the ultrasound echo is narrowed is acquired.

The signal processing unit <NUM> generates reception data before imaging by executing signal processing on the sound ray signal generated by the beamformer <NUM> of the transmission and reception circuit <NUM>. More specifically, the signal processing unit <NUM> performs correction of attenuation on the sound ray signal generated by the beamformer <NUM> of the transmission and reception circuit <NUM> due to a propagation distance depending on a depth of a position where the ultrasonic wave is reflected, and then, executes envelope detection processing to generate a signal representing tomographic image information regarding a tissue in the subject as reception data before imaging.

The probe-side wireless communication unit <NUM> includes an antenna that performs transmission and reception of radio waves, and modulates a carrier based on the reception data before imaging generated by the signal processing unit <NUM> to generate a transmission signal representing the reception data before imaging. The probe-side wireless communication unit <NUM> supplies the transmission signal generated in this manner to the antenna and transmits the radio waves from the antenna, thereby sequentially wirelessly transmitting the reception data before imaging to the HMD-side wireless communication unit <NUM> of the HMD <NUM> and the external wireless communication unit <NUM> of the external apparatus <NUM>. As a modulation system of the carrier, for example, amplitude shift keying (ASK), phase shift keying (PSK), quadrature phase shift keying (QPSK), <NUM> quadrature amplitude modulation (16QAM), or the like is used.

The wireless communication among the probe-side wireless communication unit <NUM> of the ultrasound probe <NUM>, the HMD-side wireless communication unit <NUM> of the HMD <NUM>, and the external wireless communication unit <NUM> of the external apparatus <NUM> can be performed conforming to a communication standard regarding mobile communication, such as a 5th Generation mobile communication system (<NUM>) or a 4th Generation mobile communication system (<NUM>), or a communication standard regarding short-distance wireless communication, such as WiFi (Registered Trademark), Bluetooth (Registered Trademark), or an ultra wide band wireless system (UWB).

It is assumed that the ultrasound probe <NUM> and the HMD <NUM> are positioned close to each other, and thus, as the wireless communication between the ultrasound probe <NUM> and the HMD <NUM>, any communication system of mobile communication or short-distance wireless communication may be employed.

It is assumed that the external apparatus <NUM> is positioned at a remote location with respect to the ultrasound probe <NUM> and the HMD <NUM>, and thus, it is preferable that, as the wireless communication between the external apparatus <NUM> and the ultrasound probe <NUM> and the wireless communication between the external apparatus <NUM> and the HMD <NUM>, mobile communication is performed. In particular, from a viewpoint of reducing a time lag in transmission of data between the external apparatus <NUM>, and the ultrasound probe <NUM> and the HMD <NUM>, it is preferable that, as the wireless communication between the external apparatus <NUM> and the ultrasound probe <NUM> and the wireless communication between the external apparatus <NUM> and the HMD <NUM>, mobile communication conforming to <NUM> is performed.

The probe controller <NUM> performs control of each unit of the ultrasound probe <NUM> based on a control program and the like stored in advance.

Though not shown, a probe-side storage unit is connected to the probe controller <NUM>. The probe-side storage unit stores the control program and the like of the ultrasound probe <NUM>. As the probe-side storage unit, for example, a flash memory, a random access memory (RAM), a secure digital card (SD), or a solid state drive (SSD) can be used.

Though not shown, a battery is incorporated in the ultrasound probe <NUM>, and power is supplied from the battery to each circuit of the ultrasound probe <NUM>.

Although the probe-side processor <NUM> having the signal processing unit <NUM>, the probe-side wireless communication unit <NUM>, and the probe controller <NUM> is configured with a central processing unit (CPU) and a control program causing the CPU to execute various kinds of processing, the probe-side processor <NUM> may be configured using a field programmable gate array (FPGA), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a graphics processing unit (GPU), or other integrated circuits (ICs) or may be configured by combining such ICs.

The signal processing unit <NUM>, the probe-side wireless communication unit <NUM>, and the probe controller <NUM> of the probe-side processor <NUM> may be configured to be partially or wholly integrated into one CPU or the like.

The HMD <NUM> is a display device that is mounted on a head of an operator and is viewed by the operator who mounts the HMD <NUM>, and as shown in <FIG>, has a shape of so-called spectacles. The HMD <NUM> comprises two monitors 36A and 36B as an HMD-side monitor <NUM>. The two monitors 36A and 36B are connected to each other by a bridge portion B, and temple portions T are connected to end portions of the two monitors 36A and 36B, respectively. For example, the bridge portion B is placed and fixed on a nose of the operator and the two temple portions T are placed and fixed on both ears of the operator, whereby the HMD <NUM> is fixed to the head of the operator. In this case, the two monitors 36A and 36B face right and left eyes of the operator.

The camera unit <NUM> with an imaging lens F disposed on a front surface is attached to a connecting portion of the left monitor 36B and the temple portion T as viewed from the operator in a state in which the operator mounts the HMD <NUM>. An accommodation portion D where various circuits and the like necessary for the operation of the HMD <NUM> is disposed in the temple portion T connected to the right monitor 36A.

Here, the HMD-side wireless communication unit <NUM> shown in <FIG> includes an antenna that performs transmission and reception of radio waves, and receives the transmission signal representing the reception data before imaging transmitted from the probe-side wireless communication unit <NUM> of the ultrasound probe <NUM>, through the antenna and outputs the reception data before imaging by demodulating the received transmission signal under the control of the HMD controller <NUM>. The HMD-side wireless communication unit <NUM> sends the reception data before imaging to the image processing unit <NUM>.

The image processing unit <NUM> raster-converts the reception data before imaging sent from the HMD-side wireless communication unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, an image size correction, refresh rate correction, scanning frequency correction, and color correction, conforming to a display format for the HMD-side monitor <NUM> on the converted image signal, thereby generating a brightness mode (B mode) image signal. The B mode image signal generated in this manner is simply referred to as an ultrasound image U. The image processing unit <NUM> sends the generated ultrasound image U to the display controller <NUM>.

The HMD-side monitor <NUM> displays the ultrasound image U and the like under the control of the display controller <NUM>, and has transmittance to secure the field of view of the operator in a state in which the operator mounts the HMD <NUM>. For this reason, the operator can confirm the ultrasound image U and the like displayed on the HMD-side monitor <NUM> while confirming the field of view in front through the HMD-side monitor <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U sent from the image processing unit <NUM> and displays the ultrasound image U on the HMD-side monitor <NUM> of the HMD <NUM> as shown in <FIG> under the control of the HMD controller <NUM>. <FIG> shows an example where a subject P positioned in front of the operator is confirmed by the operator through the HMD-side monitor <NUM> and the ultrasound image U is displayed on the HMD-side monitor <NUM> to be superimposed on a part of the field of view in front of the operator.

The camera unit <NUM> acquires a view image C obtained by imaging a scanning point of the ultrasound probe <NUM> in the subject P. Te camera unit <NUM> incorporates the imaging lens F, an image sensor (not shown) that images the scanning point of the ultrasound probe <NUM> through the imaging lens F to acquire a view image signal as an analog signal, an analog signal processing circuit (not shown) that amplifies the view image signal acquired by the image sensor and converts the view image signal into a digital signal, and a digital signal processing circuit (not shown) that performs various kinds of correction, such as a gain, on the converted digital signal to generate the view image C. The analog signal processing circuit and the digital signal processing circuit may be incorporated in an HMD-side processor <NUM>. The camera unit <NUM> sends the generated view image C to the HMD-side wireless communication unit <NUM>. The HMD-side wireless communication unit <NUM> wirelessly transmits the view image C sent to the HMD-side wireless communication unit <NUM>, to the external apparatus <NUM>.

The HMD controller <NUM> performs control of each unit of the HMD <NUM> based on a control program and the like stored in advance.

Though not shown, an HMD-side storage unit is connected to the HMD controller <NUM>. The HMD-side storage unit stores the control program and the like of the HMD <NUM>. As the HMD-side storage unit, for example, a flash memory, a RAM, an SD card, or an SSD can be used.

Though not shown, a battery is incorporated in the HMD <NUM>, and power is supplied from the battery to each circuit of the HMD <NUM>.

Although the HMD-side processor <NUM> having the HMD-side wireless communication unit <NUM>, the image processing unit <NUM>, the display controller <NUM>, and the HMD controller <NUM> is configured with a CPU and a control program causing the CPU to execute various kinds of processing, the HMD-side processor <NUM> may be configured using an FPGA, a DSP, an ASIC, a GPU, or other ICs or may be configured by combining such ICs.

The HMD-side wireless communication unit <NUM>, the image processing unit <NUM>, the display controller <NUM>, and the HMD controller <NUM> of the HMD-side processor <NUM> may be configured to be partially or wholly integrated into one CPU or the like.

The external wireless communication unit <NUM> of the external apparatus <NUM> includes an antenna that performs transmission and reception of radio waves, and receives the transmission signal representing the reception data before imaging transmitted from the probe-side wireless communication unit <NUM> of the ultrasound probe <NUM> and a transmission signal representing the view image C transmitted from the HMD-side wireless communication unit <NUM> of the HMD <NUM> and outputs the reception data before imaging and the view image C by demodulating the received transmission signals under the control of the external controller <NUM>. The external wireless communication unit <NUM> sends the reception data before imaging to the image processing unit <NUM> and sends the view image C to the image synchronization unit <NUM>.

The image processing unit <NUM> raster-converts the reception data before imaging sent from the external wireless communication unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, conforming to a display format for the external monitor <NUM> on the converted image signal, thereby generating an ultrasound image U. The image processing unit <NUM> sends the generated ultrasound image U to the image synchronization unit <NUM>.

The image synchronization unit <NUM> of the external apparatus <NUM> synchronizes the ultrasound image U sent from the image processing unit <NUM> and the view image C sent from the external wireless communication unit <NUM> with each other to generate a composite image M based on the ultrasound image U and the view image C synchronized with each other. Here, synchronizing the ultrasound image U and the view image C with each other refers to associating the ultrasound image U and the view image C captured at the same timing with each other. For example, in a case where a time stamp representing at time at which the ultrasound image U is generated is given to the ultrasound image U by the image processing unit <NUM> of the external apparatus <NUM>, and a time stamp representing a time at which the view image C is generated is given to the view image C by the camera unit <NUM> of the HMD <NUM>, the image synchronization unit <NUM> can synchronize the ultrasound image U and the view image C captured at the same timing with each other by regarding the time stamp of the ultrasound image U as representing a time at which the ultrasound image U is captured, regarding the time stamp of the view image C as representing a time at which the view image C is captured, and referring to the time stamps of the ultrasound image U and the view image C.

In associating the ultrasound image U and the view image C with each other, for example, the image synchronization unit <NUM> can refer to the time stamp of the ultrasound image U and the time stamp of the view image C, and in a case where a difference between the time at which the ultrasound image U is captured and the time at which the view image C is captured is within a given range, for example, within <NUM> seconds, can regard the ultrasound image U and the view image C as being captured at the same timing to perform association. Alternatively, for example, the image synchronization unit <NUM> may refer to the time stamp of the ultrasound image U and the time stamp of the view image C, may select the view image C captured at a time closest to the time at which the ultrasound image U to be associated is captured, and may associate the selected view image C and the ultrasound image U with each other. For example, the image synchronization unit <NUM> may select the ultrasound image U captured at a time closest to the time at which the view image C to be associated is captured, and may associate the selected ultrasound image U and the view image C with each other.

The image synchronization unit <NUM> sends the ultrasound image U and the view image C synchronized in this manner to the display controller <NUM>.

The display controller <NUM> executes predetermined processing on the composite image M sent from the image synchronization unit <NUM> and displays the ultrasound image U and the view image C synchronized with each other together on the external monitor <NUM> of the external apparatus <NUM> as shown in <FIG> under the control of the external controller <NUM>.

The external monitor <NUM> displays the ultrasound image U, the view image C, and the like under the control of the display controller <NUM>, and includes, for example, a display device, such as a liquid crystal display (LCD) or an organic electroluminescence display (organic EL display).

The input device <NUM> of the external apparatus <NUM> is provided for the operator to perform an input operation, and includes a touch sensor disposed on the external monitor <NUM> in a superimposed manner.

The external controller <NUM> performs control of each unit of the external apparatus <NUM> based on a control program and the like stored in advance.

Though not shown, an external apparatus-side storage unit is connected to the external apparatus <NUM>. The external apparatus-side storage unit stores the control program and the like of the external apparatus <NUM>. As the external apparatus-side storage unit, for example, a flash memory, a RAM, an SD card, or an SSD can be used.

Though not shown, a battery is incorporated in the external apparatus <NUM>, and power is supplied from the battery to each circuit of the external apparatus <NUM>.

Although the external apparatus-side processor <NUM> having the external wireless communication unit <NUM>, the image processing unit <NUM>, the image synchronization unit <NUM>, the display controller <NUM>, and the external controller <NUM> is configured with a CPU and a control program causing the CPU to execute various kinds of processing, the external apparatus-side processor <NUM> may be constituted using an FPGA, a DSP, an ASIC, a GPU, or other ICs or may be constituted by combining such ICs. The external wireless communication unit <NUM>, the image processing unit <NUM>, the image synchronization unit <NUM>, the display controller <NUM>, and the external controller <NUM> of the external apparatus-side processor <NUM> may be configured to be partially or wholly integrated into one CPU or the like.

Next, the operation of the ultrasound system <NUM> according to Embodiment <NUM> of the present invention will be described.

First, the ultrasound probe <NUM> is brought into contact with a body surface of the subject P by the operator, and ultrasonic beams are transmitted from a plurality of transducers of the transducer array <NUM> into the subject P in response to the drive signals from the pulser <NUM> of the transmission and reception circuit <NUM> under the control of the probe controller <NUM>. An ultrasound echo based on the transmitted ultrasonic beam is received by each transducer, the reception signal as an analog signal is output to the amplification unit <NUM> and amplified, and is AD-converted by the AD conversion unit <NUM>, and reception data is acquired. The beamformer <NUM> executes the reception focus processing on the reception data to generate a sound ray signal.

The signal processing unit <NUM> converts the generated sound ray signal into reception data before imaging that is a signal representing tomographic image information regarding a tissue in the subject P. In this case, the signal processing unit <NUM> performs correction of attenuation on the sound ray signal due to a propagation distance depending on a depth of a position where the ultrasonic wave is reflected, and then, executes envelope detection processing.

The probe-side wireless communication unit <NUM> wirelessly transmits the generated sound ray signal to the HMD <NUM> and the external apparatus <NUM>.

The HMD-side wireless communication unit <NUM> of the HMD <NUM> receives the reception data before imaging wirelessly transmitted from the ultrasound probe <NUM> and sends the received reception data before imaging to the image processing unit <NUM>. The image processing unit <NUM> raster-converts the reception data before imaging sent from the HMD-side wireless communication unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, an image size correction, refresh rate correction, scanning frequency correction, and color correction, conforming to a display format for the HMD-side monitor <NUM> on the converted image signal, thereby generating the ultrasound image U. The ultrasound image U generated in this manner is sent to the display controller <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U, then, sends the ultrasound image U to the HMD-side monitor <NUM>, and displays the ultrasound image U on the HMD-side monitor <NUM> as shown in <FIG>. The ultrasound image U is displayed on the HMD-side monitor <NUM> to be superimposed on a part of the field of view in front of the operator, and thus, the operator can simultaneously confirm the field of view in front and the ultrasound image U to easily correspond and recognize the scanning point of the ultrasound probe <NUM> in the subject P and the tissue in the subject P to be observed at the scanning point. An example of <FIG> shows a state in which the ultrasound probe <NUM> is in contact with an abdomen of the subject P as the field of view in front of the operator, and an internal tissue of the abdomen of the subject P is rendered in the ultrasound image U.

The camera unit <NUM> of the HMD <NUM> acquires the view image C obtained by imaging the scanning point of the ultrasound probe <NUM> in the subject P under the control of the HMD controller <NUM>. For example, as shown in <FIG>, the operator turns the field of view in front toward the subject P, whereby the view image C obtained by imaging the scanning point of the ultrasound probe <NUM> in the subject P is acquired by the camera unit <NUM>. The view image C acquired in this manner is sent to the HMD-side wireless communication unit <NUM>.

The HMD-side wireless communication unit <NUM> wirelessly transmits the view image C sent from the camera unit <NUM>, to the external apparatus <NUM>.

The external wireless communication unit <NUM> of the external apparatus <NUM> receives the reception data before imaging wirelessly transmitted from the ultrasound probe <NUM> and the view image C wirelessly transmitted from the HMD <NUM>, sends the received reception data before imaging to the image processing unit <NUM>, and sends the received view image C to the image synchronization unit <NUM>.

The image synchronization unit <NUM> synchronizes the ultrasound image U sent from the image processing unit <NUM> and the view image C sent from the external wireless communication unit <NUM> with each other to generate the composite image M in which the ultrasound image U and the view image C synchronized with each other are put together into one image. For example, in a case where a time stamp representing at time at which the ultrasound image U is generated is given to the ultrasound image U by the image processing unit <NUM> of the external apparatus <NUM>, and a time stamp representing a time at which the view image C is generated is given to the view image C by the camera unit <NUM> of the HMD <NUM>, the image synchronization unit <NUM> can synchronize the ultrasound image U and the view image C captured at the same timing with each other by regarding the time stamp of the ultrasound image U as representing a time at which the ultrasound image U is captured, regarding the time stamp of the view image C as representing a time at which the view image C is captured, and referring to the time stamps of the ultrasound image U and the view image C. In this case, the time in the HMD <NUM> and the time in the external apparatus <NUM> can be shared by each other.

Although the time in the HMD <NUM> and the time in the external apparatus <NUM> can be shared by each other, specifically, for example, the time can be shared with the HMD <NUM> or the external apparatus <NUM> as a reference. For example, in a case where any one of the HMD <NUM> or the external apparatus <NUM> is connected to the Internet, a time of an internal timepiece may be set using a communication protocol, such as Network Time Protocol (NTP) or Network Identity and Time Zone (NITZ).

The ultrasound image U and the view image C synchronized with each other by the image synchronization unit <NUM> are sent as the composite image M to the display controller <NUM>. The display controller <NUM> executes predetermined processing on the composite image M, then, sends the composite image M to the external monitor <NUM>, and displays the ultrasound image U and the view image C together on the external monitor <NUM> as shown in <FIG>. An example of <FIG> shows that the external apparatus <NUM> is a mobile thin type computer, such as a so-called smartphone or a tablet, and the view image C and the ultrasound image U are displayed on the upper and lower sides of the external monitor <NUM> of the external apparatus <NUM>, respectively. In this example, a state in which the ultrasound probe <NUM> is in contact with the abdomen of the subject P is rendered in the view image C, and the internal tissue of the abdomen of the subject P is rendered in the ultrasound image U.

Here, although the ultrasound image U is displayed on the HMD-side monitor <NUM> of the HMD <NUM> and the view image C and the ultrasound image U synchronized with each other are displayed on the external monitor <NUM> of the external apparatus <NUM>, the same ultrasound image U is displayed on the HMD-side monitor <NUM> and the external monitor <NUM> substantially simultaneously. The view image corresponding to the field of view in front to be observed by the operator through the HMD-side monitor <NUM> is displayed on the external monitor <NUM> substantially in real time. For this reason, for example, even in a case where the external apparatus <NUM> is positioned at a remote location with respect to the HMD <NUM>, the observer who observes the external monitor <NUM> can observe the ultrasound image U captured in a site of inspection where the subj ect P and the operator are positioned and the view image corresponding to the field of view in front of the operator substantially in real time.

Incidentally, in general, it is known that a given level or higher of skill is needed to accurately recognize the part in the subject P rendered in the ultrasound image by confirming the ultrasound image. Furthermore, it is known that the image quality of the ultrasound image generated in the ultrasound diagnostic apparatus significantly depends on the skill involving the hands of the operator.

For example, in a case where an ultrasound image is captured at a remote location other than a hospital, such as home care, the operator who operates the ultrasound probe to capture the ultrasound image may be different from the observer who observes the captured ultrasound image to perform diagnosis. In this case, since the operator normally needs to operate the ultrasound probe to capture an ultrasound image of an intended part in a subject P while confirming the obtained ultrasound image personally, in particular, in a case where the level of skill of the operator is low, the operator may hardly determine whether or not the intended part of the subject is accurately observed. The operator having a low level of skill may not operate the ultrasound probe using appropriate skill involving the hands, and an ultrasound image with low image quality is obtained.

The observer positioned at a remote location with respect to the subject P and the operator confirms the ultrasound image captured by the operator of the ultrasound diagnostic apparatus to perform diagnosis; however, since the observer cannot recognize a state in which the operator captures the ultrasound image, in particular, in a case where the ultrasound image is captured by the operator having a low level of skill, the observer may hardly accurately recognize whether or not the captured ultrasound image is captured by appropriate skill involving the hands.

With the ultrasound system <NUM> according to Embodiment <NUM> of the present invention, the same ultrasound image U is displayed on the HMD-side monitor <NUM> and the external monitor <NUM> substantially simultaneously, and the view image C corresponding to the field of view in front of the operator is displayed on the external monitor <NUM> substantially in real time. Thus, for example, even in a case where the external apparatus <NUM> is positioned at a remote location with respect to the HMD <NUM>, the observer who observes the external monitor <NUM> can observe the view image C and the ultrasound image U captured in a site of inspection where the subject and the operator are positioned, substantially in real time. With this, for example, since the observer having a high level of skill can give advice to the operator in real time, even in a case where the level of skill of the operator positioned at a remote location with respect to the observer is low, an appropriate ultrasound image U is obtained, and it is possible to improve accuracy of ultrasound diagnosis.

With the ultrasound system <NUM> according to Embodiment <NUM> of the present invention, for example, the observer who is positioned at a remote location with respect to the operator and has a low level of skill can also be made to confirm the view image C representing a state in which the operator having a high level of skill operates the ultrasound probe <NUM> and the appropriate ultrasound image U corresponding to the view image C. In this way, the ultrasound system <NUM> according to Embodiment <NUM> of the present invention is considerably useful even from a viewpoint of training.

In the ultrasound system <NUM> according to Embodiment <NUM> of the present invention, since the ultrasound image U is displayed on the HMD-side monitor <NUM> of the HMD <NUM>, the operator can confirm the ultrasound image U while confirming the field of view in front. In addition, since the view image C is captured by the camera unit <NUM> of the HMD <NUM>, the operator does not need to use hands to capture the view image C.

For this reason, the operator can perform more various inspections, such as performing skill involving the hands to insert a so-called puncture needle into the subject P using the other hand while operating the ultrasound probe <NUM> using one hand, without separating the line of sight from the subj ect P.

Although an example where the time stamp is given to the generated ultrasound image U in each of the image processing unit <NUM> of the HMD <NUM> and the image processing unit <NUM> of the external apparatus <NUM> has been described, instead of the image processing unit <NUM> of the HMD <NUM> and the image processing unit <NUM> of the external apparatus <NUM> giving the time stamp to the ultrasound image U, the signal processing unit <NUM> of the ultrasound probe <NUM> may give a time stamp to the signal subjected to the envelope detection processing. In this case, for example, the time in the ultrasound probe <NUM> and the time in the HMD <NUM> are shared by each other, whereby it is possible to synchronize the ultrasound image U generated by the image processing unit <NUM> of the HMD <NUM> and the view image C generated by the camera unit <NUM> with each other based on the signal given the time stamp, and to synchronize the ultrasound image U generated by the image processing unit <NUM> of the external apparatus <NUM> and the view image C generated by the camera unit <NUM> with each other.

Here, the time in the ultrasound probe <NUM> and the time in the HMD <NUM> can be shared, for example, with the ultrasound probe <NUM> or the HMD <NUM> as a reference. For example, in a case where any one of the ultrasound probe <NUM> or the HMD <NUM> is connected to the Internet, the time of the internal timepiece may be set using a communication protocol, such as NTP or NITZ.

A method of synchronizing the ultrasound image U and the view image C with each other is not limited to the method using the time stamp described above. For example, as disclosed in <CIT>, an imaging timing of the ultrasound image U by the ultrasound probe <NUM> and an imaging timing of the view image C by the camera unit <NUM> of the HMD <NUM> are synchronized with each other, and a time difference between the time at which the ultrasound image U is captured and the time at which the view image C is captured is within a given range, for example, within <NUM> seconds, the image synchronization unit <NUM> of the external apparatus <NUM> can regard that the ultrasound image U and the view image C are captured at the same timing, and can synchronize the ultrasound image U and the view image C with each other.

Although the image synchronization unit <NUM> of the external apparatus <NUM> generates the composite image M in which the ultrasound image U and the view image C synchronized with each other are put together into one image, and sends the generated composite image M to the display controller <NUM>, instead of generating the composite image M, each of the ultrasound image U and the view image C synchronized with each other may be sent to the display controller <NUM>. In this case, the display controller <NUM> executes predetermined processing on each of the ultrasound image U and the view image C sent from the image synchronization unit <NUM> and displays the ultrasound image U and the view image C synchronized with each other together on the external monitor <NUM>, for example, as shown in <FIG>. For this reason, the observer who views the external monitor <NUM> can observe the view image C and the ultrasound image U captured in a site of inspection where the subject P and the operator are positioned, substantially in real time.

Though not shown, for example, the HMD <NUM> may comprise an eye camera unit that images eyes of the operator, and an eye movement detection unit that analyzes an eye image representing the eyes of the operator captured by the eye camera unit to detect a wink, the line of sight, or the like of the operator. The detected wink and movement of the light of sight of the operator can be used, for example, as an input operation of the operator. For example, the number of winks, the position of the light of sight, or the like of the operator detected by the eye movement detection unit can be used as a trigger or the like of imaging start and imaging stop of the view image C by the camera unit <NUM>. In this way, the wink, the movement of the light of sight, or the like of the operator is used as an input operation, whereby it is possible to allow the operator to perform an input operation without using the hands even in a case where both hands are used during inspection of the subject P.

Although the ultrasound probe <NUM> and the HMD <NUM> are connected to each other by wireless communication, for example, the ultrasound probe <NUM> and the HMD <NUM> may be connected to each other by wired communication, instead of being connected by wireless communication.

In <FIG>, although an example where the external apparatus <NUM> is a mobile thin type computer, such as a so-called smartphone or a tablet, has been illustrated, the external apparatus <NUM> is not limited thereto. For example, as the external apparatus <NUM>, a so-called notebook type personal computer, a stationary type personal computer, or the like may be used.

As shown in <FIG>, although the transmission and reception circuit <NUM> has the beamformer <NUM> together with the amplification unit <NUM> and the AD conversion unit <NUM>, the beamformer <NUM> may be disposed between the transmission and reception circuit <NUM> and the signal processing unit <NUM>, not inside the transmission and reception circuit <NUM>. In this case, the probe-side processor <NUM> may configure the beamformer <NUM>.

For example, as shown in <FIG>, external input information, such as a cursor A that is movable by an input operation of the observer through the input device <NUM> of the external apparatus <NUM>, can be displayed on the external monitor <NUM> of the external apparatus <NUM> and the HMD-side monitor <NUM> of the HMD <NUM> simultaneously. In this case, for example, in a case where the cursor A displayed on the external monitor <NUM> of the external apparatus <NUM> is moved by an input operation of the observer through the input device <NUM> of the external apparatus <NUM>, the cursor A displayed on the terminal monitor <NUM> of the mobile information terminals is moved similarly. With this, for example, it is possible to perform more detailed information sharing between the operator of the ultrasound probe <NUM> and the HMD <NUM> and the observer positioned close to the external apparatus <NUM>. For example, the observer having a high level of skill who observes the ultrasound image U and the view image C on the external monitor <NUM> of the external apparatus <NUM> can easily support inspection that is performed by the operator, such as indicating a position where the ultrasound probe <NUM> is to be scanned, to the operator having a low level of skill of the ultrasound probe <NUM> and the HMD <NUM> using the cursor A.

For example, in a case where an input operation can be performed through the HMD <NUM> by the movement of the light of sight or the like of the operator, the cursor A that is movable by an input operation of the operator may displayed on the HMD-side monitor <NUM> of the HMD <NUM> and the external monitor <NUM> of the external apparatus <NUM> simultaneously. In this case, for example, the operator having a high level of skill can perform training on ultrasound diagnosis for the observer having a low level of skill positioned close to the external apparatus <NUM> more easily and in more detail.

The shape of the cursor A is not limited to an arrow shape, and can have any shape, such as a circular shape or a polygonal shape.

For example, wireless communication of voice data may be performed between the HMD <NUM> and the external apparatus <NUM> in two directions. <FIG> shows the configuration of an HMD 3A in a modification example of Embodiment <NUM> of the present invention. The HMD 3A is further provided with a microphone <NUM> and a speaker <NUM>, comprises an HMD controller 37A instead of the HMD controller <NUM>, and comprises an HMD-side processor 39A instead of the HMD-side processor <NUM>, compared to the HMD <NUM> shown in <FIG>. In the HMD 3A, the microphone <NUM> and the speaker <NUM> are connected to the HMD-side wireless communication unit <NUM>.

<FIG> shows the configuration of an external apparatus 4A in the modification example of Embodiment <NUM> of the present invention. The external apparatus 4A is further provided with a microphone <NUM> and a speaker <NUM>, comprises an external controller 46A instead of the external controller <NUM>, and comprises an external apparatus-side processor 48A instead of the external apparatus-side processor <NUM>, compared to the external apparatus <NUM> shown in <FIG>. In the external apparatus 4A, the microphone <NUM> and the speaker <NUM> are connected to the external wireless communication unit <NUM>.

In the modification example of Embodiment <NUM> of the present invention, voice data is transmitted and received between the HMD 3A and the external apparatus 4A in two directions. For example, in a case where the operator of the ultrasound probe <NUM> and the HMD 3A utters voice toward the HMD 3A, the uttered voice is input to the microphone <NUM> of the HMD 3A, and voice data is generated by the microphone <NUM>. The generated voice data is wirelessly transmitted from the HMD-side wireless communication unit <NUM> to the external apparatus 4A. The external wireless communication unit <NUM> of the external apparatus 4A receives the voice data wirelessly transmitted from the HMD 3A and sends the received voice data to the speaker <NUM>. The speaker <NUM> reproduces the voice uttered by the operator of the ultrasound probe <NUM> and the HMD 3A based on the voice data received from the external wireless communication unit <NUM>.

For example, the observer who observes the ultrasound image U and the view image C on the external monitor <NUM> of the external apparatus 4A utters voice toward the external apparatus 4A, the uttered voice is input to the microphone <NUM> of the external apparatus 4A, and voice data is generated by the microphone <NUM>. The generated voice data is wirelessly transmitted from the external wireless communication unit <NUM> to the HMD 3A. The HMD-side wireless communication unit <NUM> of the HMD 3A receives the voice data wirelessly transmitted from the external apparatus 4A and sends the received voice data to the speaker <NUM>. The speaker <NUM> reproduces the voice uttered by the observer positioned close to the external apparatus <NUM> based on the voice data received from the HMD-side wireless communication unit <NUM>.

In this manner, the voice data is transmitted and received between the HMD 3A and the external apparatus 4A in two directions, whereby it is possible to perform more detailed information sharing between the operator of the ultrasound probe <NUM> and the HMD 3A and the observer positioned close to the external apparatus 4A. For example, the observer having a high level of skill who observes the ultrasound image U and the view image C on the external monitor <NUM> of the external apparatus 4A can give advice to the operator having a low level of skill of the ultrasound probe <NUM> and the HMD 3A more easily and in more detail. For example, the operator having a high level of skill can perform training on ultrasound diagnosis for the observer having a low level of skill positioned close to the external apparatus 4A more easily and in more detail.

The voice of the operator input to the microphone <NUM> of the HMD 3A may be used as an input operation of the operator. For example, the HMD controller 37A can acquire instruction information by analyzing the voice data generated based on the voice of the operator by the microphone <NUM> and can perform control of each unit of the HMD 3A, such as imaging start and imaging stop of the view image C by the camera unit <NUM>, conforming to the acquired instruction information. Alternatively, the control of the ultrasound probe <NUM> may be performed based on the voice data analyzed by the HMD controller 37A. In this case, for example, the voice data analyzed by the HMD controller 37A is wirelessly transmitted as input information from the operator from the HMD-side wireless communication unit <NUM> to the ultrasound probe <NUM>, and is input to the probe controller <NUM> by way of the probe-side wireless communication unit <NUM>. The probe controller <NUM> can perform control of each unit of the ultrasound probe <NUM>, such as transmission start and transmission stop of ultrasonic waves by the transducer array <NUM>.

Alternatively, the voice of the observer input to the microphone <NUM> of the external apparatus 4A may be used as an input operation of the observer. For example, the external controller 46A may acquire instruction information by analyzing the voice data generated based on the voice of the observer by the microphone <NUM> and may perform control of each unit of the head-mounted display 3A, such as imaging start and imaging stop of the view image C by the camera unit <NUM> of the head-mounted display 3A, and control of each unit of the ultrasound probe <NUM>, such as transmission start and transmission stop of ultrasonic waves by the transducer array <NUM> of the ultrasound probe <NUM>.

In Embodiment <NUM>, although the reception data before imaging obtained by performing the envelope detection processing on the sound ray signal is generated in the ultrasound probe <NUM>, and the generated reception data before imaging is wirelessly transmitted to the HMD <NUM> and the external apparatus <NUM>, the ultrasound image U may be generated in the ultrasound probe <NUM>, and the generated ultrasound image U may be wirelessly transmitted to the HMD <NUM> and the external apparatus <NUM>.

<FIG> shows the configuration of an ultrasound system 1B according to Embodiment <NUM> of the present invention. The ultrasound system 1B comprises an ultrasound probe 2B instead of the ultrasound probe <NUM>, comprises an HMD 3B instead of the HMD <NUM>, and comprises an external apparatus 4B instead of the external apparatus <NUM>, compared to the ultrasound system <NUM> of Embodiment <NUM> shown in <FIG>.

The ultrasound probe 2B is further provided with an image processing unit <NUM>, comprises a probe controller 26B instead of the probe controller <NUM>, and a probe-side processor 27B instead of the probe-side processor <NUM>, compared to the ultrasound probe <NUM> in Embodiment <NUM>. In the ultrasound probe 2B, the image processing unit <NUM> is connected to the signal processing unit <NUM>. The probe-side wireless communication unit <NUM> and the probe controller 26B are connected to the image processing unit <NUM>. Though not shown, the signal processing unit <NUM> and the image processing unit <NUM> configure an ultrasound image generation unit.

The HMD 3B is not provided with the image processing unit <NUM>, comprises an HMD controller 37B instead of the HMD controller <NUM>, and comprises an HMD-side processor 39B instead of the HMD-side processor <NUM>, compared to the HMD <NUM> in Embodiment <NUM>. In the HMD 3B, the display controller <NUM> and the camera unit <NUM> are connected to the HMD-side wireless communication unit <NUM>.

The external apparatus 4B is not provided with the image processing unit <NUM>, comprises an external controller 46B instead of the external controller <NUM>, and comprises an external apparatus-side processor 48B instead of the external apparatus-side processor <NUM>, compared to the external apparatus <NUM> in Embodiment <NUM>.

The image processing unit <NUM> of the ultrasound probe 2B raster-converts the signal subjected to the envelope detection processing by the signal processing unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, an image size correction, refresh rate correction, scanning frequency correction, and color correction, on the converted image signal, thereby generating an ultrasound image U conforming to a display format for the HMD-side monitor <NUM> of the HMD 3B and an ultrasound image U conforming to a display format for the external monitor <NUM> of the external apparatus 4B. The image processing unit <NUM> wirelessly transmits the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> of the HMD 3B from the probe-side wireless communication unit <NUM> to the HMD 3B and wirelessly transmits the ultrasound image U conforming to the display format for the external monitor <NUM> of the external apparatus 4B from the probe-side wireless communication unit <NUM> to the external apparatus 4B.

The HMD-side wireless communication unit <NUM> of the HMD 3B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B and sends the received ultrasound image U to the display controller <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U sent from the HMD-side wireless communication unit <NUM>, then, sends the ultrasound image U to the HMD-side monitor <NUM>, and displays the ultrasound image U on the HMD-side monitor <NUM> as shown in <FIG>.

The external wireless communication unit <NUM> of the external apparatus 4B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B and the view image C wirelessly transmitted from the HMD 3B and sends the received ultrasound image U and view image C to the image synchronization unit <NUM>.

The image synchronization unit <NUM> synchronizes the ultrasound image U and the view image C sent from the external wireless communication unit <NUM> with each other and generates a composite image M based on the ultrasound image U and the view image C synchronized with each other.

The display controller <NUM> executes predetermined processing on the composite image M generated by the image synchronization unit <NUM>, then, sends the composite image M to the external monitor <NUM>, and displays the ultrasound image U and the view image C synchronized with each other together on the external monitor <NUM> as shown in <FIG>.

As described above, with the ultrasound system 1B according to Embodiment <NUM> of the present invention, even in a case where the ultrasound probe 2B comprises the image processing unit <NUM>, similarly to the ultrasound system <NUM> of Embodiment <NUM> in which the HMD <NUM> comprises the image processing unit <NUM> and the external apparatus <NUM> comprises the image processing unit <NUM>, the same ultrasound image U is displayed on the HMD-side monitor <NUM> and the external monitor <NUM> substantially simultaneously, and the ultrasound probe 2B and the view image C corresponding to the field of view in front of the operator of the HMD 3B are displayed on the external monitor <NUM> substantially in real time. For this reason, for example, since the observer who observes the view image C and the ultrasound image U with the external apparatus 4B disposed at a remote location can give advice to the operator of the ultrasound probe 2B and the HMD 3B, an appropriate ultrasound image U is obtained, and it is possible to improve accuracy of ultrasound diagnosis.

In the ultrasound system <NUM> of Embodiment <NUM> shown in <FIG>, the HMD <NUM> comprises the image processing unit <NUM> and the external apparatus <NUM> comprises the image processing unit <NUM>. In contrast, in the ultrasound system 1B according to Embodiment <NUM>, the ultrasound probe 2B comprises the image processing unit <NUM>. Thus, the HMD 3B and the external apparatus 4B do not need to have the image processing units <NUM> and <NUM>, respectively, and the internal configurations of the HMD 3B and the external apparatus 4B are simplified compared to the internal configurations of the HMD <NUM> and the external apparatus <NUM> in the ultrasound system <NUM> of Embodiment <NUM>. For this reason, with the ultrasound system 1B according to Embodiment <NUM>, it is possible to reduce power consumption, calculation load, and the like of the HMD 3B and the external apparatus 4B compared to the ultrasound system <NUM> of Embodiment <NUM>.

In Embodiment <NUM>, although the ultrasound image U and the view image C are synchronized in the external apparatus <NUM>, for example, the ultrasound image U and the view image C may be synchronized in the HMD <NUM>.

<FIG> shows the configuration of an ultrasound system 1C according to Embodiment <NUM> of the present invention. The ultrasound system 1C comprises an ultrasound probe 2C having the same internal configuration as the ultrasound probe <NUM>, comprises an HMD 3C instead of the HMD <NUM>, and comprises an external apparatus 4C instead of the external apparatus <NUM>, compared to the ultrasound system <NUM> of Embodiment <NUM> shown in <FIG>. The ultrasound probe 2C is connected only to the HMD 3C by wireless communication, and the external apparatus 4C is connected only to the HMD 3C by wireless communication.

The HMD 3C is further provided with an image synchronization unit <NUM>, comprises an HMD controller 37C instead of the HMD controller <NUM>, and comprises an HMD-side processor 39C instead of the HMD-side processor <NUM>, compared to the HMD <NUM> in Embodiment <NUM>. In the HMD 3C, the image synchronization unit <NUM> is connected to the HMD-side wireless communication unit <NUM>, the image processing unit <NUM>, and the camera unit <NUM>. The display controller <NUM> is connected to the image synchronization unit <NUM>.

The external apparatus 4C is not provided with the image processing unit <NUM> and the image synchronization unit <NUM>, comprises an external controller 46C instead of the external controller <NUM>, and comprises an external apparatus-side processor 48C instead of the external apparatus-side processor <NUM>, compared to the external apparatus <NUM> in Embodiment <NUM>. In the external apparatus 4C, the display controller <NUM> is connected to the external wireless communication unit <NUM>.

The probe-side wireless communication unit <NUM> of the ultrasound probe 2C wirelessly transmits the reception data before imaging subjected to the envelope detection processing by the signal processing unit <NUM> only to the HMD 3C.

The HMD-side wireless communication unit <NUM> of the HMD 3C receives the reception data before imaging wirelessly transmitted from the ultrasound probe 2C and sends the received reception data before imaging to the image processing unit <NUM>.

The image processing unit <NUM> raster-converts the reception data before imaging sent from the HMD-side wireless communication unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, an image size correction, refresh rate correction, scanning frequency correction, and color correction, on the converted image signal, thereby generating an ultrasound image U conforming to a display format for the HMD-side monitor <NUM> of the HMD 3C and an ultrasound image U conforming to a display format for the external monitor <NUM> of the external apparatus 4C. The image processing unit <NUM> sends the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> of the HMD 3C to the display controller <NUM> by way of the image synchronization unit <NUM> and sends the ultrasound image U conforming to the display format for the external monitor <NUM> of the external apparatus 4C to the image synchronization unit <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> sent from the image processing unit <NUM> by way of the image synchronization unit <NUM>, and then, displays the ultrasound image U on the HMD-side monitor <NUM> as shown in <FIG>.

The camera unit <NUM> acquires a view image C obtained by imaging a scanning point of the ultrasound probe 2C in the subject P and sends the acquired view image C to the image synchronization unit <NUM>.

The image synchronization unit <NUM> synchronizes the ultrasound image U sent from the image processing unit <NUM> and the view image C sent from the camera unit <NUM> with each other and generates a composite image M based on the ultrasound image U and the view image C synchronized with each other.

The image synchronization unit <NUM> sends the composite image M generated based on the ultrasound image U conforming to the display format for the external monitor <NUM> of the external apparatus 4C and the view image C to the HMD-side wireless communication unit <NUM>.

The HMD-side wireless communication unit <NUM> wirelessly transmits the composite image M sent from the image synchronization unit <NUM>, to the external apparatus 4C.

The external wireless communication unit <NUM> of the external apparatus 4C receives the composite image M wirelessly transmitted from the HMD 3C and sends the received composite image M to the display controller <NUM>. The display controller <NUM> executes predetermined processing on the composite image M sent from the external wireless communication unit <NUM>, then, sends the composite image M to the external monitor <NUM>, and displays the ultrasound image U and the view image C synchronized with each other together on the external monitor <NUM> as shown in <FIG>.

From the above description, with the ultrasound system 1C according to Embodiment <NUM> of the present invention, even in a case where only the HMD 3C comprises the image processing unit <NUM> and the image synchronization unit <NUM>, similarly to the ultrasound system <NUM> of Embodiment <NUM> in which the HMD <NUM> comprises the image processing unit <NUM> and the external apparatus <NUM> comprises the image processing unit <NUM> and the image synchronization unit <NUM>, the same ultrasound image U is displayed on the HMD-side monitor <NUM> and the external monitor <NUM> substantially simultaneously, and the ultrasound probe 2C and the view image C corresponding to the field of view in front of the operator of the HMD 3C are displayed on the external monitor <NUM> substantially in real time. For this reason, for example, since the observer who observes the view image C and the ultrasound image U with the external apparatus 4C disposed at a remote location can give advice to the operator of the ultrasound probe 2C and the HMD 3C, an appropriate ultrasound image U is obtained, and it is possible to improve accuracy of ultrasound diagnosis.

In the ultrasound system <NUM> of Embodiment <NUM> shown in <FIG>, although the external apparatus <NUM> comprises the image processing unit <NUM> and the image synchronization unit <NUM>. In contrast, in the ultrasound system 1C according to Embodiment <NUM>, the composite image M generated based on the ultrasound image U and the view image C is wirelessly transmitted from the HMD 3C to the external apparatus 4C. Thus, the external apparatus 4C does not need to have the image processing unit <NUM> and the image synchronization unit <NUM>, and the internal configuration of the external apparatus 4C is simplified compared to the internal configuration of the external apparatus <NUM> in Embodiment <NUM>. For this reason, with the ultrasound system 1C according to Embodiment <NUM>, it is possible to reduce power consumption, calculation load, and the like of the external apparatus 4C.

In Embodiment <NUM>, although the reception data before imaging subjected to the envelope detection processing by the signal processing unit <NUM> of the ultrasound probe <NUM> is wirelessly transmitted to the HMD <NUM> and the external apparatus <NUM>, the ultrasound image U may be generated in the ultrasound probe <NUM>.

<FIG> shows the configuration of an ultrasound system 1D according to Embodiment <NUM> of the present invention. The ultrasound system 1D comprises an ultrasound probe 2D instead of the ultrasound probe 2C, comprises an HMD 3D instead of the HMD 3C, and comprises an external apparatus 4D instead of the external apparatus 4C, compared to the ultrasound system 1C of Embodiment <NUM> shown in <FIG>. The ultrasound probe 2D is connected only to the HMD 3D by wireless communication, and the external apparatus 4D is connected only to the HMD 3D by wireless communication.

The ultrasound probe 2D is further provided with an image processing unit <NUM>, comprises a probe controller 26D instead of the probe controller <NUM>, and comprises a probe-side processor 27D instead of the probe-side processor <NUM>, compared to the ultrasound probe 2C in Embodiment <NUM>. In the ultrasound probe 2D, the image processing unit <NUM> is connected to the signal processing unit <NUM>, and the probe-side wireless communication unit <NUM> and the probe controller 26D are connected to the image processing unit <NUM>. Though not shown, the signal processing unit <NUM> and the image processing unit <NUM> configure an ultrasound image generation unit.

The HMD 3D is not provided with the image processing unit <NUM>, comprises an HMD controller 37D instead of the HMD controller 37C, and comprises an HMD-side processor 39D instead of the HMD-side processor 39C, compared to the HMD 3C in Embodiment <NUM>. In the HMD 3D, the image synchronization unit <NUM> is connected to the HMD-side wireless communication unit <NUM>. The camera unit <NUM> is connected to the image synchronization unit <NUM>.

The external apparatus 4D comprises an external controller 46D instead of the external controller 46C and comprise an external apparatus-side processor 48D instead of the external apparatus-side processor 48C, compared to the external apparatus 4C in Embodiment <NUM>.

The image processing unit <NUM> of the ultrasound probe 2D raster-converts the signal subjected to the envelop detection processing by the signal processing unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, an image size correction, refresh rate correction, scanning frequency correction, and color correction, on the converted image signal, thereby generating an ultrasound image U conforming to a display format for the HMD-side monitor <NUM> of the HMD 3D and an ultrasound image U conforming to a display format for the external monitor <NUM> of the external apparatus 4D. The image processing unit <NUM> sends the generated ultrasound images U to the probe-side wireless communication unit <NUM>.

The probe-side wireless communication unit <NUM> wirelessly transmits the ultrasound image U sent from the image processing unit <NUM> to the HMD 3D.

The HMD-side wireless communication unit <NUM> receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2D. The HMD-side wireless communication unit <NUM> sends the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> to the display controller <NUM> by way of the image synchronization unit <NUM> and sends the ultrasound image U conforming to the display format for the external monitor <NUM> to the image synchronization unit <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U sent from the HMD-side wireless communication unit <NUM> by way of the image synchronization unit <NUM> and displays the ultrasound image U on the HMD-side monitor <NUM> as shown in <FIG>.

The camera unit <NUM> acquires a view image C obtained by imaging a scanning point of the ultrasound probe 2D in the subject P and sends the acquired view image C to the image synchronization unit <NUM>.

The image synchronization unit <NUM> synchronizes the ultrasound image U sent from the HMD-side wireless communication unit <NUM> and the view image C sent from the camera unit <NUM> with each other and generates a composite image M based on the ultrasound image U and the view image C synchronized with each other.

The image synchronization unit <NUM> sends the composite image M generated based on the ultrasound image U conforming to the display format for the external monitor <NUM> and the view image C synchronized with each other to the HMD-side wireless communication unit <NUM>.

The HMD-side wireless communication unit <NUM> wirelessly transmits the composite image M sent from the image synchronization unit <NUM> to the external apparatus 4D.

The external wireless communication unit <NUM> of the external apparatus 4D receives the composite image M wirelessly transmitted from the HMD 3D and sends the received composite image M to the display controller <NUM>.

The display controller <NUM> executes predetermined processing on the composite image M sent from the external wireless communication unit <NUM>, then, sends the composite image M to the external monitor <NUM>, and displays the ultrasound image U and the view image C synchronized with each other together on the external monitor <NUM> as shown in <FIG>.

From the above description, with the ultrasound system 1D according to Embodiment <NUM>, even in a case where only the ultrasound probe 2D comprises the image processing unit <NUM> and only the HMD 3D comprises the image synchronization unit <NUM>, similarly to the ultrasound system <NUM> of Embodiment <NUM> in which the HMD <NUM> comprises the image processing unit <NUM> and the external apparatus <NUM> comprises the image processing unit <NUM> and the image synchronization unit <NUM>, the same ultrasound image U is displayed on the HMD-side monitor <NUM> and the external monitor <NUM> substantially simultaneously, and the ultrasound probe 2C and the view image C corresponding to the field of view in front of the operator of the HMD 3C are displayed on the external monitor <NUM> substantially in real time. For this reason, for example, since the observer who observes the view image C and the ultrasound image U with the external apparatus 4D disposed at a remote location can give advice to the operator of the ultrasound probe 2D and the HMD 3D, an appropriate ultrasound image U is obtained, and it is possible to improve accuracy of ultrasound diagnosis.

In Embodiment <NUM>, since the external apparatus 4C receives the composite image M from the HMD 3C and displays the received composite image M on the external monitor <NUM>, the disposition and the size of the ultrasound image U and the view image C displayed on the external monitor <NUM> cannot be freely changed on the external apparatus 4C side. In contrast, with an ultrasound system 1E of Embodiment <NUM> shown in <FIG>, the disposition and the size of the ultrasound image U and the view image C displayed on the external monitor <NUM> can be arbitrarily changed on the external apparatus 4E side.

<FIG> shows the configuration of an ultrasound system 1E according to Embodiment <NUM> of the present invention. The ultrasound system 1E comprises an ultrasound probe 2E having the same internal configuration as the ultrasound probe 2C, comprises an HMD 3E instead of the HMD 3C, and comprises an external apparatus 4E instead of the external apparatus 4C, compared to the ultrasound system 1C of Embodiment <NUM>. The ultrasound probe 2E is connected only to the HMD 3E by wireless communication, and the external apparatus 4E is connected only to the HMD 3E by wireless communication.

The HMD 3E comprises an HMD controller 37E instead of the HMD controller <NUM>, and comprises an HMD-side processor 39E instead of the HMD-side processor <NUM>, compared to the HMD 3C in Embodiment <NUM>. In the HMD 3E, the image synchronization unit <NUM> is connected to the HMD-side wireless communication unit <NUM>, the image processing unit <NUM>, and the camera unit <NUM>, and the display controller <NUM> is connected to the image synchronization unit <NUM>.

The external apparatus 4E comprises an external controller 46E instead of the external controller <NUM> and comprises an external apparatus-side processor 48E instead of the external apparatus-side processor <NUM>, compared to the external apparatus 4C in Embodiment <NUM>.

The probe-side wireless communication unit <NUM> of the ultrasound probe 2E wirelessly transmit the reception data before imaging subjected to the envelope detection processing by the signal processing unit <NUM> to the HMD 3E.

The HMD-side wireless communication unit <NUM> of the HMD 3E receives the reception data before imaging wirelessly transmitted from the ultrasound probe 2E and sends the received reception data before imaging to the image processing unit <NUM>.

The image processing unit <NUM> generates an ultrasound image U conforming to a display format for the HMD-side monitor <NUM> of the HMD 3E and an ultrasound image U conforming to a display format for the external monitor <NUM> of the external apparatus 4E based on the reception data before imaging sent from the HMD-side wireless communication unit <NUM>. The image processing unit <NUM> sends the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> to the display controller <NUM> by way of the image synchronization unit <NUM> and sends the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> to the image synchronization unit <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U sent from the image processing unit <NUM> by way of the image synchronization unit <NUM>, and then, displays the ultrasound image U on the HMD-side monitor <NUM> as shown in <FIG>.

The camera unit <NUM> acquires a view image C obtained by imaging a scanning point of the ultrasound probe 2E in the subject P and sends the acquired view image C to the image synchronization unit <NUM>.

The image synchronization unit <NUM> synchronizes the ultrasound image U sent from the HMD-side wireless communication unit <NUM> and the view image C sent from the camera unit <NUM> with each other.

The image synchronization unit <NUM> sends each of the ultrasound image U and the view image C to the HMD-side wireless communication unit <NUM>, instead of generating one composite image M based on the ultrasound image U conforming to the display format for the external monitor <NUM> and the view image C synchronized with each other.

The HMD-side wireless communication unit <NUM> wirelessly transmits the ultrasound image U and the view image C sent from the image synchronization unit <NUM> to the external apparatus 4E.

The external wireless communication unit <NUM> of the external apparatus 4E receives the ultrasound image U and the view image C wirelessly transmitted from the HMD 3E and sends each of the received ultrasound image U and view image C to the display controller <NUM>.

The display controller <NUM> executes predetermined processing on the ultrasound image U and the view image C sent from the external wireless communication unit <NUM> and displays the ultrasound image U and the view image C synchronized with each other together on the external monitor <NUM>.

Here, the disposition and the size of the ultrasound image U and the view image C displayed on the external monitor <NUM> can be adjusted by an input operation of the observer through the input device <NUM>. For example, in a case where the observer inputs instruction information for the guidance on adjusting the disposition and the size of the ultrasound image U and the view image C on the external monitor <NUM> through the input device <NUM>, the input instruction information is input to the display controller <NUM> by way of the external controller 46E. The display controller <NUM> displays the ultrasound image U and the view image C synchronized with each other, for example, with the disposition and the size as shown in <FIG> based on the input instruction information. In an example shown in <FIG>, the external apparatus 4E, the ultrasound image U, and the view image C are rotated at <NUM> degrees, and the ultrasound image U and the view image C are displayed on the external monitor <NUM> such that the view image C is superimposed on a part of the ultrasound image U, compared to the example shown in <FIG>.

From the above description, with the ultrasound system 1E according to Embodiment <NUM> of the present invention, the disposition and the size of the ultrasound image U and the view image C displayed on the external monitor <NUM> of the external apparatus 4E can be adjusted. Thus, the observer who observes the ultrasound image U and the view image C displayed on the external monitor <NUM> can more clearly confirm the ultrasound image U and the view image C conforming to the observer's preference.

In Embodiment <NUM>, although the reception data before imaging subjected to the envelope detection processing by the signal processing unit <NUM> is wirelessly transmitted to the HMD 3E by the probe-side wireless communication unit <NUM>, the ultrasound image U may be generated in the ultrasound probe <NUM>.

<FIG> shows the configuration of an ultrasound system 1F according to Embodiment <NUM> of the present invention. The ultrasound system 1F comprises an ultrasound probe 2F instead of the ultrasound probe 2E, comprises an HMD 3F instead of the HMD 3E, and comprises an external apparatus 4F instead of the external apparatus 4E, compared to the ultrasound system 1E according to Embodiment <NUM> shown in <FIG>. The ultrasound probe 2F is connected only to the HMD 3F by wireless communication, and the external apparatus 4F is connected only to the HMD 3F by wireless communication.

The ultrasound probe 2F is further provided with an image processing unit <NUM>, comprises a probe controller 26F instead of the probe controller <NUM>, and comprises a probe-side processor 27F instead of the probe-side processor <NUM>, compared to the ultrasound probe 2E in Embodiment <NUM>. In the ultrasound probe 2F, the image processing unit <NUM> is connected to the signal processing unit <NUM>, and the probe-side wireless communication unit <NUM> and the probe controller 26F are connected to the image processing unit <NUM>. Though not shown, the signal processing unit <NUM> and the image processing unit <NUM> configure an ultrasound image generation unit.

The HMD 3F is not provided with the image processing unit <NUM>, comprises an HMD controller 37F instead of the HMD controller 37E, and comprises an HMD-side processor 39F instead of the HMD-side processor 39E, compared to the HMD 3E in Embodiment <NUM>. In the HMD 3F, the image synchronization unit <NUM> is connected to the HMD-side wireless communication unit <NUM>. The camera unit <NUM> is connected to the image synchronization unit <NUM>.

The external apparatus 4F comprises an external controller 46F instead of the external controller 46E and comprises an external apparatus-side processor 48F instead of the external apparatus-side processor 48E, compared to the external apparatus 4E in Embodiment <NUM>.

The image processing unit <NUM> of the ultrasound probe 2F raster-converts the signal subjected to the envelope detection processing by the signal processing unit <NUM> into an image signal conforming to a normal television signal scanning system and executes various kinds of necessary image processing, such as brightness correction, gradation correction, sharpness correction, an image size correction, refresh rate correction, scanning frequency correction, and color correction, on the converted image signal, thereby generating an ultrasound image U conforming to the display format for the HMD-side monitor <NUM> of the HMD 3F and an ultrasound image U conforming to a display format for the external monitor <NUM> of the external apparatus 4F. The image processing unit <NUM> sends the generated ultrasound images U to the probe-side wireless communication unit <NUM>.

The HMD-side wireless communication unit <NUM> receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2F. The HMD-side wireless communication unit <NUM> sends the ultrasound image U conforming to the display format for the HMD-side monitor <NUM> to the display controller <NUM> by way of the image synchronization unit <NUM> and sends the ultrasound image U conforming to the display format for the external monitor <NUM> to the image synchronization unit <NUM>.

The camera unit <NUM> acquires a view image C obtained by imaging a scanning point of the ultrasound probe 2F in the subject P and sends the acquired view image C to the image synchronization unit <NUM>.

The HMD-side wireless communication unit <NUM> wirelessly transmits the ultrasound image U and the view image C sent from the image synchronization unit <NUM> to the external apparatus 4F.

The external wireless communication unit <NUM> of the external apparatus 4F receives the ultrasound image U and the view image C wirelessly transmitted from the HMD 3F and sends each of the received ultrasound image U and view image C to the display controller <NUM>.

In this case, the display controller <NUM> can adjust the disposition and the size of the ultrasound image U and the view image C displayed on the external monitor <NUM> in response to an input operation of the observer through the input device <NUM>. With this, for example, as shown in <FIG>, the ultrasound image U and the view image C synchronized with each other are displayed together on the external monitor <NUM>.

Claim 1:
An ultrasound system (1B) comprising:
an ultrasound probe (2B);
a head-mounted display (3B); and
an external apparatus (4B),
wherein the ultrasound probe (2B) includes
a transducer array (<NUM>),
a transmission and reception circuit (<NUM>) that transmits an ultrasonic wave from the transducer array (<NUM>) and generates a sound ray signal based on a reception signal acquired by the transducer array (<NUM>),
an ultrasound image generation unit that generates an ultrasound image based on the sound ray signal generated by the transmission and reception circuit (<NUM>), and
a probe-side wireless communication unit (<NUM>) that wirelessly transmits the ultrasound image,
the head-mounted display (3B) includes
a camera unit (<NUM>) that acquires a view image obtained by imaging a scanning point of the ultrasound probe (2B) in a subject, and
a head-mounted display-side wireless communication unit (<NUM>) that wirelessly transmits the view image acquired by the camera unit (<NUM>), and
the external apparatus (4B) includes
an external wireless communication unit (<NUM>) that is wirelessly connected to at least the head-mounted display-side wireless communication unit (<NUM>),
a first image synchronization unit (<NUM>) that synchronizes the ultrasound image wirelessly transmitted from the ultrasound probe (2B) and the view image wirelessly transmitted from the head-mounted display (3B) captured at the same timing with each other by referring to a time stamp of the ultrasound image representing a time at which the ultrasound image is captured and a time stamp of the view image representing a time at which the view image is captured,
an external monitor (<NUM>), and
a display controller (<NUM>) that displays the ultrasound image and the view image synchronized with each other by the first image synchronization unit (<NUM>) on the external monitor (<NUM>).