MEDICAL SYSTEM, COMMUNICATION METHOD, IMAGING DEVICE, INFORMATION PROCESSING DEVICE, AND ENDOSCOPE SYSTEM

The present technology relates to a medical system, a communication method, an imaging device, an information processing device, and an endoscope system capable of stably transmitting sensor signals output from a sensor that obtains data in a living body by wireless communication. A medical system includes a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body, and a sensor communication unit that serves as a communication unit that transmits, by wireless communication, a first sensor signal output from the sensor to an aid communication unit that serves as a communication unit provided in the insertion aid. The present technology can be applied to, for example, an endoscope system.

TECHNICAL FIELD

The present technology relates to a medical system, a communication method, an imaging device, an information processing device, and an endoscope system, and more particularly, to a medical system, a communication method, an imaging device, an information processing device, and an endoscope system capable of stably transmitting sensor signals from a sensor that obtains data in a living body by wireless communication.

BACKGROUND ART

In recent operation sites, various medical devices are used and power cables and communication cables are arranged everywhere, which hinders movement of medical devices and people. For example, while an endoscope is repeatedly inserted into and removed from the body of a patient for an insertion position change or cleaning, a cable connected to the endoscope may hinder smooth movement of the endoscope.

In view of the above, an endoscope camera that wirelessly transmits image signals has been proposed (e.g., see Patent Document 1).

CITATION LIST

Patent Document

SUMMARY OF THE INVENTION

Problems to be Solved by the Invention

Meanwhile, since an image captured by the endoscope camera is used for an operation, it is required to minimize the time from the imaging to the presentation to a user such as a doctor.

However, during the operation, doctors, assistants, nurses, and the like surround, look into, and move around the operative field (operation site) of the patient. Therefore, a transmission path to a device, such as a camera control unit (CCU), which receives image signals may be hindered, and transmission of the image signals may become unstable.

The present technology has been conceived in view of such a situation, and aims to stably transmit sensor signals output from a sensor that obtains data such as an image in a living body by wireless communication.

Solutions to Problems

A medical system according to a first aspect of the present technology includes a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body, and a sensor communication unit that serves as a communication unit that transmits, by wireless communication, a first sensor signal output from the sensor to an aid communication unit that serves as a communication unit provided in the insertion aid.

A communication method according to a first aspect of the present technology includes transmitting, by wireless communication, a sensor signal output from a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body to a communication unit provided in the insertion aid.

An imaging device according to a second aspect of the present technology includes an imaging unit that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and images the inside of the living body, and a sensor communication unit that serves as a communication unit that transmits, by wireless communication, an image signal output from the imaging unit to an aid communication unit that serves as a communication unit provided in the insertion aid.

An information processing device according to a third aspect of the present technology includes a communication unit that receives a sensor signal output from a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body, and a communication control unit that controls at least one of a communication path or a transmission amount of the sensor signal on the basis of at least one of a communication state or a distance between an aid communication unit that serves as a communication unit provided in the insertion aid and a sensor communication unit that serves as a communication unit that transmits the sensor signal to the aid communication unit by wireless communication.

An endoscope system according to a fourth aspect of the present technology includes an insertion part to be inserted into a living body via an insertion aid, an imaging unit that is provided in or connected to the insertion part and images the inside of the living body, and a sensor communication unit that serves as a communication unit that transmits, by wireless communication, an image signal output from the imaging unit to an aid communication unit that serves as a communication unit provided in the insertion aid.

According to the first aspect of the present technology, a sensor signal output from a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body is transmitted to a communication unit provided in the insertion aid by wireless communication.

According to the second aspect of the present technology, an image signal output from an imaging unit that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and images the inside of the living body is transmitted to an aid communication unit that serves as a communication unit provided in the insertion aid by wireless communication.

According to the third aspect of the present technology, a sensor signal output from a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body is received, and at least one of a communication path or a transmission amount of the sensor signal is controlled on the basis of at least one of a communication state or a distance between an aid communication unit that serves as a communication unit provided in the insertion aid and a sensor communication unit that serves as a communication unit that transmits the sensor signal to the aid communication unit by wireless communication.

According to the fourth aspect of the present technology, an image signal output from an imaging unit that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and images the inside of the living body is transmitted to an aid communication unit that serves as a communication unit provided in the insertion aid by wireless communication.

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments for implementing the present technology will be described. Descriptions will be given in the following order.

1. First Embodiment (First Embodiment of Medical System)

2. Second Embodiment (Second Embodiment of Endoscope and Insertion Aid)

3. Third Embodiment (Second Embodiment of Medical System)

4. Fourth Embodiment (Third Embodiment of Medical System)

1. First Embodiment

Next, a first embodiment of the present technology will be described with reference toFIGS. 1 to 7.

<Exemplary Configuration of Medical System1>

FIG. 1illustrates a first embodiment of a medical system1to which the present technology is applied. The medical system1constitutes an endoscope system for performing an endoscope operation. This drawing shows an exemplary case where an operator (doctor)2performs an endoscope operation on a patient4lying on a bed3(placed on the bed3) using the medical system1.

The medical system1includes an endoscope11, a surgical instrument (surgical tool)12other than the endoscope11, a support arm device13that supports the endoscope11, a cart14containing various devices for the endoscope operation, and a communication device15.

In the endoscope operation, for example, a plurality of tubular insertion aids34A to34D called trocars punctures the abdominal wall of the patient4instead of a laparotomy for opening the abdominal cavity.

Then, an insertion part21, which is a lens barrel of the endoscope11, and other surgical tools12are inserted into the body of the patient4via the insertion aids34A to34D.

Note that, hereinafter, the insertion aids34A to34D will be simply referred to as an insertion aid34in a case of not being required to distinguish them individually.

The endoscope11includes the insertion part21and a camera head22to be coupled to the base end of the insertion part21. A portion from the distal end to a certain length of the insertion part21is inserted into the body (body cavity) of the patient4. While this drawing illustrates an exemplary case where the endoscope11is configured by what is called a rigid endoscope having the rigid insertion part21, the endoscope11may be configured by what is called a flexible endoscope. Furthermore, the endoscope11may be configured by a forward-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope.

An optical system that condenses a subject image using one or a plurality of lenses is provided in the insertion part21. An opening into which an objective lens is fitted is provided at the distal end of the insertion part21.

Furthermore, a light source device63is coupled to the insertion part21. The light generated by the light source device63is guided to the distal end of the insertion part21by a light guide extending inside the insertion part21, and is emitted toward an object to be observed in the body of the patient4via the objective lens.

The camera head22includes an imaging unit incorporating an optical system, a drive system, and an image sensor, and a communication unit (communication unit102inFIG. 2). The optical system typically includes a lens unit, and condenses observation light (reflected light of irradiation light) from a subject taken in from the distal end of the insertion part21toward the image sensor. Positions of a zoom lens and a focus lens in the lens unit may be driven and changed by the drive system to variably control imaging conditions such as magnification and a focal length.

The image sensor of the camera head22is coupled to the insertion part21, photoelectrically converts the observation light condensed by the optical system of the insertion part21, and generates image signals, which are electric signals. That is, the image sensor obtains image data in the body of the patient4, and generates image signals including the image data. The image sensor may be a three-plate sensor having separate imaging elements that respectively generate image signals of three color components, or may be another type of image sensor such as single-plate type or a double-plate type. The image sensor may include any type of imaging elements such as a complementary metal oxide semiconductor (CMOS) or a charge-coupled device (CCD), for example. The image signals generated by the image sensor are, for example, image signals including RAW data of 4K or more. Note that a part or all of the imaging unit may be provided in the insertion part21.

The communication unit of the camera head22performs wireless communication with (a communication unit provided in) the insertion aid34, and transmits/receives various signals to/from a camera control unit (CCU)61via the insertion aid34and the communication device15. For example, the communication unit of the camera head22transmits image signals and the like to the CCU61via the insertion aid34and the communication device15, and receives control signals, synchronization signals, clock signals, and the like from the CCU61. Furthermore, the communication unit of the camera head22is capable of directly performing the wireless communication with the CCU61without passing through the insertion aid34and the communication device15.

Furthermore, in this example, a pneumoperitoneum tube31, an energy treatment tool32, and forceps33are illustrated as the other surgical tools12. The energy treatment tool32is used for treatment such as incision or detachment of a tissue, sealing of a blood vessel, or the like based on high-frequency current or ultrasonic vibration. Note that the illustrated surgical tools12are merely examples, and other types of surgical tools (e.g., tweezers, a retractor, etc.) may be provided.

An in vivo image of the patient4captured by the endoscope11is displayed by a display device62. While viewing the displayed image in real time, the operator2performs treatment such as resection of an affected part using the energy treatment tool32and the forceps33, for example. Note that, although illustration is omitted, the pneumoperitoneum tube31, the energy treatment tool32, and the forceps33are supported by a user, such as the operator2or an assistant, during operation.

The support arm device13includes an arm part42extending from a base part41. In this example, the arm part42includes joint parts51A to51C and links52A and52B, and supports the endoscope11. With the arm part42driven under control of an arm control device64, the position and posture of the endoscope11are fixed or changed.

The cart14stores, for example, the CCU61, the display device62, the light source device63, the arm control device64, an input device65, a treatment tool control device66, a pneumoperitoneum device67, a recorder68, and a printer69.

The CCU61includes a processor such as a central processing unit (CPU) and a memory such as a random access memory (RAM), and centrally controls operation of the endoscope11and the display device62. The CCU61may further include a frame memory for temporarily storing image signals, and one or more graphics processing unit (GPU) that executes image processing.

The CCU61performs various types of image processing on the image signals, and supplies them to the display device62, the recorder68, and the like. An image based on a series of image signals output from the CCU61may constitute a moving image (video). The image processing executed in the CCU61may include general processing such as development and noise reduction, for example.

Furthermore, the CCU61is coupled to the camera head22via a power cable, and supplies power to the camera head22. Moreover, the CCU61transmits control signals and the like to the camera head22via the communication device15and the insertion aid34A to control the camera head22.

Under the control of the CCU61, the display device62displays a display image based on the image signals from the CCU61, and outputs sound according to the control signals from the CCU61.

The light source device63includes, for example, a light source corresponding to a light-emitting diode (LED), a xenon lamp, a halogen lamp, a laser light source, or any combination thereof, and supplies irradiation light to be emitted to the object to be observed to the endoscope11through the light guide.

The arm control device64includes, for example, a processor such as a CPU, and operates according to a predetermined program to control the arm part42of the support arm device13.

The input device65includes one or more input interfaces that receive a user input to the medical system1. The user can input various kinds of information and instructions to the medical system1via the input device65.

The input device65may handle any type of user input. For example, the input device65may detect physical user input via a mechanism such as a mouse, a keyboard, a switch (e.g., foot switch70), or a lever. The input device65may detect a touch input via a touch panel. The input device65may be implemented in a form of a wearable device such as a glasses-like device or a head mounted display (HMD), and may detect a line-of-sight or a gesture of the user. Furthermore, the input device65may include a microphone capable of collecting the voice of the user, and may detect a voice command via the microphone.

The treatment tool control device66controls the energy treatment tool32for treatment such as ablation or incision of a tissue or sealing of a blood vessel.

In order to inflate the body cavity of the patient4, the pneumoperitoneum device67feeds gas into the body cavity via the pneumoperitoneum tube31for the purpose of securing a field of view observed by the endoscope11and a work space of the operator2.

The recorder68records, in a recording medium, various kinds of information related to medical work (e.g., one or more of setting information, image signals, and measurement information from a vital sensor (not illustrated)), for example.

The printer69prints various kinds of information related to medical work in some form such as text, an image, or a graph, for example.

The communication device15is provided on the back of the bed3, more specifically, on the back surface of the floor board of the bed3. The communication device15is coupled to the insertion aid34A by a communication cable, and performs wired communication with the insertion aid34A. Furthermore, the communication device15performs wireless communication with the CCU61to function as a relay between the endoscope11and the CCU61.

Note that various communication schemes can be used for the wireless communication between the camera head22and the insertion aid34or the CCU61and for the wireless communication between the communication device15and the CCU61.

However, since the user (operator2, etc.) operates the endoscope11and the other surgical tools12while viewing a display image displayed on the display device62, it is required to minimize (e.g., within 10 milliseconds) the time from when the inside of the body of the patient4is imaged until when the display image is displayed. Furthermore, the image captured by the endoscope11has a high resolution (e.g., 4K or more), and the data volume of the image signals is large.

In view of the above, it is preferable to adopt a large-capacity and high-speed communication scheme for the wireless communication between the camera head22and the insertion aid34or the CCU61and for the wireless communication between the communication device15and the CCU61. For example, it is preferable to adopt a communication scheme (e.g., 5G communication scheme) of a wide bandwidth of 6 GHZ or more (millimeter-wave frequency band, etc.).

Meanwhile, as a communication frequency increases with a large-capacity and high-speed communication scheme adopted, rectilinearity of the transmission signals increases. Therefore, the transmission signals are easily blocked by an obstacle, and are hardly transmitted to a distant place.

Meanwhile, with the communication device15provided on the back of the bed3, obstacles between the communication device15and the CCU61decreases. For example, in a case where the communication device15is provided on the bed3, bodies of doctors, assistants, nurses, and the like serve as obstacles. Meanwhile, in a case where the communication device15is provided on the back of the bed3, legs of doctors, assistants, nurses, and the like serve as obstacles. Since an area of a leg is naturally smaller than that of a body, obstacles between the communication device15and the CCU61are reduced.

Furthermore, with the communication device15provided on the back of the bed3, it becomes possible to use reflection of the floor for wireless communication.

Therefore, with the communication device15provided on the back of the bed3, the wireless communication between the communication device15and the CCU61is further stabilized, thereby improving communication quality.

Note that, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), or the like other than the scheme described above may be adopted as a communication scheme between the camera head22and the insertion aid34, between the camera head22and the CCU61, and between the communication device15and the CCU61.

Furthermore, the communication schemes between the camera head22and the insertion aid34, between the camera head22and the CCU61, and between the communication device15and the CCU61may or may not be unified.

<Exemplary Configuration and Exemplary Connection of Endoscope11>

FIG. 2illustrates an exemplary configuration and exemplary connection of the endoscope11inFIG. 1.

The camera head22of the endoscope11includes a main body101and a communication unit102.

The main body101incorporates the imaging unit of the camera head22. Furthermore, the main body101is detachably coupled to an eyepiece21A at the base end of the insertion part21.

The communication unit102is provided at the rear end of the main body101, that is, at one end different from one end coupled to the insertion part21of the main body101. The communication unit102performs wireless communication with the insertion aid34A using the communication scheme described above, and transmits/receives image signals, control signals, synchronization signals, clock signals, and the like to/from the CCU61via the insertion aid34A and the communication device15. Furthermore, the communication unit102is capable of directly performing the wireless communication with the CCU61without passing through the insertion aid34A and the communication device15.

Note that the insertion part21and the main body101are exposed to high heat and high pressure by sterilization treatment (autoclaving). Accordingly, the main body101is usually airtight or includes metal. In view of the above, as in this example, the communication unit102is preferably provided outside the main body101and at a posterior portion away from the insertion part21. Furthermore, for example, the communication unit102is preferably configured by a detachable component, such as a connector, at a part of the conventional main body101to which a communication cable is connected.

One end of a light guide111is detachably coupled to the light source device63, and the other end is detachably coupled to the insertion part21. In addition, the light guide111transmits the irradiation light supplied from the light source device63from one end to the other end, and supplies it to the insertion part21. The irradiation light supplied to the insertion part21is emitted from the distal end of the insertion part21, and is applied to the inside of the living body. The light (subject image) emitted to the inside of the living body and reflected in the living body is condensed by the optical system in the insertion part21.

One end of a power cable112is detachably coupled to the CCU61via a connector, and the other end is coupled to the camera head22via a connector. In addition, the power cable112transmits power output from the CCU61to the camera head22.

One end of a communication cable113is detachably coupled to the display device62, and the other end is detachably coupled to the CCU61. In addition, the communication cable113transmits the image signals processed by the CCU61and the control signals output from the CCU61to the display device62.

One end of a communication cable114is detachably coupled to the light source device63, and the other end is detachably coupled to the CCU61. In addition, the communication cable114transmits control signals from the CCU61to the light source device63.

<Exemplary Configuration of Communication Processing Unit151of Endoscope11>

FIG. 3illustrates an exemplary configuration of a communication processing unit151that performs processing related to communication of the endoscope11.

The communication processing unit151includes the communication unit102described above and a communication control unit161.

The communication control unit161is provided in the main body101of the camera head22, for example, and controls the communication unit102to control communication of the endoscope11. For example, the communication control unit161controls a communication path of the communication unit102and a transmission amount of signals.

<Exemplary Configuration of Insertion Aid34A>

FIG. 4schematically illustrates an exemplary configuration of an appearance of the insertion aid34A.FIG. 5schematically illustrates a state in which the patient4is punctured by the insertion aid34A and the insertion part21of the endoscope11is inserted into the body of the patient4via the insertion aid34A.

The insertion aid34A includes an insertion part201, a fixing part202, and a communication unit203.

The insertion part201is a part to be inserted into the body of the patient4. That is, the insertion aid34A is inserted into the body of the patient4from the distal end of the insertion part201.

The fixing part202is a part not to be inserted into the body of the patient4and to be fixed outside the body. An air supply hole202A is provided in a side surface of the fixing part202. The air supply hole202A is a hole for feeding gas into the body via the insertion part201, for example.

In addition, as illustrated inFIG. 5, the insertion part21of the endoscope11is inserted into the body of the patient4via the fixing part202and the insertion part201.

The communication unit203performs wireless communication with the communication unit102of the endoscope11using the communication scheme described above. Furthermore, the communication unit203is coupled to the communication device15on the back of the bed3via the communication cable211, and performs wired communication with the communication device15.

Note that, if the communication unit203is provided in the insertion part201, for example, the communication unit203is to be inserted into the body of the patient4. In that case, the communication unit203may be apart from the communication unit102of the endoscope11, and the body of the patient4may serve as an obstacle, which may lead to unstable wireless communication. Therefore, the communication unit203is preferably provided on the fixing part202.

Furthermore, considering that the communication cable211is connected, the communication unit203is preferably provided on the side surface (outer surface) of the fixing part202, not on the inner surface (surface facing the insertion part21) of the fixing part202.

Moreover, fine vibration is likely to be generated around the inlet and outlet of gas, such as the air supply hole202A, and the vibration may hinder the wireless communication. In view of the above, the communication unit203is preferably provided at a position away from the inlet and outlet of the gas, for example, on the side surface of the fixing part202, and on the opposite side of the air supply hole202A.

Furthermore, the communication unit203is preferably detachable from the fixing part202. With this arrangement, it becomes possible to separately perform sterilizing treatment of the main body (insertion part201and fixing part202) and sterilizing treatment of the communication unit203of the insertion aid34A.

Here, the state in which the insertion aid34A includes the communication unit203, in other words, the state in which the communication unit203is provided in the insertion aid34A includes not only a state in which the communication unit203is in contact with the insertion aid34A but also a state in which the communication unit203is close to the insertion aid34A. For example, a state in which the communication unit203is disposed near the insertion aid34A by being attached to the surface of the body of the patient4, for example, is also included.

As described above, the communication unit102of the endoscope11and the communication unit203of the insertion aid34A are close to each other outside the body of the patient4, thereby achieving stable wireless communication between them. Furthermore, since wired communication is performed between the communication unit203of the insertion aid34A and the communication device15, the communication between them is stable. Moreover, as described above, the communication device15is provided on the back of the bed3, thereby achieving stable wireless communication between the communication device15and the CCU61.

Therefore, the communication unit102of the endoscope11and the CCU61can stably perform high-speed communication of large-capacity signals via the communication unit203of the insertion aid34A and the communication device15. With this arrangement, for example, it becomes possible to promptly and stably transmit the image signals obtained by the endoscope11to the CCU61. As a result, an in vivo image of the patient4is promptly and stably displayed on the display device62, whereby the operator2or the like is enabled to continue the operation with security without being interrupted by an abnormality or the like of the displayed image.

Furthermore, the endoscope11(camera head22) is assumed to be held by the user (doctor, etc.) for a long period of time during the operation. Furthermore, even in a case where the endoscope11is supported by the support arm device13, when the camera head22increases in size, the support arm device13also increases in size. In view of the above, the communication unit102to be provided in the endoscope11is preferably low-powered (hardly generates heat) and small in size.

Meanwhile, for example, a communication device capable of transmitting/receiving strong wireless signals to/from a device1M or more away is large in size and tends to generate heat.

In contrast, since the communication unit102of the endoscope11and the communication unit203of the insertion aid34A perform wireless communication at close range, it becomes possible to achieve downsizing and low power consumption of the communication device constituting the communication unit102.

Furthermore, the communication unit102of the endoscope11and the communication unit203of the insertion aid34A transmit/receive image signals and the like by wireless communication, whereby communication cables of the endoscope11can be reduced. Moreover, for example, by wirelessly supplying power to the endoscope11to delete the power cable112, it becomes possible to eliminate the wiring between the endoscope11and the CCU61.

<Exemplary Configuration of Communication Processing Unit251of CCU61>

FIG. 6illustrates an exemplary configuration of a communication processing unit251that performs processing related to communication of the CCU61.

The communication processing unit251includes a communication unit261and a communication control unit262.

The communication unit261performs wireless communication with the communication device15and the communication unit102of the endoscope11using the communication scheme described above.

The communication control unit262controls the communication unit261to control communication of the CCU61.

Next, a transmission amount control process to be executed by the CCU61will be described with reference to the flowchart ofFIG. 7.

In the medical system1ofFIG. 1, there is a possibility that a display error (e.g., freeze of a displayed image, frame dropping, significant delay, etc.) occurs in the display device62due to occurrence of a communication error or packet loss (communication packet loss) between the communication unit102of the endoscope11and the communication unit203of the insertion aid34A.

Meanwhile, when a display error occurs, it is difficult to confirm an in vivo state of the patient4, which may delay the operation. In view of the above, even if the image quality is degraded, display images are preferably displayed continuously in real time rather than occurrence of a display error.

Meanwhile, this process is carried out to prevent occurrence of a display error.

Note that this process starts when the power of the CCU61is turned on, for example, and ends when it is turned off.

In step S1, the communication unit261of the CCU61receives image signals transmitted from the communication unit102of the endoscope11via the communication unit203of the insertion aid34A and the communication device15. The communication unit261supplies the received image signals to the communication control unit262.

In step S2, the communication control unit262detects a noise amount of the image signals. Note that a method of detecting the noise amount is not particularly limited.

In step S3, the communication control unit262determines whether or not the noise amount of the image signals has exceeded a predetermined threshold value. In a case where it is determined that the noise amount of the image signals has not exceeded the threshold value, the process returns to step S1.

Thereafter, the process of steps S1to S3is repeatedly executed until it is determined in step S3that the noise amount of the image signals has exceeded the threshold value. That is, imaging and transmission of image signals are continued while the transmission amount of the image signals is in a normal state.

On the other hand, in a case where it is determined in step S3that the noise amount of the image signals has exceeded the threshold value, the process proceeds to step S4.

In step S4, the communication control unit262issues a command for reducing the transmission amount. Specifically, the communication control unit262generates command signals for commanding reduction of the transmission amount of the image signals, and transmits them via the communication unit203.

Meanwhile, the communication unit102of the endoscope11receives the command signals via the communication device15and the communication unit203of the insertion aid34A, and supplies them to the communication control unit161. The communication control unit161instructs the camera head22to reduce the data volume of the image signals.

For example, the camera head22reduces the resolution of the image from 4K resolution to high definition (HD) (compresses the image), performs crop imaging, or reduces an imaging rate.

With this arrangement, the data volume of the image signals is reduced and the transmission amount of the image signals between the communication unit102of the endoscope11and the communication unit203of the insertion aid34A is reduced, thereby improving the communication state between them. As a result, display images are stably displayed on the display device62in real time so that the user is enabled to confirm the in vivo state in real time, whereby the operation is continued without delay.

Thereafter, the transmission amount control process is terminated.

Note that the transmission amount of the image signals may be switched on the basis of, for example, the number of packet losses or the like other than the noise amount of the image signals.

Furthermore, for example, the communication unit261of the CCU61may constantly establish communication between the communication unit102of the endoscope11and the communication unit203of the insertion aid34A, and the communication control unit262may monitor the communication state with the endoscope11and the insertion aid34A. Then, the communication control unit262may control the communication path or the like on the basis of the communication states of the communication unit102and the communication unit203. For example, in a case where the noise amount or the number of packet losses in the communication with the communication unit203of the insertion aid34A exceeds a predetermined threshold value, or in a case where an abnormality occurs in the communication of the communication unit203, the communication control unit262may perform control in such a manner that the communication unit261directly performs wireless communication with the communication unit102of the endoscope11without passing through the communication unit203of the insertion aid34A and receives image signals.

Moreover, for example, the communication control unit262may detect the distance between the communication unit102of the endoscope11and the communication unit203of the insertion aid34A on the basis of an image based on image signals, a detection result of a distance sensor (not illustrated), or the like, and may control the transmission amount, the communication path, and the like on the basis of the detected distance. For example, in a case where the distance therebetween is equal to or more than a predetermined threshold value, the communication control unit262may reduce the transmission amount of the image signals, or may perform control in such a manner that the CCU61and the communication unit102of the endoscope11directly communicate with each other. Meanwhile, for example, in a case where the distance therebetween is less than the predetermined threshold value, the communication control unit262may turn back the transmission amount of the image signals to normal, or may perform control in such a manner that the CCU61communicates with the communication device15.

With this arrangement, for example, even when the endoscope11is removed from the insertion aid34A or when the insertion aid34A is removed from the patient4and the endoscope11is directly inserted into the body of the patient4, image signals are stably and continuously supplied to the CCU61, thereby displaying display images stably and continuously.

Note that, for example, the communication control unit161of the endoscope11may control the transmission amount, the transmission amount, the communication path, and the like of the image signals by itself on the basis of at least one of the communication state or the distance between the communication unit102of the endoscope11and the communication unit203of the insertion aid34A, without being instructed by the communication control unit262of the CCU61.

2. Second Embodiment

Next, a second embodiment of the present technology will be described with reference toFIGS. 8 and 9.

While an exemplary case where the endoscope11and the insertion aid34A perform wireless communication outside the body of the patient4has been described above, an exemplary case where an endoscope and an insertion aid perform wireless communication inside the body of a patient will be described in the second embodiment.

<Exemplary Configuration of Endoscope301>

FIG. 8schematically illustrates an exemplary configuration of an endoscope301to which the present technology is applied.

The endoscope301includes an insertion part311and an operation unit312.

The insertion part311is rigid or at least partially soft, which has an elongated shape and is inserted into a living body. An image sensor321is incorporated in the distal end of the insertion part311. Furthermore, an antenna323is incorporated in the insertion part311.

The operation unit312is a part operated by a user without being inserted into the living body. A wireless module322is incorporated in the operation unit312.

Note that an optical system, such as a lens, may be provided in the insertion part311, and the image sensor321may be provided in the operation unit312. In addition, the image sensor of the operation unit312may photoelectrically convert observation light condensed by the optical system of the insertion part311to generate image signals, which are electric signals.

<Exemplary Configuration of Insertion Aid351>

FIG. 9schematically illustrates an exemplary configuration of an insertion aid351to which the present technology is applied.

In a similar manner to the insertion aid34A ofFIG. 4, the insertion aid351is configured by a trocar including an insertion part361and a fixing part362.

An antenna372is incorporated in the insertion part361.

A wireless relay module371and an antenna373are incorporated in the fixing part362.

In addition, the wireless relay module371relays a communication network inside the living body and a communication network outside the living body. The communication network inside the living body includes, for example, the wireless module322and the antenna323of the endoscope301, the wireless relay module371and the antenna372of the insertion aid351, and the like. The communication network outside the living body includes, for example, the wireless relay module371and the antenna373of the insertion aid351, a communication device15, a communication unit261of a CCU61, and the like.

For example, the image sensor321of the endoscope301captures an in vivo image, and supplies the obtained image signals to the wireless module322. In the living body, the wireless module322transmits the image signals to the insertion aid351via the antenna323.

The wireless relay module371of the insertion aid351receives the image signals via the antenna372. At this time, the antenna323, the insertion aid351, and the antenna372of the endoscope301are close to each other in the living body, whereby the image signals are stably transmitted in the living body.

The wireless relay module371transmits the image signals via the antenna373. The image signals transmitted from the antenna373are received by, for example, the communication device15or the communication unit261of the CCU61.

Note that the wireless relay module371is also capable of receiving, via the antenna372, sensor signals transmitted from a device other than the endoscope301in the living body. For example, the wireless relay module371is capable of receiving, via the antenna372, image signals transmitted from a capsule endoscope (not illustrated) inserted into the living body.

Then, for example, the wireless relay module371can synchronize the image signals from the endoscope301and the image signals from the capsule endoscope by adding a time stamp to both of them. For example, the CCU61can cause the display device62to display an image based on the image signals of the endoscope301and an image based on the image signals of the capsule endoscope in synchronization with each other on the basis of the added time stamp.

Next, a third embodiment of the present technology will be described with reference toFIG. 10.

FIG. 10illustrates an exemplary configuration of a medical system401to which the present technology is applied.

The medical system401includes an endoscope411, a camera-equipped treatment tool412, an insertion aid413, a CCU414, and a monitor415. The endoscope411and the camera-equipped treatment tool412are inserted into the living body of a patient402via the insertion aid413. The insertion aid413is coupled to the CCU414via a communication cable421.

The endoscope411captures an in vivo image of the patient402. Furthermore, in a similar manner to the endoscope301ofFIG. 8, the endoscope411includes a communication unit (not illustrated) that performs wireless communication, and performs wireless communication with (a communication unit (not illustrated) provided in) the insertion aid413in the living body of the patient402. For example, the endoscope411transmits, to the insertion aid413, image signals obtained by capturing an in vivo image of the patient402.

The camera-equipped treatment tool412is a surgical tool to be used for an operation, which includes a camera and is capable of capturing an in vivo image of the patient402. Furthermore, in a similar manner to the endoscope411, the camera-equipped treatment tool412includes a communication unit (not illustrated) that performs wireless communication, and performs wireless communication with (a communication unit (not illustrated) provided in) the insertion aid413in the living body of the patient402. For example, the camera-equipped treatment tool412transmits, to the insertion aid413, image signals obtained by capturing an in vivo image of the patient402.

The insertion aid413has a communication function, and relays a communication network inside the living body and a communication network outside the living body in a similar manner to the insertion aid351ofFIG. 9. The communication network inside the living body includes, for example, the endoscope411, the camera-equipped treatment tool412, and the insertion aid413. The communication network outside the living body includes, for example, the insertion aid413and the CCU414.

For example, the insertion aid413transmits, to the CCU414, the image signals received from the endoscope411and the camera-equipped treatment tool412. For example, the insertion aid413receives control signals transmitted from the CCU414, and transmits them to the endoscope411and to the camera-equipped treatment tool412.

Furthermore, for example, inside the living body of the patient402, the insertion aid413relates the communication between the endoscope411and the camera-equipped treatment tool412.

Moreover, for example, the insertion aid413is capable of synchronizing the image signals received from the endoscope411and the image signals received from the camera-equipped treatment tool412by adding a time stamp to both of them. For example, the CCU414can cause the monitor415to display an image based on the image signals of the endoscope411and an image based on the image signals of the camera-equipped treatment tool412in synchronization with each other on the basis of the added time stamp.

Note that the insertion aid413and the CCU414may wirelessly communicates with each other without being connected by the communication cable421.

As described above, the endoscope411and the camera-equipped treatment tool412are inserted into the body of the patient402via one insertion aid413and perform wireless communication with the insertion aid413, whereby it becomes possible to reduce the number of the insertion aids413.

Furthermore, it becomes possible to smoothly perform communication in the communication network inside the living body, communication network in the communication network outside the living body, and relay between the communication network inside the living body and the communication network outside the living body via the insertion aid413.

Next, a fourth embodiment of the present technology will be described with reference toFIG. 11.

FIG. 11illustrates an exemplary configuration of a medical system451to which the present technology is applied. Note that, in the drawing, a part corresponding to that of the medical system401ofFIG. 10is denoted by the same reference sign, and descriptions thereof will be omitted as appropriate.

The medical system451is the same as the medical system401in that it includes an endoscope411, a camera-equipped treatment tool412, a CCU414, and a monitor415, and is different in that it includes an insertion aid461instead of the insertion aid413and includes an antenna462and a wireless relay463.

The endoscope411and the camera-equipped treatment tool412are inserted into the body of a patient402via the insertion aid461. The antenna462is set in the body of the patient402, and is coupled to the insertion aid461via a communication cable471. The wireless relay463is provided on the back of a bed403on which the patient402lies. Furthermore, the wireless relay463is coupled to the insertion aid461via a communication cable472. Therefore, the antenna462and the wireless relay463are coupled to each other via the communication cable471, the insertion aid461, and the communication cable472.

The insertion aid461has a communication function, and relays a communication network inside the living body and a communication network outside the living body in a similar manner to the insertion aid461ofFIG. 10. The communication network inside the living body includes, for example, the endoscope411, the camera-equipped treatment tool412, the insertion aid461, and the antenna462. The communication network outside the living body includes, for example, the insertion aid461, the wireless relay463, and the CCU414.

In addition, the endoscope411, the camera-equipped treatment tool412, and the CCU414communicate with each other via the antenna462, the communication cable471, the insertion aid461, the communication cable472, and the wireless relay463. Furthermore, the endoscope411and the camera-equipped treatment tool412communicate with each other via the antenna462and the insertion aid461.

Note that, for example, the antenna462, the communication cable471, and the communication cable472may be detachable from the insertion aid461.

Furthermore, for example, an existing insertion aid may be used as a wireless relay with the antenna462, the communication cable471, and the communication cable472attached to the existing insertion aid.

Hereinafter, variations of the above-described embodiments according to the present technology will be described.

<Variation for Communication Device15>

For example, in the medical system1ofFIG. 1, a plurality of communication devices15may be provided. In this case, for example, the plurality of communication devices15communicate with each other by wire or wirelessly. Furthermore, each of the communication devices15is coupled to the insertion aid34A by wire, or one communication device15is coupled to the insertion aid34A by wire. Moreover, each of the communication devices15performs wireless communication with the CCU61.

Then, for example, the communication device15with the best communication state with the CCU61among the plurality of communication devices15transmits image signals received from the endoscope11to the CCU61via the insertion aid34A.

Note that the communication device15with the best communication state is, for example, the communication device15with the most stable communication speed with the CCU61, the communication device15with the least packet loss with the CCU61, the communication device15with the maximum signal strength with the CCU61, or the like.

With this arrangement, it becomes possible to further improve the communication state between the communication device15and the CCU61.

While an exemplary case where only the insertion aid34A includes the communication unit203has been described in the first embodiment above, a plurality of insertion aids34may include a communication unit to allow them to perform wireless communication with the communication unit102of the endoscope11. In this case, the plurality of insertion aids34may share the communication device15, or the communication device15may be individually provided for each of the insertion aids34.

In addition, for example, the communication control unit161of the endoscope11may select the optimum insertion aid34to transmit image signals. For example, the communication control unit161selects the insertion aid34including a communication unit having the shortest distance to the communication unit102or the insertion aid34including a communication unit having the best communication state with the communication unit102, and transmits image signals. Note that the communication control unit161may switch the insertion aid34for transmitting image signals as needed depending on the communication state.

Furthermore, for example, the communication control unit161of the endoscope11may perform control to communicate with the communication unit of the insertion aid34set in advance. For example, the communication control unit161causes each of the insertion aids34to broadcast endoscope ID for identifying the endoscope11from the communication unit102. Then, among the insertion aids34that have received the endoscope ID, the communication unit of the insertion aid34in which the endoscope ID set in advance by the CCU61matches the endoscope ID received from the endoscope11may communicate with the communication unit102of the endoscope11.

Moreover, for example, the communication unit102of the endoscope11may transmit the endoscope ID to the CCU61, and the communication unit203of each of the insertion aids34may transmit insertion aid ID for identifying each of the insertion aids34to the CCU61. In addition, for example, the display device62may display, on the operation screen, the endoscope ID and the insertion aid ID received by the CCU61, and the user may select a pair of the insertion aid34and the endoscope11for performing wireless communication while viewing the operation screen.

Furthermore, for example, the communication unit102of the endoscope11may transmit image signals to the communication units of the plurality of insertion aids34. In this case, for example, the communication unit of the insertion aid34with the least packet loss of the received image signals may transmit the image signals to the communication device15. Alternatively, the communication device15may transmit, to the CCU61, the image signals with the least packet loss from among the image signals received from the communication units of the plurality of insertion aids34.

Moreover, for example, the communication unit of each of the insertion aids34may share the packets of the image signals received from the endoscope11and transmit them to the CCU61via the communication device15. In this case, for example, the communication control unit262of the CCU61restores the image signals by combining the packets transmitted from the communication units of the respective insertion aids34. Furthermore, for example, in a case where packet loss occurs in signals received from a communication unit of a certain insertion aid34, the communication control unit262may complement the signals with signals received from a communication unit of another insertion aid34.

<Variation for Communication Scheme>

For example, the communication device15may be provided at a position in contact with the body of the patient4, and the communication unit203of the insertion aid34A and the communication device15may communicate with each other using human body communication (body area network) in which communication is performed by applying a current to the body surface of the patient4. With this arrangement, it becomes possible to reduce the communication cables between the insertion aid34A and the communication device15. Furthermore, it becomes possible to transmit a large volume of data without a cable between the insertion aid34A (sanitary area) and the communication device15on the bed3(insanitary area), whereby the sanitary conditions around the surgical site of the patient4can be maintained.

Furthermore, for example, the human body communication may be performed between the communication units of the plurality of insertion aids34.

Moreover, for example, a connecting part of a communication cable (e.g., connector, jack, etc.) may be provided on the camera head22of the endoscope11so that the communication unit102is also enabled to perform wired communication. In addition, for example, in a case where an abnormality occurs in wireless communication between the communication unit102of the endoscope11and the communication unit203of the insertion aid34, the endoscope11and the CCU61may be coupled to each other by a cable, and the communication unit102may transmit image signals to the CCU61by wired communication. With this arrangement, even in a case where abnormality occurs in the wireless communication, display images can be continuously displayed, whereby it becomes possible to avoid interruption of the operation.

Furthermore, for example, a communication cable may be provided in the power cable112, and lower-capacity signals such as control signals may be transmitted between the endoscope11and the CCU61via the communication cable in the power cable112.

Moreover, for example, the communication device15and the CCU61may be coupled to each other by a communication cable to perform wired communication between them.

Furthermore, for example, the communication unit203of the insertion aid34A and the CCU61may directly communicate with each other without the communication device15provided. In this case, although the communication unit203and the CCU61preferably perform wireless communication, the communication unit203and the CCU61may be coupled to each other by a communication cable to perform wired communication with each other.

Although an exemplary case where the image signals are transmitted via the communication unit203of the insertion aid34A has been described above, the signals to be transmitted using the present technology are not limited to the image signals. For example, sensor signals including in vivo data detected by various sensors provided at the distal end of the surgical tool12may be transmitted to the CCU61via the communication unit203of the insertion aid34A and the communication device15. Examples of such sensors include a time of flight (TOF) sensor, a vital sensor, a distance sensor, and a temperature sensor.

Furthermore, the endoscope or the surgical tool may be inserted into the living body from a natural hole such as a nasal cavity via the insertion aid.

Moreover, the endoscope or the surgical tool may be inserted into the living body from a natural hole without passing through the insertion aid. In this case, for example, sensor signals such as image signals are transmitted via a communication unit of an insertion aid used to insert another endoscope or surgical tool near the endoscope or surgical tool.

The series of processing described above may be executed by hardware or by software. In a case where the series of processing is executed by software, a program constituting the software is installed in a computer. Here, examples of the computer include a computer incorporated in dedicated hardware, a general-purpose personal computer capable of implementing various functions by installing various programs, and the like.

FIG. 12is a block diagram illustrating an exemplary hardware configuration of a computer that executes, using a program, the series of processing described above.

In the computer, a central processing unit (CPU)1001, a read only memory (ROM)1002, and a random access memory (RAM)1003are coupled to one another via a bus1004.

An input/output interface1005is further connected to the bus1004. An input unit1006, an output unit1007, a storage unit1008, a communication unit1009, and a drive1010are coupled to the input/output interface1005.

The input unit1006includes a keyboard, a mouse, a microphone, and the like. The output unit1007includes a display, a speaker, and the like. The storage unit1008includes a hard disk, a non-volatile memory, and the like. The communication unit1009includes a network interface and the like. The drive1010drives a removable medium1011such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

In the computer configured as described above, for example, the CPU1001loads the program stored in the storage unit1008into the RAM1003via the input/output interface1005and the bus1004and executes the program, thereby performing the series of processing described above.

The program to be executed by the computer (CPU1001) may be provided by, for example, being recorded in the removable medium1011as a package medium or the like. Furthermore, the program may be provided through a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

In the computer, the program may be installed in the storage unit1008via the input/output interface1005by attaching the removable medium1011to the drive1010. Furthermore, the program may be received by the communication unit1009via a wired or wireless transmission medium and installed in the storage unit1008. In addition, the program may be installed in the ROM1002or the storage unit1008in advance.

Note that the program to be executed by the computer may be a program in which processing is executed in a time-series manner according to the order described in the present specification, or may be a program in which processing is executed in parallel or at a necessary timing such as when a call is made.

Furthermore, in the present specification, a system indicates a set of a plurality of constituent elements (devices, modules (parts), etc.), and it does not matter whether or not all the constituent elements are in the same housing. Therefore, a plurality of devices housed in separate housings and connected through a network, and one device in which a plurality of modules is housed in one housing are both systems.

Note that an embodiment of the present technology is not limited to the embodiments described above, and various modifications can be made without departing from the gist of the present technology.

For example, the present technology may employ a configuration of cloud computing in which one function is shared and jointly processed by a plurality of devices via a network.

Furthermore, each step described in the flowchart described above may be executed by one device or shared by a plurality of devices.

Moreover, in a case where a plurality of processes is included in one step, the plurality of processes included in the one step may be executed by one device or shared by a plurality of devices.

The present technology may also employ the following configurations.

A medical system including:

a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body; and

a sensor communication unit that serves as a communication unit that transmits, by wireless communication, a first sensor signal output from the sensor to an aid communication unit that serves as a communication unit provided in the insertion aid.

The medical system according to (1) described above, further including:

a communication control unit that selects a communication path of the first sensor signal on the basis of at least one of a communication state or a distance with the aid communication unit.

The medical system according to (2) described above, in which

the communication path of the first sensor signal includes a first communication path that passes through the aid communication unit and a second communication path that does not pass through the aid communication unit.

The medical system according to (1) described above, further including:

a communication control unit that controls a transmission amount of the first sensor signal on the basis of a communication state with the aid communication unit.

The medical system according to (1) described above, in which

the sensor communication unit performs wireless communication with a plurality of the aid communication units respectively provided in a plurality of the insertion aids inserted into the living body.

The medical system according to (5) described above, further including:

a communication control unit that selects the aid communication unit with which the sensor communication unit performs the wireless communication from among the plurality of aid communication units.

The medical system according to (6) described above, in which

the communication control unit selects the aid communication unit with which the sensor communication unit performs the wireless communication on the basis of at least one of a communication state or a distance with each of the aid communication units.

The medical system according to (6) or (7) described above, in which

the sensor communication unit transmits the first sensor signal to each of the aid communication units.

The medical system according to any one of (1) to (8) described above, in which

the sensor communication unit performs wireless communication with the aid communication unit in the living body via an antenna provided in the insertion part.

The medical system according to (9) described above, in which

the sensor communication unit communicates with a communication unit provided in a surgical tool inserted into the living body via the aid communication unit in the living body.

The medical system according to any one of (1) to (11) described above, further including:

the insertion part;

an imaging unit including an image sensor serving as the sensor; and

the sensor communication unit.

The medical system according to (11) described above, in which

the endoscope further includes:

a connection part capable of being connected to a communication cable, and

the sensor communication unit is capable of performing wired communication with an information processing device that uses the first sensor signal via the communication cable.

The medical system according to any one of (1) to (12) described above, in which

the sensor communication unit performs communication using a frequency of a millimeter-wave frequency band.

The medical system according to any one of (1) to (13) described above, further including:

the insertion aid.

The medical system according to (14) described above, in which

the aid communication unit relays a first communication network configured inside the living body and a second communication network configured outside the living body.

The medical system according to (15) described above, in which

the insertion aid further includes:

a first antenna provided at a part to be inserted into the living body, and

the aid communication unit performs wireless communication with the sensor communication unit via the first antenna.

The medical system according to (16) described above, in which

the insertion aid further includes:

a second antenna provided at a part not to be inserted into the living body, and

the aid communication unit performs communication in the second communication network via the second antenna.

The medical system according to any one of (14) to (17) described above, in which

the aid communication unit performs wired communication with a communication device that transmits the first sensor signal to an information processing device via a communication cable.

The medical system according to (18) described above, in which

the communication device is provided on a bed on which the living body is placed.

The medical system according to (14) described above, in which

the aid communication unit performs human body communication with a communication device in contact with the living body or with another aid communication unit provided in another insertion aid via the living body.

The medical system according to any one of (14) to (20) described above, in which

the aid communication unit adds a time stamp to the first sensor signal received from the sensor communication unit and to a second sensor signal received from another surgical tool.

The medical system according to any one of (12) to (21) described above, in which

the aid communication unit is detachable from the insertion aid.

A communication method including:

transmitting, by wireless communication, a sensor signal output from a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body to a communication unit provided in the insertion aid.

An imaging device including:

an imaging unit that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and images the inside of the living body; and

a sensor communication unit that serves as a communication unit that transmits, by wireless communication, an image signal output from the imaging unit to an aid communication unit that serves as a communication unit provided in the insertion aid.

An information processing device including:

a communication unit that receives a sensor signal output from a sensor that is provided in or connected to an insertion part to be inserted into a living body via an insertion aid and obtains data in the living body; and

a communication control unit that controls at least one of a communication path or a transmission amount of the sensor signal on the basis of at least one of a communication state or a distance between an aid communication unit that serves as a communication unit provided in the insertion aid and a sensor communication unit that serves as a communication unit that transmits the sensor signal to the aid communication unit by wireless communication.

An endoscope system including:

an insertion part to be inserted into a living body via an insertion aid;

an imaging unit that is provided in or connected to the insertion part and images the inside of the living body; and

a sensor communication unit that serves as a communication unit that transmits, by wireless communication, an image signal output from the imaging unit to an aid communication unit that serves as a communication unit provided in the insertion aid.

Note that the effects described herein are merely examples and not limited, and additional effects may be included.

REFERENCE SIGNS LIST