Patent ID: 12225173

DESCRIPTION OF EMBODIMENTS

An embodiment for implementing the present technique will be described below. The description will be made in the following order.1. Background2. Embodiment3. Modification Examples4. Others

1. Background

In conventional face-to-face medical care, a medical practitioner provides medical care for a patient in person in the same space (e.g., in a consultation room) under the same environment. Thus, a medical practitioner deliberately or unconsciously compares a skin color or the like of a patient with that in the experience of the medical practitioner or a scene in the field of view and uses the comparison to determine the presence or absence of a disease.

In this case, a medical practitioner is a person who provides medical care and conducts diagnosis and treatment on a patient, and is not limited to a doctor. For example, medical practitioners include a nurse, a pharmacist, a dentist, and a hygienist. A patient is a person who undergoes medical care by a medical practitioner regardless of whether the person is suffering from a disease.

In contrast, in telemedicine, a patient and a medical practitioner are present in different spaces, so that an environment where the patient is imaged is different from an environment where the image of the patient (hereinafter referred to as a patient image) is examined by the medical practitioner. Thus, visual information obtained for the patient (hereinafter referred to as patient visual information) by the medical practitioner may be different from that in face-to-face medical care, leading to unexpected wrong diagnosis.

For example, if a patient is illuminated with yellow light while a medical practitioner is illuminated with blue light, the medical practitioner is more likely to be affected by an impression of yellow components in a patient image unlike in the case where the medical practitioner is present with the patient in the same space. Hence, the medical practitioner is more likely to erroneously diagnose the patient as jaundice or the like.

Moreover, depending upon the conditions of a camera for imaging a patient, a display device for displaying a patient image, and equipment including a transmission line for transmitting a patient image, a difference increases between patient visual information obtained by a medical practitioner in telemedicine and patient visual information obtained by a medical practitioner in face-to-face medical care.

The difference in patient visual information depending upon the conditions of equipment is multiplied though each part of the equipment. The multiplied difference is, for example, a color variation in a patient image because of the type, the manufacturing error, and the setting or the like of a camera, a color change made in a patient image by compression and decompression during transmission, or a color variation in a patient image because of the type, the manufacturing error, and the setting or the like of a display device. This further increases a difference between patient visual information obtained by a medical practitioner in telemedicine and patient visual information obtained by a medical practitioner in face-to-face medical care.

Furthermore, the conditions of equipment vary among patients or examinations and thus are hard to adjust with uniformity.

As described above, telemedicine may cause a difference from patient visual information obtained by face-to-face medical care, thereby preventing a medical practitioner from accurately acquiring patient visual information.

In contrast, the present technique is devised to reduce a difference from patient visual information obtained by face-to-face medical care, allowing a medical practitioner to accurately obtain patient visual information in telemedicine.

2. Embodiment

Referring toFIGS.1to8, an embodiment of the present technique will be described below.

Configuration Example of Telemedicine System1

FIG.1illustrates an embodiment of a telemedicine system1to which the present technique is applied.

The telemedicine system1includes a patient terminal11, a medical practitioner terminal12, and a server13. The patient terminal11, the medical practitioner terminal12, and the server13are connected to one another via a network21.

In the telemedicine system1, the patient terminal11and the medical practitioner terminal12communicate with each other and transfer various kinds of data to each other via the server13, achieving telemedicine.

The patient terminal11is an information processing device that is used by a patient and includes, for example, a computer, a TV, or a smartphone. The patient terminal11is disposed in a space where a patient undergoes telemedicine (hereinafter referred to as a patient space). The patient space is not particularly limited. For example, the space may be a room of a patient's house, a patient's room in a lodging facility, a store, various facilities, a vehicle, or an outdoor space.

The medical practitioner terminal12is an information processing device that is used by a medical practitioner and includes, for example, a computer. The medical practitioner terminal12is disposed in a space that is different from the patient space and is provided for telemedicine conducted by a medical practitioner (hereinafter referred to as a medical practitioner space). The medical practitioner space is not particularly limited. For example, the space may be a consultation room of a medical institution or a room in the house of a medical practitioner.

The server13is an information processing device to which client terminals (e.g., the patient terminal11and the medical practitioner terminal12) are connectable. The server13includes, for example, a computer.

The server13transmits data from one of the client terminals to the other client terminal and optionally performs a variety of processing on data. For example, the server13receives image data corresponding to a patient image from the patient terminal11, corrects the patient image, and transmits image data corresponding to the corrected patient image to the medical practitioner terminal12.

In this way, the patient terminal11and the medical practitioner terminal12do not directly communicate with each other but indirectly communicate with each other via the server13. This can prevent personal information and medical information on patients from being accidentally left at the patient terminal11or the medical practitioner terminal12.

Configuration Example of the Patient Terminal11

Referring toFIGS.2to4, a configuration example of the patient terminal11will be described below.

FIG.2is a block diagram illustrating a functional configuration example of the patient terminal11.

The patient terminal11includes a CPU (Central Processing Unit)101, a memory102, a storage103, an operation unit104, a display unit105, a speaker106, an imaging unit107, a microphone108, a communication unit109, an external I/F110, a drive111, and a sensor unit112. The units from the CPU101to the sensor unit112are connected to a bus and conduct necessary communications with one another.

The CPU101performs a variety of processing by running programs installed in the memory102and the storage103.

The memory102includes, for example, a volatile memory and temporarily stores the program to be executed by the CPU101and necessary data.

The storage103includes, for example, a hard disk or a nonvolatile memory and stores the program to be executed by the CPU101and necessary data.

The operation unit104includes a physical key (including a key board), a mouse, and a touch panel. The operation unit104outputs an operation signal onto the bus in response to a user operation, the operation signal corresponding to the user operation.

The display unit105includes, for example, a display device such as an LCD (Liquid Crystal Display) and displays an image according to data supplied from the bus.

In this configuration, a touch panel acting as the operation unit104includes a transparent member and can be integrated with the display unit105. Thus, a user (e.g., a patient) can input information so as to operate an icon or a button that is displayed on the display unit105.

The speaker106outputs sound according to data supplied from the bus.

The imaging unit107includes, for example, a digital camera. The imaging unit107captures (senses light) an image (a still image or a moving image) and outputs corresponding image data onto the bus.

The microphone108collects sounds (senses sounds) and outputs corresponding sound data onto the bus.

The communication unit109includes a communication circuit and an antenna and communicates with the server13or the like via the network21.

The external I/F (interface)110is an interface for exchanging data with various external devices.

In the drive111, for example, a removable medium111A such as a memory card can be loaded and removed. The drive111drives the loaded removable medium111A.

The sensor unit112includes a sensor other than the imaging unit107for sensing light and the microphone108for sensing sound, that is, a sensor for sensing a different physical quantity different from those of the imaging unit107and the microphone108. The sensor unit112senses any physical quantity or any kind of physical quantity. For example, physical quantities such as a temperature, a humidity, and illuminance, an acceleration, an angular velocity, and geomagnetism may be sensed. The sensor unit112outputs sensor data, which indicates the sensed physical quantity, onto the bus.

In the patient terminal11configured thus, the program (e.g., a patient application) to be executed by the CPU101can be recorded in advance in the storage103serving as a recording medium contained in the CPU101.

The program is provided as so-called package software that is stored (recorded) in the removable medium111A. The program can be installed on the patient terminal11from the removable medium111A.

Additionally, the program can be downloaded from the server13or the like via the network21and the communication unit109and can be installed on the patient terminal11.

The CPU101can act as a voice recognition unit121, a data processing unit122, and an output control unit123by running the program installed on the patient terminal11.

The voice recognition unit121performs voice recognition on, for example, on voice data outputted from the microphone108and outputs voice recognition data, which indicates the result of the voice recognition, onto the bus.

The data processing unit122performs processing on various kinds of data used for the processing of telemedicine. For example, the data processing unit122generates imaging condition data that indicates the conditions for imaging a patient. For example, the data processing unit122generates input data that indicates contents inputted by a user (e.g., a patient), based on an operation signal from the operation unit104. For example, the data processing unit122optionally performs a variety of processing on transmission data to be transmitted to the medical practitioner terminal12. The transmission data includes, for example, image data, voice data, voice recognition data, sensor data, imaging condition data, and input data. For example, the data processing unit122optionally performs a variety of processing on data acquired from the medical practitioner terminal12.

The output control unit123controls, for example, the display of an image by the display unit105and the output of sound from the speaker106.

FIG.3illustrates a configuration example of the appearance of the patient terminal11and an example of the display layout of the display unit105.

In this example, the display unit105is mounted on a main unit151, and the imaging unit107is mounted on the display unit105. The main unit151contains, for example, the CPU101, the memory102, the storage103, the communication unit109, the external I/F110, the drive111, and the sensor unit112that are illustrated inFIG.2.

The screen of the display unit105is divided into, for example, display areas161to164.

In the display area161, an image of a medical practitioner U2is displayed, the image being captured by the medical practitioner terminal12.

In the display area162, an image of a patient U1is displayed, the image being captured by the imaging unit107.

In the display area163, for example, a text indicating the voice of the medical practitioner U2or an option to be selected by the patient U1is displayed. The voice of the medical practitioner U2is recognized by the medical practitioner terminal12, and the option is inputted to the medical practitioner terminal12by the medical practitioner U2.

In the display area164, an action record log by the patient U1or the medical practitioner U2is displayed. The action record log includes, for example, the comments of the patient U1and the medical practitioner U2and information or the like selected or inputted by the patient U1and the medical practitioner U2.

FIG.4illustrates an example of the action record log. In this example, a patient icon is displayed on the left side of the display area164while a medical practitioner icon is displayed on the right side. The comments of the patient U1or the medical practitioner U2and information or the like selected or inputted by the patient U1and the medical practitioner U2are displayed in time sequence while being associated with the icons.

For example, the patient U1is diagnosed by the medical practitioner U2displayed on the display unit105. For example, the patient U1can undergo medical care by the medical practitioner U2via telemedicine by answering a question from the medical practitioner U2displayed on the display unit105or selecting an option displayed in the display area163.

Configuration Example of Medical Practitioner Terminal12

Referring toFIGS.5and6, a configuration example of the medical practitioner terminal12will be described below.

FIG.5is a block diagram illustrating a functional configuration example of the medical practitioner terminal12.

The medical practitioner terminal12includes a CPU201, a memory202, a storage203, an operation unit204, a display unit205, a speaker206, an imaging unit207, a microphone208, a communication unit209, an external I/F210, a drive211, and a sensor unit212. The units from the CPU201to the sensor unit212are connected to a bus and conduct necessary communications with one another.

The configurations of the CPU201to the sensor unit212are similar to those of the CPU101to the sensor unit112inFIG.2.

In the medical practitioner terminal12, as in the patient terminal11, a program (e.g., a medical practitioner application) to be executed by the CPU201can be recorded in advance in the storage203serving as a recording medium contained in the medical practitioner terminal12.

The program is provided as package software that is stored (recorded) in a removable medium211A. The program can be installed on the medical practitioner terminal12from the removable medium211A.

Additionally, the program can be downloaded from the server13or the like via the network21and the communication unit209and can be installed on the medical practitioner terminal12.

The CPU201can act as a voice recognition unit221, a data processing unit222, and an output control unit223by running the program installed on the medical practitioner terminal12.

The voice recognition unit221performs voice recognition on, for example, on voice data collected by the microphone208and outputs voice recognition data, which indicates the result of the voice recognition, onto the bus.

The data processing unit222performs processing on various kinds of data used for the processing of telemedicine. For example, the data processing unit222generates display condition data that indicates the conditions for displaying a patient image. For example, the data processing unit222generates input data that indicates contents inputted by a user (e.g., a medical practitioner), based on an operation signal from the operation unit204. For example, the data processing unit222optionally performs a variety of processing on transmission data to be transmitted to the patient terminal11. The transmission data includes, for example, image data, voice data, voice recognition data, sensor data, display condition data, and input data. For example, the data processing unit222optionally performs a variety of processing on data acquired from the patient terminal11.

The output control unit223controls, for example, the display of an image by the display unit205and the output of sound from the speaker206.

FIG.6illustrates a configuration example of the appearance of the medical practitioner terminal12and an example of the display layout of the display unit205.

In this example, the display unit205is mounted on a main unit251, and the imaging unit207is mounted on the display unit205. The main unit251contains, for example, the CPU201, the memory202, the storage203, the communication unit209, the external I/F210, the drive211, and the sensor unit212that are illustrated inFIG.5.

The screen of the display unit205is divided into, for example, display areas261to264.

In the display area261, an image of the patient U1is displayed, the image being captured by the patient terminal11.

In the display area262, for example, the electronic medical chart of the patient U1is displayed.

In the display area263, for example, a text indicating the voice of the patient U1, a question to the patient U1, or an answer to the question is displayed. The voice of the patient U1is recognized by the patient terminal11, the question is inputted by the medical practitioner U2, and the answer is inputted to the patient terminal11by the patient U1. The question to the patient U1includes, for example, a plurality of options.

In the display area264, for example, an action record log is displayed as in the display area164of the patient terminal11inFIG.3.

For example, the medical practitioner U2can perform telemedicine on the patient U1by asking a question to the patient U1displayed on the display unit205, referring to information on symptoms presented by the patient U1, or visually checking an image of the patient U1.

Configuration Example of Server13

FIG.7is a block diagram illustrating a functional configuration example of the server13.

The server13includes a CPU301, a memory302, a storage303, an operation unit304, a display unit305, a speaker306, a communication unit307, an external I/F308, and a drive309. The units from the CPU301to the drive309are connected to a bus and conduct necessary communications with one another.

The configurations of the CPU301to the drive309are similar to those of the CPU101to the speaker106and the communication unit109to the drive111inFIG.2.

In the server13, as in the patient terminal11, a program to be executed by the CPU301can be recorded in advance in the storage303serving as a recording medium contained in the server13.

The program is provided as package software that is stored (recorded) in a removable medium309A. The program can be installed on the server13from the removable medium309A.

Additionally, the program can be downloaded from another server (not illustrated) via the network21and the communication unit307and can be installed on the server13.

The CPU301can act as a condition identification unit321, an image processing unit322, a data processing unit323, and a communication control unit324by running the program installed on the server13.

The condition identification unit321identifies the imaging conditions for imaging a patient on the patient terminal11, based on imaging condition data acquired from the patient terminal11. Furthermore, the condition identification unit321identifies the display conditions for displaying a patient image on the medical practitioner terminal12, based on display condition data acquired from the medical practitioner terminal12.

The image processing unit322corrects a patient image corresponding to image data acquired from the patient terminal11, based on the imaging conditions of a patient and the display conditions of a patient image. The image processing unit322outputs, onto the bus, image data corresponding to the corrected patient image.

For example, the data processing unit323optionally performs a variety of processing on data other than image data corresponding to a patient image from among data transferred between the patient terminal11and the medical practitioner terminal12. The data processing unit323generates an action record log based on, for example, the data transferred between the patient terminal11and the medical practitioner terminal12.

The communication control unit324controls communications between the patient terminal11and the medical practitioner terminal12. For example, the communication control unit324controls the transmission of various kinds of data to the medical practitioner terminal12after the data is received from the patient terminal11. For example, the communication control unit324controls the transmission of various kinds of data to the patient terminal11after the data is received from the medical practitioner terminal12.

<Patient Image Correction>

Referring toFIG.8, the correction of a patient image by the server13will be described below.

This processing is started, for example, when telemedicine is started or at least the imaging conditions of a patient in a patient space or the display conditions of a patient image in a medical practitioner space are changed.

In step S1, the condition identification unit321identifies the imaging conditions of a patient.

Specifically, the data processing unit122of the patient terminal11generates imaging condition data on the imaging conditions of the patient and transmits the data to the server13via the communication unit109.

The imaging condition data includes, for example, image data corresponding to a patient image of the patient imaged by the imaging unit107. For example, if the sensor unit112of the patient terminal11includes a thermometer and an illuminometer or the like, the imaging condition data may include the measurement results of a temperature and an illuminance or the like in a patient space.

In response to the transmission, the condition identification unit321receives the imaging condition data via the network21and the communication unit307and identifies the imaging conditions of the patient based on the imaging condition data.

For example, the condition identification unit321identifies the illumination conditions of a patient space as the imaging conditions of the patient. For example, the condition identification unit321identifies, as the illumination conditions of the patient space, the conditions of at least one of the color (e.g., hue, saturation, or lightness) of illumination light, the brightness of illumination light, and the kind of light source.

For example, the condition identification unit321identifies the illumination conditions of the patient space by using a predetermined function. Specifically, for example, the condition identification unit321extracts an area where the skin of the patient is exposed (hereinafter referred to as a skin area), from the patient image. The condition identification unit321calculates tristimulus values (CIE-XYZ) from the pixel values (RGB values) of the skin area of the patient image according to a sensor correlational method. The condition identification unit321identifies color temperatures corresponding to the calculated tristimulus values, as the color temperatures of the light source in the patient space by using a predetermined translation table. In other words, the condition identification unit321identifies the color temperatures of the light source in the patient space on the assumption that the spectral distribution of the light source in the patient space agrees with the spectral distribution of blackbody radiation.

The translation table is a table indicating a correspondence between the tristimulus values and the color temperatures. The table is recorded in advance in the storage303.

Alternatively, for example, the condition identification unit321identifies the illumination conditions of the patient space by using machine learning.

Specifically, pieces of learning data are prepared such that an image of a person is labeled with the illumination conditions of a space where the image is captured. Furthermore, by using the learning data and any machine learning algorithm of deep learning or the like, a classifier (estimation algorithm) is generated to estimate, based on the image of the person, the illumination conditions of the space where the image is captured.

The generated classifier is used for the condition identification unit321. For example, when a patient image is inputted, the condition identification unit321outputs the illumination conditions of a patient space based on the inputted patient image.

The illumination light of the patient space is not always limited to artificial light. For example, natural light, e.g., sunlight may be used instead.

In step S2, the condition identification unit321identifies the display conditions of the patient image.

Specifically, the data processing unit222of the medical practitioner terminal12generates display condition data on the display conditions of the patient image and transmits the data to the server13via the communication unit209.

The display condition data includes, for example, image data corresponding to a medical practitioner image of a medical practitioner imaged by the imaging unit207. For example, if the sensor unit212of the medical practitioner terminal12includes a thermometer and an illuminometer or the like, the display condition data may include the measurement results of a temperature and an illuminance or the like in a medical practitioner space.

In response to the transmission, the condition identification unit321receives the display condition data via the network21and the communication unit307and identifies the display conditions of the patient image based on the display condition data.

For example, the condition identification unit321identifies the illumination conditions of the medical practitioner space as the display conditions of the patient image according to the same method as the illumination conditions of the patient space.

The illumination light of the medical practitioner space is not always limited to artificial light. For example, natural light, e.g., sunlight may be used instead.

In step S3, the image processing unit322starts processing for correcting the patient image based on the imaging conditions and the display conditions.

For example, when image data corresponding to a patient image received from the patient terminal11is transmitted to the medical practitioner terminal12, the image processing unit322starts processing for correcting the patient image based on a difference between the imaging conditions of the patient and the display conditions of the patient image.

For example, the image processing unit322estimates a difference between the illumination conditions of the patient space and the illumination conditions of the medical practitioner space, estimates the view of the patient on the assumption that the patient is present in the medical practitioner space, and corrects the patient image.

Specifically, for example, the image processing unit322estimates the skin color of the patient upon changing from the illumination conditions of the patient space to the illumination conditions of the medical practitioner space. The image processing unit322then corrects the patient image with reference to the estimated skin color. For example, on the assumption that the skin of the patient is a Lambertian surface, the image processing unit322estimates the skin color of the patient in the patient image when the color temperature of the light source is changed from the color temperature of the patient space to the color temperature of the medical practitioner space. The image processing unit322corrects the patient image by adjusting a white balance such that the skin of the patient has the estimated color.

Thereafter, the correction of the patient image is terminated.

As described above, by using the corrected patient image, the medical practitioner can observe the patient substantially under the same illumination conditions as the case where the patient is present in the same space. Thus, the medical practitioner can obtain patient visual information as in face-to-face medical care for a patient in the same space, thereby accurately obtaining patient visual information. This can suppress the occurrence of wrong diagnoses in telemedicine.

3. Modification Examples

Hereinafter, modification examples of the foregoing embodiments of the present technique will be described.

Modification Examples of the Correction of a Patient Image

For example, the imaging condition data transmitted from the patient terminal11to the server13may include the conditions of the configuration and setting of the imaging unit107. The conditions of the configuration of the imaging unit107include, for example, the kinds and models of a camera and a lens that are provided for the imaging unit107. The conditions of the setting of the imaging unit107include, for example, the setting values of exposure conditions such as a shutter speed, an f number, and sensitivity.

Likewise, the display condition data transmitted from the medical practitioner terminal12to the server13may include the conditions of the configuration and setting of the display unit205. The conditions of the configuration of the display unit205include, for example, the kind and model of a display device provided for the display unit205. The conditions of the setting of the display unit205include, for example, the setting values of display brightness, a color, and a contrast.

The image processing unit322of the server13then corrects a patient image based on, for example, the configuration and setting of the imaging unit107of the patient terminal11and the configuration and setting of the display unit205of the medical practitioner terminal12.

For example, a user (e.g., a medical practitioner) may provide an instruction for the server13via the medical practitioner terminal12so as to set the presence or absence of a correction on a patient image by the image processing unit322of the server13or the intensity of a correction. Thus, for example, if a medical practitioner determines that a patient image has a large correction error, the correction of the patient image can be canceled.

Moreover, for example, the imaging condition data may include information on a patient to be imaged, and the display condition data may include information on a patient to be displayed. The information on a patient includes, for example, information on at least one of the attribute (e.g., an age, a gender, or a nationality) of the patient and past medical care information (e.g., medical history) on the patient.

Thus, for example, the medical practitioner can set the presence or absence of a correction to the patient image or the intensity of a correction based on the age or the medical history of the patient. For example, if a patient has suffered from a liver disease in the past, a medical practitioner can carefully observe a skin color while switching the presence or absence of a correction to a patient image or the intensity of a correction.

For example, the image processing unit322of the server13may change the correction contents of a patient image based on the contents of conversation between the patient and the medical practitioner. For example, if a predetermined keyword or phrase is detected in conversation between a patient and a medical practitioner based on the result of voice recognition of the conversation, the image processing unit322may change the correction contents of a patient image. For example, if the image processing unit322detects a comment from a patient, for example, “a poor skin color,” “redness in my skin,” or “eczema on my skin,” the image processing unit322may increase or reduce the intensity of a correction to a patient image. Thus, a medical practitioner can more accurately compare visual information on a patient with the memory of the medical practitioner.

Modification Examples of the Imaging Condition Data and the Display Condition Data

For example, a user (e.g., a patient) may enter part or whole of imaging condition data supplied from the patient terminal11to the server13. For example, a patient may enter the model name or installation date of lighting equipment in a patient space into the patient terminal11.

Likewise, for example, a user (e.g., a medical practitioner) may enter part or whole of display condition data supplied from the medical practitioner terminal12to the server13. For example, a medical practitioner may enter the model name or installation date of lighting equipment in a medical practitioner space into the medical practitioner terminal12.

The display condition data may include, for example, data on the imaging conditions of a medical practitioner in a medical practitioner space.

For example, if the lighting equipment in the patient space is lighting equipment compliant with IoT (Internet of Things) connectable to the network21, the condition identification unit321of the server13may directly acquire data on the illumination conditions from the lighting equipment in the patient space.

Likewise, for example, if the lighting equipment in the medical practitioner space is lighting equipment compliant with IoT connectable to the network21, the condition identification unit321of the server13may directly acquire data on the illumination conditions from the lighting equipment in the medical practitioner space.

Modification Example of the Configuration of the Telemedicine System

The configuration and the sharing of processing of the telemedicine system1can be modified when necessary.

For example, the processing of the server13may be shared between the patient terminal11and the medical practitioner terminal12without providing the server13, so that communications may be conducted without the server13. In this case, for example, the medical practitioner terminal12may identify the imaging conditions of a patient and the display conditions of a patient image and correct a patient image. Likewise, for example, the patient terminal11may identify the imaging conditions of a patient and the display conditions of a patient image and correct a patient image.

Example of the Patient Terminal11Provided with Three-Dimensional Measuring Equipment

For example, the patient terminal11may be provided with three-dimensional measuring equipment (three-dimensional information detection unit) capable of detecting three-dimensional information. The three-dimensional measuring equipment may be, for example, a ToF (Time-of-Flight) sensor.

A patient image captured by a camera may cause a color variation due to the illumination conditions and the manufacturing error or deterioration of an image sensor. As described above, a patient image is susceptible to a camera, a display device, and equipment and a communication environment in, for example, compression and decompression during transmission. Moreover, in a patient image, a saturated luminance or a color breakup may occur, so that small tumors may escape detection.

To address the problem, three-dimensional information (depth data) on a patient is acquired by a ToF sensor, and the medical practitioner terminal12three-dimensionally displays the face of the patient as a monochrome image based on the three-dimensional information. The three-dimensional information includes, for example, point group data. The point group data is less susceptible to the illumination conditions, the equipment, and the communication environment. Hence, stable information can be provided for a medical practitioner regardless of the illumination conditions, the equipment, and the communication environment, though the three-dimensional information has a lower resolution than a patient image and does not include color information.

Other Modification Examples

For example, the server13may generate a medical practice summary, which is a summary of the contents of a medical practice, at the end of the medical practice, and the patient terminal11may be allowed to download the medical practice summary.

Moreover, a medical practitioner may be allowed to store, for example, patient images and an action record log, which are acquired during telemedicine, in the patient terminal11with the consent of a patient.

4. Others

In the present specification, the processing performed by the computer (CPU) in accordance with the program may not necessarily be performed chronologically in the order described in the flowchart. That is, the processing performed by the computer in accordance with the program also includes processing which is performed individually or in parallel (for example, parallel processing or processing by an object).

The program may be a program processed by one computer (processor) or may be distributed and processed by a plurality of computers. Furthermore, the program may be a program transmitted to a remote computer to be executed.

Moreover, in the present specification, a system means a collection of a plurality of constituent elements (including devices and modules (components)) regardless of whether all the constituent elements are contained in the same casing.

Accordingly, a plurality of devices accommodated in separate casings and connected via a network and one device in which a plurality of modules are accommodated in one casing are all systems.

Embodiments of the present technique are not limited to the above-described embodiment and various modifications can be made within the scope of the present technology without departing from the gist of the present technique.

Furthermore, the present technique may have, for example, a configuration of clouding computing in which a plurality of devices share and process one function together via a network.

In addition, each step described in the above flowchart can be executed by one device or shared by a plurality of devices.

Furthermore, in a case where a plurality of kinds of processing are included in a single step, the plurality of kinds of processing included in the single step may be executed by one device or by a plurality of devices in a shared manner.

The advantageous effects described in the present specification are merely exemplary and are not limited, and other advantageous effects may be achieved.

Note that the present technique may also have the following configurations.

(1) A telemedicine system comprising:a first imaging unit that images a patient in a first space;an image processing unit that corrects an image of the patient based on imaging conditions in the first space and display conditions in a second space for displaying the image of the patient imaged in the first space; anda display unit that displays the corrected image of the patient in the second space.

(2) The telemedicine system according to (1), whereinthe imaging conditions include illumination conditions of the first space, andthe display conditions include illumination conditions of the second space.

(3) The telemedicine system according to (2), whereinthe image processing unit estimates a skin color of the patient upon changing from the illumination conditions of the first space to the illumination conditions of the second space, and then the image processing unit corrects the image of the patient with reference to the estimated skin color.

(4) The telemedicine system according to (3), wherein the image processing unit corrects the image of the patient by adjusting a white balance.

(5) The telemedicine system according to any one of (2) to (4), wherein the illumination conditions of the first space and the illumination conditions of the second space include conditions of at least one of a color of illumination light, brightness of illumination light, and the kind of light source.

(6) The telemedicine according to any one of (2) to (5), further comprising: a second imaging unit that images a medical practitioner who provides medical care for the patient in the second space; anda condition identification unit that identifies the illumination conditions of the first space based on the image of the patient imaged by the first imaging unit and identifies the illumination conditions of the second space based on an image of the medical practitioner imaged by the second imaging unit.

(7) The telemedicine system according to any one of (1) to (6), whereinthe imaging conditions include conditions of at least one of a configuration and a setting of the first imaging unit, andthe display conditions include conditions of at least one of a configuration and a setting of the display unit.

(8) The telemedicine system according to any one of (1) to (7), wherein the image processing unit is capable of changing at least one of presence or absence of a correction to the image of the patient and intensity of a correction according to a user setting.

(9) The telemedicine system according to any one of (1) to (8), wherein at least the imaging conditions or the display conditions include information on at least one of an attribute of the patient and past medical care information on the patient.

(10) The telemedicine system according to any one of (1) to (9), wherein the image processing unit corrects the image of the patient based on contents of conversation between the patient and the medical practitioner who provides medical care for the patient in the second space.

(11) The telemedicine system according to any one of (1) to (10), further comprising a three-dimensional information detection unit that detects three-dimensional information on the patient in the first space,wherein the display unit displays the three-dimensional information on the patient.

(12) The telemedicine system according to (1), further comprising a condition identification unit that identifies the imaging conditions and the display conditions.

(13) The telemedicine system according to (1) further comprising:a first information processing device provided with the first imaging unit;a second information processing device provided with the display unit; anda third information processing device that is provided with the image processing unit and is connected to the first information processing device and the second information processing device via a network, whereinthe third information processing device receives the image of the patient from the first information processing device via the network and transmits the corrected image of the patient to the second information processing device.

(14) The telemedicine system according to any one of (1) to (5) and (7) to (13), further comprising:a first information processing device provided with the first imaging unit; anda second information processing device that is provided with the display unit and the image processing unit and is connected to the first information processing device via a network, whereinthe second information processing device receives the image of the patient from the first information processing device via the network.

(15) A telemedicine method comprising:imaging a patient in a first space;correcting an image of the patient based on imaging conditions in the first space and display conditions in a second space for displaying the image of the patient imaged in the first space; anddisplaying the corrected image of the patient in the second space.

(16) An information processing device comprising an image processing unit that corrects an image of a patient based on imaging conditions for imaging the patient in a first space and display conditions in a second space for displaying the image of the patient imaged in the first space.

(17) The information processing device according to (16) further comprising an output control unit that controls display of the corrected image of the patient.

(18) A program for causing a computer to perform processing of correcting an image of a patient based on imaging conditions for imaging the patient in a first space and display conditions in a second space for displaying the image of the patient imaged in the first space.

The advantageous effects described in the present specification are merely exemplary and are not limited, and other advantageous effects may be obtained.

REFERENCE SIGNS LIST

1Telemedicine system11Patient terminal12Medical practitioner terminal13Server21Network101CPU105Display unit107Imaging unit112Sensor unit121Voice recognition unit122Data processing unit123Output control unit201CPU205Display unit207Imaging unit212Sensor unit221Voice recognition unit222Data processing unit223Output control unit301CPU321Condition identification unit322Image processing unit323Data processing unit324Communication control unit