Patent Description:
With an aging population, soaring medical costs, and a lack of medical personnel for specialized medical services, research is being actively conducted on information technology (IT)-medical convergence technologies, in which IT technology and medical technology are combined. Particularly, monitoring of the health condition of the human body is not limited to places such as hospitals, but is expanding to mobile healthcare fields that may monitor a user's health condition anywhere and anytime in daily life at home or office. Typical examples of bio-signals, which indicate the health condition of individuals, include an electrocardiography (ECG) signal, a photoplethysmogram (PPG) signal, an electromyography (EMG) signal, and the like, and various bio-signal sensors are being developed to measure these signals in daily life. Particularly, the PPG sensor may estimate blood pressure of a human body by analyzing a pulse waveform which reflects a condition of the cardiovascular system and the like.

Studies on the PPG signal show that the entire PPG signal is a superposition of propagation waves starting from the heart toward the distal end portions of the body and reflection waves returning back from the distal end portions. Further, it has been known that information for estimating blood pressure may be obtained by extracting various features related to the propagation waves or the reflection waves.

<CIT> refers to a feature extraction apparatus and method for biometric information detection, biometric information detection apparatus, and variable device. A feature extraction apparatus configured to perform biometric information detection includes a biosignal obtainer configured to acquire a biosignal; and a processor configured to decompose a waveform of the acquired biosignal into component pulses and extract a feature for the biometric information detection based on characteristic points of the component pulses. A general apparatus for extracting a feature from a biosignal may search for a local minimum point from a second order differential signal of a biosignal. In addition, features for detecting biometric information may be extracted using acquired characteristic points. In this case, the local minimum point refers to a specific point in a part of the biosignal observed where the decreasing signal increases again, and may also referred to as a downward convex point.

<CIT> refers to an apparatus and method for extracting feature of biosignal, and apparatus for detecting bioinformation. An apparatus configured to extract a feature from a biosignal is disclosed. The apparatus includes a bio-signal acquirer configured to acquire the biosignal, and a processor configured to analyze concavity and convexity of a waveform of the biosignal in intervals of the bio-signal, and extract the feature from the bio-signal based on the analyzed concavity and the analyzed convexity.

<CIT> refers to implantable systems and methods for use therewith for monitoring and modifying arterial blood pressure without requiring an intravascular pressure transducer. For each of a plurality of periods of time, there is a determination one or more metrics indicative of pulse arrival time (PAT), each of which are indicative of how long it takes for the left ventricle to generate a pressure pulsation that travels from the patient's aorta to a location remote from the patient's aorta. Based on the one or more metrics indicative of PAT, the patient's arterial blood pressure is estimated. Changes in the arterial blood pressure are monitored over time. Additionally, the patient's arterial blood pressure can be modified by initiating and/or adjusting pacing and/or other therapy based on the estimates of the patient's arterial blood pressure and/or monitored changes therein.

<CIT> refers to systems and methods for improved computation of differential pulse transit time from photoplethysmograph signals. Systems and methods for processing photoplethysmograph (PPG) signals to determine a differential pulse transit time (DPTT) are disclosed. Sensors may be used to obtain first and second PPG signals from a subject. The sensors may be placed at different locations on the subject's body. A first algorithm may be performed on the PPG signals or on signals derived from them to obtain a DPTT. A corresponding confidence measure may be determined and if the confidence measure falls within a first numerical range, the calculated DPTT may be used. On the other hand, if the confidence measure falls within a second numerical range, an alternative algorithm may be performed on the PPG signals or on signals derived from them and the DPTT obtained using the alternative algorithm may be used. The DPTT may be used to perform continuous or periodic measurements of blood pressure.

<CIT> refers to a physiological signal monitoring system.

It is the object of the present invention to provide an improved apparatus, method and computer-readable medium for accurately estimating bio-information by extracting a characteristic point having a high correlation with blood pressure.

According to the present disclosure, there is provided an apparatus for estimating bio-information. The apparatus includes a sensor configured to measure a bio-signal; and a processor configured to obtain one or more characteristic points, related to one or more pulse waveform components constituting the bio-signal, based on a differential signal of the biosignal, and to estimate bio-information based on the obtained one or more characteristic points.

The processor obtains an internally dividing point between a first point and a second point, the first point and the second point being selected from a first local minimum point related to a specific pulse waveform component and adjacent local maximum points preceding or following the first local minimum point in the differential signal, and obtain a characteristic point related to the specific pulse waveform component based on the obtained internally dividing point.

The processor obtains a time value of the internally dividing point as a time value of the characteristic point from the differential signal, and obtain an amplitude value, corresponding to the time value of the internally dividing point, as an amplitude value of the characteristic point from the bio-signal.

The processor may obtain, as the internally dividing point, a middle point between a time value of the first point and a time value of the second point.

The processor may apply a weighted value to each of time values of the first point and the second point, and obtain the internally dividing point based on a result of applying the weighted value.

The processor may apply the weighted value to each of the time values based on at least one of differential signal strength of each of the first point and the second point, and an amplitude value of the bio-signal which corresponds to each of the time values of the first point and the second point.

The processor may select the first local minimum point as the first point, and any one of the adjacent local maximum points as the second point, and obtains the internally dividing point between the first point and the second point based on a difference in differential signal strength between the first point and the second point, and a difference in differential signal strength between a second local minimum point, which is different from the first local minimum point and adjacent to the second point, and the second point.

The processor may select the first point and the second point based on a sequence of pulse waveform components constituting the bio-signal.

The processor may, in obtaining a characteristic point related to a first pulse waveform component of the bio-signal, select a third local minimum point of the differential signal as the first point, and any one of adjacent local maximum points preceding or following the third local minimum point as the second point, the third local minimum point being a local minimum point that firstly appears in the differential signal.

The processor may, obtaining a characteristic point related to an n-th (n≥<NUM>, n being an integer) pulse waveform component of the bio-signal, respectively select, as the first point and the second point, local maximum points respectively preceding and following a local minimum point that appears n-th in the differential signal.

The processor may extract a feature by combining one or more of the obtained one or more characteristic points related to the one or more pulse waveform components, and estimate the bio-information based on the extracted feature.

The sensor may include a light source configured to emit light onto an object; and a detector configured to detect light scattered from the object.

The bio-information may include one or more of blood pressure, vascular age, arterial stiffness, aortic pressure waveform, stress index, and degree of fatigue.

The apparatus may further include an output part configured to output a processing result of the processor.

According to the present disclosure, there is provided a method of estimating bio-information. The method includes measuring a bio-signal; and obtaining one or more characteristic points, related to one or more pulse waveform components constituting the biosignal, based on a differential signal of the bio-signal; and estimating bio-information based on the obtained one or more characteristic points.

The obtaining includes selecting a first point and a second point from a first local minimum point related to a specific pulse waveform component and adjacent local maximum points preceding or following the first local minimum point in the differential signal; obtaining an internally dividing point between the first point and the second point; and obtaining a characteristic point related to the specific pulse waveform component based on the obtained internally dividing point.

The obtaining the internally dividing point may include obtaining, as the internally dividing point, a middle point between a time value of the first point and a time value of the second point.

The obtaining the internally dividing point may include applying a weighted value to each of time values of the first point and the second point, and obtaining the internally dividing point based on a result of the applying the weighted value.

The obtaining the internally dividing point based on the result of the applying the weighted value may include applying the weighted value to each of the time values based on at least one of a differential signal strength of each of the first point and the second point, and an amplitude value of the bio-signal which corresponds to each of the time values of the first point and the second point.

The selecting the first point and the second point may include selecting the first local minimum point as the first point, and selecting any one of the adjacent local maximum points as the second point. The obtaining the internally dividing point may include obtaining the internally dividing point between the first point and the second point based on a difference in differential signal strength between the first point and the second point, and a difference in differential signal strength between a second local minimum point, which is different from the first local minimum point and adjacent to the second point, and the second point.

The selecting the first point and the second point may include selecting the first point and the second point based on a sequence of pulse waveform components constituting the bio-signal.

The selecting the first point and the second point may include, in obtaining a characteristic point related to a first pulse waveform component of the bio-signal, selecting a third local minimum point of the differential signal as the first point, and any one of adjacent local maximum points preceding or following the third local minimum point as the second point, the third local minimum point being a local minimum point that firstly appears in the differential signal.

The selecting the first point and the second point may include, in obtaining a characteristic point related to an n-th (n≥<NUM>, n being an integer) pulse waveform component of the bio-signal, respectively selecting, as the first point and the second point, local maximum points respectively preceding and following a local minimum point that appears n-th in the differential signal.

The estimating may include: extracting a feature by combining one or more of the obtained one or more characteristic points related to the one or more pulse waveform components; and estimating the bio-information based on the extracted feature.

The method may further include outputting an estimation result of the bioinformation.

According to the present disclosure, there is provided a computer-readable storage medium having instructions that, when performed by a processor, cause a communicator to receive a bio-signal from an external device; and the processor to obtain one or more characteristic points, related to one or more pulse waveform components constituting the bio-signal, based on a differential signal of the received bio-signal, and to estimate bioinformation based on the obtained one or more characteristic points.

The external device may include at least one of a bio-signal measuring sensor, a smartphone, a tablet personal computer (PC), and a wearable device.

The processor obtains an internally dividing point between a first point and a second point, which are selected from a first local minimum point related to a specific pulse waveform component and adjacent local maximum points preceding or following the first local minimum point in the differential signal, and obtain a characteristic point related to the specific pulse waveform component based on the obtained internally dividing point.

The apparatus may further include an output part configured to output at least one of the estimated bio-information and a change trend graph illustrating a change trend of the bio-information.

In response to at least one of a user selection of the estimated bio-information and a user selection of a time point of the change trend graph, the output part may display at least one of a bio-signal related to the selected bio-information, the differential signal, a pulse waveform, and a characteristic point related to the pulse waveform.

The above and/or other aspects will become apparent and more readily appreciated by describing certain exemplary embodiments with reference to the accompanying drawings, in which:.

Exemplary embodiments are described in greater detail below with reference to the accompanying drawings.

The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters.

Any references to singular may include plural unless expressly stated otherwise. In addition, unless explicitly described to the contrary, an expression such as "comprising" or "including" will be understood to imply the inclusion of stated elements but not the exclusion of any other elements. Also, the terms, such as 'part' or 'module', etc., should be understood as a unit that performs at least one function or operation and that may be embodied as hardware, software, or a combination thereof.

Hereinafter, exemplary embodiments of a bio-information estimating apparatus and a bio-information estimating method will be described in detail with reference to the accompanying drawings.

<FIG> is a block diagram illustrating a bio-information estimating apparatus according to an exemplary embodiment. The bio-information estimating apparatus <NUM> may be embedded in a terminal, such as a smartphone, a tablet personal computer (PC), a desktop computer, a laptop computer, and the like, or in a wearable device that may be worn on an object OBJ. Examples of the wearable device may include a wristwatch-type wearable device, a bracelet-type wearable device, a wristband-type wearable device, a ring-type wearable device, a glasses-type wearable device, a hairband-type wearable device, or the like, but the wearable device is not limited thereto. For example, the wearable device may be embedded in a medical device manufactured for use in medical institutions to measure and analyze bio-information.

Referring to <FIG>, the bio-information estimating apparatus <NUM> includes a sensor <NUM> and a processor <NUM>.

The sensor <NUM> may measure a bio-signal from the object OBJ. The bio-signal may be a pulse wave signal including a photoplethysmogram (PPG) signal. However, the biosignal is not limited thereto, and may include various bio-signals, such as an electrocardiography (ECG) signal, a photoplethysmogram (PPG) signal, an electromyography (EMG) sensor, and the like, which may be modeled by the sum of a plurality of waveform components. The object OBJ may be a body part which comes into contact with or is adjacent to the sensor <NUM>, and may be a body part where pulse waves may be easily measured. For example, the object OBJ may be an area on the wrist that is adjacent to the radial artery or a human skin area through which veins or capillaries pass, but the object is not limited thereto, and may be peripheral body portions, such as fingers, toes, and the like, which have a high density of blood vessels.

The sensor <NUM> may include a light source and a detector. The light source may emit light onto the object OBJ, and the detector may detect light scattered or reflected from the object OBJ. The light source may include a light emitting diode (LED), a laser diode (LD), a fluorescent body, and the like, and may include one array or two or more arrays. The detector may include one or more pixels, each of which includes a photo diode, a photo transistor (PTr), and the like, which detects light and converts the detected light into an electric signal.

The processor <NUM> may be electrically connected to the sensor <NUM>. The processor <NUM> may control the sensor <NUM> in response to a request for estimating bioinformation, and may receive a bio-signal measured by the sensor <NUM>. The request for estimating bio-information may be input by a user, or may be generated at predetermined intervals. Upon receiving a bio-signal from the sensor <NUM>, the processor <NUM> may perform preprocessing such as filtering for reducing noise, amplification of the bio-signal, conversion of the bio-signal to a digital signal, and the like.

The processor <NUM> may estimate bio-information based on the bio-signal received from the sensor <NUM>. In this case, the bio-information may include blood pressure, vascular age, arterial stiffness, aortic pressure waveform, stress index, degree of fatigue, and the like, but is not limited thereto.

For example, the processor <NUM> may obtain a differential signal of the received bio-signal, and may obtain a characteristic point, related to one or more pulse waveform components constituting the bio-signal, based on the obtained differential signal. The differential signal may be a secondary differential signal, but is not limited thereto.

For example, the processor <NUM> may detect a local minimum point and a local maximum point from the secondary differential signal, and may obtain a characteristic point, related to individual pulse waveform components constituting the bio-signal, by using the detected local minimum point and local maximum point. Each local minimum point detected from the secondary differential signal may be related to each pulse waveform component which causes the bio-signal to have an upward convex waveform.

The processor <NUM> may obtain, as a characteristic point, a point of a bio-signal waveform which corresponds to each local minimum point detected from the secondary differential signal. Alternatively, the processor <NUM> may obtain an internally dividing point by using the detected local minimum point and local maximum point, and may obtain a point of the bio-signal waveform, which corresponds to the obtained internally dividing point, as a characteristic point. In this manner, even when the bio-signal waveform is unstable due to a non-ideal environment such as motion noise, light noise, sleep, and the like, the processor <NUM> may accurately obtain a characteristic point.

Based on a sequence of pulse waveform components of the bio-signal and/or characteristics of the bio-signal waveform, the processor <NUM> may determine a method of selecting a local minimum point, a local maximum point, an internally dividing point, and the like, which are references for obtaining a characteristic point, and/or a method of selecting two points which are references for obtaining an internally dividing point. For example, according to the sequence of pulse waveform components to be obtained, the processor <NUM> may select, as two points for obtaining an internally dividing point, a local minimum point and a local maximum point adjacent to the local minimum point, either preceding or following the local minimum point, or select, as two points for obtaining an internally dividing point, a preceding local maximum point and a following local maximum point adjacent to the local minimum point.

Upon obtaining a characteristic point for one or more pulse waveforms, the processor <NUM> may extract a feature by combining time and amplitude information of the characteristic point for each pulse waveform, and may estimate bio-information by using the extracted feature. In this case, the processor <NUM> may estimate bio-information by applying a pre-generated estimation model. The bio-information estimation model may be a linear or nonlinear function.

<FIG> is a block diagram illustrating a bio-information estimating apparatus according to another exemplary embodiment.

Referring to <FIG>, the bio-information estimating apparatus <NUM> includes a processor <NUM>, a communicator <NUM>, an output part <NUM>, and a storage part <NUM>.

The communicator <NUM> may communicate with an external device <NUM> by connecting to a communication network using a communication technique. The communicator <NUM> may receive a bio-signal from the external device <NUM>, and may transmit the received biosignal to the processor <NUM>. In an exemplary embodiment, no sensor for measuring a bio-signal may be included, such that the bio-information estimating apparatus <NUM> may be manufactured in a compact size, and may be mounted in various information processing devices. Examples of the external device <NUM> may include a smartphone, a tablet PC, a laptop computer, a desktop computer, and a wearable device, but the external device <NUM> is not limited thereto. Further, the external device <NUM> may be a bio-signal measuring sensor, in which case the communicator <NUM> may communicate with the sensor directly by wire or wirelessly.

Although a sensor for measuring a bio-signal is not illustrated in <FIG>, the bioinformation estimating apparatus <NUM> may include the sensor depending on an embodiment. In this case, under the control of the processor <NUM> or at the request of the external device <NUM>, the bio-information estimating apparatus <NUM> may selective obtain a bio-signal. For example, the bio-information estimation apparatus <NUM> may obtain a bio-signal by receiving a bio-signal from the external device <NUM> or by directly driving the sensor.

In this case, the communicator <NUM> may perform communication by using a communication technique such as Bluetooth communication, Bluetooth Low Energy (BLE) communication, Near Field Communication (NFC), WLAN communication, Zigbee communication, Infrared Data Association (IrDA) communication, Wi-Fi Direct (WFD) communication, Ultra-Wideband (UWB) communication, Ant+ communication, WiFi communication, mobile communications, and the like. However, this is merely exemplary and is not intended to be limiting.

Upon receiving a bio-signal, the processor <NUM> may obtain a characteristic point by analyzing the received bio-signal, and may extract a feature, which is to be used for estimating bio-information, by using the obtained characteristic point. In this case, when a biosignal waveform is non-ideal and unstable, the processor <NUM> may obtain an internally dividing point by using local minimum points and local maximum points of a secondary differential signal, and may obtain a characteristic point of the bio-signal based on the internally dividing point. Further, the processor <NUM> may estimate bio-information by using the extracted feature and an estimation model.

The output part <NUM> may output and provide a bio-signal and/or an estimation result of bio-information to a user. For example, the output part <NUM> may output the estimated bio-information or a graph illustrating a change trend of bio-information. In this case, in response to a user's selection of any one bio-information item from the change trend graph of bio-information, the processor <NUM> may read detailed information related to the selected bioinformation, e.g., a bio-signal, a differential signal, a pulse waveform, a characteristic point, and the like, from the storage part <NUM>, and may output the read information through the output part <NUM>.

The output part <NUM> may output the information by various visual methods using a display module, or by non-visual methods through voice, tactile sensation, vibration, and the like using a speaker, a haptic module, and the like. For example, based on information whether estimated blood pressure of a user is normal, the output part <NUM> may display the blood pressure by adjusting a font color or a font style, and the like. Alternatively, the output part <NUM> may display the estimated blood pressure by a non-visual method through voice, or by changing vibration, tactile sensation, and the like based on abnormality of blood pressure. In addition, in the case where the estimated blood pressure is not normal, the output part <NUM> may output the blood pressure along with warning information, and depending on an embodiment, may also output guide information, including food information requiring attention, appropriate or inappropriate actions before measuring blood pressure, various types of additional information, and the like.

The storage part <NUM> may store reference information to be used for estimating bio-information, the obtained bio-signal, a differential signal, a local minimum point, a local maximum point, an internally dividing point, a characteristic point, a feature, an estimation result of bio-information, and the like. In this case, the reference information used for estimating bio-information may include user information, such as a user's age, gender, occupation, current health condition, and the like, estimation model information, and the like, but is not limited thereto.

The storage part <NUM> may include at least one storage medium of a flash memory type memory, a hard disk type memory, a multimedia card micro type memory, a card type memory (e.g., a Secure Digital (SD) memory, an eXtreme Digital (XD) memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, and an optical disk, and the like, but the storage medium is not limited thereto.

The processor <NUM> may be connected to the communicator <NUM>, the output part <NUM>, and the storage part <NUM> through an internal bus, and may control the communicator <NUM>, the output part <NUM>, and the storage part <NUM>. For example, the processor <NUM> may control the communicator <NUM> to transmit and receive various types of information with the external device <NUM>. In addition, through the communicator <NUM>, the processor <NUM> may store the received information in the storage part <NUM> and may obtain information used for estimating bioinformation from the storage part <NUM>. Further, the processor <NUM> may control the output part <NUM> to output a processing result.

<FIG> is a block diagram illustrating a processor according to the embodiments of <FIG> and <FIG>. <FIG> are diagrams explaining an example of obtaining an internally dividing point from a bio-signal.

Generally, the pulse wave signals, obtained from an object, are a superposition of propagation waves, starting from the heart toward the distal end portions of the body, and reflection waves returning back from the distal end portions. <FIG> illustrates an example of a pulse wave signal <NUM> formed by superposition of five pulse waveforms <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>. By obtaining points, related to the pulse waveforms <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>, as characteristic points from the pulse wave signal <NUM>, and by properly combining time and amplitude information of the obtained characteristic points and the like, features having a high correlation with blood pressure may be extracted. Generally, pulse waveforms from the first pulse waveform up to the third pulse waveform are mainly used to estimate blood pressure. Pulse waveforms after the third pulse waveform may not be observed depending on individuals in some cases, and are difficult to find due to noise, or have a low correlation with estimation of blood pressure.

Referring to <FIG>, the processor <NUM> includes an internally dividing point obtainer <NUM>, a characteristic point obtainer <NUM>, a feature extractor <NUM>, and a bio-information estimator <NUM>.

The internally dividing point obtainer <NUM> may obtain a differential signal (e.g., secondary differential signal) from a bio-signal, and may obtain a local minimum point and a local maximum point by detecting the obtained differential signal. Here, the local minimum point in an interval of a secondary differential signal refers to a specific point at which the secondary differential signal is observed to be reduced and then is increased past the specific point. In other words, the local minimum point refers to a point at which the second differential signal forms a downward convex shape. By contrast, the local maximum point in an interval of the secondary differential signal refers to a point at which the secondary differential signal forms an upward convex shape. In this case, an i-th local minimum point of the differential signal may be related to an i-th pulse waveform of the bio-signal, in which i≥<NUM>, and i is an integer.

Further, the internally dividing point obtainer <NUM> may select two points from among the detected local minimum points and local maximum points, and may obtain an internally dividing point between the selected two points. For example, the internally dividing point obtainer <NUM> may obtain, as an internally dividing point, a middle point on a time axis between the selected first point and second point, as represented by the following Equation <NUM>. That is, the internally dividing point obtainer <NUM> may determine, as a time value of an internally dividing point, a median value between a time value of the first point and a time value of the second point.

Herein, Tdi denotes the time value of the internally dividing point related to an i-th pulse waveform component, and T1i and T2i denote the time values of the first point and the second point selected for obtaining the internally dividing point related to the i-th pulse waveform component.

In another example, the internally dividing point obtainer <NUM> may apply a weighted value to each of the time values of the first point and the second point, and may obtain an internally dividing point based on each of the time values to which the weighted value is applied, as represented by the following Equation <NUM>.

Herein, Tdi denotes the time value of the internally dividing point related to the i-th pulse waveform component; T1i and T2i denote the time values of the first point and the second point selected for obtaining the internally dividing point related to the i-th pulse waveform component; and a and b denote weighted values respectively applied to the time values of each of the points. In this case, the weighted values a and b may be set based on the strength of each differential signal of the first point and the second point, or based on an amplitude value of a bio-signal corresponding to the time values of the first point and the second point.

The internally dividing point obtainer <NUM> may select two points from among local minimum points and local maximum points based on a sequence of pulse waveform components. For example, in order to obtain a characteristic point related to a first pulse waveform component of a bio-signal, the internally dividing point obtainer <NUM> may select a first local minimum point of a differential signal as a first point, and may select any one of adjacent local maximum points preceding or following the first local minimum point on the time axis, for example, a following local maximum point, as a second point. Alternatively, in order to obtain a characteristic point related to an n-th (n≥<NUM>, n being an integer) pulse waveform component of the bio-signal, the internally dividing point obtainer <NUM> may select local maximum points, preceding or following an n-th local minimum point, as the first point and the second point, but the characteristic point is not limited thereto.

The characteristic point obtainer <NUM> may obtain a characteristic point related to each pulse waveform component from the bio-signal based on the detected local minimum point and/or the internally dividing point. The characteristic point obtainer <NUM> may obtain, as the characteristic point related to pulse waveform components, each point of the bio-signal waveform which corresponds to the time of the local minimum point of the obtained differential signal and/or the time of the internally dividing point, and may obtain time and amplitude information of each characteristic point as information of each pulse waveform component.

Referring to <FIG>, (<NUM>) once a bio-signal is obtained, (<NUM>) the internally dividing point <NUM> performs secondary differentiation of the obtained bio-signal to obtain a secondary differential signal, and (<NUM>) may detect local minimum points from the obtained secondary differential signal, to extract time values T1, T2, and T3 corresponding to a first, a second, and a third local minimum points. Then, (<NUM>) the characteristic point obtainer <NUM> may obtain, as characteristic points related to the first, second, and third pulse waveform components, each point of the bio-signal waveform corresponding to the time values T1, T2, and T3 of the local minimum points extracted by the internally dividing point obtainer <NUM>, and may obtain information on the time values T1, T2, and T3 and amplitude values P1, P2, and P3 of the characteristic points as information of each pulse waveform component.

<FIG> illustrates an example of an ideal bio-signal 40a, in which individual waveform components 41a, 42a, and 43a may be easily identified even in a superposed waveform of the bio-signal 40a. Accordingly, in the case where the ideal bio-signal 40a is obtained, the internally dividing point <NUM> may extract the time values T1, T2, and T3 of the first, second, and third local minimum points from a secondary differential signal 46a, without separately performing operation to obtain an internally dividing point. The characteristic point obtainer <NUM> may obtain points, corresponding to each of the time values T1, T2, and T3 extracted by the internally dividing point obtainer <NUM>, from the waveform of the bio-signal 40a as characteristic points of the first, second, and third pulse waveforms 41a, 42a, and 43a. In addition, the characteristic point obtainer <NUM> may obtain information on the time values T1, T2, and T3 and amplitude values P1, P2, and P3 as information of each pulse waveform component.

<FIG> and <FIG> illustrate an example where individual waveform components are not easily identified but distorted in a superposed waveform of a bio-signal 40b. Referring to <FIG>, relative imbalance of a superposed amount of amplitudes occurs in an area near a point of the bio-signal 40b which corresponds to the time T1 of a first local minimum point of a secondary differential signal 46b. That is, there is no anterior interference in the amplitude P1 related to the first waveform component as compared to other waveform components, such that asymmetry in the direction of interference occurs, resulting in a smaller amplitude value P1 than intended. Under these circumstances, when bio-information is estimated using the time values T1, T2, and T3 and amplitude values P1, P2, and P3 obtained as illustrated in <FIG>, accuracy of estimating bio-information may be reduced.

Referring to <FIG>, under the circumstances of <FIG>, the internally dividing point obtainer <NUM> may obtain an internally dividing point to obtain a characteristic point related to the first pulse waveform. As illustrated therein, in order to obtain a characteristic point related to the first pulse waveform, the internally dividing point obtainer <NUM> may select a first local minimum point N1 of a secondary differential signal 46b as a first point, and may select a local maximum point X1, adjacent to the first local minimum point N1 on the right side thereof, as a second point. Further, the internally dividing point obtainer <NUM> may obtain an internally dividing point between the first point N1 and the second point X1 as described above. The characteristic point obtainer <NUM> may obtain a time value T1 and an amplitude value P1 related to the internally dividing point from a bio-signal 40b as a characteristic point of the first pulse waveform component. It can be seen that compared to <FIG>, the characteristic point of the first pulse waveform component is moved to the right, i.e., to a position adjacent to a first upward convex point of the bio-signal.

<FIG> and <FIG> illustrate an example where waveform flexibility of a bio-signal 40c is relatively reduced. Referring to <FIG>, the flexibility is reduced at a point related to the second pulse waveform component in the bio-signal 40c, thereby increasing instability of the time value T2 in an area FT near the second local minimum point of a secondary differential signal 46c. As a result, the amplitude value P2 related to the second pulse waveform may be obtained at an incorrect location. Under these circumstances, when characteristic points are obtained as in the case of the ideal bio-signal illustrated in <FIG>, and bio-information is estimated using the time values T1, T2, and T3 and amplitude values P1, P2, and P3 obtained as illustrated in <FIG>, accuracy of estimating bio-information may be reduced.

Referring to <FIG>, under the circumstances of <FIG>, the internally dividing point obtainer <NUM> may obtain an internally dividing point to accurately obtain a characteristic point related to the second pulse waveform of the bio-signal 40c. As illustrated in <FIG>, in order to obtain a characteristic point related to the second pulse waveform, the internally dividing point obtainer <NUM> may select preceding or following local maximum points X1 and X2, adjacent to a second local minimum point N2 of the secondary differential signal 46c, as the first point and the second point respectively. Further, the internally dividing point obtainer <NUM> may obtain an internally dividing point between the first point X1 and the second point X2 as described above. In this case, the characteristic point obtainer <NUM> may obtain the time value T2 and the amplitude value P2 related to the internally dividing point from the biosignal 40c as a characteristic point of the second pulse waveform component. It can be seen that compared to <FIG>, the characteristic point of the second pulse waveform component is moved to the right, i.e., to a position adjacent to the second pulse waveform component. Therefore, according to an exemplary embodiment, accuracy of estimating bio-information may be improved.

<FIG> is a diagram explaining another example of obtaining an internally dividing point by the internally dividing point obtainer <NUM>. In order to obtain a characteristic point related to the first pulse waveform from a bio-signal 40d, the internally dividing point obtainer <NUM> may select the first local minimum point N1 of a differential signal 46d and the local maximum point X1, adjacent to the first local minimum point N1, as the first point and the second point respectively, and may internally divide the time between the first point N1 and the second point X1 at a predetermined ratio.

For example, the internally dividing point obtainer <NUM> may calculate a difference a1 in differential signal strength between the first point N1 and the second point X1, and a difference a2 in differential signal strength between the second point X1 and a second local minimum point N2 following the second point N1, and may obtain an internally dividing point by using the calculated values a1 and a2 as an internal division ratio between the first point N1 and the second point X1. The characteristic point obtainer <NUM> may obtain, as a characteristic point of the first pulse waveform, the time T1 of the obtained internally dividing point and the amplitude P1 of the bio-signal corresponding to the time.

Although <FIG> illustrates an example of obtaining an internally dividing point related to the first pulse waveform, the example may also be applied to the case of obtaining an internally dividing point related to the second and subsequent pulse waveforms following the first pulse waveform. For example, in order to obtain an internally dividing point related to the second pulse waveform, local maximum points adjacent to the second local minimum point may be selected as the first point and the second point, and a difference in the differential signal strength between the first point and the second local minimum point and a difference in the differential signal strength between the second point and the second local minimum point may be used as an internal division ratio between the first point and the second point.

In <FIG>, the difference in the differential signal strength between two points is used as an internal division ratio, but the internal division ratio is not limited thereto, and a difference in the amplitude value between two points may also be used.

Referring back to <FIG>, the characteristic point obtainer <NUM> may obtain, as characteristic point information, various types of information in addition to the aforementioned characteristic points related to the local minimum point of the differential signal and/or the internally dividing point. For example, the characteristic point obtainer <NUM> may obtain, as additional characteristic point information, a specific interval of a bio-signal, a time and an amplitude at a point where an amplitude has a maximum value in a systolic blood pressure (SBP) interval, an entire area or a partial area of the bio-signal waveform, and the like.

Once characteristic points are extracted from the bio-signal, the feature extractor <NUM> may combine the extracted characteristic points to extract a feature for estimating bioinformation, as represented by the following Equation <NUM>. However, Equation <NUM> is merely exemplary, and characteristic point information itself or various combinations of two or more characteristic points may also be used.

Once the feature extractor <NUM> extracts a feature, the bio-information estimator <NUM> may estimate bio-information by using the extracted feature. For example, the bioinformation estimator <NUM> may estimate blood pressure by applying the feature, for example, extracted by using the above Equation <NUM>, to a blood pressure estimation equation as represented by the following Equation <NUM>.

Herein, BP denotes an estimated blood pressure value, and A, w, and B denote any predefined coefficients.

<FIG> is a flowchart illustrating a bio-information estimating method according to an exemplary embodiment. The embodiment of <FIG> may be an example of a bioinformation estimating method performed by any one of the bio-information estimating apparatuses <NUM> and <NUM> of <FIG> or <FIG>, which is described above in detail, such that description thereof will be briefly made.

The bio-information estimating apparatus may receive a request for estimating bio-information in <NUM>. The bio-information estimating apparatus may provide an interface which performs various interactions with a user. The user may transmit a request for estimating bio-information through the interface provided by the bio-information estimating apparatus. Alternatively, a request for estimating bio-information may be received from an external device. The request for estimating bio-information received form the external device may include a request for providing an estimation result of bio-information. In the case where the external device has an embedded algorithm for estimating bio-information, the request for estimating bio-information may also include a request for providing characteristic points or feature information. Examples of the external device may include a smartphone, a tablet PC, a laptop computer, a wearable device and the like which may be carried by a user.

Then, the bio-information estimating apparatus may obtain a bio-signal for estimating bio-information in <NUM>. For example, in the case where a sensor is mounted in the bio-information estimating apparatus, the bio-information estimating apparatus may control a sensor to obtain a pulse wave signal from an object. Alternatively, in the case where no sensor for measuring a bio-signal is included, the bio-information estimating apparatus may receive a bio-signal from an external device.

Subsequently, the bio-information estimating apparatus may obtain an internally dividing point, related to pulse waveform components constituting the bio-signal, based on a differential signal of the obtained bio-signal in <NUM>. For example, the bioinformation estimating apparatus may detect a local minimum point and a local maximum point of a secondary differential signal, and may obtain an internally dividing point by using the detected local minimum point and local maximum point. As described above, in order to obtain a characteristic point related to a first pulse waveform component, the bio-information estimating apparatus may obtain an internally dividing point between the first local minimum point and an adjacent local maximum point. Additionally, in order to obtain a characteristic point related to pulse waveform components of the second and subsequent pulse waveforms following the first pulse waveform, the bio-information estimating apparatus may obtain an internally dividing point between two local maximum points adjacent to a local minimum point of the second and subsequent pulse waveforms.

Next, the bio-information estimating apparatus may obtain a characteristic point from the bio-signal based on the local minimum point obtained from the differential signal and/or the internally dividing point in <NUM>. The bio-information estimating apparatus may obtain, as a characteristic point, a point corresponding to a time of the local minimum point and/or a time of the internally dividing point, from the bio-signal, and may obtain time information and amplitude information corresponding to the time information as characteristic point information related to the pulse waveform components. Further, in order to supplement an unstable bio-signal due to motion noise and the like, the bio-information estimating apparatus may extract, as an additional characteristic point, a time and an amplitude at a point where an amplitude has a maximum value in an SBP interval, or an entire or partial area of the bio-signal.

Then, the bio-information estimating apparatus may extract a feature, to be used for estimating bio-information, by using the obtained characteristic points in <NUM>. In this case, the feature to be used for estimating bio-information may be extracted by combining two or more characteristic points as represented by Equation <NUM>.

Subsequently, the bio-information estimating apparatus may estimate bioinformation by using the extracted feature in <NUM>. In this case, a bio-information estimation model may be pre-generated as a function, as represented by Equation <NUM>.

Next, the bio-information estimating apparatus may provide an estimation result of bio-information to a user in <NUM>. In this case, the bio-information estimating apparatus may provide the estimated bio-information to a user by various visual methods using a display, or non-visual methods through voice, tactile sensation, vibration and the like using a speaker, a haptic module, and the like, to a user. Further, the bio-information estimating apparatus may determine a user's health condition based on the estimated bio-information, and may provide guide information, including a warning or measures, to a user based on the determination.

<FIG> are diagrams explaining an example of a wearable device according to an exemplary embodiment. Various embodiments of the above-described bioinformation estimating apparatus may be embedded in a smart watch worn on the wrist or a smart band-type wearable device as described in <FIG> and <FIG>. However, this is merely exemplary for convenience of explanation, and the wearable device may be applied to an information processing terminal such as a smartphone, a tablet PC, a laptop computer, a desktop computer, and the like.

Referring to <FIG>, the wearable device <NUM> includes a main body <NUM> and a strap <NUM>.

The main body <NUM> may be formed to have various shapes, and may have modules which are mounted on an inner or outer surface of the main body <NUM> to perform various functions in addition to the aforementioned function of estimating bio-information. A battery may be embedded in the main body <NUM> or the strap <NUM> to supply power to various modules of the wearable device <NUM>.

The strap <NUM> may be connected to the main body <NUM>. The strap <NUM> may be flexible, so as to be bent around a user's wrist. The strap <NUM> may be bent in such a manner that the strap <NUM> may be detached from the user's wrist or may be formed as a band that is not detachable. Air may be injected into the strap <NUM> or an airbag may be included in the strap <NUM>, so that the strap <NUM> may have elasticity according to a change in pressure applied to the wrist, and the change in pressure of the wrist may be transmitted to the main body <NUM>.

A measurer <NUM>, which measures a bio-signal by emitting light onto an object OBJ and by detecting light scattered from the object OBJ, may be mounted at one surface of the main body <NUM>. The measurer <NUM> may be mounted on a rear surface of the main body <NUM>, i.e., a portion that comes into contact with a user's wrist, and may include one or more light sources 611a for emitting light onto the skin of the wrist, or one or more detectors 611b for detecting light scattered from the object OBJ. The measurer <NUM> may further include a contact pressure sensor for measuring contact pressure of the object OBJ.

A processor <NUM> may be mounted in the main body <NUM>. The processor <NUM> may be connected to the measurer <NUM>, a communicator <NUM>, a display <NUM>, and various other modules to control operations thereof. In addition, the processor <NUM> may estimate bioinformation by using the bio-signal measured by the measurer <NUM>, and may provide an estimation result to a user through the display <NUM>. As described above, the processor <NUM> may obtain a characteristic point, related to each pulse waveform component constituting the biosignal, by using a differential signal of the bio-signal, and may estimate bio-information, such as blood pressure, by using the obtained characteristic point.

In the case where the measurer <NUM> includes a contact pressure sensor, the processor <NUM> may monitor a contact state of an object based on the measured contact pressure signal, and may provide a user with a guide to a contact position and/or a contact state through the display <NUM>.

The processor <NUM> may manage the estimated bio-information, e.g., blood pressure history information, a bio-signal used for measuring blood pressure, and each constituent pulse decomposed from the bio-signal, in a storage device. Further, the processor <NUM> may generate additional information, including warning information, a health state change trend, and the like, which is used for healthcare management of a user, based on the estimated bio-information, and may manage the generated information in a storage device.

In addition, a manipulator <NUM>, which receives a control command of a user and transmits the received control command to the processor <NUM>, may be mounted in the main body <NUM>. The manipulator <NUM> may include a power button to input a command to turn on/off the wearable device <NUM>.

The display <NUM> may be mounted on a front surface of the main body <NUM> as illustrated therein, and may include a touch panel for touch input. The display <NUM> may be controlled by the processor <NUM> to receive a touch input from a user and to transmit the received touch input to the processor <NUM>, and may display a processing result of the processor <NUM>.

For example, the display <NUM> may display the estimated bio-information, e.g., blood pressure information, as illustrated in <FIG>. In this case, the display <NUM> may also display additional information such as a warning and the like. When a user requests detailed information by operating the manipulator <NUM> or by touching the display <NUM> for touch input, the display <NUM> may display detailed information by various methods as illustrated in <FIG> and <FIG>. In this manner, a user may easily identify a blood pressure change trend, and may intuitively understand a bio-signal according to a blood pressure change trend and various types of information extracted from the bio-signal.

Referring to <FIG> and <FIG>, the display <NUM> may be divided into a first area 614a and a second area 614b, in which the first area 614a may display detailed information, and the second area 614b may display a blood pressure history graph. In this case, an identification mark M, indicating currently selected blood pressure information I, may be displayed along with the blood pressure history graph. The identification mark M is shown as a vertical line, but is not limited thereto, and may have various shapes such as a circular shape, a polygonal shape such as a square shape, an arrow indicating a position, and the like. When a blood pressure change trend is displayed in the second area 614b, a user may view detailed information of specific blood pressure information by selecting the specific blood pressure information. For example, the user may select the specific blood pressure information by touching the specific blood pressure information of the graph, or by moving the graph to a right side or a left side to place the specific blood pressure information to align with the identification mark M. When a user selects desired blood pressure information in the second area 614b, the display <NUM> may output information, such as a bio-signal related to the blood pressure information selected in the first area 614a, individual pulse waveform graphs, an estimated blood pressure value at the time point, a measurement date, a health condition at the time point, as illustrated in <FIG> and <FIG>. However, this is merely exemplary, and may display various types of detailed information not illustrated in <FIG> and <FIG>.

Moreover, a communicator <NUM>, provided for communication with an external device, such as a mobile terminal of a user, may be mounted in the main body <NUM>. The communicator <NUM> may transmit an estimation result of bio-information to an external device, e.g., a user's smartphone, to display the result to a user. However, this is merely exemplary, and the communicator <NUM> may transmit and receive various relevant information.

The disclosure can be implemented as a computer-readable code written on a computer-readable recording medium. The computer-readable recording medium may be any type of recording device in which data is stored in a computer-readable manner.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage, and a carrier wave (e.g., data transmission through the Internet). The computer-readable recording medium can be distributed over a plurality of computer systems connected to a network so that a computer-readable code is written thereto and executed therefrom in a decentralized manner. Functional programs, codes, and code segments needed for realizing the disclosure can be easily deduced by one of ordinary skill in the art.

At least one of the components, elements, modules or units described herein may be embodied as various numbers of hardware, software and/or firmware structures that execute respective functions described above, according to an exemplary embodiment. For example, at least one of these components, elements or units may use a direct circuit structure, such as a memory, a processor, a logic circuit, a look-up table, etc. that may execute the respective functions through controls of one or more microprocessors or other control apparatuses. Also, at least one of these components, elements or units may be specifically embodied by a module, a program, or a part of code, which contains one or more executable instructions for performing specified logic functions, and executed by one or more microprocessors or other control apparatuses. Also, at least one of these components, elements or units may further include or implemented by a processor such as a central processing unit (CPU) that performs the respective functions, a microprocessor, or the like. Two or more of these components, elements or units may be combined into one single component, element or unit which performs all operations or functions of the combined two or more components, elements of units. Also, at least part of functions of at least one of these components, elements or units may be performed by another of these components, element or units. Further, although a bus is not illustrated in some of block diagrams, communication between the components, elements or units may be performed through the bus. Functional aspects of the above exemplary embodiments may be implemented in algorithms that execute on one or more processors. Furthermore, the components, elements or units represented by a block or processing steps may employ any number of related art techniques for electronics configuration, signal processing and/or control, data processing and the like.

Claim 1:
An apparatus for estimating bio-information, the apparatus comprising:
a sensor (<NUM>, <NUM>) configured to measure a bio-signal, the bio-signal being constituted of one or more pulse waveform components; and
a processor (<NUM>, <NUM>, <NUM>) configured to:
obtain an internally dividing point between a first point and a second point, the first point and the second point being selected from a first local minimum point related to a specific pulse waveform component and adjacent local maximum points preceding or following the first local minimum point in a differential signal of the bio-signal, the internally dividing point being obtained based on a result of applying a median or weighted value to each of time values of the first point and the second point,
obtain a characteristic point, related to the specific pulse waveform component, based on the obtained internally dividing point, and
estimate bio-information based on the obtained characteristic point,
wherein the processor (<NUM>, <NUM>, <NUM>) is further configured to obtain a time value of the internally dividing point as a time value of the characteristic point from the differential signal, and obtain an amplitude value, corresponding to the time value of the internally dividing point, as an amplitude value of the characteristic point from the bio-signal.