Patent Description:
For example, piezoelectric sensors can be used for performing ballistocardiography (BCG) to measure the heart rate, breathing rate and even pulse wave velocity in a semi-contact manner through clothing or bedding/matrass (e.g. chair/bed). Preferably, the sensors need to be in proximity to relevant parts of the body to transfer the vibrations. Unfortunately this contact information is difficult to extract from the sensor signal. As a consequence artefacts are quite common and this is worse when the position of the subject is undefined.

<CIT> describes a multi-element piezo sensor for in-bed physiological measurements. The monitoring system can perform a first scan of all of the piezo sensors. The first scan can be, for example, a high-level scan to determine roughly where the user is located along the mat. The monitoring system can perform a second scan of one or more piezo sensors, such as piezo sensors potentially located in the immediate periphery of the user's body. The piezo sensors that are potentially located in the immediate periphery of the user's body can be, for example, those piezo sensors measuring a force, while also located adjacent to piezo sensors that do not measure force.

<CIT> and <CIT> disclose similar systems comprising an array of force-sensitive resistors and an array of piezoelectric transducers for determining a heart rate of a subject.

However, piezoelectric sensors typically produce time-dependent signals which may need individual and continuous monitoring. It can also be difficult to balance the accuracy for different time scales and pressure ranges. There remains a need for further improvements in accuracy heart rate monitoring.

Aspects of the present disclosure relate to a heart monitoring system and method. As described herein, the heart monitoring system preferably uses a sensor surface with a combination of (membrane based) force-sensitive resistors and piezoelectric transducers. The force sensitive resistors can be configured to measure a respective amount of pressure exerted on the sensor surface by a subject. For example, the force sensitive resistors may change a respective resistance value dependent on the pressure. The piezoelectric transducers can be interspersed among, e.g. between, the force-sensitive resistors and configured to measure respective vibrations exerted on the sensor surface at a respective location of the transducer by the subject. For example, the piezoelectric transducers can produce time-dependent electrical signals dependent on the vibrations. The heart rate of the subject can be determined based on a combination of the respective signals from the different types of sensors, e.g. the measured resistance values of the force-sensitive resistors and the time-dependent electrical signals of the piezoelectric transducers.

Using the force-sensitive resistors, the (static) pressure profile of a subject can be more accurately determined, than using piezo-electric sensors. For example, the force sensitive resistors can be arranged in a (relatively) high density grid, e.g. with shared scan lines in a passive matrix configuration. As will be appreciated, the force sensitive resistors may be better suited to measure a range of different pressure signals and in a high density grid can be used to accurately determine a pressure profile. Using the accurate pressure profile information of the force sensitive resistors, a better selection can be made which of the piezoelectric transducers will likely produce the best signals. For example, the pressure profile can be used to determine regions of the body where the heart rate vibrations are most prominent. For example, the piezoelectric transducers can be arranged in a (relatively) low density grid, e.g. to allow dedicated circuit lines between the relatively few transducers and the controller. In this way rapidly changing signals such as heart beat can be unambiguously and accurately measured from specific locations. This can improve reliability and data integrity. The data from the pressure sensor may also be used for a number of other applications such as breathing, posture detection, et cetera. This can further enhance the applications of the sensors.

Aspects of the present disclosure relate to performing data fusion to improve the reliability of piezo sensors for the detection of heart beat or other physiological parameters such as respiration rate. Preferably, a combination of piezo sensors and membrane based pressure sensors is used. For example, based on the pressure sensor distribution, the piezoelectric sensors with the highest likelihood of good signal integrity can be selected.

In some embodiments, quasi-static pressure distributions onto an object, e.g. bed, seat, baby bed, garment, is first detected using pressure sensor technology, e.g. based on Thermoplastic Polyurethane (TPU) technology. Using the pressure distribution, piezo sensors with the highest likeliness of providing the accurate data can be used to extract a heart rate and/or breathing rate measurement. Preferably, the piezo sensors are printed.

In some embodiments, the pressure sensors are used to reconstruct how someone is laying onto the sensors. This can help the piezo sensor readout, e.g. because the pressure sensors can provide a low power solution to detect if there is a person or an object present on the sensor system. Accordingly, the obtained pressures distribution can be used to reconstruct a model of the person on the pressure sensor. In one embodiment, the piezo sensors are exclusively readout when a human body is detected. This may save computationally heavy analysis in other circumstances when it is not needed. In another or further embodiment, based on a combination of physical location with respect to the body and body parts, e.g. arm, leg, neck, the sensors located on the best body parts for detecting the BCG are extracted and within this group of piezo sensors, the piezo sensors within the optimal pressure range are selected.

In some embodiments, piezo sensors having a high likeliness not to be in contact with the body are used for noise cancellations, e.g. to remove unrelated (e.g. parasitic) vibrations. In other or further embodiments, sensors which are located on parts of the body where no BCG signal should be present are used to remove other vibrations, e.g. related to breathing and not heart rate, or vice versa (in case the breathing rate is measured). In some embodiments, the breathing rate of a subject is extracted simultaneously from the pressure sensor signal and the piezo sensors providing a redundancy on the obtained signal. Advantageously, motion artefacts can be actively suppressed since motions of a subject are detected using the pressure sensor. Alternatively, or in addition, the motion artefacts can be removed spatially and/or temporally.

Using a piezo resistive sensor array, data which is directly relevant to improving signal quality can be provided by defining the most accurate place to measure and measuring real-time spatial and temporal low frequency motions, e.g. below <NUM>. It will be appreciated that using an absolute pressure distribution provides much more relevant data for improving the measurements, compared to for example using only piezo sensors. Advantageously, the static pressure sensor information can be used to better filter the piezo date and to complement (in the case of breathing rate) the piezo sensor data.

In some embodiments, stretchable inks and TPU technology are used for the manufacturing of the sensors. Accordingly, the sensors may be located closer to the persons body, which improves the reliability of the signals. In other or further embodiments, the measurements may be complemented by incorporating (printed) temperature sensors in the sensor surface to, for example, measure a temperature in a bed or chair.

<FIG> illustrates an exemplary embodiment of a heart monitoring system <NUM>.

In some embodiments, e.g. as shown, the heart monitoring system <NUM> comprises an array of force-sensitive resistors <NUM> spanning a sensor surface <NUM>, e.g. substrate. In one embodiment, each resistor <NUM> is configured to change a respective resistance value "R" in accordance with an amount of (quasi) static pressure "P" exerted on the sensor surface <NUM> at a respective location of the force-sensitive resistor <NUM> by a subject <NUM>. In other or further embodiments, the system comprises an array of piezoelectric transducers <NUM> interspersed among the array of force-sensitive resistors <NUM>, e.g. on the same or another (overlapping) substrate. In one embodiment, each transducer <NUM> is configured to generate a respective time-dependent electrical signal S in accordance with respective vibrations "F" exerted on the sensor surface <NUM> at a respective location of the transducer <NUM> by the subject <NUM>. In a preferred embodiment, e.g. as shown, a controller <NUM> is configured to determine a heart rate "H1" of the subject <NUM> based on a combination of the measured resistance values "R" of the force-sensitive resistors <NUM> and the time-dependent electrical signals "S" of the piezoelectric transducers <NUM>.

The heart monitoring system <NUM> as described herein may find application in various settings and situations. In one embodiment, e.g. as shown, aspects or applications, can be embodied as a bed <NUM> comprising the heart monitoring system <NUM> as described herein. In some embodiments, a mattress of a bed <NUM> comprises a heart monitoring system <NUM> for a subject <NUM> to lie on. In some embodiments, e.g. as shown, the sensor surface <NUM> is embedded in the mattress. Alternatively, the sensor surface <NUM> may be disposed on top of the mattress. In other or further embodiments, the sensor surface <NUM> may be disposed between one or more sheets or other bedding. For example, the subject <NUM> may be a patient who needs continuous monitoring lying in a hospital bed. The heart monitoring system can also be incorporated in other types of furniture, e.g. a chair (not shown). For example, the system can be incorporated in the bottom and/or back section of the chair, e.g. regular chair or car seat. For example, the sensor surface <NUM> including the force-sensitive resistors <NUM> and piezoelectric transducers <NUM> may be clamped onto the seat back and disposed on top of the seat bottom. Alternatively, or additionally, the sensor surface <NUM> may be embedded in an internal layer of the seat, e.g. inside a seat cushion.

In a preferred embodiment, e.g. as shown, the controller <NUM> receives the measured resistance values "R" of the force-sensitive resistors <NUM> and the time-dependent electrical signals "S" of the piezoelectric transducers <NUM> as an input, and produces a heart rate "H1" as an output. Accordingly, the heart monitoring system <NUM> may provide a continuous, real-time measurement and analysis of the subject's <NUM> heart rate, even when the subject (<NUM>) is in non-direct contact with the sensor surface <NUM>. In some embodiments, e.g. as shown, the controller <NUM> may be provided as an external device to the bed <NUM>. For example, the controller <NUM> is connected with an electrical connection to the bed <NUM>. Alternatively, the controller <NUM> may be provided as part of the bed <NUM>. In one embodiment, e.g. as shown, a display device is connected to the controller <NUM>. The heart rate can also be output in other ways, e.g. as a an electrical data signal for further processing, or an audible or haptic signal.

In some embodiments, as shown in <FIG>, a secondary heart monitoring device <NUM> may be temporarily or permanently provided and coupled to the controller <NUM>. In some embodiments, the secondary heart monitoring device <NUM> is attached to the subject's <NUM>, e.g. wrist or chest, for a period of time to produce a secondary heart rate measurement H2 which can be used as a reference value. For example, the secondary heart controller <NUM> can compare the secondary heart rate measurement H2 to the primary measurement of the heart rate "H1". In the embodiment shown, the secondary heart rate measurement H2 is measured using a separate instrument, e.g. a dedicated secondary heart monitoring device <NUM> based on electrical signals from the heart region (electrocardiogram). In some embodiments, the secondary heart monitoring device <NUM> may be provided temporarily, as check and/or to correct the primary heart monitoring system <NUM>. Alternatively, the secondary heart monitoring device, e.g. electrodes on the chest, can be removed once the network has been trained, as will be explained later in <FIG>.

In some embodiments, e.g. as shown, the subject's weight, position or movement may cause a static or quasi-static pressure "P" onto the sensor surface <NUM>. For example, the pressure "P" may be relatively high in specific areas, e.g. higher at the subject's chest area compared to the subject's legs. In a preferred embodiment, the pressure profile is used to determine where the heart rate is measured. Static pressure can be distinguished from dynamic vibrations "F" such as heart rate, e.g. based on time scale. As will be appreciated, a force sensitive resistor, is typically capable of measuring static pressures, i.e. even if the pressure is constant in time. Of course, the pressure may change, e.g. by the subject moving, which will result in a new (static) pressure being measured. This may be contrasted with the measurements using piezo-electric sensors, which are typically more sensitive to vibrations or pressure changes.

<FIG> illustrates a cross-section view of a heart monitoring system <NUM> with a force-sensitive resistor <NUM> and a piezoelectric transducer <NUM>.

In a preferred embodiment, the force-sensitive resistors <NUM> are arranged on or spanning the sensor surface <NUM>. Most preferably, the force-sensitive resistors <NUM> are distributed with equally spacing over the sensor surface <NUM>. This may allow easy correspondence between respective signals and location of the sensors. In another or further embodiment, the force-sensitive resistors <NUM> may vary in distribution, orientation, number and/or shape. This may allow, e.g. a higher concentration of sensors at relevant locations.

Typically, each of the force-sensitive resistors <NUM> comprises a force-sensitive material <NUM>, e.g. a conductive composite material or other material which changes its resistance when a force is applied in a membrane configuration. In one embodiment, e.g. as shown, the force-sensitive material <NUM> disposed on a first flexible substrate <NUM>, e.g. a thermoplastic polyurethane (TPU) substrate, wherein the force-sensitive material <NUM> is facing a set of electrodes <NUM>,<NUM> disposed on an opposing second substrate <NUM>, e.g. a TPU substrate. In another or further embodiment, e.g. as shown, the force-sensitive material <NUM> is held apart from the electrodes <NUM>,<NUM> by a spacer material <NUM> disposed between the substrates <NUM>,<NUM> and surrounding the force-sensitive material <NUM>. In some embodiments, e.g. as shown, the first <NUM> and/or second substrate <NUM> is configured to flex towards the opposing substrate under the influence of static pressure "P" applied to the force-sensitive resistors <NUM>. Accordingly, the force-sensitive material <NUM> contacts the electrodes <NUM>,<NUM> and changes the resistance value "R". In another or further embodiment, when there is no pressure applied, the sensor acts like an infinite resistor, i.e. an open circuit. Preferably, the more pressure is applied to the surface of the sensor, the more the electrodes <NUM>,<NUM> touch the force-sensitive material <NUM>, and the lower the resistance becomes. Preferably, the force-sensitive resistors have a diameter D10 on the order of a few millimeters. For example, between one millimeter and fifty millimeters, preferably between five millimeters and twenty millimeters, for example ten millimeters.

In a preferred embodiment, piezoelectric transducers <NUM> are interspersed among the force-sensitive resistors <NUM>. Typically, each of the piezoelectric transducers <NUM> comprises a layer of piezoelectric material <NUM>. Preferably, the piezoelectric material <NUM> is made of a polymer, e.g. PVDF-TrFE, which has a piezoelectric effect. The piezoelectric effect can be understood as a phenomenon whereby electric charges and corresponding fields may accumulate in certain materials in response to applied mechanical stress. For example, a piezoelectric transducer <NUM> may detect small changes in pressure, acceleration, temperature, strain, or force and convert them into an electrical signal.

In one embodiment, e.g. as shown, the piezoelectric material <NUM> is sandwiched between a bottom electrode <NUM> and top electrode <NUM>. In some embodiments, the bottom electrode <NUM> is disposed on a substrate <NUM>, e.g. a TPU substrate. Preferably, the piezoelectric transducers <NUM> are configured to generate a respective time-dependent electrical signal S in response to a time dependent mechanical stress being applied to the piezoelectric material <NUM>. Preferably, the piezoelectric transducers have a diameter D20 on the order of a few millimeters. For example, between one millimeter and fifty millimeters, preferably between five millimeters and twenty millimeters, for example ten millimeters.

<FIG> illustrates a schematic layout of sensors <NUM>,<NUM> on a sensor surface <NUM> in a heart monitoring system <NUM> and respective connections with a controller <NUM>.

As described herein, the sensor surface <NUM> can be formed by one or more substrates housing the sensors. For example, the force-sensitive resistors <NUM> and/or piezoelectric transducers <NUM> can be distributed (interspersed) on a single substrate, or each type sensor may be disposed on a respective substrate. While the present figure shows the force-sensitive resistors <NUM> and piezoelectric transducers <NUM> disposed on top of a substrate <NUM>, in other embodiments the substrates <NUM>,<NUM> of the sensors may be part of the sensor surface.

In one embodiment, e.g. as shown, each of the force-sensitive resistors <NUM> is coupled to a pair of shared circuit lines <NUM>,30v. For example, each shared circuit line connects a plurality of the force-sensitive resistors <NUM> to the controller <NUM>. Accordingly a resistance value "R" of a respective force-sensitive resistors <NUM> can be determined e.g. by scanning a respective pair of the shared circuit lines <NUM>,30v connected to said force-sensitive resistors <NUM>. For example, as shown in <FIG>, the first row of force-sensitive resistors <NUM> are horizontally coupled to a shared circuit line <NUM>, and the first column of force-sensitive resistors <NUM> are also coupled to a shared circuit line 30v. In another or further embodiment, e.g. the multiple shared circuit lines 30v,<NUM> are coupled to the controller <NUM> from one side, and to a ground on the other side. Of course also other configurations are possible.

In another or further embodiment, e.g. as shown, each of the piezoelectric transducers <NUM> is separately coupled with a dedicated circuit line 30p to the controller <NUM>. Piezoelectric transducers <NUM> may typically use a dedicated circuit line 30p, e.g. because they produce single time-dependent electrical signals which is preferably detected individually. For example, the first piezoelectric transducer <NUM> on the first column of the array is individually coupled with a dedicated circuit line 30p to the controller <NUM> from one side and to a ground from the other side. In other embodiments, any other suitable means for coupling the force-sensitive resistors <NUM> and piezoelectric transducers <NUM> to the controller <NUM> is contemplated.

In a preferred embodiment, the sensor surface <NUM> comprises more force-sensitive resistors <NUM> than piezoelectric transducers <NUM>. For example, the force-sensitive resistors are arranged in a relatively high density grid while the piezoelectric transducers are arranged in a relatively low density grid. For example, the number of force-sensitive resistors <NUM> can be higher than the number of piezoelectric transducers <NUM> by at least a factor of two, three, four or five. It will be appreciated that it may be easier to connect many force-sensitive resistors <NUM> than piezoelectric transducers <NUM>, e.g. owing to the differing signals and/or connections. This can be used to advantage in providing a better measurement of the pressure profile using the force-sensitive resistors <NUM> while using the few interspersed piezoelectric transducers <NUM> to measure heart rate at specific locations, e.g. based on the profile.

In one embodiment, the multiple shared circuit lines 30v,<NUM> and dedicated circuit lines 30p form a matrix readout system. In another or further embodiment, the controller <NUM> is configured to determine a pressure profile based on the measured resistance values (R) of the force-sensitive resistors <NUM>. In some embodiments, the pressure profile is used to determine a region of interest (RoI) based on locations of corresponding force-sensitive resistors <NUM> on the surface <NUM>. For example, the region of interest is the region of the sensor surface <NUM> that the subject <NUM> is contacting. In a preferred embodiment, the controller <NUM> is configured to analyze a shape and/or magnitude of the pressure profile to overlay a shape of the subject's body. In another or further preferred embodiment, the region of interest is determined at one or more specific locations in the pressure profile corresponding to respective location on the subject's body.

In one embodiment, the controller <NUM> is configured to exclusively or predominantly select the piezoelectric transducers <NUM> located in the region of interest, for measuring the respective time-dependent electrical signals "S". Accordingly, the heart rate "H1" is determined by measuring vibrations "F" using a subset of the piezoelectric transducers <NUM> located on the surface <NUM> in the region of interest. For example, the region of interest is the region of the sensor surface <NUM> wherein the BCG signal of the subject <NUM> is optimal. In some embodiments, only the piezoelectric transducers <NUM> located in the region of interest are active. It will be appreciated that this way, the controller does not have to continuously monitor all the piezoelectric transducers <NUM> on the sensor surface <NUM>.

In some embodiments, at least one of the piezoelectric transducers <NUM> outside a region of interest based on the force-sensitive resistors <NUM>, is used for noise cancellation. For example, after determining the region of interest, one or more piezoelectric transducers 20i outside the region of interest may be used to cancel noise by cancelling any vibrations "F" detected by the inactive piezoelectric transducers 20i. It will be appreciated that this way vibrations "F" that are not induced by the contact of the subject <NUM> with the sensor surface <NUM>, and any background noise will be cancelled and not taken into consideration while measuring the heart rate "H1".

<FIG> illustrate examples of machine learning to improve determination of a heart rate "H1" using a neural network 30n.

In one embodiment, e.g. as shown in <FIG>, the controller <NUM> comprises a neural network 30n configured to receive at least the resistance values "R" to determine a region of interest. For example, the resistance values "R" are fed as input into the neural network 30n and the neural network is trained to output a region of interest. In a preferred embodiment, e.g. as shown, based on the region of interest determined by the neural network, a selection is made from one or more of the time-dependent electrical signals "S(t)" for determining a primary measurement of the heart rate "H1". In some embodiments, the network is trained for each individual subject to provide optimal accuracy taking into account specific characteristics of the subject. In other or further embodiments, the network is generally trained to be used also for other subjects. Also combinations are possible, e.g. the network starts with a basic training which can be improved for a specific individual. For example, the trained network may comprise a set of weights (w), offsets or other parameters which determine the network to output a region of interest and/or heart rate based on the respective input signals.

In another or further embodiment, e.g. as shown in <FIG>, the time-dependent electrical signals "S(t)" can be input into the same or another neural network for determining a respective heart rate measurement. For example the resistance values "R" and time-dependent electrical signals "S" are fed as input into a neural network 30n. In a preferred embodiment, the neural network 30n is configured to output a value indicative of a primary measurement of the heart rate "H1".

In some embodiments, e.g. as shown in both <FIG>, the primary measurement of the heart rate "H1" is compared to a secondary measurement of heart rate "H2", obtained by an independent heart monitoring device <NUM>, for training the neural network 30n. For example, the neural network 30n may be trained by comparing a direct or indirect output from the neural network 30n with the secondary heart rates of the secondary heart monitoring device <NUM>. For example, the difference between the primary and secondary heart rate measurements is fed back as an error "Err" into the network, which may result in changes to the weights "w" or other parameters of the neuron connections.

In some embodiments, a recurrent neural network (RNN) is used. This is a class of artificial neural networks where connections between nodes form a directed graph along a temporal sequence. This allows it to exhibit temporal dynamic behavior, e.g. a time dependent heart rate signal. Also other or similar artificial networks can be used. Also other or further values H' can be output from the neural network 30n, or the controller <NUM> in general. For example, the neural network 30n may output physiological parameters such a breathing rate, blood pressure, weight, posture detection, body position, body temperature, et cetera.

For the purpose of clarity and a concise description, features are described herein as part of the same or separate embodiments, however, it will be appreciated that the scope of the disclosure may include embodiments having combinations of all or some of the features described. Some aspects of the present disclosure relate to a non-transitory computer-readable medium storing instructions. In some embodiments, the non-transitory computer-readable when executed by a controller in a heart monitoring system causes the system to determine the heart rate of a subject directly or indirectly contacting the sensor surface. Other aspects of the present disclosure relate to a method for heart monitoring. In some embodiments, the method comprises providing an array of force-sensitive resistors spanning a sensor surface. In one embodiment, each resistor is configured to change a respective resistance value in accordance with an amount of quasi static pressure exerted on the sensor surface at a respective location of the force-sensitive resistor by a subject. In other or further embodiments, the method comprises providing an array of piezoelectric transducers interspersed among the array of force-sensitive resistors. In one embodiment, each transducer is configured to generate a respective time-dependent electrical signal in accordance with respective vibrations exerted on the sensor surface at a respective location of the transducer by the subject. In a preferred embodiment, the method comprises determining a heart rate of the subject based on a combination of the measured resistance values of the force-sensitive resistors and the time-dependent electrical signals of the piezoelectric transducers.

Claim 1:
A heart monitoring system (<NUM>) comprising
an array of force-sensitive resistors (<NUM>) spanning a sensor surface (<NUM>), wherein each resistor (<NUM>) is configured to change a respective resistance value (R) in accordance with an amount of static pressure (P) exerted on the sensor surface (<NUM>) at a respective location of the force-sensitive resistor (<NUM>) by a subject (<NUM>);
an array of piezoelectric transducers (<NUM>) interspersed between the force-sensitive resistors (<NUM>), wherein each transducer (<NUM>) is configured to generate a respective time-dependent electrical signal (S) in accordance with respective vibrations (F) exerted on the sensor surface (<NUM>) at a respective location of the transducer (<NUM>) by the subject (<NUM>); wherein the sensor surface (<NUM>) has more force-sensitive resistors (<NUM>) than piezoelectric transducers (<NUM>); and
a controller (<NUM>) configured to determine a heart rate (H1) of the subject (<NUM>) based on a combination of the measured resistance values (R) of the force-sensitive resistors (<NUM>) and the time-dependent electrical signals (S) of the piezoelectric transducers (<NUM>),
characterised in that the controller (<NUM>) is configured to measure a pressure profile using the force-sensitive resistors (<NUM>) and, based on the measured pressure profile, use a subset of the piezoelectric transducers (<NUM>) between the force-sensitive resistors (<NUM>) to measure the heart rate at one or more specific locations of the sensor surface (<NUM>).