Patent Description:
<CIT> relates to a device comprising a processor, an output device, and at least one accelerometer, angle, location, direction, or physiological state sensor.

<CIT> relates to methods and kits for detecting, screening, quantifying or localizing the etiology for reduced or impaired cranial nerve function or conduction; localizing a central nervous system lesion; detecting, diagnosing or screening for increased intracranial pressure, pressure or disruption of central nervous system physiology as seen with concussion; or detecting, diagnosing, monitoring progression of or screening for a disease or condition featuring increased intracranial pressure or concussion by tracking eye movement of the subject.

<CIT> relates to an apparatus for early detection of paralysis based on motion sensing including a sensing part and a motion disorder determination unit <CIT> relates to a real-time automated method to diagnose and/or detect stroke including the steps of continuously measuring natural limb activity, conveying the measurements to a cloud based real-time data processing system, identifying patient specific alert conditions, and determining solutions for acting upon needs of the patient.

<CIT> relates to real-time head and spine alignment, position and other physiological parameters that are detected to measure human being health and wellness status. The system includes wearable universal sensor modules that are attached and detached easily from receiver units having different formats for different body locations depending on their physiological functions.

The cerebral infarction is a state in which a cerebral blood vessel is blocked or stenosed to cause cerebral ischemia, and brain tissue is in a necrotic state. The cause of the cerebral infarction is mainly divided into thrombotic, embolic, and hemodynamic properties, and is specifically divided into atherothrombotic cerebral infarction, cardiogenic cerebral infarction, lacunar infarction, and others. In a case where cerebral infarction has occurred, cells downstream of the blocked or stenosed cerebral blood vessel are necrotic, so that symptoms such as paralysis, disturbance of speech, blindness, dizziness, incontinence, consciousness disorders, and the like are generated.

The cerebral infarction is enlarged as time passes, and thus becomes more serious as the detection is further delayed. Therefore, it is important to detect cerebral infarction at an early stage after these symptoms have occurred. PTL <NUM> describes a method of detecting cerebral infarction by measuring the concentration of nick β2 glycoprotein I in a body fluid sample.

A subject actively uses a diagnosis using the method as in PTL <NUM> to allow cerebral infarction to be detected. Meanwhile, symptoms indicating the occurrence of cerebral infarction or cerebral ischemia suddenly appear in daily life in many cases. Moreover, a symptom such as transient cerebral ischemic attack is transient and disappears in a short time. In such a case, even if a symptom of cerebral infarction or cerebral ischemia appears, the subject has no subjective symptom or overlooks the symptom, and a case where the cerebral infarction is not detected can occur.

An object of the present disclosure is to provide an information processing device capable of determining the presence or absence of an abnormal state in which there is a possibility of cerebral infarction in a subject.

In order to solve the above problem, the present invention provides an information processing device according to independent claim <NUM>. The dependent claims relate to advantageous embodiments.

With the present disclosure, it is possible to determine the presence or absence of an abnormal state in which there is a possibility of cerebral infarction in a subject.

Embodiments of the present invention are specifically described with reference to the drawings.

<FIG> is schematic diagram of an information processing system <NUM> in a first embodiment. The information processing system <NUM> in the present embodiment is a system that determines a possibility of cerebral infarction from motion information on a subject. The information processing system <NUM> includes an information processing device <NUM>, and a motion detection sensor 2a that is provided to a detection device <NUM>. The information processing device <NUM> and the detection device <NUM> can transmit and receive information via a network N such as the Internet. The information processing device <NUM> further communication-connected with a terminal device <NUM> via the network N.

The information processing device <NUM> determines, based on motion information on a subject acquired from the detection device <NUM>, a risk of a symptom, a sign, or the like of cerebral infarction or cerebral ischemia in the subject, in other words, a possibility of cerebral infarction. The information processing device <NUM> provides information in accordance with a determination result via the terminal device <NUM> and the like.

The motion information is a parameter representing a motion amount of the subject. The motion amount is, for example, a movement amount (movement speed) per unit time, a movement distance, a shake, an angular speed, and the like of each site such as limbs and a head of the subject, and can be obtained from an image in which the subject is photographed as will be described later. Note that, as will be described later, the motion amount is not limited to the one obtained from an image, but may be data detected by a microwave sensor, a millimeter wave sensor, an ultrasound sensor, an acceleration sensor, or the like.

The detection device <NUM> is provided in a house of a subject, for example, and detects a motion of the subject in a daily life. The detection device <NUM> is provided with the motion detection sensor (motion detection device) 2a, and transmits motion information detected by the motion detection sensor 2a to the information processing device <NUM>. A plurality of the motion detection sensor 2a are preferably provided in a plurality of areas such as a living room, a dining room, a kitchen, a washroom, and a bedroom inside the house of the subject, for example. The motion detection sensors 2a may be disposed at positions where the subject can live without being conscious of the sensors. The detection device <NUM> may be provided with, in addition to the motion detection sensor 2a, a living body information detection sensor (living body information detection device) 2b. The living body information detection sensor 2b will be described in details in another embodiment.

The motion detection sensor 2a is, for example, a camera that photographs an image within an imaging target region. The motion detection sensor 2a includes an imaging element such as an charge coupled device (CCD) image sensor, a lens, or the like, and acquires motion information that is image data by photoelectrically converting light entered through the lens by the imaging element. The motion detection sensor 2a may be a stereo camera including a plurality of imaging elements. By analyzing image data photographed by the motion detection sensor 2a, it is possible to two-dimensionally or three-dimensionally recognize a motion of a subject included in the image data. The motion detection sensor 2a is not limited to the one that uses the abovementioned camera, but may detect a position, a shape, and the like of the subject by using an ultrasound sensor, a microwave sensor, a millimeter wave sensor, or a laser radar sensor, for example. The motion detection sensor 2a may measure an eye movement of the subject by using a line-of-sight detection sensor, and detect a line-of-sight direction, a view point, and the like. The detection device <NUM> acquires a detection value of the motion detection sensor 2a.

Although the configuration in which the detection device <NUM> is disposed in the house of the subject has been described in the above, the present embodiment is not limited thereto. For example, the detection device <NUM> may be configured as a wearable device, and may be mounted to the subject. The detection device <NUM> has a shape of a spectacle type, for example. The detection device <NUM> is provided with a motion sensor serving as the motion detection sensor 2a that measures the acceleration, the angular speed, and the geomagnetism respectively with three axes, and detects a motion of the subject. The detection device <NUM> may be provided with a myoelectric potential sensor serving as the motion detection sensor 2a at a position where the myoelectric potential sensor is in contact with the nose, the head, or the like of the subject in a mounted state, and may detect a face myoelectric potential of the subject. The detection device <NUM> may be provided with a myoelectric potential sensor serving as the motion detection sensor 2a at a position where the myoelectric potential sensor is in contact with the nose of the subject in a mounted state, for example, and may detect a line-of-sight direction and a motion such as a blink by detecting an eye potential of the subject. The detection device <NUM> is not limited to the one having a shape of a spectacle type, for example, but may have a band shape and be mounted to an arm, a leg, a waist, or the like of the subject. The detection device <NUM> may have a sheet shape with the elasticity, for example, and may be stuck to the body of the subject. Moreover, the detection device <NUM> may be configured as a cavity device of a contact lens type, a mouthpiece type, or the like, for example, and may be mounted to the body cavity of the subject.

A plurality of the detection devices <NUM> may be mounted to the subject. The detection device <NUM> may include a combination of several types of the motion detection sensors 2a, and may acquire detection values by the several types of the sensors. For example, the detection device <NUM> may detect information on the whole imaging region including a subject by a camera, and may detect a motion of the subject specified based on the detected imaging data by a laser radar sensor and the like.

In the information processing system <NUM>, the motion detection sensor 2a detects motion information specially related to a motion that is repeatedly performed by the subject on a daily basis. The detected motion information is analyzed, and a motion state in the left half body and a motion state in the right half body of the subject are acquired and compared with motion states in the left half body and the right half body of the subject in normal times, thereby determining a possibility of cerebral infarction in the subject.

For example, specially, the appearance of a symptom such as sudden numbness of the face or the limb, poor eyesight, or slurred speech at one side of the body is highly probably caused because a part of the brain does not function. Accordingly, by detecting an occurrence of a sudden left-right difference in the motion of the subject, it is possible to identify a possibility of an onset or a sign of cerebral infarction or cerebral ischemia. The configuration and detailed processing content of such the information processing system <NUM> will be described below.

<FIG> is a block diagram illustrating a configuration of the information processing device <NUM>. A server computer is used as the information processing device <NUM>. The information processing device <NUM> is provided with a control unit <NUM>, a storage unit <NUM>, and a communication unit <NUM>. The information processing device <NUM> is described as one server computer for easy explanation, however, the function or processing thereof may be distributed by a plurality of server computers, or the information processing device <NUM> may be one of a plurality of server computers (instances) that are virtually generated in one large computer.

The control unit <NUM> is a processor in which one or a plurality of central processing units (CPUs), graphics processing units (CPUs), and the like are used, and controls respective constituent units by using an embedded memory such as a read only memory (ROM) or a random access memory (RAM) to execute processing.

The communication unit <NUM> is an communication interface that implements communication via the network N. The control unit <NUM> can transmit and receive information to and from the detection device <NUM>, other external devices, and the like via the network N, by the communication unit <NUM>.

The storage unit <NUM> includes, for example, a nonvolatile memory such as a hard disk or a solid state drive (SSD). In the storage unit <NUM>, programs including a program 1P and data to which the control unit <NUM> refers are stored. The control unit <NUM> reads and executes the program 1P to cause a general-purpose server computer to function as an information processing device specific to the present disclosure. The program 1P to be stored in the storage unit <NUM> may be a form in which the program 1P is recorded on a recording medium in a computer-readable manner. The storage unit <NUM> stores therein the program 1P read from a recording medium 1A by a reading device, which is not illustrated. Moreover, the program 1P may be downloaded from an external computer, which is not illustrated, connected to a communication network, which is not illustrated, and may be stored in the storage unit <NUM>. Note that, the storage unit <NUM> may include a plurality of storage devices, or may be an external storage device connected to the information processing device <NUM>.

Moreover, in the storage unit <NUM>, a subject information data base (DB) <NUM>, a detection value DB <NUM>, a reference motion information DB <NUM>, and the like are stored. <FIG> is an explanation diagram illustrating an example of a record layout of the subject information DB <NUM>, <FIG> is an explanation diagram illustrating an example of a record layout of the detection value DB <NUM>, and <FIG> is an explanation diagram illustrating an example of a record layout of the reference motion information DB <NUM>.

The subject information DB <NUM> is a data base that stores therein information on subjects who use the information processing system <NUM>. For example, in the subject information DB <NUM>, as illustrated in <FIG>, information such as a subject ID of each of a plurality of subjects, a name, an age, an address of the subject, image data in which a face of the subject is photographed, a notification destination, and an emergency notification destination is stored in association with one another. The notification destination includes a notification destination to which a notification is output in a case where an abnormal state having a possibility of cerebral infarction in the subject has occurred. In the notification destination, for example, a MAC address of the terminal device <NUM> owned by the subject, a mail address, and the like are stored. The emergency contact address includes a notification destination in an emergency at which a possibility of cerebral infarction in the subject is high. In the emergency contact address, for example, a telephone number or the like of a person other than the subject is stored.

The detection value DB <NUM> is a data base in which a detection value, motion information, and the like detected by the motion detection sensor 2a are stored. As illustrated in <FIG>, in the detection value DB <NUM>, for example, information such as detection date and time, sensor information, a detection value, motion information, a subject ID, and a motion pattern is stored in association with one another in a time-series manner. Each motion information to be stored in the detection value DB <NUM> is acquired and stored by the control unit <NUM> for every time when a control unit <NUM> of the detection device <NUM> acquires motion information, and transmits the acquired motion information to the information processing device <NUM>.

In the sensor information, identification information for identify the motion detection sensor 2a that has output a detection value is included, and a unique ID of the sensor is stored, for example. In the detection value, a detection value by the motion detection sensor 2a is stored.

The column of the motion information includes a column of left motion information and a column of right motion information. In the column of the left motion information and the column of the right motion information, motion information indicating a motion at the left half body and motion information indicating a motion at the right half body in the subject are respectively stored. Each of the left motion information and the right motion information is a parameter indicating a motion amount in a corresponding site of the subject, is data such as a movement speed, a movement distance, a shake, an angular speed, and the like of the corresponding site, as mentioned above. The corresponding site is a site of a human body such as a joint that serves as a feature point for specifying a posture of the subject. In the present embodiment, as one example, movement amounts (movement speeds) of a left hand and a right hand of the subject per unit time are respectively stored in the column of the left motion information and the column of the right motion information.

In the subject ID, identification information for identifying a subject of the motion information is included, and a subject ID is stored, for example. The subject ID is specified such that a face feature amount of a photographed subject is extracted from an image photographed for detecting motion information, and is subjected to pattern matching with a pre-registered face feature amount of the subject. The subject ID may be specified by using another method including machine learning.

The motion pattern is a type of a motion that can be daily performed by the subject, and can include, for example, sleeping, meal, toothbrushing, television viewing, cooking, and walking. The motion pattern is specified, for example, by performing pattern matching of a position, a posture, or a motion amount of the subject inside a room. The motion pattern may be specified by using another method including machine learning.

The reference motion information DB <NUM> is a data base in which reference motion information indicating a motion of a subject in a normal state is stored. The information processing device <NUM> acquires, when determining a possibility of cerebral infarction in a subject, reference motion information obtained by collecting motion information on the subject in a predetermined period, and stores the reference motion information in the reference motion information DB <NUM>. The information processing device <NUM> determines the presence or absence of an abnormal state by comparing the reference motion information with motion information to be acquired in real time. In the reference motion information DB <NUM>, for example, as illustrated in <FIG>, information such as a subject ID, a motion pattern, reference motion information, a reference period, and update date and time is stored in association with one another.

In the motion pattern, information for identifying a motion pattern is included, and names indicating motion patterns such as sleeping, meal, toothbrushing, television viewing, cooking, and walking are stored, for example.

The reference motion information includes motion information on the subject in a reference state obtained by analyzing the motion information in a predetermined period. The reference motion information includes left reference motion information indicating a motion in the left half body and right reference motion information indicating a motion in the right half body. Each of the left reference motion information and the right reference motion information is acquired, for example, in a predetermined period, by collecting motion information including left motion information and right motion information with respect to the identical motion pattern of the subject, and calculating a range and a mean value thereof. The reference motion information may include a plurality pieces of motion information in which information related to time is associated.

The reference period includes a period during which motion information for deriving reference motion information is collected. The reference period is, for example, seven days. The update date and time include the latest information on the date and time when reference motion information has been updated. In the present embodiment, the reference motion information is updated whenever needed based on the motion information that is detected in real time. The use of the reference motion information to be generated based on a most recent motion state of the subject allows the determination in accordance with a state of an individual subject including a temporary injury and a change due to aging, for example. Note that, the storage contents of the subject information DB <NUM>, the detection value DB <NUM>, and the reference motion information DB <NUM> are not limited to the examples illustrated in <FIG>.

<FIG> is a block diagram illustrating a configuration of the detection device <NUM>. The detection device <NUM> is provided with the control unit <NUM>, a storage unit <NUM>, a communication unit <NUM>, and a motion information detection unit <NUM>.

The control unit <NUM> is a processor in which one or a plurality of CPUs, GPUs, and the like are used, and controls respective constituent units by using an embedded memory such a ROM or a RAM to execute processing. The storage unit <NUM> includes, for example, a nonvolatile memory such as a flash memory. In the storage unit <NUM>, information to which the control unit <NUM> refers is stored. The communication unit <NUM> is a communication interface that implements communication with the information processing device <NUM> via the network N.

The motion information detection unit <NUM> acquires a detection signal by using the motion detection sensor 2a. The motion information detection unit <NUM> may include an A/D conversion function, and may output a measurement value obtained from the motion detection sensor 2a to the control unit <NUM>.

<FIG> is a block diagram illustrating a configuration of the terminal device <NUM>. As the terminal device <NUM>, for example, a smartphone, a tablet terminal, or the like is used. The terminal device <NUM> may be an information terminal device such as a personal computer. The terminal device <NUM> is provided with a control unit <NUM>, a storage unit <NUM>, a communication unit <NUM>, a display unit <NUM>, and an operation unit <NUM>.

The control unit <NUM> includes a processor such as a CPU or a GPU, a memory, and the like. The control unit <NUM> may be configured as one hardware (SoC: System On a Chip) in which the processor, the memory, the storage unit <NUM>, and the communication unit <NUM> are integrated. The control unit <NUM> controls the respective constituent units based on a program stored in the storage unit <NUM> to execute processing.

The storage unit <NUM> includes, for example, a nonvolatile memory such as a flash memory. The storage unit <NUM> stores therein a program and data to which the control unit <NUM> refers. The communication unit <NUM> is a communication interface that implements communication with the information processing device <NUM> via the network N.

The display unit <NUM> includes a display device such as a liquid crystal panel or an organic electro luminescence (EL) display. The display unit <NUM> displays various kinds of information in accordance with an instruction from the control unit <NUM>. The operation unit <NUM> is an interface that receives an operation by a user, and includes, for example, a physical button, a mouse, a touch panel device that is embedded in the display, a speaker, a microphone, and the like. The operation unit <NUM> receives an operation input from the user, and sends out a control signal in accordance with the operation content to the control unit <NUM>.

<FIG> is a flowchart illustrating one example of a processing procedure of reference motion information acquisition. The processing in <FIG> is executed by the control unit <NUM> of the information processing device <NUM> and the control unit <NUM> of the detection device <NUM>. The execution timing of the processing is, for example, timing at which the motion detection sensor 2a detects a signal.

The control unit <NUM> of the detection device <NUM> acquires an image in which a subject is photographed from the motion detection sensor 2a in real time or at a predetermined detection interval (for example, for every minute) (Step S10). The control unit <NUM> detects a feature point corresponding to a corresponding site of the subject from the acquired image (Step S11). For example, the control unit <NUM> detects a right hand and a left hand of the subject as feature points.

The control unit <NUM> acquires motion information including right motion information and left motion information based on a detection result of feature points in each image acquired on a time-series basis (Step S12). Specifically, the control unit <NUM> compares image data acquired on a time-series basis to calculate motion amounts of the corresponding site in the right half body and the left half body included in the images at the previous time and the current time. For example, the detection device <NUM> respectively compares coordinates of the left hand and the right hand in the previous frame with coordinates of the left hand and the right hand in the current frame, and acquires movement speeds calculated from the movement distance and the detection time, as motion information.

Moreover, the control unit <NUM> specifies a motion pattern of the subject, and the subject (Step S13). For example, the control unit <NUM> detects respective sites such as limbs and a head as feature points at Step S11, and from coordinate values of the detected respective feature points, performs pattern matching of a position, a posture, and a motion (gesture) of the subject inside a room, thereby specifying a motion pattern. Moreover, the control unit <NUM> stores (registers) in advance a subject ID and a face feature amount of the subject in association with each other, extracts a face feature amount at Step S10, and performs pattern matching with the stored face feature amount, thereby specifying the subject ID. The control unit <NUM> outputs motion information in association with the specified motion pattern, the subject ID, the detection date and time, the sensor ID, the detection value, and the like, to the information processing device <NUM> (Step S14).

The control unit <NUM> of the information processing device <NUM> acquires motion information by the communication unit <NUM> (Step S15). The control unit <NUM> stores the acquired motion information in association with the subject ID, the motion pattern, and the like, in the detection value DB <NUM> (Step S16).

The control unit <NUM> derives reference motion information indicating a motion of the subject in normal times, based on the collected motion information (Step S17). Specifically, the control unit <NUM> refers to the detection value DB <NUM>, and acquires motion information on the same subject detected within a predetermined period (for example, seven days) and stored in the detection value DB <NUM>. In this case, the control unit <NUM> derives reference motion information for each motion pattern, and thus may extract motion information including the identical motion pattern. For example, in a case where basic motion information relative to a motion pattern "meal" is derived, the control unit <NUM> extracts detection date and time including the most recent one week from the derivation time point, an identical subject ID, and motion information including "meal" as the identical motion pattern. The control unit <NUM> calculates, based on left motion information and right motion information in the extracted motion information, mean values of the left motion information and the right motion information, and thus derives reference motion information including left reference motion information indicating a reference motion of the left half body, right reference motion information indicating a reference motion of the right half body.

In addition, the control unit <NUM> compares the derived reference motion information with reference motion information already recorded in advance, and determines whether the reference motion information is to be corrected (Step S18). Specifically, the control unit <NUM> determines a magnitude relationship of a difference value between the derived reference motion information and the already-recorded reference motion information, and a threshold value set in advance, and determines whether the difference value is equal to or more than the threshold value. If the control unit <NUM> has determined that the reference motion information is not corrected because the difference value is less than the threshold value (Step S18: NO), the control unit <NUM> skips the correction processing of the reference motion information.

If the control unit <NUM> has determined that the reference motion information is corrected because the difference value is equal to or more than the threshold value (Step S18: YES), the control unit <NUM> executes correction of changing the already-recorded reference motion information to the newly derived reference motion information (Step S19). The control unit <NUM> may correct the value of the already-recorded reference state information based on a predetermined rule. The control unit <NUM> stores the reference motion information after the correction and information such as the update date and time, in the reference motion information DB <NUM> (Step S20), and ends the series of the processing.

In the abovementioned processing, the control unit <NUM> may execute the processing at Step S17 and the subsequent processing if the feature amount indicating the motion pattern that is included in the acquired motion information is equal to or more than a predetermined value, from the analyzed result at Step S15. In other words, in a case where the acquired motion information corresponds to the motion pattern set in advance, the control unit <NUM> may execute the derivation processing of the reference motion information.

Note that, an example in which a series of the processing are shared and executed by the control unit <NUM> of the information processing device <NUM> and the control unit <NUM> of the detection device <NUM> in the abovementioned processing has been described, however, the sharing of these by the control unit <NUM> and the control unit <NUM> is one example, and the abovementioned processing is not limited to the example of <FIG>. In other words, the detection device <NUM> may substantially include the information processing device <NUM>. Alternatively, the control unit <NUM> of the detection device <NUM> only outputs the detection value detected by the motion detection sensor 2a, and the control unit <NUM> of the information processing device <NUM> may perform the subsequent processing. Alternatively, the control unit <NUM> of the information processing device <NUM> and the control unit <NUM> of the detection device <NUM> perform inter-process communication, for example, and thus may execute a series of the processing in cooperation with each other.

By using the reference motion information acquired as the above, the information processing device <NUM> determines whether there is a possibility of cerebral infarction from the motion information on the subject. <FIG> is a flowchart illustrating one example of a determination processing procedure of an abnormal state. The processing in <FIG> is executed by the control unit <NUM> of the information processing device <NUM> and the control unit <NUM> of the terminal device <NUM>. The execution timing of the processing is, for example, timing at which new motion information is stored in the detection value DB <NUM>.

The control unit <NUM> of the information processing device <NUM> refers to the detection value DB <NUM>, and acquires new motion information in real time acquired and stored by the detection device <NUM> (Step S21). The motion information is associated with a subject ID, a motion pattern, and the like. The control unit <NUM> acquires reference motion information to be compared with the acquired motion information (Step S22). The control unit <NUM> refers to the reference motion information DB <NUM>, and acquires reference motion information including a subject ID and a motion pattern identical to those in the acquired motion information.

The control unit <NUM> compares the acquired motion information with the reference motion information, and determines whether there is a possibility of cerebral infarction in a subject, in other words, whether the motion information on the subject is in an abnormal state (Step S23). If the control unit <NUM> detects, by analyzing left motion information in the left half body and right motion information in the right half body, a motion different from that in normal times in either one of the left half body and the right half body of the subject, the control unit <NUM> determines that an abnormal state where there is a possibility of cerebral infarction is present.

Specifically, the control unit <NUM> compares the acquired left motion information with left reference motion information in the reference motion information and compares the acquired right motion information with right reference motion information in the reference motion information, and determines whether a difference between the motion information and the reference motion information is equal to or more than the threshold value in each of the left half body and the right half body. <FIG> illustrates explanation diagrams related to determination processing of an abnormal state. <FIG> conceptually illustrates time-series changes in reference motion information (for example, the movement speed of the left hand and the right hand) in the left half body and the right half body on the upper side, and the time-series changes to which motion information on the left half body and the right half body at present is added on the lower side. In each graph in <FIG>, the longitudinal axis indicates the motion information, and the horizontal axis indicates the time.

As mentioned above, the control unit <NUM> derives reference motion information on each of the left and right half bodies in a predetermined period from the collected motion information, and stores the reference motion information in the reference motion information DB <NUM>. In a case where the control unit <NUM> has acquired motion information from the detection device <NUM>, the control unit <NUM> compares motion information on each of the left and right half bodies with reference motion information, and calculates a difference value with the reference motion information in each of the left half body and the right half body. In other words, the control unit <NUM> calculates a difference between right reference motion information illustrated by solid line and current right motion information illustrated by thick line, in <FIG>. Similarly, the control unit <NUM> calculates a difference between left reference motion information and current left motion information.

The control unit <NUM> compares the calculated difference value of each of the left and right half bodies with a predetermined threshold value, and determines whether an abnormality is present in the left half body and the right half body for each of the left half body and the right half body. Specifically, the control unit <NUM> determines that the abnormality is present if the difference value is equal to or more than the threshold value. Note that, for example, the control unit <NUM> may make a determination by comparing a difference of an instantaneous value at certain time with a threshold value, or may make a determination by comparing an integral value or a mean value of differences for a certain unit time (for example, five minutes) with a threshold value. The control unit <NUM> eventually determines whether the subject is in the abnormal state where there is a possibility of cerebral infarction based on a determination result of each of the left half body and the right half body. Specifically, if the control unit <NUM> has determined that an abnormality is present in one of the half bodies and no abnormality is present in the other half body, the control unit <NUM> determines that the abnormal state is present. If the control unit <NUM> has determined that no abnormality is present in both of the half bodies, the control unit <NUM> determines that no abnormal state is present. Moreover, also if the control unit <NUM> has determined that the abnormality is present in both of the half bodies, the control unit <NUM> determines that no abnormal state is present. For example, when a difference with the reference motion information is occurred as for both of the left and right motion information, it is determined that a possibility of cerebral infarction is low because the abnormality only in one side is not present.

Referring back to <FIG>, the explanation is continuously made. If the control unit <NUM> has determined that the motion information is not in an abnormal state (Step S23: NO), the control unit <NUM> causes the processing return to Step S21, and continues the acquisition of motion information. If the control unit <NUM> has determined that the motion information is in an abnormal state (Step S23: YES), the control unit <NUM> determines whether the abnormal state is a false abnormal state (Step S24).

The false abnormal state herein is a state in which a predetermined change temporarily occurs in a motion of the left half body or the right half body due to a factor other than the cerebral infarction, and is a state having a low possibility of cerebral infarction, which is different from the abnormal state. Examples of factors of the false abnormal state can include, for example, numbness caused by the temporary and partial compression of the blood flow and the nerve due to sleeping for a long period of time with either one of the left half body or the right half body lying down, and muscle pain in only one side due to exercise and the like. Similar to the abnormal state, motion information having a left-right difference is detected from a subject in these false abnormal states in some cases.

The control unit <NUM> stores a false abnormal state information DB (not illustrated) that stores therein false abnormal state information in which motion information in a false abnormal state has been defined in advance. In the false abnormal state information DB, motion information for defining a false abnormal state to be indicated in a predetermined motion and other conditions are stored. The control unit <NUM> compares motion information in the false abnormal state information DB with the acquired motion information on the subject, and determines whether the abnormal state of the subject is a false abnormal state. For example, a case where the time when one side of the body lies down at sleeping is equal to or more than a predetermined value and a left-right difference of the difference value between left motion information or right motion information and reference motion information is less than a predetermined value, corresponds to false abnormal state information. Note that, the control unit <NUM> may determine whether the abnormal state is a false abnormal state by using the method of machine learning, in addition thereto. The control unit <NUM> may create and store in advance a learning model in which an identification result as to whether the abnormal state is a false abnormal state is output in a case where motion information is input, in the storage unit <NUM>, and may determine whether the abnormal state is a false abnormal state from the learning model.

If the control unit <NUM> has determined that the abnormal state is a false abnormal state because the motion information on the subject corresponds to the false abnormal state information, in other words, a possibility of cerebral infarction is low (Step S24: YES), the control unit <NUM> causes the processing to return to Step S21, and continues the acquisition of motion information.

If the control unit <NUM> has determined that the abnormal state is not a false abnormal state because the motion information on the subject does not correspond to false abnormal state information, in other words, a possibility of cerebral infarction is high (Step S24: NO), the control unit <NUM> outputs notification information for making a notification about the occurrence of the abnormal state, to the terminal device <NUM>, by the communication unit <NUM> (Step S25). The control unit <NUM> refers to the subject information DB <NUM> to specify a notification destination in a case where the subject is in an abnormal state, and outputs the notification information to the specified notification destination by using a mail function, for example.

The control unit <NUM> of the terminal device <NUM> acquires notification information for making a notification about the occurrence of the abnormal state, by the communication unit <NUM> (Step S26). The control unit <NUM> displays a notification screen <NUM> including the information indicating the occurrence of the abnormal state on the display unit <NUM>, based on the acquired notification information (Step S27), and ends the series of the processing
Note that, the control unit <NUM> may perform loop processing in which the processing at Step S21 is executed after the processing at Step S25.

<FIG> is a view illustrating one example of the notification screen <NUM> that is displayed on the display unit <NUM>. The control unit <NUM> displays notification screen information based on the notification information acquired from the information treatment device <NUM> on the display unit <NUM>. The notification screen <NUM> includes the notification related to the motion information determined as being in an abnormal state. The notification screen <NUM> may further include a notification for prompting a check of the determination with respect to the motion information determined as being in an abnormal state. In the example illustrated in <FIG>, the notification screen <NUM> includes information indicating detection date and time, a detection place, and the like of the motion information, and further include a motion graph <NUM> indicating the detected motion information, a check button <NUM> for prompting the check of the screen content, and the like. The notification screen <NUM> may further include a message for notifying the subject of support information (for example, the content for prompting the subject to have a consultation in a medical institution) in accordance with the determination result.

In the example illustrated in <FIG>, on the notification screen <NUM>, a time change of motion information (for example, the movement speed of the right hand) on a half body in which an abnormality is detected is illustrated in the motion graph <NUM> with the movement speed as the longitudinal axis and the time as the horizontal axis. The motion graph <NUM> includes a reference value curve <NUM> indicating reference motion information on the subject and a detection value curve <NUM> indicating motion information relating to the detected abnormal state. The control unit <NUM> of the information processing device <NUM> refers to reference motion information stored in the reference motion information DB <NUM> and motion information stored in the detection value DB <NUM>, and generates and displays the reference value curve <NUM> and the detection value curve <NUM> in which time information is associated therewith, on the motion graph <NUM>. Moreover, the control unit <NUM> refers to the detection value DB <NUM>, acquires detection date and time, a detection place, and the like of the motion information relating to the abnormal state, generates text information in which the acquired detection date and time, detection place, and the like are displayed, and displays the text information on the notification screen <NUM>. The control unit <NUM> may further read a detection value relating to the abnormal state detected by the motion detection sensor 2a from the detection value DB <NUM>, and may display the read detection value with the motion graph <NUM> on the notification screen <NUM>. In addition to motion information in the abnormal state, for example, the detection value acquired from the image data is displayed in association with the motion information, whereby it is possible to recognize the state of the actual motion of the subject in more details.

The subject can recognize the occurrence of the abnormal state on the notification screen <NUM> that is displayed in the display unit <NUM>. This can make a notification of a possibility of cerebral infarction even in a case where the subject himself/herself is not aware, so that it is possible to prompt an early medical check and consultation, and can assist the detection of cerebral infarction. The subject checks the notification screen, and then clicks the check button <NUM>. In a case where the control unit <NUM> of the terminal device <NUM> has received the pressing-down operation of the check button <NUM>, the control unit <NUM> transmits operation information to the information processing device <NUM>. The control unit <NUM> of the information processing device <NUM> acquires the operation information. In a case where the operation information is not acquired for a predetermined period, the control unit <NUM> may output again the notification information to the terminal device <NUM>. This can reliably notify the subject of the information.

Note that, in the above, a difference value is determined for each of the left half body and the right half body, however, the present embodiment is not limited thereto. Specifically, the control unit <NUM> may determine whether the abnormal state is present based on a difference value between the left motion information and the right motion information.

In this case, the control unit <NUM> derives a difference value between left motion information and right motion information serving as reference motion information, by calculating, from the left motion information and the right motion information in a predetermined period, a difference value therebetween at each time, and obtaining the average of difference values for the period. The control unit <NUM> calculates a difference value between left motion information and right motion information in a case where the control unit <NUM> has acquired motion information from the detection device <NUM>. The control unit <NUM> compares the calculated difference value with the difference value indicated by the reference motion information, and calculates a difference value (for convenience, called "second difference value") therebetween.

The control unit <NUM> compares the calculated second difference value with a threshold value, and determines that the abnormal state is present if the second difference value is equal to or more than the threshold value. In this manner, the control unit <NUM> may determine whether the abnormal state is present by comparing the left-right difference (difference value serving as the reference motion information) of the motion information in the reference state with the left-right difference in the current motion information.

Note that, the example in which the determination processing of an abnormal state and the determination processing of a false abnormal state are executed by the different processing has been described in the above, however, these determination processing may be executed as one processing. In other words, the processing at Step S23 may include the processing at Step S24, and the control unit <NUM> may determine whether an abnormal state is present by the determination processing of a false abnormal state. For example, the control unit <NUM> may determine that the subject has a low possibility of cerebral infarction, in other words, is not in an abnormal state by determining that the subject is in a false abnormal state based on the motion information.

Moreover, in the abovementioned determination of an abnormal state, in a case where several types of motion information are detected by a plurality of the motion detection sensors 2a, the information processing device <NUM> may determine whether an abnormal state is present for each of the several types of the motion information. For example, the information processing device <NUM> determines whether an abnormal state is present for each of motion information to be derived from image data by the camera and motion information to be derived from line-of-sight data by a line-of-sight sensor, so that it is possible to further improve the determination accuracy.

Moreover, as for the threshold value that is used for the abovementioned determination of an abnormal state, different threshold values may be defined in accordance with detection places of motion information, or the threshold value may be corrected in accordance with the detection place. For example, even for the identical motion pattern, the intensity, the movable range, and the like may change in accordance with the place where the motion is performed, so that it is preferable to use a threshold value in accordance with the detection place of the motion information and perform comparison with reference motion information. Moreover, for example, in a case where an ambient temperature in the surrounding of a subject is detected by using a temperature sensor or the like provided to the motion detection sensor 2a, a threshold value may be corrected based on a change in ambient temperature in a movement path of the subject. In a case where a temperature change equal to or more than a predetermined value has been detected in the surrounding of the subject, the motion content may change for the same motion pattern. The control unit <NUM> acquires a temperature change, performs comparison with reference motion information using a threshold value corrected by using a different correction value depending on the acquired temperature change, and determines the presence or absence of an abnormal state.

In a case where the abnormal state continues, the information processing device <NUM> outputs an additional notification. <FIG> is a flowchart illustrating one example of a processing procedure relating to warning information. The processing in <FIG> is executed by the control unit <NUM> of the information processing device <NUM> and the control unit <NUM> of the terminal device <NUM>. If it has been determined that the subject is in the abnormal state at Step S24 in <FIG>, the following processing is executed in parallel to the processing in <FIG>.

The control unit <NUM> determines whether the abnormal state continues for a predetermined time (Step S31). The control unit <NUM> refers to the detection value DB <NUM>, and specifies the time when first motion information relating to the abnormal state is detected. The control unit <NUM> determines a magnitude relationship between an elapsed time from the time when the first motion information is detected and a threshold value set in advance (for example, <NUM> minutes), and determines whether the elapsed time is equal to or more than the threshold value.

If the control unit <NUM> has determined that the abnormal state does not continue for the predetermined time because the elapsed time is less than the threshold value (Step S31: NO), the control unit <NUM> ends the processing. In this case, the control unit <NUM> may output information making a notification of the end of the abnormal state to the terminal device <NUM>, by the communication unit <NUM>.

If the control unit <NUM> has determined that the abnormal state continues for the predetermined time because the elapsed time is equal to or more than the threshold value (Step S31: YES), the control unit <NUM> may output warning information for making a notification of the continuation of the abnormal state to the terminal device <NUM>, by the communication unit <NUM> (Step S32). The output destination of the warning information is the terminal device <NUM> of the subject, similar to the output destination of the notification information.

The control unit <NUM> of the terminal device <NUM> acquires warning information by the communication unit <NUM> (Step S33). The control unit <NUM> displays, based on the acquired warning information, a warning screen <NUM> that receives the warning information and an emergency notice operation for the warning information, on the display unit <NUM> (Step S34).

<FIG> is a view illustrating one example of the warning screen <NUM> that is displayed on the display unit <NUM>. The control unit <NUM> displays warning screen information based on the warning information acquired from the information treatment device <NUM> on the display unit <NUM>. The warning screen <NUM> includes warning information indicating the occurrence and the content of the warning state, and further includes a notification unnecessary button <NUM> for receiving the selection that an emergency notice for the warning information is unnecessary and a notification necessary button <NUM> for receiving the selection that an emergency notice for the warning information is necessary. The emergency notice indicates that in a case where the abnormal state of the subject continues, a high possibility of cerebral infarction is notified to others except the subject. The emergency notice assists a request for support to the subject in an emergency state, by the report to a family of the subject, a fire department, and a medical institution, for example. The subject performs a button operation of selecting the presence or absence of an emergency notice on the warning screen <NUM> that is displayed on the display unit <NUM>. The control unit <NUM> receives the button operation, and executes processing in accordance with the received operation content.

Referring back to <FIG>, the explanation is continuously made. The control unit <NUM> determines whether an emergency notice is necessary (Step S35). If the control unit <NUM> has determined that the emergency notice is not necessary by receiving the selection operation of the notification unnecessary button <NUM> with the operation unit <NUM> (Step S35: NO), the control unit <NUM> ends the processing. On the other hand, if the control unit <NUM> has determined that the emergency notice is necessary by receiving the selection operation of the notification necessary button <NUM> with the operation unit <NUM> (Step S35: YES), the control unit <NUM> outputs emergency notice information indicating that the emergency notice is necessary to the information processing device <NUM>, by the communication unit <NUM> (Step S36). The control unit <NUM> may determine that the emergency notice is necessary when an selection operation for neither of the notification unnecessary button <NUM> nor the notification necessary button <NUM> is received, and a predetermined time has elapsed.

The control unit <NUM> of the information processing device <NUM> determines whether an emergency notice for the warning information is necessary (Step S37). If the control unit <NUM> has determined that the emergency notice is necessary by having acquired the emergency notice information from the terminal device <NUM> (Step S37: YES), the control unit <NUM> outputs emergency information for making a notification of the abnormal state in the subject to the outside, by the communication unit <NUM> (Step S38). The control unit <NUM> may refer to the subject information DB <NUM> to specify an emergency notification destination in an emergency, and may make a notification to the emergency notification destination using a telephone call function, for example. If the control unit <NUM> has determined that the emergency notice is not necessary by having not acquired the emergency notice information from the terminal device <NUM> (Step S37: NO), the control unit <NUM> skips the emergency notice processing at Step S38, and ends the series of the processing.

In the abovementioned processing, the information processing device <NUM> preferably changes an acquisition interval of the motion information in accordance with a state of the subject. For example, at Step S23 in <FIG>, if the control unit <NUM> has determined that the motion information is in an abnormal state, the control unit <NUM> outputs a change instruction of a detection interval to the detection device <NUM>. For example, the acquisition interval of the motion information that is set as for every minute in normal times is changed to for every <NUM> seconds after the occurrence of the abnormal state, so that it is possible to identify a state of the subject in more details.

Note that, in the present embodiment, in the processing having described in the abovementioned respective flowcharts in <FIG> and <FIG>, a part or all of the processing executed by the control unit <NUM> of the information processing device <NUM> may be executed by the control unit <NUM> of the terminal device <NUM>, or may be executed by the control unit <NUM> of the detection device <NUM>.

In the present embodiment, the terminal device <NUM> substantially may include the information processing device <NUM>, and may perform communication directly with the detection device <NUM>. Alternatively, the terminal device <NUM> may be configured to substantially include the information processing device <NUM> and the detection device <NUM>, and one terminal device <NUM> having these functions may execute the abovementioned respective processing.

With the present embodiment, it is possible to determine a possibility of cerebral infarction based on a daily motion of the subject, specially motion information related to a motion to be repeatedly performed on a daily basis. When an abnormal state where there is a possibility of cerebral infarction has been detected, the subject is immediately notified, so that it is possible to assist the early detection of cerebral infarction. It is possible to more accurately determine whether an abnormal state is present by using the reference motion information and the false abnormal state information in accordance with individual subjects.

In a second embodiment, living body information on a subject is acquired, and the presence or absence of a possibility of cerebral infarction in the subject is determined based on motion information and the living body information. Hereinafter, points in the second embodiment different from those in the first embodiment will be described. Other configurations except the configuration to be described later are similar to those of the information processing system <NUM> in the first embodiment, and the common configurations are assigned with the identical reference numerals and detailed explanations thereof are omitted.

The detection device <NUM> in the second embodiment is provided with the motion detection sensor 2a and the living body information detection sensor 2b, as illustrated in <FIG>. The living body information detection sensor 2b is a detection device that detects living body information on a subject. The detection device <NUM> transmits motion information detected by the motion detection sensor 2a and living body information detected by the living body information detection sensor 2b, to the information processing device <NUM>.

The living body information detection sensor 2b is, for example, an infrared ray camera that detects a blood flow and a surface temperature of the subject. The living body information detection sensor 2b may detect a body pressure of the subject by using a surface pressure sensor that is provided to a mat such as bedding and a seat that is used by the subject. In a case where the detection device <NUM> is a wearable device, the living body information detection sensor 2b may detect a pulse wave, a body temperature, and the like of the subject by using a pulse wave sensor, a temperature sensor, and the like. Note that, the detection device <NUM> may be configured to include a combination of the motion detection sensors 2a of several types and the living body information detection sensors 2b of several types.

<FIG> is a block diagram illustrating a configuration of the detection device <NUM> in the second embodiment. The detection device <NUM> is provided with a living body information detection unit <NUM>, in addition to the control unit <NUM>, the storage unit <NUM>, the communication unit <NUM>, and the motion information detection unit <NUM>. The living body information detection unit <NUM> acquires a detection signal by using the living body information detection sensor 2b. The living body information detection unit <NUM> may have an A/D conversion function, and may output a measurement value obtained from the living body information detection sensor 2b, to the control unit <NUM>.

In the second embodiment, the control unit <NUM> of the information processing device <NUM> stores detection values including the motion information and the living body information acquired from the detection device <NUM>, in the detection value DB <NUM>. The information processing device <NUM> determines a possibility of cerebral infarction in the subject based on the motion information and the living body information. <FIG> is a flowchart illustrating one example of a determination processing procedure of an abnormal state in the second embodiment. The processing common to that of <FIG> in the first embodiment is assigned with the identical step number, and a detailed explanation thereof is omitted.

The control unit <NUM> of the information processing device <NUM> refers to the detection value DB <NUM>, and acquires in real time new motion information and new living body information acquired and stored by the detection device <NUM> (Step S41). The motion information is associated with a subject ID, a motion pattern, and the like. The control unit <NUM> acquires reference motion information to be compared with the acquired motion information (Step S22). The control unit <NUM> refers to the reference motion information DB <NUM>, and acquires reference motion information including a subject ID and a motion pattern identical to those in the acquired motion information.

The control unit <NUM> compares the acquired motion information with the reference motion information, and determines whether there is a possibility of cerebral infarction in a subject, in other words, whether the motion information on the subject is in an abnormal state (Step S23). If the control unit <NUM> has determined that the motion information is not in an abnormal state (Step S23: NO), the control unit <NUM> causes the processing return to Step S41, and continues the acquisition of motion information and living body information. If the control unit <NUM> has determined that the motion information is in an abnormal state (Step S23: YES), the control unit <NUM> determines whether the abnormal state is a false abnormal state (Step S44).

The control unit <NUM> compares false abnormal state information related to a false abnormal state and stored in advance with the motion information on the subject, and determines whether the abnormal state in the subject is a false abnormal state. The control unit <NUM> in the second embodiment determines whether the abnormal state in the subject is a false abnormal state based on the motion information and the living body information. In other words, the false abnormal state information is defined by including motion information and living body information. For example, in a case where a change value of the blood flow amount, a body temperature, change values in shape of left and right half bodies, and the like of the subject are predetermined values, the motion information on the subject corresponds to the false abnormal state information.

If the control unit <NUM> has determined that the abnormal state is a false abnormal state because the motion information on the subject corresponds to the false abnormal state information (Step S44: YES), the control unit <NUM> causes the processing to return to Step S41 and continues the acquisition of motion information. If the control unit <NUM> has determined that the abnormal state is not a false abnormal state because the motion information on the subject does not correspond to the false abnormal state information (Step S44: NO), the control unit <NUM> outputs notification information for making a notification about the occurrence of the abnormal state, to the terminal device <NUM>, by the communication unit <NUM> (Step S25).

The control unit <NUM> of the terminal device <NUM> acquires notification information for making a notification about the occurrence of the abnormal state, by the communication unit <NUM> (Step S26). The control unit <NUM> displays a notification screen including the information indicating the occurrence of the abnormal state on the display unit <NUM>, based on the acquired notification information (Step S27), and ends the series of the processing. Note that, the control unit <NUM> may perform loop processing in which the processing at Step S21 is executed after the processing at Step S25.

With the present embodiment, for example, even in a case where it is difficult to determine whether the abnormal state is an abnormal state or a false abnormal state from only the motion information, a possibility of cerebral infarction is determined by including the motion information and the living body information, so that a suitable determination result can be provided.

In a third embodiment, information processing is implemented by specializing motion information that is voice data. Hereinafter, points in the third embodiment different from those in the first embodiment will be described. Other configurations except the configuration to be described later are similar to those of the information processing system <NUM> in the first embodiment, and the common configurations are assigned with the identical reference numerals and detailed explanations thereof are omitted.

The detection device <NUM> in the third embodiment is provided with a sound sensor that detects speech sound of a subject, as the motion detection sensor 2a. The motion detection sensor 2a may be further provided with a camera or the like that detects a motion of a face of the subject.

The information processing device <NUM> determines a possibility of cerebral infarction based on motion information that is voice data acquired from the detection device <NUM>. In the third embodiment, voice data relating to words of a plurality of patterns serving as the reference is stored in the reference motion information in the reference motion information DB <NUM>. The information processing device <NUM> compares voice data on the subject in normal times with voice data detected in real time, and determines a possibility of cerebral infarction.

The control unit <NUM> executes an analysis of voice data detected by the sound sensor, and extracts a word pattern set in advance from the speech sound. The control unit <NUM> determines a magnitude relationship of a difference value between voice data corresponding to the extracted word pattern and voice data serving as reference motion information, and a threshold value set in advance, and determines, by determining whether the difference value is equal to or more than the threshold value, whether the abnormal state having a possibility of cerebral infarction is present.

The control unit <NUM> may further acquire image data indicating a speech motion of a face of the subject imaged by the camera. For example, by using a pattern matching method and other publicly known techniques, the control unit <NUM> performs an image analysis of the motion information that is the acquired image data, and determines whether the image data corresponds to the speech pattern set in advance. If the control unit <NUM> has determined that the image data corresponds to the speech pattern, the control unit <NUM> executes analysis processing of the abovementioned voice data, and determines whether the abnormal state is present.

With the present embodiment, for example, even in a case where the determination is difficult from a left-right difference of the motions in the body, a possibility of cerebral infarction can be determined based on the much sound information that occurs on a daily basis.

Claim 1:
An information processing device (<NUM>), comprising:
a motion information acquisition unit that is configured to acquire motion information detected by a motion detection device (2a) that detects a motion of a subject;
a storage unit (<NUM>) that is configured to store therein the motion information acquired by the motion information acquisition unit;
a control unit (<NUM>);
wherein the control unit (<NUM>) is configured to derive reference motion information on a left half body and reference motion information on a right half body of the subject, based on the motion information in a predetermined period stored by the storage unit; and
the control unit (<NUM>) is configured to determine whether an abnormal state in which there is a possibility of cerebral infarction in the subject is present based on the reference motion information, and motion information on a left half body and motion information on a right half body of the subject at a detection time subsequent to the predetermined period
wherein the motion information includes first motion information in which a motion in the left half body of the subject is detected and second motion information in which a motion in the right half body of the subject is detected,
the control unit (<NUM>) is configured to respectively compare the first motion information in the reference motion information with the first motion information at the detection time, and the second motion information in the reference motion information with the second motion information at the detection time,
wherein, if the control unit (<NUM>) has determined that an abnormality is present in one of the half bodies and no abnormality is present in the other half body, the control unit (<NUM>) determines that the abnormal state is present, and if the control unit (<NUM>) has determined that no abnormality is present in both of the half bodies, the control unit (<NUM>) determines that no abnormal state is present, and also if the control unit (<NUM>) has determined that the abnormality is present in both of the half bodies, the control unit (<NUM>) determines that no abnormal state is present.