Abstract:
There is provided a daily activity recognition system using sensors installed in required positions in a home to recognize daily activities of an old person, the system including: a radio frequency (RF) management unit receiving data measured by a plurality of sensors installed in required positions in a home, recognizing a corresponding sensor transmitting the received data, and converting the received data into a basic activity corresponding to the recognized sensor; a buffer management unit storing the basic activity received from the wireless processing manager in an internal buffer; and a daily activity recognition unit recognizing daily activities of an old person at each point in time previously set, based on the basic activity stored in the buffer. The daily activities of the old person are recognized and stored in a database, thereby providing various services related to the health of the old person.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    This application claims the priority of Korean Patent Application No. 10-2007-0083375 filed on Aug. 20, 2007, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference. 
       BACKGROUND OF THE INVENTION 
       [0002]    1. Field of the Invention 
         [0003]    The present invention relates to a daily activity recognition method and system, and more particularly, to a method and a system for recognizing daily activities of an old person by using sensors. 
         [0004]    The present invention was supported by the IT R&amp;D program of MIC/IITA [2006-S-007-02, titled: Ubiquitous Health Monitoring Module and System Development]. 
         [0005]    2. Description of the Related Art 
         [0006]    In general, a method of recognizing daily activities, there are a vision-based method and radio frequency identification (RFID)-based method. 
         [0007]    In the case of the vision-based method, a camera such as closed-circuit television (CCTV) is installed in a home and an activity is recognized by analyzing camera images. Via this method, daily activities of an old person may be recognized while the old person is not aware of that. However, in the vision-based method, since it is required to process moving pictures, complexity of processing is high, processing time is long, and it is difficult to provide high quality. Also, since it is required to install cameras in a home, a user may feel that the user is observed. 
         [0008]    In the case of RFID-based method, an RFID tag is attached to things in a home and an old person wears a reader, thereby recognizing daily activities. The RFID-based method has an advantage that information on using things related to daily activities maybe directly known. However, since the old person should wear the reader that is big, it is difficult to apply the method to a real life. Also, when attaching an RFID tag to a material such as metal, a recognition function of the RFID tag is decreased. 
       SUMMARY OF THE INVENTION 
       [0009]    An aspect of the present invention provides a daily activity recognition system in which sensors are installed on pieces of furniture and floors in a home to recognize daily activities and to directly know information on using goods related to the daily activities while an old person is unaware of this, the system capable of estimating a position and a posture of the old person by using the installed sensors and recognizing the daily activities based on a maintenance time of the estimated position and posture. 
         [0010]    According to an aspect of the present invention, there is provided a daily activity recognition system using sensors, the system including: a radio frequency (RF) management unit receiving data measured by a plurality of sensors installed in required positions in a home, recognizing a corresponding sensor transmitting the received data, and converting the received data into a basic activity corresponding to the recognized sensor; a buffer management unit storing the basic activity received from the wireless processing manager in an internal buffer; and a daily activity recognition unit recognizing daily activities of an old person at each point in time previously set, based on the basic activity stored in the buffer. 
         [0011]    According to another aspect of the present invention, there is provided a method of recognizing daily activities of an old person in a daily activity recognition system, the method including: receiving data measured by a plurality of sensors installed in required positions in a home in real time; recognizing a corresponding sensor transmitting the received data and converting the received data into a basic activity corresponding to the recognized sensor; storing the received basic activity received from an RF management unit, in an internal buffer; recognizing the daily activities of the old person based on the basic activity stored in the buffer for each present point in time; and storing the recognized daily activities in a database. 
         [0012]    As described above, according to an exemplary embodiment of the present invention, daily activities of an old person are recognized by installing sensors in required positions in a home and the recognized daily activities are accumulated in a database, thereby providing various services related to the health of the old person. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0013]    The above and other aspects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which: 
           [0014]      FIG. 1  is a diagram illustrating sensors installed in required positions in a home, according to an exemplary embodiment of the present invention; 
           [0015]      FIG. 2  is a diagram illustrating a configuration of a daily activity recognition system according to an exemplary embodiment of the present invention; and 
           [0016]      FIG. 3  is a flowchart illustrating a process of recognizing daily activities at a daily activity recognition unit according to an exemplary embodiment of the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
       [0017]    Exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Only, in describing operations of the exemplary embodiments in detail, when it is considered that a detailed description on related well-known functions or constitutions may make essential points of the present invention be unclear, the detailed description will be omitted. 
         [0018]    In an exemplary embodiment of the present invention, a sensor measuring a pressure of an object put on the sensor is installed on pieces of furniture and floors in a home. Hereinafter, the present embodiment will be described employing a pressure sensor. However, various sensors such as a thermal sensor capable of recognizing daily activities of an old person may be used. 
         [0019]    An example of installing pressure sensors (hereinafter, referred to as sensors) is shown in  FIG. 1 . The example of installing sensors will be described with reference to  FIG. 1 . 
         [0020]    To recognize daily activities of an old person in a home, sensors are installed pieces of furniture and floors of a place where the old person generally lives. For example, the sensors may be installed on a bed  11  to recognized a sleep, on a sofa  12  to recognize a rest, on a table and table chairs  13  to recognize a meal, on a front of a toilet bowl and a lever for the toilet bowl  14  to recognize an excretion, bottoms  15  of both sides of a door to recognize a go-out. For example, four or more of sensors are installed on top areas of the bed  11 , the sofa  12 , and table and table chairs  13  and one or more of sensors are installed on the front of the toilet bowl and the lever for the toilet bowl  14  and the bottoms  15  of the both sides of the door. Also, when necessary, the sensors may be installed certain positions indoor or outdoor. 
         [0021]    The sensors may include a measuring unit measuring a pressure and a transmitting unit transmitting a measured value. 
         [0022]    The measuring unit is a polymer thick film device having characteristics in which resistance decrease when a vertical force increases a surface of a polymer thick film, which measures a pressure of an object put on the sensor via a resistance value. 
         [0023]    The transmitting unit is a radio frequency (RF) communication device, which transmits the resistance value to a set-top box  20  installed in a home. 
         [0024]    The sensors communicate via the same channel with a bandwidth of 2.4 GHz, are distinguished by particular identification for each sensor, and transmit 32-bit data as shown in Table 1. 
         [0000]    
       
         
               
               
               
             
           
               
                 TABLE 1 
               
               
                   
               
               
                 Number of bits 
                 Value 
                 Range of expression 
               
               
                   
               
             
             
               
                 0-3 
                 Sensor type 
                 0-15 
               
               
                  4-13 
                 Sensor 
                 0-1023 
               
               
                   
                 identification 
               
               
                 14-15 
                 Sensor state 
                 00, 01, 10, 11 
               
               
                 16-31 
                 Sensor value 
                 0-1023 
               
               
                   
               
             
          
         
       
     
         [0025]    The sensor type is a field considering an additional sensor. The sensors have the same value. 
         [0026]    The sensor identification has a particular value previously defined for each sensor installed in the home. 
         [0027]    The sensor state shows a state change of ON and OFF based on the sensor value. In this case, a certain threshold value is determined according to a piece of furniture where the sensor is installed and it is determined as ON when less than the threshold value and is determined as OFF when more than the threshold value. In the case of the sensor state, 00 indicates OFF−&gt;OFF, 01 indicates OFF−&gt;ON, 10 indicates ON−&gt;OFF, and 11 indicates ON CONTINUE. Accordingly, data transmission is performed for each 0.5 second at a point in time when the sensor state is changed and ON CONTINUE. 
         [0028]    The sensor value shows a degree of a resistance value measured at a force sensing resistor (FSR) sensor. The greater pressure value, the lower resistance value. 
         [0029]    A method and a system for recognizing daily activities of an old person by using data measured at sensors installed in required positions in a home, as shown in  FIG. 1 , will be described. 
         [0030]    A configuration of the system for recognizing daily activities will be described in detail with reference to  FIG. 2 . 
         [0031]      FIG. 2  is a diagram illustrating the system according to an exemplary embodiment of the present invention. 
         [0032]    Referring to  FIG. 2 , the system  100  may include a radio frequency (RF) management unit  110 , a buffer management unit  120 , a daily activity recognition unit  130 , an activity recoding unit  140 , and a database  150 . 
         [0033]    The RF management unit  110  receives data measured in real time from the sensors  11  to  15 , recognizes a sensor transmitting the received data based on sensor identification, and converts the received data into a basic activity, which is one of a table-based activity (TABLE), abed-based activity (BED), a sofa-based activity (SOFA), a first toilet-based activity (TOILET), a second lever-based activity (LEVER), a first go-out-based activity (GO-OUT), and a come-in-based activity (COME-IN). The basic activity may include other activities in addition to the described above. In this case, the table-based activity indicates a basic activity when one or more of sensors installed on a table chair are turned ON. The bed-based activity indicates a basic activity when two or more of sensors installed on a bed are turned ON. The sofa-based activity indicates a basic activity when two or more of sensors installed on a sofa. The toilet-based activity indicates a basic activity when a sensor installed on a front bottom of a toilet bowl is turned ON. The lever-based activity indicates a basic activity when a sensor installed on a lever for the toilet bowl is turned ON. The go-out-based activity indicates a basic activity when sensors installed on a bottom of a door are sequentially turned ON from inside to outside. The come-in-based activity indicates a basic activity when the sensors installed on the bottom of the door are sequentially turned ON from outside to inside. Also, the RF management unit  110  compares the converted basic activity with a previous basic activity and stores the converted basic activity together with present time information in the buffer management unit  120  when the converted basic activity is different from the previous basic activity. 
         [0034]    The buffer management unit  120  includes a buffer  121 , checks the present time information inputted from the RF management unit  110 , and stores the converted basic activity in the buffer  121  in the order of time. The buffer management unit  120  deletes basic activities recognized as daily activities via each recognitions for daily activities. 
         [0035]    The daily activity recognition unit  130  includes a candidate daily activity recognizer  131 , a meal recognizer  132 , a sleep recognizer  133 , a rest recognizer  134 , an excretion recognizer  135 , and a go-out recognizer  136 , which are daily activity recognizer, and a timer (not shown). The daily activity recognition unit  130  checks contents of the buffer management unit  120 , that is, contents of stored basic activities for a certain time preset in the timer, extracts candidate daily activities according to the checked contents, and transmits the extracted candidate daily activities to a corresponding daily activity recognizer. In this case, a basic activity corresponding to each daily activity is shown in Table 2. 
         [0000]    
       
         
               
               
               
             
           
               
                   
                 TABLE 2 
               
               
                   
                   
               
               
                   
                 Daily activities 
                 Basic activities 
               
               
                   
                   
               
             
             
               
                   
                 Meal activity 
                 Table-based activity 
               
               
                   
                 Sleep activity 
                 Bed-based activity 
               
               
                   
                 Rest activity 
                 Sofa-based activity 
               
               
                   
                 Excretion activity 
                 Toilet and lever-based activities 
               
               
                   
                 Go-out activity 
                 Go-out and come-in-based 
               
               
                   
                   
                 activities 
               
               
                   
                   
               
             
          
         
       
     
         [0036]    The meal recognizer  132  recognizes a meal activity based on a table-based activity. In this case, the table-based activity is a basic activity when a person sits on a table chair and foods are put on the table. Accordingly, the meal recognizer  132  does not recognize as a meal when an old person sit on the table chair without taking a meal. As a reference for recognizing a meal, there are a reference time and an ordinary meal-maintenance time. That is, a probability value increases as the meal time is close to an reference meal time or the maintenance time is similar to an ordinary meal maintenance time. The meal recognizer  132  estimates a reference time and a ordinary maintenance time for each user, based on data accumulated in the database  150 . When the probability value based on the reference time and the maintenance time is greater than a certain value, the meal recognizer  132  recognizes as the meal. In this case, the reference time is shown as a Gaussian mixture of normal distribution estimated for each of a breakfast, a lunch, and a dinner. The maintenance time is shown as normal distribution. 
         [0037]    The sleep recognizer  133  recognizes a sleep activity based on a bed-based activity. In this case, the bed-based activity is an activity when two or more sensors are turned ON. Accordingly, excluding a case in which the old person sits on a bed, only a case in which the persona lies on the bed may be recognized as the sleep activity. The sleep recognizer  133  recognizes the sleep activity based on a reference sleep time and a sleep maintenance time, similar to the meal activity. The reference time and the maintenance time are estimated as normal distribution based on the data accumulated in the database  150 . Accordingly, the sleep recognizer  133  recognizes as the sleep activity when a probability value is greater than a certain value based on the reference time and the maintenance time. 
         [0038]    The rest recognizer  134  recognizes a rest activity based on a maintenance time of a sofa-based activity. In this case, a rest in the daily activities indicates watching TV or reading on a sofa for a long time, excluding an activity of sitting on the sofa for a short while. In this case, the maintenance time of the sofa-based activity includes activities of standing and walking for a short while or going to a bathroom. For this, the rest recognizer  134  calculates the maintenance time including a break for a short time within the sofa-based activity. To calculate the maintenance time, the rest recognizer  134  recognizes the rest activity based on an existing maintenance time of the sofa-based activity when the sofa-based activity does not occur for a certain amount of time. For example, when the maintenance time of the rest activity is greater than 30 minutes, from a start point in time to an end point in time of the maintenance is recognized as the rest activity. 
         [0039]    The excretion recognizer  135  recognizes an excretion activity based on a toilet and lever-based activities. The excretion activity is not divided into feces or urine. The excretion recognizer  135  recognizes as the excretion activity from a point in time when the toilet-based activity occurs to a point in time when the lever-based activity starts since the basic activities guarantees the daily activity. Also, when the toilet-based activity occurs but the lever-based activity does not occur, it is considered as the old person tries to relieve nature but does not succeed due to weakening of an urinary function, which is not recognized as the excretion activity. 
         [0040]    The go-out recognizer  136  recognizes a go-out activity based on a time interval between a go-out-based activity and a come-in-based activity. When the time interval is more than a certain amount of time, for example, 30 minutes, the go-out recognizer  136  recognizes an amount of time from a point in time of going-out to a point in time of coming-in, as the go-out activity. When the time interval is short, the go-out recognizer  136  considers as daily activities associated with a door, such as throwing trashes out and does not recognize as the go-out activity. 
         [0041]    the database  150  stores daily activities recognized at the daily activity recognition unit  130 . An example of the recognized daily activities stored in the database  150  is as shown in Table 3. 
         [0000]    
       
         
               
               
               
               
             
           
               
                   
                 TABLE 3 
               
               
                   
                   
               
               
                   
                 Start time 
                 End time 
                 Daily activity 
               
               
                   
                   
               
             
             
               
                   
                 2007-07-01 09:05:02 
                 2007-07-01 11:50:28 
                 Go-out activity 
               
               
                   
                 2007-07-01 12:10:37 
                 2007-07-01 12:38:13 
                 Meal activity 
               
               
                   
                   
               
             
          
         
       
     
         [0042]    The method of recognizing the daily activities of the old person in the system  100  will be described in detail. 
         [0043]    When receiving real-time measured data from the sensors, the RF management unit  110  checks a sensor transmitting the measured data by using sensor identification thereof and converts the data into a basic activity according to a position where the sensor is installed. The RF management unit  110  stores and manages the converted basic activity in the order of time in the buffer management unit  120 . 
         [0044]    In this case, the daily activity recognition unit  130  recognizes the daily activities of the old person, based on the basic activity stored in the buffer management unit  120 . 
         [0045]      FIG. 3  is a flowchart illustrating a process of recognizing daily activities at the daily activity recognition unit  130 , according to an exemplary embodiment of the present invention. 
         [0046]    Referring to  FIG. 3 , in  210 , the daily activity recognition unit  130  checks whether a timer included in the candidate daily activity recognizer  131  is expired and continuously waits when the timer is not expired. On the other hand, when the timer is expired, the daily activity recognition unit  130  checks contents stored in the buffer management unit  120  and extracts candidate daily activities in  220 . 
         [0047]    The daily activity recognition unit  130  checks each basic activity corresponding to each of the candidate daily activities extracted and recognizes the each basic activity as a corresponding daily activity such as a meal activity, a sleep activity, a rest activity, an excretion activity, and a go-out activity. 
         [0048]    In  230 , the daily activity recognition unit  130  checks the extracted candidate daily activity. When there is present a table-based activity, in  231 , a reference meal time and a meal maintenance time are estimated and a probability value is obtained based thereon. In  232 , the daily activity recognition unit  130  checks whether the obtained probability value is greater than a threshold value. As a result of the checking, when the probability value is greater than the threshold value, in  233 , the daily activity recognition unit  130  recognizes the extracted candidate daily activity as the meal activity. After the meal activity is recognized or when the probability value is smaller than the threshold value, the daily activity recognition unit  130  performs  240 . 
         [0049]    As a result of the checking in  230 , when the table-based activity is not present, in  240 , the daily activity recognition unit  130  checks whether a bed-based activity is present. As a result of the checking, when there is present the bed-based activity, in  241 , the daily activity recognition unit  130  estimates a reference sleep time and a sleep maintenance time and a probability value is obtained based thereon. In  242 , it is checked whether the obtained probability value is greater than a threshold value. As a result of the checking, when the probability value is greater than the threshold value, in  243 , the daily activity recognition unit  130  recognizes the extracted candidate daily activity as the sleep activity. After the sleep activity is recognized or when the probability value is smaller than the threshold value, the daily activity recognition unit  130  performs  250 . 
         [0050]    As a result of the checking in  240 , when there is not present the bed-based activity, in  250 , the daily activity recognition unit  130  checks whether there is present a sofa-based activity. As a result of the checking, when there is present the sofa-based activity, in  251 , the daily activity recognition unit  130  calculates a maintenance time of a rest, including a break within the sofa-based activity. In  252 , the daily activity recognition unit  130  checks whether the calculated maintenance time is greater than a preset threshold time. As a result of the checking, when the maintenance time is greater than the threshold time, in  253 , an activity performed in an amount of time from a point in time when the maintenance time starts to a point in time when the maintenance time ends is recognized as the rest activity. After the rest activity is recognized or when the maintenance is smaller than the threshold time, the daily activity recognition unit  130  performs  260 . 
         [0051]    As a result of the checking in  250 , when there is not present the sofa-based activity, in  260 , the daily activity recognition unit  130  checks whether there is present a toilet-based activity. As a result of the checking, when there is present the toilet-based activity, in  261 , the daily activity recognition unit  130  checks whether there is present a lever-based activity. As a result of the checking, when the lever-based activity occurs, in  262 , the daily activity recognition unit  130  recognizes an activity performed in an amount of time from a point in time when the toilet-based activity starts to a point in time when the lever-based activity starts, as the excretion activity. After the excretion activity is recognized or when the lever-based activity does not occur, the daily activity recognition unit  130  performs  270 . 
         [0052]    As a result of the checking in  260 , when there is not present the toilet-based activity, in  270 , the daily activity recognition unit  130  checks whether there are present a go-out-based activity and a come-in-based activity. As a result of the checking, when there are present the go-out-based activity and the come-in-based activity, in  271 , the daily activity recognition unit  130  obtains a time interval between the go-out-based activity and the come-in-based activity. In  272 , the daily activity recognition unit  130  checks whether the obtained time interval is greater than a preset threshold time. When the time interval is greater than the threshold time, in  273 , the daily activity recognition unit  130  recognizes an activity performed in an amount of time from a point in time when the go-out-based activity starts to a point of time when the come-in-based activity starts, as the go-out activity. After this, the daily activity recognition unit  130  returns to  210  and repeatedly performs the process as described above for a certain time. 
         [0053]    As described above, daily activities recognized at the daily activity recognition unit  130  are transferred to the daily activity recording unit  140 . In this case, basic activities recognized as daily activities via daily activity recognition are deleted from the buffer management unit  120 . 
         [0054]    The daily activity recording unit  140  records the received daily activity in the database  150 . 
         [0055]    As described above, the system  100  for recognizing daily activities may receive measured data from sensors installed in required positions in a home, estimate activities that an old person performs at a certain place and a maintenance time thereof, and recognize daily activities of the old person. 
         [0056]    Also, the system  100  may be applied to sense symptoms such as a change of excretion numbers of the old person and changes of meal and sleep patterns of the old person, based on activity data accumulated in a database. 
         [0057]    Accordingly, in the present embodiment, when an old person lives alone, family living in a distant place may check daily activities of the old person via web. For example, when the old person suffers from senile dementia or diabetes, frequencies of meals and excretions may be known. 
         [0058]    While the present invention has been shown and described in connection with the exemplary embodiments, it will be apparent to those skilled in the art that modifications and variations can be made without departing from the spirit and scope of the invention as defined by the appended claims.