Abstract:
The present disclosure relates to an apparatus and method for recognizing a user input. The apparatus comprises a sensor configured to sense an acoustic wave signal generated by knocking a surface of a medium, an extractor configured to separate an initial pulse signal from the acoustic wave signal and extract signal characteristic of the separated initial pulse signal, and a controller configured to recognize a knocking gesture based on the signal characteristic extracted by the extractor and generate a corresponding control signal.

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    This application claims the benefit of priority from Korean Patent Application No. 10-2015-0049786, filed on Apr. 8, 2015, the disclosure of which is incorporated herein in its entirety by reference. 
       BACKGROUND 
       [0002]    1. Field 
         [0003]    The present invention relates to an apparatus and method for recognizing a user input to identify a knocking gesture by using the acoustic wave generated when knocking a medium surface. 
         [0004]    2. Description of the Prior Art 
         [0005]    The statements in this section merely provide background information related to the present disclosure and may not constitute prior art. 
         [0006]    Generally, an input device for inputting data is applied to an electronic apparatus such as a cell phone, a personal digital assistant (PDA), a notebook, a game machine, a navigation, etc. As this input device, a keypad method inputting corresponding data by pressing a key with a finger, and a touch (contact) method such as a touch panel or touch pad inputting corresponding data by lightly touching a contact surface are applied. 
         [0007]    The input devices of the keypad method have a problem which can&#39;t indefinitely increase the number of keys due to space constraints. 
         [0008]    And, since the input devices of the touch method can only be entered in the form of a combination of the presence or absence of a user touch, touch time, or direction, it limits the design of the user interface. Also, if it is applied to the equipment mounted on a vehicle, since the driver has to check the menu displayed on the screen and select the desired menu, it distracts the attention of the driver and so can cause a safety problem while driving. 
       SUMMARY 
       [0009]    The present disclosure is to provide an apparatus and method for recognizing a user input to identify a knocking gesture by analyzing the signal characteristic of the acoustic wave generated when knocking a medium surface. 
         [0010]    In order to address the above problems, an apparatus for recognizing a user input is provided. The apparatus comprises: a sensor configured to sense an acoustic wave signal generated by knocking a surface of a medium; an extractor configured to separate an initial pulse signal from the acoustic wave signal and extract signal characteristic of the separated initial pulse signal; and a controller configured to recognize a knocking gesture based on the signal characteristic extracted by the extractor and generate a corresponding control signal. 
         [0011]    Also, the medium is a case of a device. 
         [0012]    Also, the signal characteristic includes a length and a peak number of the initial pulse signal. 
         [0013]    Also, the knocking gesture is a specific part of a finger used to knock the surface of the medium 
         [0014]    Also, the specific part of the finger includes one of a fingertip, a finger knuckle (joint) and nail. 
         [0015]    Also, the controller identifies the knocking gesture as a knocking gesture using a fingertip if the peak number of the initial pulse signal is two. 
         [0016]    Also, the controller identifies the knocking gesture as a knocking gesture using a finger knuckle and nail based on a generating peak time of the initial pulse signal if the peak number of the initial pulse signal is one. 
         [0017]    On the other hand, a method for recognizing a user input according to an embodiment of the present invention comprises steps of: sensing an acoustic wave signal generated by knocking a surface of a medium; separating an initial pulse signal from the acoustic wave signal; extracting signal characteristic of the initial pulse signal; and recognizing a knocking gesture based on the signal characteristic. 
         [0018]    Also, the step of extracting signal characteristic extracts a length and a peak number of the initial pulse signal. 
         [0019]    Also, the step of recognizing a knocking gesture comprises the steps of: determining whether the peak number is two; and identifying the knocking gesture as a knocking gesture using a fingertip if the peak number is two. 
         [0020]    Also, the step of recognizing a knocking gesture comprises the steps of: determining whether the peak number is one, if the peak number is not two; determining whether a peak generating time of the initial pulse signal satisfies a first condition if the peak number is one; and identifying the knocking gesture as a knocking gesture using a finger knuckle, if the peak generating time satisfies the first condition. 
         [0021]    Also, the step of recognizing a knocking gesture further comprises steps of: determining whether the peak generating time satisfies a second condition, if the peak generating time does not satisfies the first condition; and identifying the knocking gesture as a knocking gesture using a nail if the peak generating time satisfies the second condition. 
         [0022]    Implementations of the present invention can identify a knocking gesture by analyzing the signal characteristic of the acoustic wave generated when knocking a medium surface. 
         [0023]    In addition, implementations of the present invention reflect the physical properties of a knocking medium while using heuristics characteristic and so can reliably classify the knocking gesture. 
         [0024]    Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. 
     
    
     
       DRAWINGS 
         [0025]    In order that the disclosure may be well understood, there will now be described various forms thereof, given by way of example, reference being made to the accompanying drawings, in which: 
           [0026]      FIG. 1  is a block configuration diagram showing an apparatus for recognizing a user input. 
           [0027]      FIG. 2A  to  FIG. 2C  are graphs showing the signal characteristic depending on parts of a hand when knocking a medium. 
           [0028]      FIG. 3  is a flow chart showing a method for recognizing a user input. 
           [0029]      FIG. 4  is a flow chart showing a process for determining a knocking gesture shown in  FIG. 3 . 
       
    
    
     DETAILED DESCRIPTION 
       [0030]    Hereinafter, the present disclosure will be described in detail with reference to the drawings. 
         [0031]      FIG. 1  is a block configuration diagram showing an apparatus for recognizing a user input. 
         [0032]    As shown in  FIG. 1 , an apparatus for recognizing a user input includes a medium  110 , a sensor  120 , a converter  130 , an extractor  140  and a controller  150 . 
         [0033]    The medium  110  means a case (housing) which surrounds a part of a device. The medium  110  is manufactured through injection molding such as plastic and metal, etc. 
         [0034]    The medium  110  receives a knocking gesture of a user. Here, the knocking gesture means a motion to knock the surface of the medium  110  by using a specific part of a user&#39;s finger. The specific part includes a fingertip, a finger knuckle (joint) and a nail. 
         [0035]    The sensor  120  is attached via an adhesive or a special structure, etc. in the medium  110  and senses (measures) the acoustic wave signal generated by knocking the surface of the medium  110 . The sensor  120  includes an acceleration sensor, an acoustic wave sensor (for example, a microphone) and the like. 
         [0036]    The converter  130  serves to convert the analog signal measured by the sensor  120  into a digital signal. The converter  130  may be implemented by an analog-to-digital converter (AC-DC Converter). 
         [0037]    The extractor  140  processes an acoustic wave signal or a vibration signal. The extractor  140  separates an initial pulse signal from the acoustic wave signal. Here, the initial impulse signal means the first impulse signal of the acoustic wave signal sensed through the sensor  120 . 
         [0038]    The extractor  140  extracts the signal characteristics by analyzing the initial pulse signal. The signal characteristic includes a length (pulse duration time) and peak number of the initial pulse signal. 
         [0039]    The controller  150  recognizes the knocking gesture on the basis of the extracted signal characteristics, and generates and outputs a control signal for controlling the operation of the electrical component (not shown) in accordance with the recognition result. The electrical equipment (not shown) operates in response to a control signal output from the controller  150 . The electrical equipment (not shown) may be a navigation, audio, radio and the like. 
         [0040]    The controller  150  determines (recognizes) as the knocking gesture using a fingertip if the peak number of the initial pulse signal is two. 
         [0041]    On the other hand, the controller  150  classifies the knocking gesture according to the time when the peak is generated if the peak number of the initial pulse signal is one. The controller  150  identifies the knocking gesture as a knocking gesture using a finger knuckle if the time when the peak of the initial pulse signal is generated satisfies a first condition. And, the controller  150  identifies the knocking gesture as a knocking gesture using a nail if the time when the peak of the initial pulse signal is generated satisfies a second condition. 
         [0042]      FIG. 2A  to  FIG. 2C  are graphs showing the signal characteristic depending on parts of a hand when knocking a medium. 
         [0043]    The signal characteristic depending on the part of a hand is generated in the early period of the total signal. 
         [0044]    Referring to  FIG. 2A , the properties of the flesh and bones of the fingertip are shown in sequence when knocking by a fingertip. Since the flesh of the finger is thicker than other part and the flesh has viscoelastic properties, the length of the first signal is relatively long and the signal peak of the beginning of the initial signal is rounded. Since then, a sharp peak appears due to a finger bone characteristic. 
         [0045]    When the finger knuckle knocks the medium, as shown in  FIG. 2B , the finger knuckle does not include much flesh than the fingertip, and the characteristic of the bone appears larger than the finger. The viscoelastic property by the flesh appears weak at the beginning, and the acoustic/vibration component becomes a major component and so a sharp peak appears. The length of the first signal is relatively short in comparison with the fingertip. 
         [0046]    When knocking the medium by a nail, the nail has no flesh and hard contact is major contact. Thus, as shown in  FIG. 2C , the viscoelastic characteristic does not appear, the signal is generally sharp and the length of the first signal is very short. 
         [0047]    The present disclosure determines the knocking gesture by using the length of the signal and the peak number of the signal. 
         [0048]      FIG. 3  is a flow chart showing a method for recognizing a user input, and  FIG. 4  is a flow chart showing a process for determining a knocking gesture shown in  FIG. 3 . 
         [0049]    Referring to  FIG. 3 , firstly, an apparatus for recognizing a user input receives an acoustic wave signal generated by a knocking gesture on the surface of the medium  110  through the sensor  120  (S 110 ). For example, if a user knocks the surface of the medium  110  using a specific part of a finger, the sensor  120  measures the acoustic wave signal generated by knocking the surface of the medium  110 . 
         [0050]    The extractor  140  of the apparatus for recognizing a user input separates an initial pulse signal from the input (sensed) acoustic wave signal (S 120 ). The extractor  140  receives the acoustic wave signal measured by the sensor  120 , and separates a first pulse signal from the received acoustic wave signal. At this time, the converter  130  converts the acoustic wave signal input from the sensor  120  to a digital signal and outputs it to the extractor  140 . 
         [0051]    The extractor  140  extracts the signal characteristic from the separated signal (S 130 ). Here, the signal characteristic includes the length (duration time) and the peak number of the initial pulse signal. 
         [0052]    The controller  150  of a user input apparatus determines(recognizes) the knocking gesture based on the signal characteristic extracted by the extractor  140  (S 140 ). 
         [0053]    Next, knocking gesture determination process will be described in more detail. 
         [0054]    The controller  150  determines whether the peak number of the initial pulse signal is two (S 141 ). The controller  150  identifies the knocking gesture as a knocking gesture using a fingertip if the peak number is two (S 142 ). 
         [0055]    On the other hand, if the peak number of the initial pulse signal is not two in step  5141 , the controller  150  determines whether the peak number of the initial pulse signal is one (S 143 ). 
         [0056]    The controller  150  classifies the knocking gesture depending on the time which the peak is generated, if the peak number of the initial pulse signal is one. Here, the peak generating time (peak time) is represented by the ratio of the time (the duration time of the initial pulse signal after the peak is generated) from the peak generating time to the ending time of the initial pulse signal compared to the duration time of the initial pulse signal. In this embodiment, the example, which determines the peak generating time by using the ratio of the time from the peak generating time to the ending time of the initial pulse signal compared to the duration time of the initial pulse signal, is described, but it can be also implemented to use the ratio of the time from the starting time of the initial pulse signal to the peak generating time compared to the duration time of the initial pulse signal. 
         [0057]    The controller  150  determines whether the peak generating time of the initial pulse signal satisfies a first condition (S 144 ). For example, the controller  150  determines whether the peak generating time is less than 0.6%. 
         [0058]    The controller  150  identifies the knocking gesture as a knocking gesture using a finger knuckle if the peak generating time of the initial pulse signal satisfies the first condition (S 145 ). 
         [0059]    The controller  150  determines whether the peak generating time of the initial pulse signal satisfies a second condition, if the peak generating time of the initial pulse signal does not satisfies the first condition (S 146 ). For example, the controller  150  determines whether the peak generating time is more than 0.8%. 
         [0060]    The controller  150  identifies the knocking gesture as a knocking gesture using a nail if the peak generating time of the initial pulse signal satisfies the second condition (S 147 ). 
         [0061]    Then, the controller  150  generates the control signal corresponding to the recognized knocking gesture and transmits it to the corresponding electrical component (not shown). 
         [0062]    In the above description, the present invention has been described through the preferred embodiments and the applications, but the present invention is not limited to the embodiments and application, and various modifications can be made by those skilled in the art without departing from the gist of the present invention, and these modifications will be not to be understood individually from the technical spirit or prospect of the present invention.