Abstract:
A glove for use in collecting data for sign language recognition comprises: multiple azimuth sensors arranged on the glove at positions corresponding to the phalanges and metacarpal bones of the hand and used for sensing postures of the hand. The azimuth sensors are only arranged on the glove at positions corresponding to the phalanges of the hand other than the distal phalange in proximity to the fingertip of at least one finger among the middle finger, the index finger, the ring finger, and the little finger. The glove reduces the number of the azimuth sensors arranged on the glove at positions corresponding to the phalanges of the hand, thus reducing costs while not affecting detection performance.

Description:
FIELD OF THE INVENTION 
       [0001]    The present utility model relates to gloves, in particularly to gloves for acquiring data for sign language recognition. 
       BACKGROUND 
       [0002]    A normal person needs to understand sign language of a deaf-mute to accomplish communication between them at present. For a normal person who does not understand sign language of the deaf-mute, how to grasp the meaning expressed by the deaf-mute with sign language is a challenge for communication between them. 
         [0003]    At present there are data gloves specially designed for deaf-mute. By disposing azimuth sensors at positions corresponding to each phalange bone phalanx of hands on the data gloves, the azimuth of each section of phalanx is sensed; and by disposing azimuth sensors at positions corresponding to the metacarpal on the data gloves, the azimuth of a hand is sensed. Then the azimuths are sent to the central computer for processing. The central computer calculates bending angles between adjacent phalanxes and bending angles between the last section of phalanxes adjacent to the metacarpal and the metacarpal based on this to determine the sign language, and outputs the meaning in speech by for example a speaker, thereby realizing communication between a normal person and a deaf-mute. 
         [0004]    However, disposing azimuth sensors at positions corresponding to each phalanx of a hand on the data gloves is of high cost and requires large amount of calculation while processing. 
       SUMMARY 
       [0005]    One of the technical problems to be addressed by one aspect of the present utility model is to reduce the number of azimuth sensors disposed at positions corresponding to phalanxes on the gloves, thereby reducing costs without impacting the detection performance. 
         [0006]    According to one embodiment of the utility model, a pair of gloves for acquiring data for recognizing sign language is provided, comprising: a plurality of azimuth sensors for sensing hands&#39; poses disposed at positions corresponding to phalanxes and metacarpi on the gloves, wherein said azimuth sensors are only disposed at phalanx positions other than positions of first phalanxes near their tips of at least one finger in index finger, middle finger, ring finger and little finger corresponding to hands&#39; phalanxes on the gloves. 
         [0007]    According to one embodiment of the utility model, said azimuth sensors are only disposed at phalanx positions other than positions of first phalanxes near their tips of index finger, middle finger, ring finger and little finger corresponding to hands&#39; phalanxes on the gloves. 
         [0008]    According to one embodiment of the utility model,  &gt; said gloves further comprise a control unit for acquiring data of said azimuth sensors. 
         [0009]    According to one embodiment of the utility model, bags are disposed inside said gloves for accommodating said azimuth sensors. 
         [0010]    According to one embodiment of the utility model, bags are disposed outside said gloves for accommodating said azimuth sensors. 
         [0011]    According to one embodiment of the utility model, height sensors for sensing data for calculating hands&#39; heights are disposed on said gloves. 
         [0012]    According to one embodiment of the utility model, said height sensors are baroceptors. 
         [0013]    According to one embodiment of the utility model, said azimuth sensors disposed at positions corresponding to the metacarpi on the gloves are disposed on positions corresponding to two metacarpi. 
         [0014]    According to one embodiment of the utility model, sizes of parts in said gloves that correspond to phalanxes and palms of hands match sizes of phalanxes and palms of men or women. 
         [0015]    The present utility model found out that when a person&#39;s hands are making various gestures of sign language, the degrees of bending between phalanxes at finger tips and the second section of phalanxes from the tips are relatively constant, while the degrees of bending between other adjacent phalanxes or between the last phalanxes and their adjacent metacarpi are of large difference. Therefore, the former contributes less to the sign language identification than the latter. Therefore, in this embodiment, by removing azimuth sensors at positions of phalanxes at four finger tips, the effect of saving costs while substantially achieving the same accuracy of determining sign language. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0016]      FIG. 1  is a structure diagram of bones of a hand. 
           [0017]      FIG. 2  is a diagram of parameters required to define gestures of sign language of a hand found out by the present utility model. 
           [0018]      FIGS. 3 a - b    are diagrams of gloves when sign language recognition according to the first embodiment of the present utility model is implemented inside and outside gloves respectively. 
           [0019]      FIGS. 4 a - b    are diagrams of gloves when sign language recognition according to the second embodiment of the present utility model is implemented inside and outside gloves respectively. 
           [0020]      FIGS. 5 a - b    are structure block diagrams of gloves when sign language recognition according to embodiments of the present utility model is implemented inside and outside gloves respectively. 
           [0021]      FIGS. 6 a - d    show four schematic diagrams of incorporating azimuth sensors on gloves respectively. 
       
    
    
     DETAILED DESCRIPTION OF EMBODIMENTS 
       [0022]    Some preferred implementations of the present utility model will be described with reference to accompanying drawings. 
         [0023]      FIG. 1  is a structure diagram of bones of a hand. As shown in  FIG. 1 , There are three long and thin bones connected in sequence by joints in each of the 5 fingers, which are called phalanxes  101 , wherein the distal phalanx  101  of the thumb is inside the palm and may be considered as the last section of phalanx  101  of the thumb due to the less relevance between its movement range and The movement range of the palm&#39;s metacarpal. The four long and thin bones connected with the last phalanxes of the index finger, the middle finger, the ring finger and the little finger through joints are called metacarpal  102 , which is located in the palm and through its position it is possible to known the position and angle of the palm. Since the four metacarpi  102  are fixed in the palm, while making a gesture, their relative positions hardly change. Its azimuths on each axis in a triaxial (such as fore and aft, left and right, up and down) coordinate system, and in turn the position and angle of the whole palm, may be calculated from the position and angle of one of the metacarpi. 
         [0024]    As shown in  FIG. 2 , while characterizing one sign language gesture, it may be simply determined using the azimuth a of the hand (namely the angle relative to the line of gravity  1003 , the azimuth α of the palm being the azimuth of one metacarpal  102 , which may also be obtained by averaging azimuths of metacarpi  102  of course), bending angles β 2 , β 3  between adjacent phalanxes  101  on fingers, and bending angles β 1  between the last phalanxes  101  adjacent to the metacarpi  102  and the metacarpi  102 . That is, when the above-mentioned azimuth α, bending angles β 2 , β 3  and β 1  are determined, the sign language gesture of the hand is determined, hence the meaning its represents. The present utility model found out that in a sign language, making an action by hands in front of chest and making the same action by hands over head, namely making the same gesture by hands at different positions, might represent different meanings some times. Therefore, with prior art sign language recognition gloves, determining meaning of sign language only depending on gestures may make mistakes. 
         [0025]    An embodiment of the present utility model introduces a hand height index. As shown in  FIG. 2 , Height sensors  12  are disposed at positions of the back of hands on gloves of the present utility model for sensing the heights of hands H. Of course, the height sensors  12  may also be positioned at other positions on the gloves as long as they can measure heights of the gloves. The heights should be relative heights, such as heights relative to the waist of a person. By calculating heights of hands relative to waist, the gloves of the present application can estimate heights of hands relative to other parts of the user&#39;s body and enable more accurate understanding of gestures by the user. That is, meaning of a gesture of sign language is determined by the above-mentioned poses of hands and heights H of hands, thereby improving accuracy of determining meaning of sign language. A gesture is a combination of the poses and heights of hands that can correspond to a certain meaning in sign language. 
         [0026]    In addition, as shown in  FIG. 2 , a plurality of azimuth sensors  11  are disposed at positions corresponding to phalanxes and metacarpi on the gloves to acquire data for calculating azimuths of phalanxes and metacarpi for calculating azimuths of phalanxes and metacarpi. The bending angles β 2 , β 3  between adjacent phalanxes may be derived from respective azimuths of the adjacent phalanxes, and bending angles β 1  between the last phalanxes adjacent to the metacarpi and the metacarpi may be derived from azimuths of the last phalanxes and the metacarpi. 
         [0027]    The above-mentioned azimuth data generally refers to all data that may be used to calculate azimuths of the carrier, such as the carrier&#39;s angular velocity, acceleration etc., from all of which the carrier&#39;s azimuth may be obtained. The azimuth data may be obtained by a triaxial micro-gyroscope, a triaxial micro-acceleration sensor and a triaxial terrestrial magnetism sensor wherein these three kinds of azimuth sensors may be used separately or in combination with the specific use manner as follows. 
         [0028]    In the first implementation, the azimuth sensor may only include the above-mentioned triaxial micro-gyroscope. 
         [0029]    In the second implementation, the azimuth sensor may only include the above-mentioned triaxial micro-acceleration sensor. 
         [0030]    In the third implementation, the azimuth sensor includes the above-mentioned triaxial micro-gyroscope and the triaxial micro-acceleration sensor for measuring angular speed in the three coordinate axes&#39; directions and measuring accelerations in said three coordinate axes&#39; directions. In this approach, one azimuth γ a  can be calculated from the angular speed, one azimuth γ b  can be calculated from the acceleration and the last azimuth may be calculated by weighting, γ=kγa+(1-k)γb (wherein 0≦k≦1). The precondition for dosing so is that the triaxial micro-gyroscope and the triaxial micro-acceleration sensor use the same three-axis reference system. Triaxial micro-acceleration sensor features its sensitivity to noise, however it will not suffer result drifting since it&#39;s not influenced by result of the previous frame. While a triaxial micro-gyroscope features its insensitivity to noise, however suffers result drifting since it&#39;s influenced by previous frame and requires an initial azimuth. Therefore, this kind of approach combines advantages of these two approaches, achieving beneficial effects that it&#39;s both unlikely sensitive to noise and unlikely influenced by previous frames. 
         [0031]    In the fourth implementation, azimuth sensors further include triaxial terrestrial magnetism sensors in addition to the above-mentioned triaxial micro-gyroscopes and the triaxial micro-acceleration sensors. 
         [0032]    The height sensors  12  of the present utility model are baroceptors, and of course may be implemented with other height sensors. In the implementation of baroceptor, it senses exterior air pressure. The air pressure is different at different heights and is used to calculate the height of a hand. The aforementioned height H may be calculated by subtracting the absolute height of waist relative to sea level from the absolute height of a hand relative to sea level. In this way, it is possible to measure the height of a hand relative to other parts of the body to determine meaning of a gesture of sign language. While in use, before the user makes a gesture of sign language, the hand wearing glove is first put at the waist to measure the absolute height of waist. Then a corresponding gesture of sign language is made. When the value of height is required, the relative height of hand is derived by subtracting the absolute height of waist from the absolute height of hand. In this way, it is possible to calculate relative height of the hand that makes the gesture of sign language. 
         [0033]    The meaning of gesture of sign language determined by gloves of the present application may be output as speech via a loudspeaking unit on the gloves or may be displayed as characters on a display on the gloves. It is also possible to output the meaning through other equipments to enable a deaf-mute to communicate with a normal person. 
         [0034]      FIGS. 3 a -3 b    are diagrams of gloves  1  when sign language recognition is according to the first embodiment of the present utility model is implemented inside and outside gloves respectively. In the first embodiments, no azimuth sensor is disposed at positions corresponding to phalanxes at tips of the four fingers on the gloves. This is because the present utility model found out that when a person&#39;s hands are making various gestures of sign language, the degrees of bending between phalanxes at finger tips and the second section of phalanxes from the tips are relatively constant, while the degrees of bending between other adjacent phalanxes or between the last phalanxes and their adjacent metacarpi are of large difference. Therefore, the former contributes less to the sign language identification than the latter. Therefore, in this embodiment, by removing azimuth sensors at positions of phalanxes at four finger tips, the effect of saving costs while substantially achieving the same accuracy of determining gesture. Although  FIGS. 3 a - b    show no azimuth sensor is disposed at positions corresponding to phalanxes at four finger&#39;s tips on the gloves, it is possible not to dispose azimuth sensor at positions corresponding to phalanxes at any one, any two or any three finger tips. 
         [0035]    The gloves  1  in the present embodiment include  12  azimuth sensors  11   a ,  11   f - 11   o ,  11   q  and a height sensor  12  (however the height sensor  12  is not necessary, as described in connection with  FIG. 2 , there is also an implementation of identifying sign language only according to data acquired by the azimuth sensors). Azimuth sensors disposed at positions corresponding to phalanxes on the gloves are disposed at positions corresponding to phalanxes on the gloves, and the azimuth sensor  11   q  is disposed at the position corresponding to the metacarpi. The height sensor  12  is used to sense height data of a hand. In  FIG. 3 a   , the control unit  13  receives data sensed by said plurality of azimuth sensors and the height sensor. As shown in  FIG. 5 a   , the control unit  13  is coupled with a transceiver module  135  that transmits data sensed by said plurality of azimuth sensors and the height sensor to an external processor  201  for recognizing gestures of sign language. The recognized gestures of sign language are converted into speech and output through a output unit  202  such as a speaker or a display. 
         [0036]    In  FIG. 3 b   , the output unit  202  is coupled to said control unit  13  for converting gestures of sign language recognized by the control unit  13  as described in connection with  FIG. 2  into speech or characters and outputting them. The principle is shown in  FIG. 5   b.    
         [0037]    In  FIG. 3 a -3 b   , only an azimuth sensor  11   q  is disposed at the position corresponding to the metacarpal connected with the middle finger on the gloves. Disposing an azimuth sensor only at a position corresponding to one metacarpal is because that when a hand is making various poses, the differences among metacarpi are not as significant as the difference among azimuths of phalanxes and therefore it is possible to save costs by disposing an azimuth sensor only at a position corresponding to one metacarpal. 
         [0038]    Of course, it is possible to dispose said azimuth sensor disposed at positions corresponding to the metacarpi on the gloves on positions corresponding to more than one metacarpi. In this way, it is possible to obtain azimuth of each metacarpal in said at least two metacarpi and calculate an average value of the obtained azimuths as the azimuth of the hand, which allows the obtained azimuth to be more accurate, and reduces gesture recognition error caused by minute difference among azimuths of metacarpi in fact when disposing only one azimuth sensor at the position corresponding to one metacarpal. Of course, it is also possible to dispose azimuth sensors at positions on four metacarpi. In addition, it is also possible to dispose azimuth sensors at positions corresponding to 2 or 3 metacarpi on the gloves. Preferably, azimuth sensors are disposed at positions corresponding to 2 metacarpi on the gloves. As shown in  FIG. 4 a -4 b    according to the second embodiment of the present utility model, the error caused by disposing an azimuth sensor only at a position corresponding to one metacarpal and the cost is saved to the maximum extent. 
         [0039]      FIGS. 5 a - b    are structure block diagrams of gloves when sign language recognition according to embodiments of the present utility model is implemented inside and outside gloves respectively.  FIG. 5 a    generally shows a case corresponding to  FIGS. 3 a , 4 a   , and  FIG. 5 b    generally shows a case corresponding to  FIGS. 3 b   ,  4   b.    
         [0040]    Fastness of azimuth sensors  11  on gloves may be implemented in a plurality of ways. As shown in  FIG. 6 a   , there are bags  199  at positions for mounting azimuth sensors  11  on the inner sides of gloves for accommodating azimuth sensors  11 . As shown in  FIG. 6 b   , the azimuth sensors  11  are glued at inner wall of the gloves. As shown in  FIG. 6 c   , there are bags  199  at positions for mounting azimuth sensors  11  on the outer sides of gloves for accommodating azimuth sensors  11 . As shown in  FIG. 6 d   , the azimuth sensors  11  are glued at outer wall of the gloves. There are also other mounting manners. 
         [0041]    In addition, in the gloves  1 , sizes of parts corresponding to phalanxes and palms match sizes of phalanxes and palms of men or women respectively, thereby forming gloves  1  suitable for men or women respectively and avoiding the problem of sensing data at error positions by azimuth sensors or height sensors since inconsistency between men and women&#39;s hands. 
         [0042]    Although the present utility model described herein with reference to specific implementations, the scope of the present utility model is not limited to the illustrated details. It is possible to make various modifications in these details without departing from the basic principle of the present utility model and all these modifications fall within the scope of the present utility model.