Source: https://patents.google.com/patent/CN103529976B/en
Timestamp: 2019-12-08 08:19:51
Document Index: 114387253

Matched Legal Cases: ['art 400', 'art 400', 'art 400', 'art 400', 'art 500', 'art 500', 'art 400', 'art 600', 'art 600', 'art 500', 'art 600', 'art 600', 'art 600', 'art 700', 'art 700', 'art 500', 'art 700', 'art 700']

CN103529976B - Interference in gesture recognition system is eliminated - Google Patents
Interference in gesture recognition system is eliminated Download PDF
CN103529976A (en
In general, the interference that the disclosure is described in gesture recognition system is eliminated.A kind of method can include：The preprocessor that gesture-type configures gesture recognition module is based at least partially on, gesture recognition module is related to gesture；Respond the first touch event generation first and contact history vectors, the first touch event is based on the first contact to touch-screen；First touch event is provided and arrives gesture recognition module；And be based at least partially on gesture-type to determine whether to provide the second touch event to gesture recognition module.
Following discloses are related to gesture recognition system, are eliminated more specifically to the interference in gesture recognition system.
Including in many mobile devices including such as smart phone and tablet PC, touch-sensitive display provides use Family interface.For example, icon can be shown to user, and user can select icon by clicking on icon, and/or user can With another to show by sliding or sweeping away and (that is, place a finger on display, and rapidly leftward or rightward mobile finger) Page icon.User's input (" gesture ") generally includes one or more contacts to touch-sensitive display.It is then possible to capture and solve Every kind of contact is released, so as to produce response.Conventional gesture includes click (tap), length and hits (long tap) and (also referred to as pin (press) or click on do not put (tap and hold)), mediate and (pinch) and sweep away (swipe).Gesture identification generally includes inspection Survey one or more contacts, the position of contact, the duration of contact and/or motion.Gesture identification is dependent on user to gesture Appropriate performance.If before gesture identification process and/or period user inadvertently or inadvertently contacts touch-sensitive display (" interference "), then may occur unexpected result.Such unexpected result may be because of causing unexpected result or harm Hinder desired result and cause the Consumer's Experience of decline.
The present invention relates to a kind of system, including：
Touch-screen, it is configured to receive contact and generates touch event based on the contact received；
Processor circuit, it is configured to execute instruction；And
One or more storage mediums, individually or are in a joint manner stored with one or more of storage mediums Instruction, the instruction causes following operation when being performed by one or more processors, and these operations include：
It is based at least partially on the preprocessor that gesture-type configures gesture recognition module, the gesture recognition module and hand Gesture is related；
Respond the first touch event generation first and contact history vectors, first touch event is based on to the touch-screen First contact；
First touch event is provided and arrives the gesture recognition module；And
It is based at least partially on the gesture-type and knows to determine whether to provide the second touch event to the gesture Other module.
The present invention relates to a kind of method, including：
Respond the first touch event generation first and contact history vectors, first touch event is based on the to touch-screen One contact；
The present invention relates to a kind of system, including one or more storage mediums, on one or more of storage mediums Individually or be in a joint manner stored with instruction, and the instruction causes following operation when being performed by one or more processors, These operations include：
The elaboration of refer to the attached drawing combination following description, it is desirable to each embodiment of the subject matter of right Feature and advantage will become obvious, in the accompanying drawings, and similar numeral refers to similar part, and wherein：
Fig. 1 shows to include the exemplary device of the example interference cancelling system according to each embodiment of the disclosure；
Fig. 2A shows the example of the interference cancelling system of one embodiment according to the disclosure；
Fig. 2 B show the example of the contact legacy system according to one embodiment of the disclosure；
Fig. 2 C show the example of the preprocessor of each embodiment according to the disclosure；
Fig. 3 shows the state transition diagram of the gesture recognition module of at least one embodiment according to the disclosure；
Fig. 4 is the flow chart of the exemplary operations of the gesture identification of at least one embodiment according to the disclosure；
Fig. 5 is the flow chart of the exemplary operations eliminated according to the interference of at least one embodiment of the disclosure；
Fig. 6 is the example behaviour eliminated according to the interference of the response TouchStart events of at least one embodiment of the disclosure The flow chart of work；And
Fig. 7 is disappeared according to the interference of the response TouchMove or TouchEnd events of at least one embodiment of the disclosure The flow chart for the exemplary operations removed.
Although following description will be illustrated with reference to an illustrative embodiment, those skilled in the art It will be apparent to its many alternative, modifications and variations.
In general, the disclosure describes a kind of interference elimination method and system for gesture recognition system.User can be with Touch and (that is, contact) the touch-sensitive display for being configured to the contact generation touch event that capture contacted and be based at least partially on capture Device.Interference cancelling system can pre-process touch event based on the gesture-type of the gesture recognition module of association.It is then possible to Touch event output based on preprocessor result is provided to the gesture recognition module to association.Gesture recognition system can include One or more gesture recognition modules.Each gesture recognition module is configured to recognize a gesture.Can be to each gesture and right The gesture recognition module answered is independent and concurrently handles touch event.
This method and system configuration are contacted into detection to the careless of touch-sensitive display (that is, touch-screen) and/or unintentionally, and Avoid causing unexpected result by these interference contacts (noise contact).In the first example, interference contact may occur Before the intentional starting of gesture identification process, so as to upset subsequent gesture identification process.In this first example, in such as hand When holding the device including touch-screen, user may inadvertently contact the corner of touch-screen.This contact may hinder follow-up Gesture is identified, so as to cause without response or incorrect response.In the second example, interference contact is likely to occur in gesture knowledge During other process.In this second example, when performing gesture, user may inadvertently be connect with one or more of the other finger Touch touch-screen.This careless contact may cause to stop current gesture identification process or may cause the gesture state of mistake. Meet the disclosure interference cancelling system and method be configured to reduce user careless contact upset gesture identification process it is general Rate." gesture identification process " used herein represents to explain touch event with based on one or more contacts to touch-screen Feature determines corresponding gesture.
Meet disclosed method and system configuration into according to based on gesture feature (that is, the spy of the contact associated with gesture Levy) each gesture classification for will being associated with corresponding gesture recognition module of gesture-type.Gesture feature includes continuing for contact The distance between initial position and proximal most position of time and/or contact.For example, gesture-type 1 corresponds to relatively short Duration and the contact do not moved, for example click on.Gesture-type 2 corresponds to the relatively long duration and not moved Dynamic contact, such as length are hit.Gesture-type 3 corresponds to mobile contact (that is, from its initial contact location traveling non-zero distance Contact), for example mediate.Each gesture recognition module can be configured according to gesture-type by meeting the system and method for the disclosure Corresponding preprocessor.
This method and system configuration into generate and store the contact each detected contact history (that is, contact history to Amount).Contact start (TouchStart) can be responded and create contact history vectors, while contact continues (for example, TouchMove or time) update contact history vectors, and the deletion contact history vectors when contact terminates (TouchEnd).Often Individual contact history vectors can be based at least partially on touch event data and/or time (for example, time interval is expired) to create Build and/or update.Each touch event can be included with contacting the corresponding x in position on the touchscreen, y-coordinate and with contacting The timestamp of association.Contact history vectors are configured to include the x of contact initial position, y-coordinate and closed with contacting initial position The timestamp of connection, the x of nearest contact position, y-coordinate and with proximal most position associate timestamp, contact duration, with And contact moves on to total distance of nearest contact position from contact initial position.Position can be by the x, the y-coordinate that are associated with touch-screen To represent.
It is then possible to by it before it will be provided with each touch event for contacting association to corresponding gesture recognition module Preprocessor is provided., can be with based on contact history, the quantity and/or gesture-type of (that is, the simultaneous) contact of activity Touch event is provided without modification and arrives corresponding gesture recognition module, or can be changed by described herein Touch event.
Therefore, meet disclosed method and system configuration into will effectively contact with interference (being not intended to) contact differentiation.This is System and method are configured to avoid hindering gesture identification, and avoidance breakout hand in progress when disturbing contact to be not present Gesture.The system and method are configured to from multiple candidates contact select effectively contact, and by with effectively contacting the touch thing associated Part, which is provided, arrives gesture recognition module.In certain embodiments, corresponding touch event can will be contacted with interference to provide to gesture Identification module.Gesture-type and contact characteristic are based at least partially on, effective contact can be identified, can be replaced with effectively contact Interference contact, then can will arrive gesture recognition module with the touch event offer for effectively contacting association.In certain embodiments, Gesture-type can be based at least partially on and select best available from multiple possible effective contacts with the contact characteristic associated Contact.In this way, it is possible to prevent interference contact from causing carelessly or unintentionally, gesture is identified.
Fig. 1 shows the device 100 for including meeting the example interference cancelling system of each embodiment of the disclosure.For example, dress Put 100 can include computing device, including but not limited to desktop computer, laptop computer, tablet PC (for example,Deng), ultra portable computer, super mobile computer, netbook computer, small notebook meter Calculation machine, mobile phone, smart phone (for example,It is based onPhone,Base InPhone, be based onPhone etc.), characteristic phone, personal digital assistant, mathematic for business assistant, move Dynamic internet appliance, personal navigation apparatus etc..
Device 100 includes processor circuit 102, memory 104, touch-screen 106 and display 108.Memory 104 is configured to deposit Storage operating system OS120 (for example, Deng), one or more application (" app ") 122, one or more gesture recognition modules 124 and interference cancelling systems 126.Interference Elimination system 126 includes contact history 128 and one or more preprocessors 130.In certain embodiments, contact can be gone through History 128 is included in each preprocessor.Processor circuit 102 can include one or more processors, and be configured to hold Row and OS120, app122, gesture recognition module 124, the operation for contacting history 128 and the association of preprocessor 130.
Contact history 128 is configured to storage with contacting corresponding contact history vectors.Can respond contact start (for example, In response to TouchStart events) and will contact history vectors initialization.(with the contacting association) time can be based on and/or another Individual touch event updates contact history vectors for the duration of contact.It is then possible to terminate in contact (for example, TouchEnd events) when contact history vectors are resetted into (for example, delete).
Preprocessor 130 is configured to receive touch event from touch-screen 106 and receives gesture from gesture recognition module 124 State.As described herein, preprocessor 130 be configured to be based at least partially on contact history 128, touch event, Gesture-type and gesture state export to provide touch event.
Touch-screen 106 is configured to capture with contacting the touch of association, including but not limited to click on (for example, click, double-click, It is long to hit and (that is, click on and do not put) etc.), mediate and deploy, sweep away, and based on the contact output touch event captured.Touch Event can include contact position, such as with contacting the corresponding x in position, y-coordinate on the touchscreen.Touch event can also be wrapped Include time parameter, for example the time corresponding timestamp with detecting contact.Timestamp can be responded contact to carry by OS120 For.Display 108 includes being configured to show text, still image, mobile image (for example, video), user interface, figure etc. Any device.Touch-screen 106 and display 108 can be integrated into touch-sensitive display 110.Touch-sensitive display 110 can collect Into in device 100, or can be via wired (for example, USB (USB), Ethernet, live wire etc.) or wireless (example Such as, WiFi, bluetooth etc.) communicate interacts with device.
Gesture recognition module 124 is configured to receive touch event, and determines the contact of the touch event association with being received Whether pre-defined gesture is corresponded to.Gesture can include one or more contacts.Can based on such as duration and/or Move to characterize contact.Gesture recognition module 124 can include general definition clearly and can be operated to determine what is received Whether touch event corresponds to the gesture identification generation of customization, proprietary, the known and/or rear exploitation of pre-defined gesture Code (or instruction set).Generally, each gesture recognition module is configured to determine (that is, " identification ") gesture.For example, clicking on gesture Module is configured to identification point hitter's gesture, and kneading gesture module is configured to recognize kneading gesture, and the long gesture module that hits is configured to identification Long hitter's gesture, etc..
Fig. 2A shows the example of the interference cancelling system 202 according to one embodiment of the disclosure.The interference cancelling system 202 may be coupled to touch-screen 204 and multiple gesture recognition modules (GRM) 206A ..., 206P.Touch-screen 204 corresponds to Fig. 1 In touch-screen 106.As described herein, touch-screen 204 is configured to capture and (that is, receives) one or more contacts, i.e. Contact 1 ..., contact n, and touch event is generated based on the contact that is captured.It is maximum that touch-screen 204 can be configured to capture The contact occurred while quantity, i.e. started (initiate) but still unclosed contact.For example, the maximum number of contact Amount can be n.
Interference cancelling system 202 is configured to receive touch event input from touch-screen 204, and is based at least partially on touch Event input provides the output of one or more touch events to corresponding (that is, by the touch event of pretreatment) GRM206A、...、206P.Interference cancelling system 202 be configured to from each GRM206A ..., 206P receive corresponding gesture State.Each GRM206A ..., 206P be configured to be based at least partially on the process received from interference cancelling system 202 in advance from The touch event of reason exports to generate corresponding gesture.For ease of description, " GRM206 " used herein refers to that gesture is known Other module 206A ... or 206P any of which one.Letter will be included when mentioning specific GRM, for example, GRM206A refers to First gesture recognition module, GRM206B refers to second gesture recognition module, etc..
Interference cancelling system 202 includes at least one contact legacy system 210 and one or more preprocessors 220A、...、220P.Contact legacy system 210 is configured to receive touch event input from touch-screen 204.Contact legacy system 210 be configured to be based at least partially on touch event input will contact historical data provide to preprocessor 220A ..., 220P.In certain embodiments, contact legacy system 210, which can be configured to provide touch event input, arrives preprocessor 220A、...、220P.In certain embodiments, touch event input data can be provided to preprocessor from touch-screen 204 220A、...、220P。
In one embodiment, contact legacy system 210 can for all preprocessor 220A ..., 220P makes With.In another embodiment, each preprocessor 220A ..., 220P can include and/or be coupled to corresponding contact and go through History system 210.In the present embodiment, contact legacy system 210 can be recycled and reused for each preprocessor 220A ..., 220P. For ease of description, it is used herein " preprocessor 220 " refer to preprocessor 220A ... or 220P any of which one It is individual, and preprocessor 220A refers to first preprocessor, and preprocessor 220B refers to second preprocessor, etc..Often Individual preprocessor can be associated with corresponding GRM.For example, preprocessor 220A is associated with GRM206A, preprocessor 220B with GRM206B is associated, and the rest may be inferred.
Fig. 2 B show the example of the contact legacy system 210 according to one embodiment of the disclosure.Contact legacy system 210 Including contact history module 212 and one or more contact history vectors 214A ..., 214N.Each contact history vectors 214A ..., 214N correspond to corresponding contact.Therefore, the maximum quantity of contact history vectors corresponds to possible contact most Big quantity n.As used herein, " contact history vectors 214 " be abutment history vectors 214A ... or 214N its In any one.Contact history module 212 is configured to respond to newly contacting corresponding touch event initialization contact history vectors 214, response subsequent touch event (and/or time interval is expired) updates contact history vectors 214, and response terminates with contact Corresponding touch event deletes contact history vectors 214.Each contact history vectors, which can include being configured to identifying most n kinds, to be connect The mere contact identifier (" contact ID ") of every kind of contact in touching.
Four elements can be included by meeting the contact history vectors 214 of the disclosure.First element includes the initial of contact and touched Touch event (for example, TouchStart) x, y-coordinate and timestamp.X of the second element including the recent renewal with contacting association, Y-coordinate and timestamp.Updating can be triggered because being expired time interval and/or receives subsequent touch event.Third element Duration including contact, i.e. the difference of the timestamp of recent renewal and the timestamp of initial touch event.Fourth element includes Total distance with contacting association.Total distance can be defined as to position and the intermediate touch thing associated with initial touch event Incremental distance sum between the position of part (if any) association and the position associated with recent renewal.Therefore, it can will Contact ID is expressed as the contact history vectors H of Contact ID contact：
H (Contact ID)={ Io(xo, yo, to)；Iq(xq, yq, tq)；(tq-to)；DT}
Wherein I0 corresponds to TouchStart events, x0And y0It is x, the y-coordinate of the initial contact location of this contact, and t0Corresponding to the timestamp of TouchStart events, IqCorresponding to recent renewal, and xqAnd yqIt is the contact position of recent renewal Coordinate, and tqCorresponding to the timestamp of recent renewal, and DT (for example, amounting to Euclidean distance) can be defined as：
Wherein i corresponds to updates (i=q) up to date with contacting the TouchStart events (i=0) that start from of association Each touch event.
Therefore, contact history 210 can include most n contact history vectors 214A ..., 214N, these contact history Vector includes touch event information and is configured to allow for each preprocessor and selects what is effectively contacted to continue from multiple contacts Time and range data.As described herein, each preprocessor is configured to be based at least partially on corresponding gesture The gesture-type of identification module come select effectively contact.
Fig. 2 C show the example of the preprocessor 220 according to each embodiment of the disclosure.Preprocessor 220 includes pre- place Device module 222 is managed, and is configured to storage gesture-type 224, effectively contact list 226 and candidate's contact list 228.Gesture class Type is related to the feature that the gesture recognition module associated is configured the gesture to be recognized.As described herein, can be dry Disturb during the initialization procedure of elimination system 202 using gesture-type come configuration preprocesor 220.
As described herein, it is possible to use gesture-type and the metric associated with gesture-type (that is, contact special Levy) contacted to distinguish effective contact with interference, candidate's contact is reclassified effectively to contact, and/or contact from multiple candidates The middle best available contact of selection.Table 1 includes gesture-type and the measurement associated.
The measurement (distance and duration) listed in table 1 corresponds to third and fourth yuan contacted in history vectors 214 Element.Preferred contact characteristic of these measurements corresponding to the gesture-type of association.For example, the measurement associated with gesture-type 1 is most Small distance and minimum length in time.Click is the example of the gesture of gesture-type 1.Therefore, including very little movement or do not move and Duration relatively short contact can correspond to the gesture of gesture-type 1.The measurement associated with gesture-type 2 is most narrow spacing From and maximum length in time.The long example for hitting the gesture for being gesture-type 2.Therefore, including very little movement or do not move but pass through Cross the gesture that the contact that at least minimum interval just terminates can correspond to gesture-type 2.The measurement associated with gesture-type 3 For ultimate range.Kneading is the example of gesture-type 3.Including mobile contact can correspond to the hand of gesture-type 3 therefore, Gesture.
The characteristic use gesture-type that the gesture associated with corresponding gesture recognition module can be based at least partially on is come Configure each preprocessor.It can come to select effectively contact in contacting from multiple candidates with the relative value of utilization measure.For example, for The gesture of gesture-type 2, can be based at least partially on the relative duration of multiple candidate's contacts to connect from this multiple candidate The best available contact of selection in touching.For example, as best available contact can be elected duration most long candidate's contact.Another In individual example, if gesture-type is gesture-type 3 and has two movable contacts (for example, the first contact and second contact), If contacting the DT that the DT in the contact history vectors of association is more than in the contact history vectors that association is contacted with second with first, Then elect the first contact as effective contact.Therefore, it is possible to use the measurement that the contact history vectors based on association are determined is relative Value to select effectively contact in contacting from multiple candidates.
Preprocessor 220 is configured to receive touch event input, contact historical data and the (gesture recognition module of association ) gesture state and provide touch event output.Effectively contact list 226 is configured to storage corresponding to the one of such contact Individual or multiple contact ID, these contacts may be effective for gesture corresponding with the gesture recognition module of association.As hereafter will It is more fully described, if interference contact is first contact for starting gesture identification process, interference can be initially contacted It is stored in effectively contact list.It is the contact ID of m that effectively contact list 226, which is configured to stored number,.Quantity m can be based on The quantity of included contact in correspondence gesture.For example, can correspond to size using the kneading gesture of two kinds of contacts for two kinds Effective contact list of contact.Candidate's contact list 228 is configured to one or more contacts that storage corresponds to such contact ID, these contacts are probably interference or may be effective for gesture corresponding with the gesture recognition module of association.Candidate contacts List 228 is configured to the contact ID that stored number subtracts m for n, wherein n be can the contact of some time point activity maximum number Amount.As described herein, watermark pre-processor 222 is configured to be based at least partially on touch event input data, contact Historical data, gesture-type 224 and/or gesture state come determine touch event export.
Therefore, interference cancelling system 202 is configured to receive touch event input from touch-screen 204, and generation contacts history, and And touch event input, contact history, corresponding gesture-type and corresponding gesture state are based at least partially on by accordingly Touch event output data provide to each gesture recognition module 206A ..., 206P.Interference contact can be detected, and can be with Contacted with the touch event with effectively contacting association to replace interference.
Fig. 3 shows that the state of the gesture state associated according at least one embodiment of the disclosure with gesture recognition module turns Become Figure 30 0.Gesture state corresponds to the gesture identification status of processes performed by gesture recognition module (for example, GRM206)." enter In row (ongoing) " be for example, determine whether by touch event export provide to associate gesture recognition module when and/or The feature for the gesture state that preprocessor is utilized when being made a distinction between effective contact is contacted with interference.Gesture state " is opened Dynamic (Started) " can be characterized as " in progress ".Gesture state " updating (Updated) " is characterized as " in progress ".For not having There is the gesture of more new state, for example, click on, gesture state " startup " is characterized as " in progress ".For the hand with more new state Gesture, for example, mediated, and gesture state " renewal " is characterized as " in progress ".Gesture with more new state is in " startup " at them Whether " in progress " is characterized as during state depending on gesture.
Gesture state " without (None) " 302 corresponds to the gesture identification process not yet started.In the state of "None" 302, first Preceding gesture identification process has terminated 310 and/or has cancelled 312.Depending on gesture, response promotes to generate TouchStart events New contact, gesture state or can not be converted to " startup " 304.For example, length is hit gesture recognition module and can not stood It is converted to " startup " in response to TouchStart events.But, it is long to hit after gesture state pass by certain time intervals It is converted to " startup " state.Being configured so that allows click to occur without triggering identification process in gesture recognition module in long hit.
Gesture state in " startup " 304 can be converted to " cancellation " 312 or can be converted to " renewal " 308.For example, For long hitter's gesture and the gesture state of the association of " startup ", after passing by certain time intervals, gesture state can be from " opening It is dynamic " 304 it is converted to " renewal " 308.In another example, the hand associated with including mobile gesture (for example, kneading gesture) The gesture state of gesture identification module can respond the movement contacted on the touchscreen and be converted to " renewal " 308 from " startup " 304. In this example, as long as mobile continue, then gesture state can keep " updating " 308.Gesture state can respond TouchEnd Event (for example, contact terminate) and be converted to " end " 310 from " renewal " 308.As additionally or alternatively, if such as gesture pair Should be in another gesture recognition module, then gesture state can be converted to " cancellation " 312 from " renewal " 308.
For clicking on, gesture identification can be functioned differently.Click is the contact of relatively short duration, for example Tapped corresponding to mouse.In certain embodiments, clicking on gesture recognition module can be until receiving TouchEnd touch events When be just converted to starting state (that is, " startup " 304).When contact start, clicking on gesture recognition module can receive TouchStart events, and TouchEnd is received if clicked on before gesture recognition module terminates at certain time intervals, " startup " can be converted to gesture state and continue another time interval by then clicking on gesture recognition module, be then converted to again TouchEnd.Then, when gesture state is in " startup ", gesture can be will click on and be characterized as " in progress ".Therefore, depend on Gesture, the gesture recognition module of association can not make an immediate response TouchStart events and be converted to gesture state " startup ". Time interval can be based at least partially on by being converted to " startup " (in the event of if).
The interference cancelling system for meeting the disclosure is configured to the gesture state associated in gesture recognition module corresponding to " progress In " (that is, gesture state be in " startup " or " renewal ") when do not interrupt gesture recognition module." in progress " mean OS and/or App may respond recognized gesture.Consumer's Experience may be unfavorable for by suspending this process when underway, therefore should be kept away Exempt from.
Fig. 4 is the flow chart 400 of the exemplary operations of the gesture identification of at least one embodiment according to the disclosure.Flow chart 400 show usual gesture identification process.The gesture identification process shown in flow chart 400 can be by one or more gesture identifications Mould determines to perform.Program circuit can start when detecting incoming event (for example, contact causes touch event) 402.In behaviour Make at 404, touch event can be distributed gesture recognition module.At operation 406, it may be determined that event type.Event class Type includes TouchStart, TouchMove and TouchEnd.The new contact that TouchStart corresponds on touch-screen 204. The position that TouchMove corresponds to existing contact changes.TouchEnd corresponds to contact and no longer touches touch-screen 204 (for example, just Touch-screen is lifted off in the finger for touching touch-screen).If event type is TouchStart, it can operate at 408, Handle TouchStart events.If event type is TouchMove, TouchMove things can be handled at operation 410 Part.If event type is TouchEnd, TouchEnd events can be handled at operation 412.Operation 414 can include Update gesture state and store result.Gesture recognition module can be independently of incoming event the touch event from touch-screen also It is the operation that the output of the touch event by pretreatment from corresponding preprocessor carrys out execution flow chart 400.
Fig. 5 shows to meet the flow chart 500 of the exemplary operations of embodiment of the disclosure.Can be by for example contacting history module 212 and preprocessor 220 come perform these operation.Specifically, flow chart 500 is described and is configured to hold in gesture recognition system The demonstration that row interference is eliminated.Program circuit can start to start at 502.Operation 504 includes being based at least partially on hand Gesture type configures each preprocessor with the contact quantity m of the gesture of the gesture recognition module associated accordingly.For example, can be with Contact quantity with the gesture-type corresponding to gesture-type 1 and equal to 1 come configure with click on that gesture recognition module associates it is pre- Processor.In another example, it can be configured with the contact with equal to 1 of the gesture-type corresponding to gesture-type 2 quantity The preprocessor that gesture recognition module is associated is hit with length.In another example, the gesture class corresponding to gesture-type 3 can be used Type and contact quantity equal to 2 configure the preprocessor associated with kneading gesture identification module.
At operation 506, touch event can be received.Touch event can be based on contact, and can include contact X, y-coordinate and the timestamp with contacting association.At operation 508, it may be determined that touch event type.For example, touch event class Type can include TouchStart, TouchMove and TouchEnd.Operation 510 includes pre-processing based on touch event type Touch event.Operation 510 can simultaneously be performed by multiple preprocessors, wherein each preprocessor and corresponding gesture identification mould Block is associated.At operation 512, the touch event output by pretreatment can be provided and arrive gesture recognition module.By pre- place Reason touch event output whether correspond to received touch event can be based at least partially on received touch event, Gesture-type and gesture state.Then, program circuit may proceed to operation 506.
Therefore, the touch event received can be produced may not whole multiple touch event outputs of identical.Can be by Each corresponding touch event output provides the gesture recognition module to association.Then, each gesture recognition module can be utilized Touch event output from preprocessor corresponding with the incoming event of detection at operation 402 carrys out the behaviour of execution flow chart 400 Make.
Fig. 6 is the exemplary operations that the interference for responding TouchStart events according at least one embodiment of the disclosure is eliminated Flow chart 600.The operation of flow chart 600 corresponds to when event type is that TouchStart (that is, gives birth to when starting new contact Into) when flow chart 500 in operation 510 and operation 512.The operative configuration of flow chart 600 is in progress into avoidance breakout Gesture, and avoid in the absence of interference contact when upsetting usual gesture identification.Program circuit can be from such as touch-screen 204 start when receiving TouchStart events.
Operation 602 includes initializing the contact history newly contacted.For example, operation 602 can be included for new contact generation Contact history vectors simultaneously store the contact history vectors.At operation 604, it may be determined that the gesture of the gesture recognition module of association Whether state corresponds to " in progress ".If for example, from gesture recognition module receive gesture state be " startup " or " renewal ", Then gesture state corresponds to " in progress ".
Turning now to operation 604 and 606, if gesture state correspond to " in progress " or contact list be it is full, Operate at 612, contact ID corresponding with the contact can be stored in candidate's contact list.If contact ID is stored in time In choosing contact list, then TouchStart events can not be provided to the gesture recognition module to association.It is then possible to be not based on TouchStart event update gesture states.If effectively contact list is that full, new candidate's contact can effectively be connect Touch or can be interference contact.
If gesture state does not correspond to " in progress ", at operation 606, it may be determined that effectively whether to contact list It is full.If for example, the quantity of the TouchStart events received before the operation of flow chart 600 starts corresponds to the hand of association The contact quantity of gesture, then effectively contact list may expire.Although effectively contact list may expire, row may be effectively contacted In table and not all contact is essentially all effective contact.In other words, at least one contact likely corresponds to interference contact.Such as Fruit effectively contact list less than, then operation 608 at, can by it is corresponding with the contact contact ID be stored in effectively contact list In.Operation 608 can also include the gesture recognition module provided TouchStart events to association.Operation 610 includes updating Gesture state simultaneously stores result.For example, the gesture recognition module of association can be configured to be based at least partially on what is received TouchStart events update and store gesture state.
It therefore, it can be not responding to new contact and the TouchStart events associated and interrupt gesture in progress.Such as Fruit effectively contact list less than, then the operative configuration of flow chart 600 into allow update gesture state, i.e. usual hand will not be prevented Gesture is recognized.If effectively contact list is full, interference contact there may be.
Fig. 7 is that the interference for responding TouchMove or TouchEnd events according at least one embodiment of the disclosure is eliminated Exemplary operations flow chart 700.The operation of flow chart 700 corresponds to when event type is TouchMove or TouchEnd Flow chart 500 in operation 510 and 512.The operative configuration of flow chart 700 contacts association into determination with interference Whether TouchStart events provide gesture recognition module, and if had been provided for, then the effective of mark association connects Touch and the TouchStart event datas associated with the effective contact identified and nearest touch event data are provided and arrive gesture Identification module.TouchStart event datas and nearest touch event data can be retrieved from the contact history vectors of association.So Afterwards, gesture recognition module will be forwarded to the subsequent touch event (if any) for effectively contacting association.When with reference to table 1 and table During 2 reading, Fig. 7 may be better understood.
Fig. 7 combines expression with table 2 and is based at least partially on whether gesture-type, gesture state correspond to " in progress ", connect Touch be with effectively contact list association or contact list association with candidate and touch event correspond to TouchMove or TouchEnd judgment rule.Included gesture-type measurement is configured to allow for making a distinction between gesture-type in table 1 And select optimum contact from multiple contacts of identical gesture-type.Table 2 is configured to provide with effectively contacting and disturbing contact phase The preference of pass.Alphabetical N in table corresponds to not preferred selection (that is, the not preferred event of gesture-type), and letter Y corresponds to Preferably select (that is, the preferred event of gesture-type).
The operation of flow chart 700 can be responded based on the contact generation that (capture) is detected by such as touch-screen 204 TouchMove or TouchEnd touch events and start.Operation 702 can include update contact history (that is, contact history to Amount).At operation 704, it may be determined that whether contact is in effectively contact list.Contact in reference table 2, effectively contact list Corresponding to the row with title " event effectively contacted ", without in effectively contact list (that is, in candidate's contact list) Contact correspond to the row with the title event of contact " candidate ".
If contact is in effectively contact list, at operation 706, it may be determined that whether touch event is preferred. Reference table 2, preferably touch event are indicated by " Y ", and not preferred touch event is indicated by " N ".Therefore, operation 706 can include It is determined that the gesture state of the gesture recognition module of association corresponds to " in progress " and also corresponded to " in non-progress ".Then, exist Operate at 706, can be that TouchMove or TouchEnd are based on gesture-type and touch event to determine touch event No is preferred.For example, referring again to table 2, if gesture state corresponds to " in progress " or " in non-progress ", and gesture class Type is gesture-type 3, and touch event type is TouchMove, then touch event is preferred.Reference table 1, with gesture-type The measurement of 3 associations corresponds to movement, i.e. the ultimate range between initial contact location and nearest contact position.
If touch event is preferred, operation 707 at, can by touch event (that is, TouchMove or TouchEnd) gesture recognition module to association is provided.At operation 708, gesture state can be updated and result is stored.Example Such as, the gesture recognition module of association can be based at least partially on received touch event to update and store gesture state. If touch event corresponds to TouchEnd touch events, at operation 730, the contact history vectors of association can be removed. For example, the contact history vectors of association can be removed, and contact ID can be used further to follow-up new contact.
If touch event is not preferred, at operation 710, gesture can be resetted.For example, can be by hand Gesture identification module provides reset command so that gesture state is converted to " cancellation " resets gesture.At operation 712, Ke Yiyong Contact the optimal preferred contact of list to replace and (that is, replace) contact with not preferred event correlation from candidate.If for example, Contact identifier is detected for two contacts of contact 1 and contact 2 and first it is detected that contact 1, then generation can be promoted by contacting 1 First TouchStart events.Contact 1 can be stored in effectively contact list, and can be with first by TouchStart things Part provides to length and hits gesture recognition module (it is assumed that gesture state is not corresponded to " in progress ").Then, contact 2 can promote generation the Two TouchStart events.In this example, if preprocessor-gesture recognition module is hit to being configured to identification length, correspond to Gesture-type be gesture-type 2.Because long hitter's gesture only needs a contact, contact 2 is likely to be brought into length and hits pre- place Manage device candidate contact list in, and may not by the 2nd TouchStart events provide to grow hit gesture recognition module.It is right In contact 1 and contact 2, the first TouchStart events and connecing that the generation of the 2nd TouchStart events is associated can be responded respectively Touch history vectors.
Continue this example, if detecting the TouchMove events with contacting 1 association, TouchMove events are for length Hit gesture recognition module to be not preferred, because the gesture-type of association is gesture-type 2.Therefore, contact 1 is for long hitter's gesture It is probably interference contact for identifier.If the distance parameter DT of the contact history vectors with contacting 2 associations is 0 or close to 0, Then contact 2 may correspond to the optimal preferred contact from candidate list.Because the preferred feature of gesture-type 2 is corresponded to seldom Minimum range that is mobile or not moving, so contact 2 is preferred.It therefore, it can in the long effective contact row for hitting preprocessor In table contact 1 is replaced and (that is, replaces) to contact 2.
If candidate's contact list includes multiple preferred contacts, (that is, their gesture-type according to table 1 has excellent Select the contact of feature), then operate 712 can include based on the optimal preferred contact of preferred feature selection.If for example, the hand of association The gesture-type of gesture identification module is gesture-type 2, then preferred feature includes minimum range and maximum length in time.If candidate Contacting list includes the first contact and the second contact, and has if contacting the contact history vectors of association with first and second 0 distance value (DT) and non-zero duration, then they can be preferred contact.If the contact history vectors bag of the first contact The duration value of the duration value more than the second contact is included, then the first contact is probably optimal preferred contact, because continuing The preferred feature of time is maximum length in time.In this way, it is possible to the preferred spy based on gesture-type and each gesture-type Levy and optimal preferred contact is selected from multiple preferred contacts.
Operation 714 can include resetting all contact history effectively contacted.For example, can will be stored in what is effectively contacted The TouchStart event datas contacted in history vectors are provided to gesture recognition module, then provide nearest touch event number According to.In this way, it is possible to which the corresponding touch event data that effectively contact with confirmation are provided to the gesture recognition module associated. Then, program circuit may proceed to operation 730.
Operation 704 is passed again to, if contact is not in effectively contact list, at operation 720, it may be determined that touch Whether event is preferred.At operation 720, can based on gesture-type, that gesture state corresponds to " in progress " is still " non- In progress " and touch event be that TouchMove or TouchEnd (are followed under table 2 and title " event of candidate's contact " The logic of row) determine whether touch event is preferred.If touch event is not preferred, program circuit can be carried out To operation 730.
If touch event is preferred, at operation 722, gesture can be resetted.At operation 724, Ke Yiyong The contact with preferred event correlation is replaced and (that is, replaces) from the worst preferred contact of effective contact list.For example, reference table 2, for the gesture with gesture-type 3 and corresponding to the candidate of gesture recognition module that associates of gesture state of " in non-progress " Contact, TouchMove events are preferred.The preferred feature of the gesture-type of gesture-type 3 is the ultimate range of contact, i.e. It is preferred that moving.Therefore, the worst preferred contact from effective contact list may correspond to its in the contact history vectors of association away from From value DT relative to the contact that the distance value of other contacts in effective contact list is minimum.In this way, it is possible to by candidate Contact moves on to effectively contact list, and the worst preferred contact from effective contact list can be moved on into candidate's contact row Table.
Operation 726 can include resetting all contact history effectively contacted.Effectively connect for example, can will be stored in and move on to TouchStart event datas in the contact history vectors for the contact for touching list, which are provided, arrives gesture recognition module, then provides most Nearly touch event data.In this way, it is possible to by with determining it is that the corresponding touch event data of candidate's contact effectively contacted are carried It is supplied to the gesture recognition module of association.Then, program circuit may proceed to operation 730.
Although Fig. 4 to Fig. 7 shows the various operations according to embodiment, it is to be appreciated that for other embodiments, and Non- Fig. 4 to it is depicted in figure 7 it is all operation be all required.In fact, herein completely it is contemplated that in the other of the disclosure , can be using not showing definitely but still complied fully with Fig. 4 to Fig. 7 by the way of the disclosure in any accompanying drawing in embodiment Middle described operation and/or other operative combinations described herein.Therefore, it is related to the spy not shown really in an accompanying drawing The claim levied and/or operated is considered as in the scope of the present disclosure and content.
As used in this paper any embodiment, term " module ", which can be assigned, is set to previously mentioned of execution App, software, firmware and/or the circuit of what operation.Software can be as being recorded in non-transitorycomputer readable storage medium Software kit, code, instruction, instruction set and/or data implement.Firmware can as hard coded in storage arrangement (for example, It is non-volatile) code, instruction or instruction set and/or data implement.
As used in any embodiment herein, " circuit " for example solely or can be wrapped in any combination Include the circuit of rigid line connection, the programmable circuit of computer processor such as including one or more individual instruction process cores, State machine circuit and/or the firmware for the instruction that can be performed by programmable circuit that is stored with.These modules can uniformly or individually Ground is calculated as such as integrated circuit (IC), system on chip (SoC), desktop computer, laptop computer, flat board is formed The circuit of a part for the larger system of machine, server, smart phone etc. is implemented.
Any operation described herein can realize in the system including one or more storage mediums, this or Individually or in a joint manner it is stored with multiple storage mediums when being performed by one or more processors and performs these methods Instruction.Herein, processor can include such as server CPU, mobile device CPU and/or other programmable circuits.Also, Operation described herein can ought to be distributed on multiple physical units, be such as located at the processing of more than one different physical locations In structure.Storage medium can include any kind of tangible medium, for example：Any kind of disk, including hard disk, floppy disk, light Disk, compact disc read write (CD-ROM), rewritable compact disk (CD-RW) and magneto-optic disk；Semiconductor device, such as it is read-only to deposit Reservoir (ROM), random access memory (RAM) (as dynamic and static state RAM), Erasable Programmable Read Only Memory EPROM (EPROM), Electrically Erasable Read Only Memory (EEPROM), flash memory, solid-state disk (SSD), magnetic or optical card；Or suitable for depositing Any kind of medium of storing up electricity sub-instructions.Other embodiments can as the software module performed by programmable control unit Lai Realize.Storage medium can be non-transitory.
Therefore, the disclosure provides a kind of interference elimination method and system being used in gesture recognition system.Based on gesture Type and contact history, can select effectively contact from the multiple contacts for potentially including interference contact.The system include with it is every The preprocessor of individual gesture recognition module association.Initially, gesture-type that can be according to the gesture recognition module of association and association The contact quantity of gesture configure each preprocessor.TouchStart events can be responded to generate the contact each contacted History vectors, can update the contact history vectors that each contact when contact continues, and can terminate in contact (for example, TouchEnd touch events) when delete the contact history vectors that each contact.The system configuration into avoid upset connect noiseless The gesture identification process and the ongoing gesture identification process of avoidance breakout carried out in the case of touching.The system is configured to from multiple Select most preferably to contact in possible effective contact.
According to one side, there is provided a kind of system.The system can include touch-screen and processor circuit, and the touch-screen is matched somebody with somebody It is set to and receives contact and touch event is generated based on the contact received, the processor circuit is configured to execute instruction.The system One or more storage mediums are may also include, individually or are in a joint manner stored with the one or more storage medium Cause the instruction operated as follows when being performed by one or more processors, these operations include：It is based at least partially on gesture class Type configures the preprocessor of gesture recognition module, and gesture recognition module is related to gesture；Respond the first touch event generation first History vectors are contacted, the first touch event is based on the first contact to touch-screen；First touch event is provided and arrives gesture identification Module；And be based at least partially on gesture-type to determine whether to provide the second touch event to gesture recognition module.
Another example system includes said modules, and also includes being based at least partially on the contact number associated with gesture Amount carrys out configuration preprocesor.
Another example system includes said modules, and also includes receiving gesture state from gesture recognition module.
Another example system includes said modules, and also includes the 3rd touch event that response contacts correlation with first Update first and contact history vectors.
Another example system include said modules, and above-mentioned determination step include by the feature of the second touch event with The character pair of 3rd touch event compares, and gesture-type is related to feature.
Another example system includes said modules, and gesture-type is related to gesture.
Another example system includes said modules, and gesture-type is with including duration and distance at least within One of contact characteristic it is related.
Another example system includes said modules, and above-mentioned determination step is based at least partially on and contacts pass with first Whether the gesture state of connection corresponds in progress.
Another example system includes said modules, and above-mentioned determination step is based at least partially on the first contact history Vector.
Another example system includes said modules, and the first contact history vectors are configured to storage and contact pass with first The first position of connection and time, the proximal most position for contacting with first association and time, contacted with first associate duration, with The distance between and proximal most position and first position.
Another example system includes said modules, and first gesture type corresponds to connecing for relatively short duration Touch, second gesture type corresponds to the contact of relatively long duration, and the 3rd gesture-type corresponds to mobile contact.
According to other side, there is provided a kind of method.This method can include：It is based at least partially on gesture-type configuration The preprocessor of gesture recognition module, gesture recognition module is related to gesture；The contact of the first touch event generation first is responded to go through History vector, the first touch event is based on the first contact to touch-screen；First touch event is provided and arrives gesture recognition module；With And be based at least partially on gesture-type to determine whether to provide the second touch event to gesture recognition module.
Another exemplary method includes aforesaid operations, and also includes receiving gesture state from gesture recognition module.
Another exemplary method includes aforesaid operations, and also includes the 3rd touch event that response contacts correlation with first Update first and contact history vectors.
Another exemplary method include aforesaid operations, and above-mentioned determination step include by the feature of the second touch event with The character pair of 3rd touch event compares, and gesture-type is related to feature.
Another exemplary method includes aforesaid operations, and gesture-type is related to gesture.
Another exemplary method includes aforesaid operations, and gesture-type is with including duration and distance at least within One of contact characteristic it is related.
Another exemplary method includes aforesaid operations, and above-mentioned determination step is based at least partially on and contacts pass with first Whether the gesture state of connection corresponds in progress.
Another exemplary method includes aforesaid operations, and above-mentioned determination step is based at least partially on the first contact history Vector.
Another exemplary method includes aforesaid operations, and the first contact history vectors are configured to storage and contact pass with first The first position of connection and time, the proximal most position for contacting with first association and time, contacted with first associate duration, with The distance between and proximal most position and first position.
Another exemplary method includes aforesaid operations, and first gesture type corresponds to connecing for relatively short duration Touch, second gesture type corresponds to the contact of relatively long duration, and the 3rd gesture-type corresponds to mobile contact.
According to other side, there is provided a kind of system.The system can include one or more storage mediums, at this Or individually or be in a joint manner stored with multiple storage mediums when being performed by one or more processors and cause following behaviour The instruction of work, these operations include：The preprocessor that gesture-type configures gesture recognition module is based at least partially on, gesture is known Other module is related to gesture；Respond the first touch event generation first and contact history vectors, the first touch event is based on to touching First contact of screen；First touch event is provided and arrives gesture recognition module；And it is based at least partially on gesture-type really Fixed whether provide the second touch event arrives gesture recognition module.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and also Carry out configuration preprocesor including being based at least partially on the contact quantity associated with gesture.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and also Including receiving gesture state from gesture recognition module.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and also The 3rd touch event that correlation is contacted with first including response updates first and contacts history vectors.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and on Stating determination step includes being compared the feature of the second touch event with the character pair of the 3rd touch event, gesture-type and feature It is related.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and hand Gesture type is related to gesture.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and hand Gesture type is related at least one of contact characteristic including duration and distance.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and on State in determining that whether step is based at least partially on the gesture state that association is contacted with first corresponding to carrying out.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and on State determination step and be based at least partially on the first contact history vectors.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and the One contact history vectors are configured to the most peri position that storage contacts the first position associated and time with first, association is contacted with first Put with the time, contact the duration associated and the distance between proximal most position and first position with first.
Another example system, which is included in, causes the instruction of aforesaid operations when being performed by one or more processors, and the One gesture-type corresponds to the contact of relatively short duration, and second gesture type corresponds to connecing for relatively long duration Touch, and the 3rd gesture-type corresponds to mobile contact.
Term and statement employed in this paper be used as description and unrestricted term, and without be intended to use such art Repel any equivalent (or one part) of shown or described feature when language and statement, and recognize, will in right Various modifications in the range of asking are possible.Correspondingly, claim will cover all such equivalents.
1. a kind of system, including：
One or more storage mediums, individually or be in a joint manner stored with finger on one or more of storage mediums Order, the instruction causes following operation when being performed by one or more processors, and these operations include：
Each gesture recognition module is configured to recognize a gesture；
The gesture-type for the gesture being associated with corresponding gesture recognition module is based at least partially on to configure each pretreatment Device；
Respond the first touch event generation first and contact history vectors, first touch event is based on the to the touch-screen One contact, wherein it is described first contact history vectors be configured to storage contacted with described first associate first position and the time, The proximal most position associated and time are contacted with described first, the duration of association and the most peri position are contacted with described first The distance between put with the first position；
By each preprocessor based on described first contact history vectors come recognize it is described first contact it is whether effective；
It is effective in response to the described first contact, first touch event is provided and arrives the gesture recognition module；And
By the preprocessor be based at least partially on the gesture-type determine whether to by the second touch event provide to The gesture recognition module.
2. the system as claimed in claim 1, wherein the instruction cause when being performed by one or more processors it is following attached Add operation：
The quantity of the contact associated with the gesture is based at least partially on to configure the preprocessor.
3. the system as claimed in claim 1, wherein the instruction cause when being performed by one or more processors it is following attached Add operation：
Gesture state is received from the gesture recognition module.
4. the system as claimed in claim 1, wherein the instruction cause when being performed by one or more processors it is following attached Add operation：
The 3rd touch event that response contacts correlation with described first updates the first contact history vectors.
5. system as claimed in claim 4, wherein the determination step is included the feature of second touch event and institute The character pair for stating the 3rd touch event compares, and the gesture-type is related to the feature.
6. the system as any one of claim 1 to 5, wherein the gesture-type is related to the gesture.
7. the system as any one of claim 1 to 5, wherein the gesture-type with including duration and distance At least one of contact characteristic is related.
8. the system as any one of claim 1 to 5, wherein the determination step is based at least partially on and described the Whether the gesture state of one contact association corresponds in progress.
9. the system as any one of claim 1 to 5, wherein the determination step is based at least partially on described first Contact history vectors.
10. the system as any one of claim 1 to 5, wherein first gesture type correspond to relatively short continue Between contact, second gesture type correspond to the relatively long duration contact, and the 3rd gesture-type correspond to movement Contact.
11. a kind of method, including：
Respond the first touch event generation first and contact history vectors, first touch event is connect based on first to touch-screen Touch, wherein the first contact history vectors are configured to first position and time and institute that storage contacts association with described first State the first contact association proximal most position and the time, contact with described first the duration associated and the proximal most position and The distance between described first position；
12. method as claimed in claim 11, in addition to：
13. method as claimed in claim 11, in addition to：
14. method as claimed in claim 11, in addition to：
15. method as claimed in claim 14, wherein the determination step include by the feature of second touch event with The character pair of 3rd touch event compares, and the gesture-type is related to the feature.
16. the method as any one of claim 11 to 15, wherein the gesture-type is related to the gesture.
17. the method as any one of claim 11 to 15, wherein the gesture-type with including the duration and away from From at least one of contact characteristic it is related.
18. the method as any one of claim 11 to 15, wherein the determination step is based at least partially on and institute Whether the gesture state for stating the first contact association corresponds in progress.
19. the method as any one of claim 11 to 15, wherein the determination step be based at least partially on it is described First contact history vectors.
20. the method as any one of claim 11 to 15, wherein first gesture type correspond to relatively short lasting The contact of time, second gesture type corresponds to the contact of relatively long duration, and the 3rd gesture-type corresponds to shifting Dynamic contact.
21. a kind of system, including one or more storage mediums, individually or with group on one or more of storage mediums Conjunction mode is stored with instruction, and the instruction causes following operation when being performed by one or more processors, and these operations include：
22. system as claimed in claim 21, wherein the instruction cause when being performed by one or more processors it is as follows Additional operations：
23. system as claimed in claim 21, wherein the instruction cause when being performed by one or more processors it is as follows Additional operations：
24. system as claimed in claim 21, in addition to：
25. system as claimed in claim 24, wherein the determination step include by the feature of second touch event with The character pair of 3rd touch event compares, and the gesture-type is related to the feature.
26. the system as any one of claim 21 to 25, wherein the gesture-type is related to the gesture.
27. the system as any one of claim 21 to 25, wherein the gesture-type with including the duration and away from From at least one of contact characteristic it is related.
28. the system as any one of claim 21 to 25, wherein the determination step is based at least partially on and institute Whether the gesture state for stating the first contact association corresponds in progress.
29. the system as any one of claim 21 to 25, wherein the determination step be based at least partially on it is described First contact history vectors.
30. the system as any one of claim 21 to 25, wherein first gesture type correspond to relatively short lasting The contact of time, second gesture type corresponds to the contact of relatively long duration, and the 3rd gesture-type corresponds to shifting Dynamic contact.
CN103529976A CN103529976A (en) 2014-01-22
CN103529976B true CN103529976B (en) 2017-09-12
KR101645685B1 (en) * 2010-12-20 2016-08-04 애플 인크. Event recognition
CN102939578A (en) 2010-06-01 2013-02-20 诺基亚公司 A method, a device and a system for receiving user input
WO2012040616A2 (en) * 2010-09-24 2012-03-29 Research In Motion Limited Portable electronic device and method of controlling same
CN103529976A (en) 2014-01-22
JP6253204B2 (en) 2017-12-27 Classification of user input intent
KR20130084982A (en) 2013-07-26 Automatic derivation of analogous touch gestures from a user-defined gesture
KR101278346B1 (en) 2013-06-25 Event recognition
CN104808942B (en) 2019-05-03 Touch event for WEB page is handled
TWI502503B (en) 2015-10-01 Multi-touch manipulation of application objects
CN102473060B (en) 2016-03-23 Coordinate determination means, the coordinate determination method
KR20140094534A (en) 2014-07-30 User interface indirect interaction