PATENT DOCUMENT

Publication Number: US-9582104-B2
Application Number: US-201615045097-A
Country: US
Kind Code: B2

Title: Scan sequence generator

Abstract:
A sensor panel device that can generate and use a stimulus signal having multiple different waveforms for detecting events on or near the sensor panel is disclosed. Among other things, such a stimulus signal can be used to reject environmental noise present in the device. In some embodiments, the stimulus signal has multiple waveforms having different frequencies. Logic circuitry can generate representative values from output of the different waveforms applied to one or more sensing nodes in the sensor panel device. From the representative values, a final value can be generated that represents whether an event occurred at or near the one or more sensing nodes.

Claims:
What is claimed is: 
     
       1. A method of detecting events with a touch sensor panel device comprising:
 applying a first stimulation signal having multiple different frequencies to a first touch sensing node of the touch sensor panel device to detect a position of touch, near touch or hover location of an object at or near the first touch sensing node; 
 while applying the first stimulation signal, sensing an output of the first touch sensing node for each of the multiple different frequencies of the first stimulation signal that was applied to the first touch sensing node to thereby provide multiple outputs; 
 determining a final result based on all or a plurality of the multiple outputs of the first touch sensing node; 
 utilizing the final result to determine the position of touch, near touch or hover location on the touch sensor panel device; and 
 determining the multiple different frequencies of the first stimulation signal in a random manner from a group of different frequency values. 
 
     
     
       2. The method of  claim 1 , further comprising:
 applying a second stimulation signal having multiple different frequencies to a second touch sensing node of the touch sensor panel device; 
 sensing an output for each of the multiple different frequencies of the second stimulation signal that was applied to the second touch sensing node; 
 determining the final result based on one or more of the outputs of the second stimulation signal, and 
 determining the multiple different frequencies of the second stimulation signal in a random manner from the group of different frequency values. 
 
     
     
       3. The method of  claim 2 , wherein the second stimulation signal comprises a pulse train having first frequency, a pulse train having a second frequency and a pulse train having a third frequency. 
     
     
       4. The method of  claim 1 , wherein the first stimulation signal comprises a pulse train having a first frequency, a pulse train having a second frequency and a pulse train having a third frequency. 
     
     
       5. The method of  claim 1 , wherein determining the final result comprises averaging at least two of the multiple results. 
     
     
       6. The method of  claim 1 , wherein determining the final result comprises applying a majority rules algorithm to the multiple results. 
     
     
       7. The method of  claim 1 , wherein determining the final result comprises taking a median value of the multiple results. 
     
     
       8. The method of  claim 1 , wherein the first stimulation signal comprises a first pulse train that is applied to the first touch sensing node at a time t1, a second pulse train that is applied to the first touch sensing node at a time t2 and a third pulse train that is applied to the first touch sensing node at a time t3, wherein t1 is before t2, t2 is before t3, and the time between t1 and t2 and the time between t2 and t3 are determined in a random manner from a group of time values. 
     
     
       9. The method of  claim 1 , wherein determining the final result further comprises determining whether one or more of the multiple outputs is corrupted and eliminating any corrupted output from being used when determining the final result. 
     
     
       10. A sensor panel device comprising:
 an event sensitive panel having at least one sense node that provides an output signal indicative of a touch or near touch event on the event sensitive panel; 
 output circuitry operatively connected to the at least one sense node that generates stimulus signals having multiple different frequencies selected in a random manner from a group of frequency values, the at least one sense node providing multiple outputs in response to the multiple different frequencies for at least one event to detect a position of touch or near touch of the sensor panel; and 
 input circuitry operatively connected to the at least one sense node to receive the multiple outputs, the input circuitry configured to measure results of the stimulus signals applied to the at least one sense node to determine the position of touch or near touch based on all or a plurality of the received multiple outputs. 
 
     
     
       11. The sensor panel device of  claim 10 , wherein the stimulus signals have a first, second and third frequency value. 
     
     
       12. The sensor panel device of  claim 10 , wherein the output circuitry comprises a randomizer lookup table for storing data indicative of the group of frequency values. 
     
     
       13. The sensor panel device of  claim 10 , further comprising:
 a plurality of drive electrodes; 
 a plurality of sense electrodes, 
 the at least one sense node formed by the crossing of one of the plurality of drive electrodes with one of the plurality of sense electrodes, the at least one sense node formed by capacitive coupling of the one of the plurality of drive electrodes and the one of the plurality of sense electrodes. 
 
     
     
       14. The sensor panel device of  claim 13 , wherein the output circuitry comprises a randomizer lookup table storing data indicative of frequency values in the group of frequency values. 
     
     
       15. The sensor panel device of  claim 14 , wherein the randomizer lookup table further stores data indicative of time intervals between the generation of the multiple different frequencies of the stimulus signals. 
     
     
       16. A mobile telephone incorporating the sensor panel device of  claim 10 . 
     
     
       17. A digital audio player incorporating the sensor panel device of  claim 10 . 
     
     
       18. A method of acquiring an image of a sensor panel device having a plurality of event sensors, comprising:
 applying a first stimulus signal having a first frequency to a first event sensor; 
 receiving a first stimulus result comprising an output of the first event sensor to which the first stimulus signal was applied; 
 applying a second stimulus signal having a second frequency to the first event sensor; 
 receiving a second stimulus result comprising an output of the first event sensor to which the second stimulus signal was applied; 
 applying a third stimulus signal having a third frequency to the first event sensor; 
 receiving a third stimulus result comprising an output of the first event sensor to which the third stimulus signal was applied; 
 the first, second and third frequencies different from one another and applied to the first event sensor to detect at least one of a touch, near touch, or hover event; 
 generating a final value of the first event sensor based on at least two of the first, second and third stimulus results; and 
 selecting the first, second and third frequencies in a random fashion from a group of frequency values. 
 
     
     
       19. The method of  claim 18 , further comprising selecting time differences between the applying of the first, second and third frequencies in a random fashion from a group of time values. 
     
     
       20. The method of  claim 18 , further comprising offset compensating the first, second and third stimulus results. 
     
     
       21. The method of  claim 18 , wherein the generating step further comprises applying a filter to the first, second and third stimulus results. 
     
     
       22. The method of  claim 21 , wherein the filter uses an averaging algorithm. 
     
     
       23. The method of  claim 21 , wherein the filter uses a median value algorithm. 
     
     
       24. The method of  claim 21 , wherein the filter uses a majority rules algorithm. 
     
     
       25. An apparatus for detecting events on a sensor panel device having a sensor panel surface, the sensor panel device having a plurality of drive electrodes and a plurality of sense electrodes and capacitive sensing nodes at intersections of the plurality of drive electrodes and the plurality of sense electrodes, the apparatus comprising:
 a plurality of sensors configured to detect one or more events, each of the plurality of sensors comprising at least one of the capacitive sensing nodes; 
 output circuitry operatively connected to the plurality of sensors, the output circuitry configured to generate stimulus signals having predetermined waveforms, at least some of the predetermined waveforms having different frequencies, each of the plurality of sensors providing different outputs corresponding to the different frequencies to detect the one or more events, the output circuitry including circuitry for selecting the different frequencies in a random manner from a group of frequency values; and 
 one or more analog channels operatively connected to the plurality of sensors, the one or more analog channels configured to generate distinct values representative of one or more events based on the different outputs for each of the plurality of sensors. 
 
     
     
       26. The apparatus of  claim 25 , wherein the output circuitry includes circuitry for selecting a time period between generation of the predetermined waveforms of different frequencies, the time periods selected in a random manner from a group of time periods. 
     
     
       27. The apparatus of  claim 25 , wherein the output circuitry and the one or more analog channels form part of a touch subsystem for processing events. 
     
     
       28. The apparatus of  claim 27 , wherein the output circuitry comprises driver logic capable of driving the plurality of touch sensors with stimulus signals. 
     
     
       29. The apparatus of  claim 25 , wherein the plurality of sensors form one or more sensor rows located in distinct and non-overlapping areas. 
     
     
       30. The apparatus of  claim 25 , wherein the one or more analog channels comprises multiple analog channels and the plurality of sensors are arranged in rows and columns in the sensor panel, each column operatively connected to a different one of the multiple analog channels. 
     
     
       31. The apparatus of  claim 25 , further comprising a computing system that incorporates the apparatus, the computing system comprising:
 an event subsystem operatively connected to the plurality of sensors; 
 an event panel processor operatively connected to the event subsystem; and 
 a host processor operatively connected to the event panel processor. 
 
     
     
       32. The apparatus of  claim 31 , further comprising a cellular telephone that incorporates the computing system. 
     
     
       33. The apparatus of  claim 32 , further comprising a digital audio player that incorporates the computing system. 
     
     
       34. A method for detecting events on or about a touch sensitive surface, comprising:
 scanning an event sensor panel of event sensors organized in rows and columns by applying a stimulus having multiple different frequencies to one of the rows or columns, the stimulus being applied to detect one or more events comprising a touching or near touching of an object on or over the touch sensitive surface; 
 selecting the multiple different frequencies in a random manner from a group of frequency values, 
 during each event sensor panel scan of the rows or columns, coupling the other of the rows or columns of the event sensor panel to one or more analog channels to generate plural output values for the multiple different frequencies representative of the one or more events; and 
 determining a final output value based on all or a plurality of the plural output values. 
 
     
     
       35. The method of  claim 34 , further comprising selecting a time period between application of the multiple different frequencies of the stimulus, the time periods selected in a random manner from a group of time periods. 
     
     
       36. The method of  claim 34 , further comprising generating the one or more output values representative of one or more events within an event subsystem. 
     
     
       37. The method of  claim 34  incorporated into a computing system. 
     
     
       38. The method of  claim 34 , incorporated into a mobile telephone. 
     
     
       39. The method of  claim 34 , incorporated into a digital audio player. 
     
     
       40. An apparatus for sensing an event on a touch sensitive panel, comprising:
 means for generating a stimulus signal comprising multiple waveforms, at least some of the waveforms having different frequencies; 
 means for selecting values of the different frequencies in a random manner from a group of frequency values; 
 means for applying the stimulus signal to a first touch sensing node of the touch sensitive panel to detect touching of the first touch sensing node, the first touch sensing node providing multiple outputs in response to the different frequencies; 
 means for generating representative values of the multiple outputs of the first sensing node; and 
 means for generating a final value based upon all or a plurality of the representative values, the final value corresponding to whether or not an event occurred at or near the first touch sensing node. 
 
     
     
       41. The apparatus of  claim 40 , further comprising means for selecting time intervals between the multiple waveforms having different frequencies of the stimulus signal in a random manner from a group of time intervals.

Description:
CROSS-REFERENCES TO RELATED APPLICATIONS 
     This application is a divisional of U.S. patent application Ser. No. 14/561,075, filed Dec. 4, 2014, published on Mar. 26, 2015 as U.S. Patent Publication No. 2015-0084926; which is a divisional of U.S. patent application Ser. No. 14/094,608, filed Dec. 2, 2013, issued on Dec. 30, 2014 as U.S. Pat. No. 8,922,519; which is a divisional of U.S. patent application Ser. No. 13/553,421, filed Jul. 19, 2012, issued on Feb. 25, 2014 as U.S. Pat. No. 8,659,568; which is a continuation of U.S. patent application Ser. No. 11/650,046, filed on Jan. 3, 2007, issued on Jul. 31, 2012 as U.S. Pat. No. 8,232,970; the disclosures of which are herein incorporated by reference in their entirety for all purposes. 
    
    
     FIELD OF THE INVENTION 
     The present invention relates generally to electronic devices (e.g., touch screen devices) capable of generating dynamic scan signals, and more particularly, to a method and system of using scan signals having different frequencies when scanning a sensor panel of an electronic device. 
     BACKGROUND OF THE INVENTION 
     Many types of input devices are presently available for performing operations in a computing system, such as buttons or keys, mice, trackballs, touch panels, joysticks, touch screens and the like. Touch screens, in particular, are becoming increasingly popular because of their ease and versatility of operation as well as their declining price. Touch screens may include a touch panel, which may be a clear panel with a touch-sensitive surface. The touch panel may be positioned in front of a display screen so that the touch-sensitive surface covers the viewable area of the display screen. Touch screens may allow a user to make selections and move a cursor by simply touching the display screen via a finger or stylus. In general, the touch screen may recognize the touch and position of the touch on the display screen, and the computing system may interpret the touch and thereafter perform an action based on the touch event. 
     One limitation of many conventional touch panel technologies is that they are only capable of reporting a single point or touch event, even when multiple objects come into contact with the sensing surface. That is, they lack the ability to track multiple points of contact at the same time. Thus, even when two points are touched, these conventional devices only identify a single location, which is typically the average between the two contacts (e.g., a conventional touchpad on a notebook computer provides such functionality). This single-point identification is a function of the way these devices provide a value representative of the touch point, which is generally by providing an average resistance or capacitance value. 
     Moreover, noise may adversely affect the performance of a touch panel device. Environmental noise, either naturally occurring or human made (e.g., wireless transmissions), may influence the results of a touch panel device. For example, environmental noise may prevent a touch panel from distinguishing between a touch event (e.g., a user&#39;s contact of a touch panel) and noise influencing the sensors of the touch panel. 
     SUMMARY OF THE INVENTION 
     A multi-touch touch system is disclosed herein. One aspect of the multi-touch touch system relates to stimulating the multi-touch sensors with multiple different waveforms and generating representative values of the waveforms 
     Another aspect of the multi-touch system relates distinguishing a user&#39;s contacts from environmental noise, or other undesirable noise that may influence detection of a touch event. 
     Yet another aspect of the multi-touch system relates to adjusting scan frequencies for consecutive scans. For example, a scan order my be low frequency-medium frequency-high frequency-high frequency-medium frequency-low frequency. 
     A further aspect of the multi-touch system relates to channel scan logic scanning a given row of a multi-touch panel at a lower frequency band, then a medium frequency band, and a high frequency band. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  illustrates an exemplary computing system using a multi-touch panel input device in accordance with one embodiment of the present invention. 
         FIG. 2 a    illustrates an exemplary capacitive multi-touch panel in accordance with one embodiment of the present invention. 
         FIG. 2 b    is a side view of an exemplary capacitive touch sensor or pixel in a steady-state (no-touch) condition in accordance with one embodiment of the present invention. 
         FIG. 2 c    is a side view of the exemplary capacitive touch sensor or pixel in a dynamic (touch) condition in accordance with one embodiment of the present invention. 
         FIG. 3 a    illustrates an exemplary analog channel in accordance with one embodiment of the present invention. 
         FIG. 3 b    is a more detailed illustration of a virtual ground charge amplifier at the input of an analog channel, and the capacitance contributed by a capacitive touch sensor and seen by the charge amplifier in accordance with one embodiment of the present invention. 
         FIG. 3 c    illustrates an exemplary Vstim signal with multiple pulse trains each having a fixed number of pulses, each pulse train having a different frequency Fstim in accordance with one embodiment of the present invention. 
         FIG. 4  illustrates noise rejection techniques employed by various filtering algorithms in accordance with one embodiment of the present invention. 
         FIG. 5  illustrates a sequence in which stimulus waveforms of varying frequencies are applied to the multi-touch sensor in accordance with one embodiment of the present invention. 
         FIG. 6  is a flowchart illustrating operation of channel scan logic obtaining an image of a touch panel in accordance with one embodiment of the present invention. 
         FIG. 7  illustrates an exemplary cellular telephone that may include multi-touch panel, display device, and other computing system blocks in accordance with one embodiment of the present invention. 
         FIG. 8  illustrates an exemplary digital audio/video player that may include a multi-touch panel, a display device, and other computing system blocks in accordance with one embodiment of the present invention. 
         FIG. 9  is a block diagram of logic circuitry used to generate randomized stimulation pulses in accordance with one embodiment of the present invention. 
         FIG. 10  is a block diagram of circuitry used to generate pulse trains in accordance with one embodiment of the present invention. 
     
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
     In the following description of preferred embodiments, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be used and structural changes may be made without departing from the scope of the preferred embodiments of the present invention. 
     A plurality of touch sensors in a multi-touch panel can enable a computing system to sense multi-touch events (the touching of fingers or other objects upon a touch-sensitive surface at distinct locations at about the same time) and perform additional functions not previously available with touch sensor devices. 
     Although some embodiments may be described herein in terms of capacitive touch sensors in a multi-touch panel, it should be understood that embodiments of the invention are not so limited, but are generally applicable to the use of any type of multi-touch sensor technology that may include resistive touch sensors, surface acoustic wave touch sensors, electromagnetic touch sensors, near field imaging touch sensors, and the like. Furthermore, although the touch sensors in the multi-touch panel may be described herein in terms of an orthogonal array of touch sensors having rows and columns, it should be understood that embodiments of the invention are not limited to orthogonal arrays, but may be generally applicable to touch sensors arranged in any number of dimensions and orientations, including diagonal, concentric circle, and three-dimensional and random orientations. 
     In general, multi-touch panels may be able to detect multiple touches (touch events or contact points) that occur at or about the same time, and identify and track their locations. Examples of multi-touch panels are described in Applicant&#39;s U.S. application Ser. No. 10/840,862 entitled “Multipoint Touchscreen,” filed on May 6, 2004 and published as U.S. Published Application No. 2006/0097991 on May 11, 2006, now issued as U.S. Pat. No. 7,663,607, issued on Feb. 16, 2010, the contents of which are incorporated by reference herein. 
     It should be understood that although embodiments of this invention are primarily described herein for use with touch sensor panels, proximity sensor panels may also be used to generate modulated output signals for detection by the analog channels. Proximity sensor panels are described in Applicants&#39; concurrently filed U.S. application Ser. No. 11/649,966 entitled “Proximity and Multi-Touch Sensor Detection and Demodulation,” filed on Jan. 3, 2007, now issued as U.S. Pat. No. 7,719,367, issued on May 18, 2010, the contents of which are incorporated herein by reference. 
     In view of the above, although this disclosure may describe detecting input in terms of touch-events, it should be understood that the various embodiments disclosed herein may detect near touches or hover-events as well. Accordingly, a touch, a near-touch or a hover may be referred to as an “event” and multiple events that occur at or about the same time may be referred to as a “multi-event.” 
       FIG. 1  illustrates computing system  100  using touch sensors according to one embodiment. Computing system  100  may correspond to computing devices such as desktops, laptops, tablets or handhelds, including personal digital assistants (PDAs), digital music and/or video players and cellular telephones. Computing system  100  may also correspond to public computer systems such as information kiosks, automated teller machines (ATM), point of sale machines (POS), industrial machines, gaming machines, arcade machines, vending machines, airline e-ticket terminals, restaurant reservation terminals, customer service stations, library terminals, learning devices, and the like. 
     Computing system  100  may include one or more multi-touch panel processors  102  and peripherals  104 , and multi-touch subsystem  106 . The one or more processors  102  can be ARM968 processors or other processors with similar functionality and capabilities. However, in other embodiments, the multi-touch panel processor functionality may be implemented instead by dedicated logic such as a state machine. Peripherals  104  may include, but are not limited to, random access memory (RAM) or other types of memory or storage, watchdog timers and the like. Multi-touch subsystem  106  may include, but is not limited to, one or more analog channels  108 , channel scan logic  110  and driver logic  114 . Channel scan logic  110  may access RAM  112 , autonomously read data from the analog channels and provide control for the analog channels. This control may include multiplexing columns of multi-touch panel  124  to analog channels  108 . In addition, channel scan logic  110  may control the driver logic and stimulation signals being selectively applied to rows of multi-touch panel  124 . In some embodiments, multi-touch subsystem  106  may be integrated into a single application specific integrated circuit (ASIC). 
     Driver logic  114  can provide multiple multi-touch subsystem outputs  116  and can present a proprietary interface that drives high voltage driver, which is comprised of decoder  120  and subsequent level shifter and driver stage  118 , although level-shifting functions could be performed before decoder functions. Level shifter and driver  118  can provide level shifting from a low voltage level (e.g. CMOS levels) to a higher voltage level, providing a better signal-to-noise (S/N) ratio for noise reduction purposes. Decoder  120  can decode the drive interface signals to one out of N outputs, whereas N is the maximum number of rows in the panel. Decoder  120  can be used to reduce the number of drive lines needed between the high voltage driver and multi-touch panel  124 . Each multi-touch panel row input  122  can drive one or more rows in multi-touch panel  124 . In some embodiments, driver  118  and decoder  120  can be integrated into a single ASIC. However, in other embodiments driver  118  and decoder  120  can be integrated into driver logic  114 , and in still other embodiments driver  118  and decoder  120  can be eliminated entirely. 
     Multi-touch panel  124  can in some embodiments include a capacitive sensing medium having a plurality of row traces or driving lines and a plurality of column traces or sensing lines, although other sensing media may also be used. The row and column traces may be formed from a transparent conductive medium, such as Indium Tin Oxide (ITO) or Antimony Tin Oxide (ATO), although other transparent and non-transparent materials, such as copper, can also be used. In some embodiments, the row and column traces can be formed on opposite sides of a dielectric material, and can be perpendicular to each other, although in other embodiments other non-orthogonal orientations are possible. For example, in a polar coordinate system, the sensing lines can be concentric circles and the driving lines can be radially extending lines (or vice versa). It should be understood, therefore, that the terms “row” and “column,” “first dimension” and “second dimension,” or “first axis” and “second axis” as used herein are intended to encompass not only orthogonal grids, but the intersecting traces of other geometric configurations having first and second dimensions (e.g. the concentric and radial lines of a polar-coordinate arrangement). It should also be noted that in other embodiments, the rows and columns can be formed on a single side of a substrate, or can be formed on two separate substrates separated by a dielectric material. In some embodiments, the dielectric material can be transparent, such as glass, or can be formed from other materials, such as mylar. An additional dielectric cover layer may be placed over the row or column traces to strengthen the structure and protect the entire assembly from damage. 
     At the “intersections” of the traces, where the traces pass above and below each other (but do not make direct electrical contact with each other), the traces essentially form two electrodes (although more than two traces could intersect as well). Each intersection of row and column traces can represent a capacitive sensing node and can be viewed as picture element (pixel)  126 , which can be particularly useful when multi-touch panel  124  is viewed as capturing an “image” of touch. (In other words, after multi-touch subsystem  106  has determined whether a touch event has been detected at each touch sensor in the multi-touch panel, the pattern of touch sensors in the multi-touch panel at which a touch event occurred can be viewed as an “image” of touch (e.g. a pattern of fingers touching the panel).) The capacitance between row and column electrodes appears as a stray capacitance on all columns when the given row is held at DC and as a mutual capacitance Csig when the given row is stimulated with an AC signal. The presence of a finger or other object near or on the multi-touch panel can be detected by measuring changes to Csig. The columns of multi-touch panel  124  can drive one or more analog channels  108  (also referred to herein as event detection and demodulation circuits) in multi-touch subsystem  106 . In some embodiments, each column is coupled to one dedicated analog channel  108 . However, in other embodiments, the columns may be couplable via an analog switch to a fewer number of analog channels  108 . 
     Computing system  100  can also include host processor  128  for receiving outputs from multi-touch panel processor  102  and performing actions based on the outputs that may include, but are not limited to, moving an object such as a cursor or pointer, scrolling or panning, adjusting control settings, opening a file or document, viewing a menu, making a selection, executing instructions, operating a peripheral device connected to the host device, answering a telephone call, placing a telephone call, terminating a telephone call, changing the volume or audio settings, storing information related to telephone communications such as addresses, frequently dialed numbers, received calls, missed calls, logging onto a computer or a computer network, permitting authorized individuals access to restricted areas of the computer or computer network, loading a user profile associated with a user&#39;s preferred arrangement of the computer desktop, permitting access to web content, launching a particular program, encrypting or decoding a message, and/or the like. Host processor  128  may also perform additional functions that may not be related to multi-touch panel processing, and can be coupled to program storage  132  and display device  130  such as an LCD display for providing a user interface (UI) to a user of the device. 
       FIG. 2 a    illustrates exemplary capacitive multi-touch panel  200 .  FIG. 2 a    indicates the presence of a stray capacitance Cstray at each pixel  202  located at the intersection of a row  204  and a column  206  trace (although Cstray for only one column is illustrated in  FIG. 2  for purposes of simplifying the figure). Note that although  FIG. 2 a    illustrates rows  204  and columns  206  as being substantially perpendicular, they need not be so aligned, as described above. In the example of  FIG. 2 a   , AC stimulus Vstim  214  is being applied to one row, with all other rows connected to DC. The stimulus causes a charge to be injected into the column electrodes through mutual capacitance at the intersecting points. This charge is Qsig=Csig×Vstm. Each of columns  206  may be selectively connectable to one or more analog channels (see analog channels  108  in  FIG. 1 ). 
       FIG. 2 b    is a side view of exemplary pixel  202  in a steady-state (no-touch) condition. In  FIG. 2 b   , an electric field of electric field lines  208  of the mutual capacitance between column  206  and row  204  traces or electrodes separated by dielectric  210  represents a signal capacitance Csig between the row and column electrodes and can cease a charge to be injected form a stimulated row to a column electrode. Since Csig is referenced to virtual ground, it also makes up a stray capacitance. For example, a total stray capacitance of a column electrode can be the sum of all signal capacitances Csig between a given column and all row electrodes. Assuming that CSig is for example 0.75 pF and a column electrode is intersected by fifteen row electrodes, the total stray capacitance on that column electrode would be at least 15×0.75 pF=11.25 pF. In reality, however, the total stray capacitance can be larger due to a trace stray capacitance between the column electrode and other conductors in the system held at a DC potential. Such connectors can include ground planes on a PCB or EMI shield. 
       FIG. 2 c    is a side view of exemplary pixel  202  in a dynamic (touch) condition. In  FIG. 2 c   , finger  212  has been placed near pixel  202 . Finger  212  is a low-impedance object at signal frequencies, and represents an CA ground return path to via body capacitance Cbody. The body has a self-capacitance to ground Cbody, which is a function of, among other things, body size and geometry. If finger  212  blocks some electric field lines  208  between the row and column electrodes (those fringing fields that exit the dielectric and pass through the air above the row electrode), those electric field lines are shunted to ground through the capacitance path inherent in the finger and the body, and as a result, the steady state signal capacitance Csig is reduced by Csig_sense. In other words, the combined body and finger capacitance act to reduce Csig by an amount ΔCsig (which can also be referred to herein as Csig_sense), and can act as a shunt or dynamic return path to ground, blocking some of the electric fields as resulting in a reduced net signal capacitance. The signal capacitance at the pixel becomes Csig−ΔCsig, where Csig represents the static (no touch) component and ΔCsig represents the dynamic (touch) component. Note that Csig−ΔCsig may always be nonzero due to the inability of a finger, palm or other object to block all electric fields, especially those electric fields that remain entirely within the dielectric material. In addition, it should be understood that as a finger is pushed harder or more completely onto the multi-touch panel, the finger can tend to flatten, blocking more and more of the electric fields, and thus ΔCsig can be variable and representative of how completely the finger is pushing down on the panel (i.e. a range from “no-touch” to “full-touch”). 
     Referring again to  FIG. 2 a   , as mentioned above, Vstim signal  214  can be applied to a row in multi-touch panel  200  so that a change in signal capacitance can be detected when a finger, palm or other object is present. Vstim signal  214  can include one or more pulse trains  216  at a particular frequency, with each pulse train including of a number of pulses. Although pulse trains  216  are shown as square waves, other waveshapes such as sine waves can also be employed. A plurality of pulse trains  216  at different frequencies can be transmitted for noise reduction purposes to minimize the effect of any noise sources. Vstim signal  214  essentially injects a charge into the row via signal capacitance Csig, and can be applied to one row of multi-touch panel  200  at a time while all other rows are held at a DC level. However, in other embodiments, the multi-touch panel may be divided into two or more sections, with Vstim signal  214  being simultaneously applied to one row in each section and all other rows in that region section held at a DC voltage. 
     Each analog channel coupled to a column can provide a result representing a mutual capacitance between a row being stimulated and a column the row is connected to. Specifically, this mutual capacitance is comprised of the signal capacitance Csig and any change Csig_sense in that signal capacitance due to the presence of a finger, palm or other body part or object. These column values provided by the analog channels may be provided in parallel while a single row is being stimulated, or may be provided in series. If all of the values representing the signal capacitances for the columns have been obtained, another row in multi-touch panel  200  can be stimulated with all others held at a DC voltage, and the column signal capacitance measurements can be repeated. Eventually, if Vstim has been applied to all rows, and the signal capacitance values for all columns in all rows have been captured (i.e. the entire multi-touch panel  200  has been “scanned”), a “snapshot” of all pixel values can be obtained for the entire multi-touch panel  200 . This snapshot data can be initially saved in the multi-touch subsystem, and later transferred out for interpretation by other devices in the computing system such as the host processor. As multiple snapshots are obtained, saved and interpreted by the computing system, it is possible for multiple touches to be detected, tracked, and used to perform other functions. 
       FIG. 3 a    illustrates exemplary analog channel or event detection and demodulation circuit  300 . One or more analog channels  300  can be present in the multi-touch subsystem. One or more columns from a multi-touch panel can be connectable to each analog channel  300 . Each analog channel  300  can include virtual-ground charge amplifier  302 , signal mixer  304 , offset compensation  306 , rectifier  332 , subtractor  334 , and analog-to-digital converter (ADC)  308 .  FIG. 3 a    also shows, in dashed lines, the steady-state signal capacitance Csig that can be contributed by a multi-touch panel column connected to analog channel  300  when an input stimulus Vstim is applied to a row in the multi-touch panel and no finger, palm or other object is present, and the dynamic signal capacitance Csig−ΔCsig that can appear when a finger, palm or other object is present. 
     Vstim, as applied to a row in the multi-touch panel, can be generated as a burst of square waves or other non-DC signaling in an otherwise DC signal, although in some embodiments the square waves representing Vstim can be preceded and followed by other non-DC signaling. If Vstim is applied to a row and a signal capacitance is present at a column connected to analog channel  300 , the output of charge amplifier  302  can be pulse train  310  centered at Vref with a peak-to-peak (p-p) amplitude in the steady-state condition that is a fraction of the p-p amplitude of Vstim, the fraction corresponding to the gain of charge amplifier  302 , which is equivalent to the ratio of signal capacitance Csig and preamplifier feedback capacitance Cfb. For example, if Vstim includes 18V p-p pulses and the gain of the charge amplifier is 0.1, then the output of the charge amplifier can be 1.8V p-p pulses. This output can be mixed in signal mixer  304  with demodulation waveform Fstim  316 . 
     Since the stimulation signal can be a square wave, it may be advantageous to use a sinusoidal demodulation waveform to remove the harmonics of the square wave. In order to reduce the stop band ripple of the mixer at a given stimulation frequency, it can be advantageous to use a Gaussian shaped sinewave. The demodulation waveform can have the same frequency as the stimulus Vstim and can be synthesised from a Lookuptable, enabling generation of any shape of demodulation waveform. Besides Gaussian shaped sinewaves, other waveshapes may be programmed to tune the filter characteristics of the mixers. In some embodiments, Fstim  316  may be tunable in frequency and amplitude by selecting different digital waveforms in the LUT  312  or generating the waveforms differently using other digital logic. Signal mixer  304  may demodulate the output of charge amplifier  302  by subtracting Fstim  316  from the output to provide better noise rejection. Signal mixer  304  may reject all frequencies outside the passband, which may in one example be about +/−15 kHz around Fstim. This noise rejection may be beneficial in noisy environment with many sources of noise, such as 802.11, Bluetooth and the like, all having some characteristic frequency that may interfere with the sensitive (femto-farad level) analog channel  300 . Since the frequency of the signals going into the signal mixer can have the same frequency, the signal mixer may be thought of as a synchronous rectifier, such that the output of the signal mixer is essentially a rectified waveform. 
     Offset compensation  306  can then be applied to signal mixer output  314 , which can remove the effect of the static Csig, leaving only the effect of ΔCsig appearing as result  324 . Offset compensation  306  can be implemented using offset mixer  330 . Offset compensation output  322  can be generated by rectifying Fstim  316  using rectifier  332 , and mixing rectifier output  336  with analog voltage from a digital-to-analog converter (DAC)  320  in offset mixer  330 . DAC  320  can generate the analog voltage based on a digital value selected to increase the dynamic range of analog channel  300 . Offset compensation output  322 , which can be proportional to the analog voltage from DAC  320 , can then be subtracted from signal mixer output  314  using subtractor  334 , producing subtractor output  338  which can be representative of the change in the signal capacitance ΔCsig that occurs when a capacitive sensor on the row being stimulated has been touched. Subtractor output  338  is then integrated and can then be converted to a digital value by ADC  308 . In some embodiments, integrator and ADC functions are combined and ADC  308  may be an integrating ADC, such as a sigma-delta ADC, which can sum a number of consecutive digital values and average them to generate result  324 . 
       FIG. 3 b    is a more detailed view of charge amplifier (a virtual ground amplifier)  302  at the input of an analog channel, and the capacitance that can be contributed by the multi-touch panel (see dashed lines) and seen by the charge amplifier. As mentioned above, there can be an inherent stray capacitance Cstray at each pixel on the multi-touch panel. In virtual ground amplifier  302 , with the + (noninverting) input tied to Vref, the − (inverting) input is also driven to Vref, and a DC operating point is established. Therefore, regardless of how much Csig is present, the − input is always driven to Vref. Because of the characteristics of virtual ground amplifier  302 , any charge Qstray that is stored in Cstray is constant, because the voltage across Cstray is kept constant by the charge amplifier. Therefore, no matter how much stray capacitance Cstray is added to the − input, the net charge into Cstray will always be zero. Accordingly, the input charge Qsig_sense=(Csig−ΔCsig_sense)Vstim is zero when the corresponding row is kept at DC and is purely a function of Csig and Vstim when the corresponding row is stimulated. In either case, because there is no charge across Csig, the stray capacitance is rejected, and it essentially drops out of any equations. Thus, even with a hand over the multi-touch panel, although Cstray can increase, the output will be unaffected by the change in Cstray. 
     The gain of virtual ground amplifier  302  is usually small (e.g. 0.1) and is equivalent to the ratio of Csig (e.g. 2 pF) and feedback capacitor Cfb (e.g. 20 pF). The adjustable feedback capacitor Cfb converts the charge Qsig to the voltage Vout. Therefore, the output Vout of virtual ground amplifier  302  is a voltage that is equivalent to the ratio of −Csig/Cfb multiplied by Vstim referenced to Vref. The high voltage Vstim pulses can therefore appear at the output of virtual ground amplifier  302  as much smaller pulses having an amplitude identified by reference character  326 . However, when a finger is present, the amplitude of the output can be reduced as identified by reference character  328 , because the signal capacitance is reduced by ΔCsig. 
     For noise rejection purposes, it may be desirable to drive the multi-touch panel at multiple different frequencies. Because noise typically exists at a particular frequency (e.g., most wireless devices send bursts at a particular frequency), changing the scanning pattern may reduce the system&#39;s susceptibility to noise. Accordingly, in some embodiments, channels (e.g., rows) of the multi-touch panel may be stimulated with a plurality of pulse train bursts. For frequency rejection purposes, the frequency of the pulse trains may vary from one to the other. 
       FIG. 3 c    illustrates an exemplary stimulation signal Vstim with multiple pulse trains  330   a ,  330   b ,  330   c , each of which have a fixed number of pulses, but have a different frequency Fstim (e.g., 140 kHz, 200 kHz, and 260 kHz). With multiple pulse trains at different frequencies, a different result may be obtained at each frequency. Thus, if a static interference is present at a particular frequency, the results of a signal at that frequency may be corrupted as compared to the results obtained from signals having other frequencies. The corrupted result or results can be eliminated and the remaining results used to compute a final result or, alternatively, all of the results may be used. 
     In one embodiment, noise rejection can be accomplished by providing multiple pulse trains at different frequencies and applying a “majority rules” algorithm to the result. In a majority rules algorithm, for each sensing node, the two or more values that provide the best amplitude match are averaged and any possibly corrupt values can be disposed of. 
     As an example, in  FIG. 4 , vertical line  400  represents a range of measured capacitance, where one end of the range may represent larger values and the other end of the range may represent smaller values (or vice versa). Markings  401 ,  402 , and  403  represent three values measured at three different stimulus frequencies Fstim. Values  402  and  403  provide the best match (because their respective values are closer to one another than with value  401 ), possibly suggesting that value  401  is corrupted. Thus, value  401  may be discarded and values  402  and  403  may averaged to form the output. 
     Alternatively, a median filter could be applied, in which case value  402  would be selected, i.e., the median value of the values shown in  FIG. 4 . As yet another alternative, all of the results can be averaged. Accordingly, the three results of  FIG. 4  would have a resulting value somewhere between value  401  and  402 . A variety of other noise rejection techniques for multiple sample values will be obvious to those skilled in the art, any of which may suitably be used with the controller described herein. 
     In an alternative embodiment, the timing between the pulse train bursts applied to a given channel may also vary. Referring back to  FIG. 3 c   , the time between the beginning of first pulse train  330   a  and the beginning of second pulse train  330   b  applied to a channel is t 1 . The time between the beginning of second pulse train  330   b  and the beginning of third pulse train  330   c  applied to that channel is t 2 . In some embodiments the time t 1  may be the same as t 2 , in other embodiments t 1  may be the less than t 2 , and in further embodiments t 1  may be the greater than t 2 . In this manner, varying the timing between pulse train bursts to a given channel may provide further noise rejection advantages. As would be appreciated by one skilled in the art, varying the time between bursts may similarly apply when applying more than three pulse train bursts to a given channel. 
     Additionally, it may be desirable to minimize the amount of stimulus frequency (Fstim) change required for each subsequent burst. Therefore, a frequency variation pattern that minimizes the changes may be used.  FIG. 5  shows one possible frequency variation pattern where the stimulus frequency Fstim changes from Low-Medium-High-High-Medium-Low and so forth. In this arrangement, a first channel is driven at a low frequency (e.g., a 104 kHz burst), then a medium frequency (e.g., a 200 kHz burst), and finally a high frequency (e.g., a 260 kHz burst). Then, a next channel may be driven with three bursts of high (260 kHz), medium (200 kHz), and low (140 kHz), respectively. This particular frequency variation pattern may keep changes between frequencies small and allow the frequency transitions to be smooth and glitch-free. In a variation to this frequency variation pattern, the timing between each burst may be varied as well, as discussed above. 
     In one embodiment, the frequencies for individual bursts are selected based on the passband characteristics of the mixer and the subsequent low pass filter. The width of the passband may be a function of the number of stimulus cycles and integration interval in a given burst and the shape of a synthesized demodulation waveform. Typically, the longer the integration time, the narrower the passband may be. The burst frequencies can be chosen to prevent overlap between the individual passbands. If, for example the passband is +/−15 KHz centered around a given stimulation frequency then the stimulation frequencies may be at least 30 Khz apart, otherwise the individual passbands are overlapping and any noise that will fall between the passbands would corrupt both frequency channels. For the +/−15 Khz passband, frequencies at 170 KHz, 200 KHz and 230 KHz can be chosen. However, to allow for some extra margin, some extra buffer (e.g. 5 Khz on each side of the individual passband) may be added. Accordingly, the stimulation frequencies can be 160 KHz, 200 KHz and 240 KHz. 
     The scan pattern shown in  FIG. 5  represents a scan sequence for two consecutive rows being scanned, assuming each row can be scanned at 3 different frequencies. In one embodiment, more than two rows could be scanned and each row could be scanned at more than three frequencies. If the maximum number of rows is N and the maximum number of frequencies is M, then the total number of scan points would be N×M. A randomizer lookup table could store N×M pairs of data. Each data pair can be comprised of two values, one representing a clock divider value, which represents the ratio of the pixel clock and the stimulus clock, a second representing the time between consecutive scans expressed in number of pixel clock cycles. For example, for a pixel clock fpix=48 MHz and the first data pair (6,10) out of the randomizer lookup table the channel scan logic would scan the 1st point in  FIG. 5 , with a scan frequency of 48/6=8 Mhz and instruct the channel scan logic to scan the next point in  FIG. 5  after 10 pixel clock cycles. A register would be utilized to determine after how many scan points the row count would be incremented to start the next row scanning sequence. In the example of  FIG. 5 , for example, if it is desired to just scan three points per row, then the row counter would be incremented after the third point. The randomizer lookup table could essentially be used to randomize scan sequence in order to vary frequency channels and sequence on a row by row and frame by frame basis. 
     In yet another embodiment of this application, multiple scan sequences represented as points on  FIG. 5  could be combined into one single scan sequence, where the frequency is continuously varied within one single scan. Specifically, the individual pulse trains shown in  FIG. 3 c    could be combined into one single pulse train, but representing frequency components present in the three pulse trains shown. The resulting pulse train could therefore be a quasi random sequence or a frequency modulated signal. 
       FIG. 10  shows a block diagram of pulse train randomizer circuitry. High frequency oscillator  1009  provides a high frequency clock  1010  which is divided down by a pixel clock divider  1015 . The divide value  1012  is provided by a randomizer  1011  which includes a programmable lookup table with quasi random clock divide ratio data. Therefore, the rate of clock signal  1013 , which is clocking the address logic  1020 , can be a quasi randomly selected frequency which affects the rate at which the digital demodulation waveform  1007  is synthesized. In one embodiment, the resulting signal  1003  from demodulation lookup table  1000  is mixed by mixer  1004 . A comparator  1002  functions as a zero crossing detector, generating a squarewave  1008  at its output  1005  that has the same frequency as the digitally synthesized demodulation waveform  1007 . The output  1005  of the comparator provides the stimulation signal for the drive logic  1006 . In an alternate embodiment, the clock signal  1013  provided to the address logic  1020  may be constant in frequency and the frequency of the demodulation waveform  1007  may be a function of the values programmed into the demodulation lookup table  1000  alone or a hybrid scheme may be used. 
     Referring to  FIG. 9 , a high frequency oscillator  901  provides a clock source  902  to address logic  903  (referred to as scan sequence statemachine), pixel clock divider  909  and delay clock divider  917 . Channel scan logic provides a start of sequence signal to the scan sequence statemachine  903  to initiate a scan sequence. Typically, the start of a sequence signal is either provided at the beginning of a new row sequence or at the beginning of a frame to be scanned. The channel scan logic  916  uses control bus  918  to reset the scan sequence state machine  903  at the beginning of a frame. The control bus  918  also contains a signal to advance the randomize lookup table address  905  retrieving the next pair of lookup table values ( 906 ,  908 ). Lookup table value  906  specifies a divide ratio between the clock source  902  and the pixel clock  911  which represents the scan frequency of the next scan sequence. Digital value  908  specifies the delay between the current and the next scan sequence. 
     Other frequency variation arrangements are also possible, including applying fewer than three stimulus frequencies Fstim at a given channel, applying more than three stimulus frequencies Fstim, applying the stimulus frequencies Fstim in a quasi random or random sequence rather than the ordered pattern described above, and adaptive frequency variation, in which the stimulus frequencies Fstim are selected based on the noise environment or previous noise results. 
     Multiple stimulus frequencies Fstims may be applied in different ways to the multi-touch panel. In some embodiments, the same Fstim may be sequentially applied to all channels (rows) (i.e., scanning one frame at a single stimulus frequency), and then repeated for the other, different frequencies. In other embodiments, a low, medium and high frequency Fstim may be applied to one channel, before moving on to the next channel. After an entire “image” is captured, it may be processed. In further embodiments, multiple stimuli (scan signals) are applied to different rows at the same time to speed up the process, which may be desirable for large multi-touch panels and when communications are USB, which could drop packets if too slow. Furthermore, Fstim may be programmable. In some embodiments, a lookup table may be used to synthesize a demodulation waveform. The feedback capacitance Cfb and offset may also be programmable. 
     The manner in which stimulus frequencies can be applied to the sensing nodes  126  of multi-touch panel  124  can be controlled by channel scan logic  110  or, alternatively, by the multi-touch panel processor. Other variations may also be used, as appreciated by those skilled in the art. An example of channel scan logic is described in Applicant&#39;s U.S. patent application Ser. No. 11/650,201 entitled “Channel Scan Logic,” filed Jan. 3, 2007, now issued as U.S. Pat. No. 8,094,128, issued on Jan. 10, 2012, the contents of which are herein incorporated by reference. 
     Further understanding of the operation of the system  100  may be had with reference to an exemplary image acquisition process  600  illustrated in  FIG. 6 . One skilled in the art will appreciate that various timing and memory storage issues are omitted from this flowchart for the sake of clarity. 
     Image acquisition of a row of a touch sensitive panel (such as multi-touch panel  124  of  FIG. 1 ) begins at block  601 . The system then sets a clock so as to acquire samples at a middle clock frequency (e.g., 200 kHz) in block  602 . Various programmable registers, which control such parameters as voltage offset, amplifier gain, delay clocks, etc., are then updated (block  603 ). Some or all of the columns (sensing lines) of the multi-touch panel are read, with the result stored as a middle result value (block  604 ). A high clock frequency is then set (block  605 ), and the steps of updating registers (block  606 ) and reading the columns and storing the result (block  607 ) are repeated for the high sample frequency. The clock is then set to the low frequency (step  608 ) and the register update (block  609 ) and column reading (block  610 ) are repeated for the low frequency. 
     The three result values (middle, high and low) may then be offset compensated, as described above (block  611 ). The offset compensated values may then be subjected to a filter, such as an averaging or median filter or any other suitable filtering technique, also as described above. In any case, a final result of the channel that was sampled is stored. If more rows remain, the process returns to the mid-frequency sampling at block  602 . If all rows are completed (block  613 ), the entire image is output to the host device via, for example, the host processor  128  (block  614 ), and a subsequent new image is acquired (block  601 ). 
       FIG. 7  illustrates an exemplary mobile (e.g., cellular) telephone  736  that may include multi-touch panel  724 , display device  730 , and other computing system blocks in the computing system  100  of  FIG. 1 . In the example of  FIG. 7 a   , if a user&#39;s cheek or ear is detected by one or more multi-touch panel sensors, computing system  100  may determine that mobile telephone  736  is being held up to the user&#39;s head, and therefore some or all of multi-touch subsystem  106  and multi-touch panel  124  may be powered down along with display device  130  to save power. 
       FIG. 8  illustrates an exemplary digital audio/video player that may include multi-touch panel  824 , display device  830 , and other computing system blocks in the computing system  100  of  FIG. 1 . 
     While this invention has been described in terms of several preferred embodiments, there are alterations, permutations, and equivalents, which fall within the scope of this invention. For example, the term “computer” does not necessarily mean any particular kind of device, combination of hardware and/or software, nor should it be considered restricted to either a multi purpose or single purpose device. Additionally, although the embodiments herein have been described in relation to touch screens, the teachings of the present invention are equally applicable to touch pads or any other touch surface type of sensor. Furthermore, although the disclosure is primarily directed at capacitive sensing, it should be noted that some or all of the features described herein may be applied to other sensing methodologies. It should also be noted that there are many alternative ways of implementing the methods and apparatuses of the present invention. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.

Metadata:
Filing Date: 20160216
Publication Date: 20170228
Grant Date: 20170228
Priority Date: 20070103
Inventors: KRAH CHRISTOPH HORST
VU MINH-DIEU THI
Assignee: APPLE INC
CPC Classifications: [{"code": "G06F3/03545", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/044", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/048", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F2203/04106", "inventive": false, "first": false, "tree": "[]"}, {"code": "G06F2203/04104", "inventive": false, "first": false, "tree": "[]"}, {"code": "G06F3/0416", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F3/0446", "inventive": false, "first": false, "tree": "[]"}, {"code": "G06F3/04182", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/04166", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F3/03545", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/048", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/03545", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F2203/04108", "inventive": false, "first": false, "tree": "[]"}, {"code": "G06F2203/04106", "inventive": false, "first": false, "tree": "[]"}, {"code": "G06F2203/04104", "inventive": false, "first": false, "tree": "[]"}, {"code": "G06F3/044", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/04182", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/04166", "inventive": true, "first": true, "tree": "[]"}]
Family ID: 39247969