Multi-layered sensing with multiple resolutions

A display component (108) displays multiple icons that a user can touch. A multi-layered sensing component (104) includes at least a high resolution sensing component (204) and a low resolution sensing component (202). The low resolution sensing component is activated to detect objects touching the multi-layer sensing component. In response to the low resolution sensing component detecting an object touching one of the multiple icons, the low resolution sensing component is deactivated and at least a portion of the high resolution sensing component over the touched icon is activated. The high resolution sensing component senses the user's fingerprint, which is authenticated. After sensing the user's fingerprint, the high resolution sensing component is deactivated and the low resolution sensing component is reactivated.

BACKGROUND

As computing technology has advanced, computing devices such as smart phones, tablet computers, desktop computers, and so forth have become increasingly commonplace. Users often times desire to restrict access to their devices, whether because they don't want others to use the functionality that the devices provide, because they store data on their devices that they desire to keep secret, or some other reason. To restrict access, devices typically have an authentication step that must be passed by the user before they can access one of their devices, such as entry of a password or personal identification number (PIN) on a log-in screen, or capturing of a fingerprint by a dedicated fingerprint sensor. Such authentication steps, however, can be time consuming and detract from the usability of the devices, leading to frustrating user experiences.

DETAILED DESCRIPTION

Multi-layered sensing with multiple resolutions is discussed herein. Multiple icons are displayed and can be selected by being touched by an object, such as a user's finger. A multi-layered sensing component includes at least a high resolution sensing component and a low resolution sensing component. The low resolution sensing component is activated to detect objects touching the multi-layer sensing component. In response to the low resolution sensing component detecting an object touching one of the multiple icons, the low resolution sensing component is deactivated and at least a portion of the high resolution sensing component over the touched icon is activated. The high resolution sensing component senses the user's fingerprint, which is authenticated. After sensing the user's fingerprint, the high resolution sensing component is deactivated and the low resolution sensing component is reactivated.

FIG. 1illustrates an example device102implementing the multi-layered sensing with multiple resolutions in accordance with one or more embodiments. The device102includes a multi-layer sensing component104, a sensing component control module106, a display component108, a display control module110, a fingerprint characteristics sensing module112, a user authentication module114, and a memory device116with authentication data118. The device102can be any of a variety of different types of devices, such as a laptop computer, a cellular or other wireless phone, a tablet computer, an entertainment device, an audio and/or video playback device, a server computer, and so forth.

Although illustrated as a single device102, it should be noted that different modules of the device102can alternatively be implemented in different devices. For example, the multi-layer sensing component104, the sensing component control module106, the display component108, and the display control module110can be implemented in one device, and the fingerprint characteristics sensing module112, the user authentication module114, and the memory device116can be implemented in another device. It should also be noted that the device102can include additional modules or components that provide additional functionality (e.g., a central processing unit (CPU), communication components, etc.), or alternatively such additional modules or components can be implemented in a separate device. For example, the device102may be implemented as a wearable device (e.g., a watch) that communicates with another device that implements the additional functionality.

The multi-layer sensing component104is a multi-layer component, the multiple layers including at least two layers that are sensing components each having different sensing component resolutions. Each layer of the multi-layer sensing component104can be implemented using any of a variety of different technologies and types of sensors, such as capacitive sensors, pressure sensors, optical sensors, thermal sensors, ultrasonic sensors, imaging sensors, and so forth. For example, each layer of the multi-layer sensing component104can be an indium tin oxide (ITO) sensor. The multi-layer sensing component104can optionally be part of a sensor structure that includes one or more layers providing various additional functionality, such as protection from scratches and abrasions, feedback regarding a user touching the multi-layer sensing component104, and so forth. Different layers of the multi-layer sensing component104can be implemented using the same or different technologies.

The multi-layer sensing component104and the display component108together can implement a touch display structure.FIG. 2illustrates a cross-section view of an example touch display structure200in accordance with one or more embodiments. The touch display structure200includes a multi-layer sensing component104having a low resolution sensing component202and a high resolution sensing resolution sensing component204. The high resolution sensing component204and the low resolution sensing component202are each a layer of the multi-layer sensing component104. Although the sensing component104includes the high resolution sensing component204and the low resolution sensing component202, typically only one of the two components202and204is activated at any given time. The one of the components202and204that is activated is able to sense an object touching the touch display structure200, whereas the one of the components202and204that is not activated (e.g., is inactive or is deactivated) is not able to sense an object touching the touch display structure200.

The sensing components202and204are separated by an additional separation layer that is illustrated as display glass206. However, it should be noted that the sensing components202and204can be separated by a layer made of any of a variety of different materials, such as various plastic materials, adhesive only, and so forth. Alternatively, depending on the manner in which the sensing components202and204are implemented, no layer need separate the sensing components202and204, and the sensing components202and204can be adjacent to one another.

Situated on top of the multi-layer sensing component104is a cover layer208, that can be made of any of a variety of protective materials, such as glass, plastic, or other protective coating. The cover layer208provides protection from scratches, abrasions, the environment, and so forth. Alternatively, depending on the manner in which the sensing component204is implemented, no protective layer on top of the multi-layer sensing component104need be used.

Reference is made herein to components or layers being above others. In the touch display structure200, the high resolution sensing component204is referred to as being above or on top of the low resolution sensing component202, and the low resolution sensing component202is referred to as being below or on bottom of the high resolution sensing component204. A user can touch the top212of the cover layer208(the face of the cover glass opposite the face touching the high resolution sensing component204). In one embodiment the high resolution sensing component204is situated closer to the top212(where a finger would touch the structure200) than the low resolution sensing component202.

The sensing components202and204have different resolutions. The resolution of a sensing component202or204indicates a number of dots or points per unit that can be sensed by the component. References to these dots or points per unit being dots per inch are made herein, although it should be noted that other units can alternatively be used (e.g., centimeters). In one or more embodiments, each sensing component202and204is a grid of lines (e.g., ITO lines) including multiple rows of lines and multiple columns of lines, some lines (e.g., rows, or alternatively columns) being drive lines and other lines (e.g., columns, or alternatively rows) being sense lines. A current is driven on the drive lines, and the sense lines sense an object touching the grid (e.g., touching the top of the sensing component, or the top212of the cover layer208). The larger the number of drive and sense lines the greater the resolution that the sensing component can provide. The dots or points in such a grid are at each intersection of a column line and a row line.

The high resolution sensing component204is a sensing component having a larger number of dots per inch, such as on the order of a few hundred dots per inch. The high resolution sensing component204has sufficient resolution to sense an object touching the sensing component as well as detail regarding the object. The high resolution sensing component204can sense fingerprint data of a user's finger that is touching the sensing component104(e.g., touching the top212of the cover layer208). The fingerprint data contains a fingerprint's pattern on each of the fingers, allowing the location of various minutiae or pattern(s) of the fingerprint and/or the outline or shape of the finger to be identified. The minutiae of the fingerprint refer to, for example, the ridge endings and bifurcations of the fingerprint. The minutiae of the fingerprint can optionally include additional details, such as the points at which scars begin, the points at which scars end, and so forth.

The low resolution sensing component202has a smaller number of dots per inch, such as on the order of tens of dots per inch. The low resolution sensing component has sufficient resolution to sense an object touching the sensing component, but very little (if any) detail regarding the object. For example, the low resolution sensing component202can sense a finger touching the sensing component, but cannot detect fingerprint minutiae or pattern(s). Although the low resolution sensing component202has a lower resolution than the high resolution sensing component204, the low resolution sensing component202typically consumes less power than the high resolution sensing component204.

Although two sensing components202and204are illustrated, alternatively the sensing component104can include one or more additional sensing components. For example, the multi-layer sensing component104may include a medium resolution sensing component (not shown) that has a smaller number of dots per inch than the high resolution sensing component204but a larger number of dots per inch than the low resolution sensing component202.

In one embodiment, each of the high resolution sensing component204and the low resolution sensing component202has a fixed resolution. In this embodiment, the resolution of each sensing component202and204does not change during operation of the touch display structure200. In other embodiments, one or both of the high resolution sensing component204and the low resolution sensing component202can operate at different resolutions, also referred to as operating in different resolution modes. For example, the high resolution sensing component204may be able to operate in a high resolution mode having a larger number of dots per inch (such as on the order of a few hundred dots per inch) and a medium resolution mode having a smaller number of dots per inch than the high resolution mode but a larger number of dots per inch than the low resolution sensing component202(such as on the order of a hundred or so dots per inch).

Additionally, different areas of one or both of the high resolution sensing component204and the low resolution sensing component202can be activated while other areas are deactivated. For example, one area of the high resolution sensing component204may be operating in a high resolution mode concurrently with another area of the high resolution sensing component204being deactivated. An area being deactivated refers to the area being unable to sense an object touching the area. The manner in which an area of a sensing component is deactivated can vary based on the manner in which the sensing component is implemented. For example, if the sensing component is a grid of drive lines and sense lines, an area can be deactivated by deactivating (not driving) current on the drive lines that pass through that area, and by not powering (deactivating) sensing circuitry to sense current on the sense lines that pass through that area.

Returning toFIG. 1, the sensing component control module106controls the multi-layer sensing component104. The sensing component control module106determines which layers of the sensing component104are to be activated at which times, and for each layer which areas of the layer are to be activated at which times. The sensing component control module106can determine which layers are to be activated, and for a given layer which areas of the layer are to be activated in a variety of different manners as discussed in more detail below.

Returning toFIG. 1, the display control module110manages display of the UI, content, or other information on the display component108. The UI includes various elements, referred to as icons, that are displayed to users and represent functionality of the device102(or another device that the device102is coupled to).

The fingerprint characteristics sensing module112receives the fingerprint data, also referred to as the sensed fingerprint data, that is sensed by the multi-layer sensing component104. In one embodiment, this fingerprint data is an indication of the locations where different portions of the surface of the finger are sensed as protruding further than other portions, these protruding portions resulting in the fingerprint's pattern. The locations can be identified in various different manners, such as using a2-dimensional Cartesian coordinate system in which the locations where protrusions are sensed are identified (e.g., a grid or matrix of values corresponding to sensor locations can be used, with one value (e.g., a value of 1) in the grid or matrix indicating a protrusion is sensed at the corresponding location, and another value (e.g., a value of 0) in the grid or matrix indicating a protrusion is not sensed at the corresponding location). Alternatively, other coordinate systems can be used, such as Polar coordinate systems, proprietary coordinate systems, and so forth.

The fingerprint characteristics sensing module112identifies, based on the sensed fingerprint data, various finger characteristics of one or more of the user's fingers sensed by the multi-layer sensing component104. These finger characteristics can include, for example, the general shape of the fingers (e.g., the lengths and widths of the fingers relative to one another), the locations of boundaries between fingers, the locations of minutiae in a fingerprint relative to the locations of other minutiae in the same fingerprint, the locations of minutiae in a fingerprint relative to the locations of minutiae in one or more other fingerprints, and so forth.

Various data regarding the user's finger characteristics is stored in the memory device116, which can be volatile and/or nonvolatile memory (e.g., RAM, Flash memory, magnetic disk, etc.), as authentication data118. The authentication data118includes data indicating one or more correct or representative finger characteristic samples for a user. Finger characteristic samples can be stored as part of the authentication data118during an enrollment process, which refers to a process during which the user is setting up or initializing the device102to authenticate his or her fingerprint. Finger characteristic samples can also be stored at other times, such as in response to a user being authenticated using the techniques discussed herein. For example, each time the user is successfully authenticated, the finger characteristics sensed during that authentication process can be combined (e.g., averaged) with the previously stored authentication data.

The fingerprint characteristics sensing module112generates data identifying the finger characteristics and makes the generated data available to the user authentication module114. The user authentication module114analyzes the finger characteristics identified by the module112and compares the identified characteristics to one or more stored finger characteristic samples maintained as part of the authentication data118. Based on this comparison, the finger authentication module114determines whether the finger characteristics identified by the module112satisfy the authentication data118. If the finger characteristics satisfy the authentication data (e.g., the finger characteristics match stored finger characteristics data), then the user authentication succeeds and the user is authenticated. However, if the finger characteristics do not satisfy the authentication data (e.g., the finger characteristics do not match stored finger characteristics data), then the user authentication fails and the user is not authenticated.

The user authentication module114can make this comparison in different manners in accordance with various different embodiments. In one embodiment, the authentication module114compares the finger characteristics identified by the sensing module112to the authentication data118and determines whether the identified finger characteristics match stored finger characteristics data for the user.

The authentication module114can determine whether two sets or samples of finger characteristics (e.g., finger characteristics identified by the sensing module112and finger characteristics stored as the authentication data118) match in various different manners. In one embodiment, the finger characteristics (e.g., locations of minutiae, patterns, finger widths, relative finger lengths) in the two finger characteristics samples are compared. If a number of corresponding finger characteristics in the two finger characteristics satisfies (e.g., is equal to and/or greater than) a threshold value then the two finger characteristics samples match; otherwise, the two finger characteristics samples do not match. The number of corresponding finger characteristics in the two finger characteristics samples can be, for example, a number of corresponding locations in the two finger characteristics samples where minutiae are located, a number of finger widths or lengths, and so forth. In another embodiment, rather than relying on whether the number of corresponding finger characteristics in the two finger characteristics satisfies a threshold value, various public and/or proprietary pattern matching techniques can be used to compare patterns in the two finger characteristics samples (e.g., patterns of minutiae) and determine whether the two finger characteristics samples match.

It should be noted that user authentication can be performed by the device102for its own use and/or used by another system or device. For example, the user authentication module114can authenticate a user in order to allow the user to access the device102itself, programs or applications running on the device102, other modules or components of the device102, and so forth. Alternatively, the module114can authenticate a user in order to allow the user to access another system or device coupled to the device102, another system or device accessed by the device102via the Internet or other network, and so forth.

It should also be noted that one or more layers of the multi-layer sensing component104can operate in different resolution modes as discussed above, and that different resolution modes of such a layer may be able to sense different details regarding an object and thus provide different amounts of fingerprint data. For example, the high resolution sensing component204ofFIG. 2may operate in a high resolution mode or a medium resolution mode, and may provide fingerprint data to the fingerprint characteristics sensing module112in both of these modes. However, a larger amount of fingerprint data may be provided to the fingerprint characteristics sensing module112when the high resolution sensing component204is operating in the high resolution mode than in the medium resolution mode. The amount of fingerprint data provided to the fingerprint characteristics sensing module112can affect whether the user authentication module114can authenticate a user and/or the accuracy of the authentication. Generally, larger amounts of fingerprint data lead to increased ability to authenticate a user and increased accuracy of the authentication.

FIG. 3illustrates an example process300implementing the multi-layered sensing with multiple resolutions in accordance with one or more embodiments. Process300is implemented by one or more devices, such as by the device102ofFIG. 1. Process300can be implemented in software, firmware, hardware, or combinations thereof. Process300is shown as a set of acts and is not limited to the order shown for performing the operations of the various acts. Process300is an example of implementing the multi-layered sensing with multiple resolutions; additional discussions of implementing the multi-layered sensing with multiple resolutions are included herein with reference to different FIGs.

Process300is discussed with reference toFIGS. 4-6, which illustrate examples of devices102implementing the multi-layered sensing with multiple resolutions discussed herein. The examples inFIGS. 4-6illustrate a sensing component104overlaying a display component108, the sensing component104being illustrated as a sensing grid of column lines and row lines. Although illustrated as a grid overlaying a display component in the examples ofFIGS. 4-6, the sensing component104can alternatively be implemented in other manners as discussed above. Additionally, although the grid is illustrated inFIGS. 4-6, it should be noted that the grid may not be (but alternatively can be) visible to the user of the device102. The sensing component104operates as a conventional touchscreen (e.g., allowing selection of icons and other interaction with the displayed user interface) as well as a fingerprint sensor.

In process300, multiple icons are displayed on a display component (act302). These multiple icons can represent various functionality as discussed above. For example, the device102ofFIG. 4displays an icon402and an icon404. The icon402includes a telephone handset, and represents telephone functionality of the device102. The icon404includes an envelope, and represents electronic mail and/or messaging functionality of the device102. It should be noted that the icons402and404are examples, and that various other icons representing various other functionality can alternatively and/or additionally be displayed by the device102. The functionality represented by displayed icons can be implemented by the device102in software, firmware, hardware, or combinations thereof.

Returning toFIG. 3, a low resolution sensing component is activated (act304). The low resolution sensing component, such as the low resolution sensing component202ofFIG. 2, can sense a relatively small number of dots per inch. In the example device102ofFIG. 4, the low resolution sensing component is activated, illustrated by a low density of column and row grid lines. The resolution of the low resolution sensing component is sufficient to sense an object touching one of the icons402and404, as well as sense which of the icons402and404is touched. As only one of the low resolution sensing component and the high resolution sensing component is active at a time, the high resolution sensing component is inactive in act304.

An object touching one of the multiple icons is detected by the low resolution sensing component (act306). The display component displays an icon in a particular portion of the display component as discussed above. An object touching an icon refers to an object touching part of a top layer of the touch display structure (e.g., touching the top212of the cover layer208ofFIG. 2) that corresponds to (is situated over) the icon.

Various actions can be taken in response to detecting an object touching an icon. For functionality associated with some icons, user authentication is to be performed. If user authentication is to be performed, the low resolution sensing component is deactivated and the high resolution sensing component is activated. Different functionality can use different user authentication levels (e.g., a particular accuracy of the authentication that is to be achieved), and thus different resolutions of the high resolution sensing component can be used to achieve the appropriate accuracy of the authentication.

Thus, in response to detecting an object touching an icon, the sensing component control module106ofFIG. 1can change which of the high resolution sensing component and the low resolution sensing component is activated. The sensing component control module106can also optionally determine which areas of the high resolution sensing component are activated, as discussed in more detail below.

In one embodiment, the sensing component control module106can also change the resolution mode that the high resolution sensing component is operating in. The resolution mode that the high resolution sensing component is to operate in can be determined by the sensing component control module106in different manners. For example, an icon can include (e.g., in data describing the icon or metadata) a security setting that indicates a resolution mode to use for the icon (a resolution mode to be activated in order to sense fingerprint data to authenticate the user to use the functionality represented by the icon). This indication can take various forms, such as specifying a particular resolution mode (e.g., high resolution or medium resolution), specifying a particular numeric value (e.g., a particular number of dots per inch the resolution mode is to support), and so forth. Alternatively, the resolution mode can be determined in other manners, such as by the sensing component control module106ofFIG. 1. For example, the high resolution mode of the sensing component may automatically be activated in response to any icon being touched, or any of a particular subset of icons being touched (e.g., any icons corresponding to functionality for which user authentication is to be performed).

An accuracy of user authentication, and thus the resolution mode to activate in response to detecting an object touching an icon, can be defined in various manners. In one embodiment, an application providing the functionality represented by the icon specifies the resolution mode that is to be activated in response to detecting an object touching the icon. This specified resolution mode can optionally be changed by various other components or entities, such as a user of the device102, contacts of the device, an administrator managing the device102, a remote service with which the device102communicates (e.g., a banking service that a banking application communicates with), and so forth.

It should be noted that some functionality may use no user authentication. In response to detecting an object touching an icon representing such functionality, the low resolution sensing component need not be deactivated and the high resolution sensing component need not be activated. For example, assume that the telephone functionality represented by the icon402ofFIG. 4can be used without user authentication. In response to an object touching the icon402, the low resolution sensing component remains active.

However, in response to detecting an object touching an icon representing functionality that does desire user authentication, the low resolution sensing component is deactivated (act308), and at least an area of the high resolution sensing component that corresponds to the touched icon is activated (act310). The high resolution sensing component can optionally be activated to operate in one of multiple different resolution modes, and the particular mode that the high resolution sensing component is activated to operate in act310can be determined in different manners as discussed above.

In one embodiment, the area of the high resolution sensing component that is activated is a portion of the high resolution sensing component that corresponds to the touched icon, and other portions of the high resolution sensing component (portions that are beyond the portion that corresponds to the touched icon) are inactive. The portion of the high resolution sensing component that corresponds to the touched icon is the portion of the high resolution sensing component that is approximately over (e.g., over or close to being over) the touched icon. The portion of the sensing component that is over a touched icon refers to the grid lines that pass over the touched icon, or other dots or points that pass over or are otherwise situated over the touched icon. The portion of the sensing component that is close to being over the touched icons refers to the grid lines that are within a threshold distance of passing over the touched icon, or other dots or points that pass over or are otherwise situated within a threshold distance of being over the touched icon. Although referred to herein as a portion being over or close to being over a touched icon, in situations in which the sensing component is implemented in a layer below the display component, the portion of the sensing component can analogously be below (or close to being below) the touched icon.

For example, assume that the electronic mail and/or messaging functionality represented by the icon404ofFIG. 4uses user authentication. In response to an object touching the icon404, the area of the high resolution sensing component that corresponds to the icon404is activated as illustrated by the device102ofFIG. 5. The area of the high resolution sensing component that is activated is the portion of the multi-layer sensing component104including the column lines502and the row lines504of a sensing grid passing over (or close to passing over) the icon404. The area of the high resolution sensing component that is activated is illustrated by a high density of column lines502and row lines504; other areas of the high resolution sensing component are not activated.

The column lines502and row lines504include drive lines and sense lines. Depending on the manner in which the high resolution sensing component is implemented, power may be consumed by drive lines being driven and sense lines being sensed. If power is consumed by both drive lines being driven and sense lines being sensed, then the drive lines that pass over or are close to passing over the touched icon are driven and circuitry to sense current on the sense lines that pass over or are close to passing over the touched icon is powered. Other drive lines are deactivated and circuitry for sensing other sense lines is deactivated. However, if power is consumed by drive lines being driven but not sense lines being sensed (or there is very little or no change in power consumed based on which sense lines are being sensed), then the drive lines that pass over or are close to passing over the touched icon are driven (but other drive lines are deactivated), and no circuitry to sense current on any of the sense lines need be deactivated.

In another embodiment, rather than activating just an area of the high resolution sensing component that corresponds to the touched icon, substantially all of the high resolution sensing component is activated. Although some portions of the sensing component may not be activated in the higher resolution mode (e.g., portions around the edges of the sensing component), all or at least almost all of the high resolution sensing component is activated. For example, assume that the electronic mail and/or messaging functionality represented by the icon404ofFIG. 4uses user authentication. In response to an object touching the icon404, the high resolution sensing component is activated as illustrated by the device102ofFIG. 6. Substantially all of the high resolution sensing component is activated in the higher resolution mode, which in the example ofFIG. 6is illustrated by a high density of column and row grid lines.

Returning toFIG. 3, a fingerprint is sensed by the high resolution sensing component in at least the area that corresponds to the touched icon (act312). The fingerprint is sensed by the fingerprint characteristics sensing module112ofFIG. 1identifying, based on the sensed fingerprint data, various finger characteristics of one or more of the user's fingers sensed by the high resolution sensing component as discussed above.

The sensed fingerprint is authenticated (act314). The sensed fingerprint is authenticated by the user authentication module114ofFIG. 1analyzing the finger characteristics identified in act312and comparing the identified characteristics to one or more stored finger characteristic samples maintained as part of the authentication data118as discussed above. The authentication in act314can result in a successful authentication (e.g., and the user is permitted access to the functionality represented by the icon) or an unsuccessful authentication (e.g., and the user is denied access to the functionality represented by the icon).

If the user's fingerprint is successfully authenticated, an indication of the identity of the user (e.g., as associated with the finger characteristic samples used to authenticate the user's fingerprint) can be provided to an application or other functionality represented by the touched icon. The application or other functionality represented by the touched icon is thus able to run with the identity of the user. The identity of the user can be used by the application or other functionality in various manners, such as to access data associated with the user, enter into transactions for the user, and so forth.

The high resolution sensing component is also deactivated (act316) and the low resolution sensing component is again activated (act318). The high resolution sensing component can be deactivated and the low resolution sensing component reactivated in response to the user fingerprint being successfully authenticated. Alternatively, the high resolution sensing component can be deactivated and the low resolution sensing component activated at other times or in response to other events, such as after a threshold amount of time elapses without the user authentication module114being able to successfully authenticate the fingerprint, in response to the user authentication module114indicating that the module114cannot successfully authenticate the fingerprint, in response to the icon no longer being touched (e.g., keeping the area of the high resolution sensing component activated only so long as the object is touching the icon), and so forth.

Thus, the low resolution sensing component of the multi-layer sensing component is activated and operates until an object touches one of the displayed icons, and in response to the touch the low resolution sensing component can be deactivated and the high resolution sensing component activated. After a fingerprint is authenticated, the high resolution sensing component can be deactivated and the low resolution sensing component re-activated. The device102thus does not expend power to run the high resolution sensing component, except for when used to sense fingerprints.

It should be noted that in the examples ofFIGS. 4-6, the icons402and404are illustrated as being displayed in particular locations on the display component. These different locations are examples, and the icons402and404can be displayed anywhere on the display component and can be moved to different locations on the display component by the user (e.g., by dragging and dropping an icon). The sensing component control module106ofFIG. 1can be aware of the locations of the icons (e.g., via communication with the display control module110). Thus, if an icon is moved to a new location on the display component and is touched at that new location, the sensing component control module106can activate an appropriate area of the high resolution sensing component that corresponds to the touched icon at its new location.

In the embodiments discussed herein, the high resolution sensing component can have a large number (e.g., thousands) of drive lines, such as in a sensing grid. In one embodiment, a driver component driving these drive lines is able to concurrently drive the number of lines dictated by the high resolution sensing component used by the device102. In this embodiment, the driver component drives the appropriate lines based on which areas of the high resolution sensing component are to be activated as discussed above.

In another embodiment, the driver component does not concurrently drive the number of lines dictated by the sensing component resolutions used by the device102. In this embodiment, the driving of drive lines is time division multiplexed, resulting in different portions of the high resolution sensing component being driven or activated at different times.

FIG. 7illustrates an example system700multiplexing drive lines in accordance with one or more embodiments. The system700includes a driver component702, a multiplexer component704, and the high resolution sensing component204. The high resolution sensing component204is a sensing grid with rows of drive lines. The high resolution sensing component204is separated into four parts710,712,714, and716, with the rows of drive lines of the high resolution sensing component204being grouped into one of the four parts. The driver component702provides signals to drive the drive lines of the high resolution sensing component204, and the multiplexer component704multiplexes those signals to the different parts710-716, providing the signals to different ones of parts710-716at different times. Thus, different parts of the high resolution sensing component204are activated at different times. For example, the multiplexer component704provides the signals to part710for an amount of time, then to part712for an amount of time, then to part714for an amount of time, then to part716for an amount of time, then to part710for an amount of time, and so forth. The multiplexer component704multiplexes the signals quickly enough so that user inputs (e.g., touches) can be provided to the high resolution sensing component204and responded to with little if any delay in response that is noticeable to a user of the device102. For example, the multiplexer component704can multiplex the signals so that each of parts710-716receives the signals for approximately 25 milliseconds every 100 milliseconds. However, it should be noted that these values are an example, and other values can alternatively be used.

FIG. 8illustrates an example system800multiplexing drive lines in accordance with one or more embodiments. The system800includes a driver component802, a multiplexer component804, and the high resolution sensing component204. The high resolution sensing component204is a sensing grid with rows of drive lines. The high resolution sensing component204is separated into eight parts810,812,814,816,818,820,822, and824, with the rows of drive lines of the high resolution sensing component204being grouped into one of the eight parts. The driver component802provides signals to drive the drive lines of the high resolution sensing component204, and the multiplexer component804multiplexes those signals to the different parts810-824, providing the signals to different ones of parts810-824at different times. Thus, different parts of the high resolution sensing component204are activated at different times. For example, the multiplexer component804provides the signals to part810for an amount of time, then to part812for an amount of time, then to part814for an amount of time, then to part816for an amount of time, then to part818for an amount of time, then to part820for an amount of time, then to part822for an amount of time, then to part824for an amount of time, then to part810for an amount of time, and so forth. The multiplexer component804multiplexes the signals quickly enough so that user inputs can be provided to the high resolution sensing component204and responded to with little if any delay in response that is noticeable to a user of the device102. For example, the multiplexer component804can multiplex the signals so that each of parts810-824receives the signals for approximately 12.5 milliseconds every 100 milliseconds. However, it should be noted that these values are an example, and other values can alternatively be used.

Despite the multiplexing of drive lines illustrated in the systems700and800, the driver components702and802still drive the number of lines dictated by the sensing component resolutions used by the device102. Drive lines for the appropriate areas of the high resolution sensing component204are activated at the appropriate times as discussed above. Any of various components (such as the driver component702or802) can readily determine, based on which areas of the high resolution sensing component204are to be activated at any given time as well as the manner in which the signals from the driver component702or802are multiplexed by the multiplexor component704or804, which signals to drive at which times so that the appropriate drive lines of the high resolution sensing component are driven at the appropriate times.

Additionally, as discussed above one of the high resolution sensing component204and the low resolution sensing component202is activated at a time. In one embodiment, separate driver components are associated with each of the components204and202, one driver component driving drive lines of the high resolution sensing component204when the component204is activated, and the other driver component driving the drive lines of the low resolution sensing component202when the component202is activated.

In another embodiment, one driver component drives both the high resolution sensing component204and the low resolution sensing component202.FIG. 9illustrates an example touch display structure200having sensing components driven by the same driver component in accordance with one or more embodiments. The driving of drive lines for the high resolution sensing component204and the low resolution sensing component202is time division multiplexed, resulting in different ones of the components202and204being driven at different times. The one of the components202and204having its drive lines driven at any given time is the one of the components202and204that is active at that given time.

In the discussions above, reference is made to sensing a fingerprint while a finger is touching an icon. It should be noted that situations can arise where fingerprint data for multiple fingers is sensed by the multi-layer sensing component104. Such situations can arise in various manners, such as after an initial user authentication is performed (e.g., in response to a user touching an icon) for functionality that desires further authentication in the form of additional fingerprints. When sensing multiple fingerprints, the multi-layer sensing component104can sense the fingerprint data for the multiple fingerprints serially or in a serial mode (e.g., one fingerprint after the other), or alternatively in parallel or in a parallel mode (e.g., the multiple fingerprints concurrently). The areas of the multi-layer sensing component104that the multiple fingers are touching can be sensed by the low resolution sensing component202, and at least the corresponding areas (e.g., portions of the high resolution sensing component that are approximately over the touched area, analogous to portions of the high resolution sensing component being approximately over a touched icon discussed above) of the high resolution sensing component204can be activated to sense the fingerprints. Alternatively, an indication can be provided to the user to place his or her fingers on a particular portion of the touch display structure200corresponding to an area of the high resolution sensing component204that can be activated to sense fingerprints, or substantially all of the high resolution sensing component can be activated.

Thus, using the techniques discussed herein, the user is authenticated on demand, as he or she uses the device102. No separate authentication screen need be displayed to the user, and no separate fingerprint sensor need be used. Rather, by simply touching the icon that represents the functionality the user desires to invoke and for which user authentication is used, the user's fingerprint is authenticated. The multi-layer sensing component has high and low resolution sensing components, conserving power by not keeping the high resolution sensing component always running.

The techniques discussed herein support various usage scenarios. For example, a user's device can support different functionality (e.g., run multiple applications) that use different authentication accuracies. By simply touching an icon with his or her finger to run the application represented by the icon, the user's fingerprint is automatically authenticated using the appropriate authentication accuracy for the application represented by the icon. By way of another example, the device includes a high resolution sensing component to authenticate fingerprints, but can use low sensing component resolutions at other times. Thus, the user's fingerprint can be authenticated by activating the high resolution sensing component, but the device can conserve power by activating the low resolution sensing component after the user's fingerprint has been sensed.

FIG. 10illustrates various components of an example electronic device1000that can be implemented as a device as described with reference to any of the previousFIGS. 1-9. The device may be implemented as any one or combination of a fixed or mobile device, in any form of a consumer, computer, portable, user, wearable, communication, phone, navigation, gaming, messaging, Web browsing, paging, media playback, and/or other type of electronic device, such as the device102.

The electronic device1000can include one or more data input ports1002via which any type of data, media content, and/or inputs can be received, such as user-selectable inputs, messages, music, television content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source. The data input ports1002may include USB ports, coaxial cable ports, and other serial or parallel connectors (including internal connectors) for flash memory, DVDs, CDs, and the like. These data input ports may be used to couple the electronic device to components, peripherals, or accessories such as keyboards, microphones, or cameras.

The electronic device1000of this example includes a processor system1004(e.g., any of microprocessors, controllers, and the like), or a processor and memory system (e.g., implemented in an SoC), which process computer-executable instructions to control operation of the device. A processing system may be implemented at least partially in hardware, which can include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon and/or other hardware. Alternatively or in addition, the electronic device can be implemented with any one or combination of software, hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits, which are generally identified at1006. Although not shown, the electronic device can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.

The electronic device1000also includes one or more memory devices116that enable data storage, examples of which include random access memory (RAM), non-volatile memory (e.g., read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device. A memory device116provides data storage mechanisms to store the device data1010, other types of information and/or data, and various device applications1012(e.g., software applications). For example, an operating system1014can be maintained as software instructions with a memory device and executed by the processor system1004.

In embodiments, the electronic device1000includes a fingerprint characteristics sensing module112, a user authentication module114, a sensing component control module106, and a display control module110as described above. Although represented as a software implementation, each of the module106, the module110, the module112, and the module114may be implemented as any form of a control application, software application, signal-processing and control module, firmware that is installed on the device, a hardware implementation of the controller, and so on. The electronic device1000also includes a multi-layer sensing component104as described above.

The electronic device1000can also include an audio and/or video processing system1020that processes audio data and/or passes through the audio and video data to an audio system1022and/or to a display system1024. The audio system and/or the display system may include any devices that process, display, and/or otherwise render audio, video, display, and/or image data, including the display component108discussed above. Display data and audio signals can be communicated to an audio component and/or to a display component via an RF (radio frequency) link, S-video link, HDMI (high-definition multimedia interface), composite video link, component video link, DVI (digital video interface), analog audio connection, or other similar communication link, such as media data port1026. In implementations, the audio system and/or the display system are external components to the electronic device. Alternatively or in addition, the display system can be an integrated component of the example electronic device, such as part of an integrated touch interface.

Although embodiments of multi-layered sensing with multiple resolutions have been described in language specific to features and/or methods, the subject of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of multi-layered sensing with multiple resolutions.