# Patent

## Title
Antialiasing for picture passwords and other touch displays

## Abstract

Antialiasing for picture passwords and other touch displays is disclosed. In some embodiments a client device for authenticating a user is operable to obtain a sequence of input actions for an image and obtain a partial hash from a Proof of Knowledge (PoK) server where the partial hash is part of a hash used for authentication of the user. The client device is also operable to calculate a hash for the sequence and determine if a part of the hash matches the partial hash. If the part of the hash matches the partial hash, the client device sends a communication to the PoK server to authenticate the user based on the hash for the sequence of the one or more input actions and obtain a response indicating whether the user is authenticated. In this way, sending some hashes to the proof of knowledge server may not be necessary, saving resources.

## Background
RELATED APPLICATIONS
This application claims the benefit of provisional patent application Ser. No. 62/006,466, filed Jun. 2, 2014 and provisional patent application Ser. No. 62/025,141, filed Jul. 16, 2014, the disclosures of which are hereby incorporated herein by reference in their entireties.


FIELD OF THE DISCLOSURE
The present disclosure relates generally to proofs of knowledge.
BACKGROUND
Authentication mechanisms use one or more authentication factors to control access to secured services or devices. An authentication mechanism may require a knowledge factor (e.g., a username and a password), an ownership factor (e.g., a hardware security token), an inherence factor (e.g., a biometric identifier such as a fingerprint), or combinations thereof. The first of these is commonly referred to as proof of knowledge.
Authentication based on proof of knowledge includes a provisioning phase (e.g., enrollment) to define user knowledge, and a use phase to authenticate a user that proves that knowledge. Authentication based on conventional identity management techniques provides access control to secured services by validating a username and password to demonstrate proof of knowledge. Improved identity management techniques to authenticate a user employ picture passwords (rather than conventional textual passwords) that prove that the user has knowledge of a combination of input actions together with a known image such as a still picture, a motion picture with or without sound, a photograph, or the like.
Determining if a user should be authenticated using a picture password may be difficult in some situations or may be computationally intensive. As such, improved authentication methods are needed.
SUMMARY
Systems and methods for antialiasing for picture passwords and other touch displays are disclosed. In some embodiments a client device for authenticating a user includes one or more processors and memory. The memory contains instructions executable by the one or more processors whereby the client device is operable to obtain a sequence of one or more input actions for an image displayed at the client device and obtain a partial hash from a proof of knowledge server where the partial hash is part of a hash used for authentication of the user. The client device is also operable to calculate a hash for the sequence of the one or more input actions and determine if a part of the hash matches the partial hash. In response to determining that the part of the hash matches the partial hash, the client device is operable to send a communication to a proof of knowledge server to authenticate the user based on the hash for the sequence of the one or more input actions and obtain a response from the proof of knowledge server indicating whether the user is authenticated based on the hash for the sequence of the one or more input actions. In this way, sending some hashes to the proof of knowledge server may not be necessary, therefore saving resources.
In some embodiments, the hash for the sequence of the one or more input actions is a hash of one of a plurality of possible sequences based on the sequence of the one or more input actions.
In some embodiments, the client device is also operable to calculate a hash of another of the plurality of possible sequences and determine if a part of the hash matches the partial hash. In response to determining that the part of the hash matches the partial hash, the client device is operable to send a communication to the proof of knowledge server to authenticate the user based on the hash of another of the plurality of possible sequences and obtain a response from the proof of knowledge server indicating whether the user is authenticated based on the hash of another of the plurality of possible sequences.
In some embodiments, the client device is also operable to, for each possible sequence in the plurality of possible sequences, perform the calculate, determine, send, and obtain steps for that possible sequence.
In some embodiments, being operable to obtain the one or more input actions comprises being operable to tile the image with an implicit grid comprising a plurality of grid elements and obtain the one or more input actions according to the implicit grid.
In some embodiments, the client device is also operable to, for each input action of the one or more input actions, determine one or more possible input actions and determine the plurality of possible sequences as the combination of one of the one or more possible input actions for each input action of the one or more input actions. In some embodiments, being operable to determine one or more possible input actions for an input action comprises being operable to determine the one or more possible input actions for the input action as the neighboring points of the input action. In some embodiments, the neighboring points of the input action are neighboring points of the input action on the implicit grid. In some embodiments, the implicit grid is hexagonal and each input action has six neighboring points comprising the vertices of a hexagon on the implicit grid centered at the input action.
In some embodiments, original hash is n bits, the partial hash is k bits of the original hash, and k is less than n. In some embodiments, the partial hash is the first k bits of the original hash.
In some embodiments, the client device is also operable to, in response to obtaining the response indicating that the user is authenticated, permit access to the user.
In some embodiments, a proof of knowledge server includes one or more processors and memory. The memory contains instructions executable by the one or more processors whereby the server computer is operable to send a communication to a client device containing a partial hash where the partial hash is a value derived from an original hash of one or more original input actions used to authenticate a user; receive a communication from a client device containing a hash of one or more input actions; and authenticate the user at the client device based on the hash received from the client device and the original hash of the one or more original input actions.
In some embodiments, being operable to authenticate the user at the client device includes being operable to determine if the hash received from the client device and the original hash of the one or more original input actions are the same. If the hash received from the client device and the original hash are the same, the proof of knowledge server is operable to send a communication to the client device indicating that the user at the client device is authenticated. If the hash received from the client device and the original hash are not the same, the proof of knowledge server is operable to send a communication to the client device indicating that the user at the client device is not authenticated.
In some embodiments, the original hash is n bits, the partial hash is k bits of the original hash, and k is less than n. In some embodiments, the partial hash is the first k bits of the original hash.
Those skilled in the art will appreciate the scope of the present disclosure and realize additional aspects thereof after reading the following detailed description of the preferred embodiments in association with the accompanying drawing figures.



BRIEF DESCRIPTION OF THE DRAWING FIGURES
The accompanying drawing figures incorporated in and forming a part of this specification illustrate several aspects of the disclosure, and together with the description serve to explain the principles of the disclosure.
FIG. 1 illustrates a proof of knowledge authentication system according to some embodiments of the present disclosure;
FIG. 2 is a flow chart that illustrates the operation of a client device in the proof of knowledge authentication system during authentication of a user using a partial hash according to some embodiments of the present disclosure;
FIG. 3 is a flow chart that illustrates the operation of a client device in the proof of knowledge authentication system during authentication of a user using possible points according to some embodiments of the present disclosure;
FIG. 4 illustrates the operation of a proof of knowledge authentication system during authentication of a user according to some embodiments of the present disclosure;
FIG. 5 is a flow chart that illustrates the operation of a client device in the proof of knowledge authentication system to provide antialiasing over time according to some embodiments of the present disclosure;
FIG. 6 is a flow chart that illustrates the operation of the proof of knowledge authentication system to detect and address excess authentication mistakes according to some embodiments of the present disclosure;
FIG. 7 is a block diagram of a proof of knowledge server for providing a proof of knowledge service according to some embodiments of the present disclosure;
FIG. 8 is a block diagram of a relying party server according to some embodiments of the present disclosure; and
FIG. 9 is a block diagram of a client device according to some embodiments of the present disclosure.



DETAILED DESCRIPTION
The embodiments set forth below represent the necessary information to enable those skilled in the art to practice the embodiments and illustrate the best mode of practicing the embodiments. Upon reading the following description in light of the accompanying drawing figures, those skilled in the art will understand the concepts of the disclosure and will recognize applications of these concepts not particularly addressed herein. It should be understood that these concepts and applications fall within the scope of the disclosure and the accompanying claims.
The purpose of terminology used herein is only for describing embodiments and is not intended to limit the disclosure.
As used herein, terms such as “first,” “second,” “third,” and the like distinguish one element or embodiment from another but should not limit the element or embodiment. For example, an embodiment can be termed a first embodiment or a second embodiment without departing from the scope of the present disclosure.
As used herein, the term “client device” refers to a device or apparatus that includes hardware and/or software that provides a web browser, a client application operable to communicate using client-server architecture, and/or a client application for retrieving, presenting, and communicating information over the Internet.
As used herein, the term “Relying Party (RP) server” refers to a device or apparatus that provides one or more services accessible by a client device via a network portal (e.g., website). The services may include actions and/or information administered by a RP server in accordance with access controls that require authentication of an identity of a user operating the client device.
As used herein, the term “Proof of Knowledge (PoK) server” refers to a device or apparatus that includes hardware and/or software to provide a service (e.g., a password service) used to authenticate the identity of a user on behalf of the RP server, where the user is operating a client device.
As used herein, the term “Requesting Party” (RQP) refers to a party that requests a proof of knowledge service from the PoK server. As such, the RP server may also be referred to as a RQP server.
As used herein, the term “AJAX” refers to Asynchronous JAVASCRIPT and XML, any suitable communication technique used to send and receive data over the Internet from a server, comparable technologies that allow web applications to send data to and retrieve data from a server asynchronously (in the background) without interfering with the display and behavior of the existing page, or any suitable communication technique as understood by persons skilled in the art.
As used herein, the term “picture password” refers to using one or more known input actions associated with a known image (e.g., without limitation, a still picture; a motion picture with or without sound; a photograph) to provide a password for access to secured information, and/or includes any suitable system or method for a proof of knowledge about an image that a user can readily remember.
As used herein, the term “hash” refers to a cryptographic salted hash, a cryptographic salted hash function (e.g., National Institute of Standards and Technology (NIST) approved SHA256 Password Based Key Derivation Function (PBKDF)), and/or a derivation of enciphered or encoded data used to authenticate the integrity of corresponding information or actions with well-known anti-dictionary attack protections afforded by cryptographic salting. A hash may also include a number of hash iterations as suggested by NIST approved PBKDF.
FIG. 1 illustrates a proof of knowledge authentication system 10 according to some embodiments of the present disclosure. The proof of knowledge authentication system 10 may be formed from a combination of one or more servers and/or one or more client devices. As shown, the proof of knowledge authentication system 10 includes client devices 12-1, 12-2, and 12-3 (generally referred to herein collectively as client device 12 and individually as client device 12), a Requesting Party (RQP)/Relying Party (RP) server 14 (hereafter referred to as the RP server 14), and a Proof of Knowledge (PoK) server 16, all interconnected via a network 18 (e.g., the Internet). In this example, the client devices 12 include a laptop computer 12-1, a desktop computer 12-2, and a mobile device 12-3. However, these are only examples. The client devices 12 can be any suitable type of device that can be used by a user to access the RP server 14.
In some embodiments, the RP server 14 and/or the PoK server 16 can be components of respective services that include one or more web servers that are remote from the client devices 12-1, 12-2, and 12-3. Optionally, the RP server 14 and the PoK server 16 may communicate over a channel separate from the network 18. For example, the client devices 12 may communicate with the servers 14 and 16 over the Internet, but the servers 14 and 16 may communicate with each other over a separate and secured network.
The PoK server 16 may operate to authenticate users of the client devices 12-1, 12-2, and 12-3 over the network 18 on behalf of the RP server 14. The PoK server 16 may also operate to test users of client devices 12-1, 12-2, and 12-3 over the network 18 on behalf of the RP server 14, as described in provisional patent application Ser. No. 62/006,472, filed Jun. 2, 2014, which is incorporated herein by reference in its entirety.
The RP server 14 provides a network portal over the network 18 to display an interface at the client device 12. For example, the network portal may include a website and the network 18 may include the Internet. The RP server 14 administers secured services (e.g., secured private information) that can be accessed via the website by a user operating the client device 12. For example, the RP server 14 may correspond to a server of a financial institution that administers a website for users to access account information over the Internet. However, this is only a particular example, and the disclosed embodiments should not be limited thereto. For example, other institutions that may benefit from the use of the proof of knowledge authentication system 10 include healthcare institutions that administer private patient information via patient portals or the like.
The client device 12 can access the secured services administered by the RP server 14 via the website by providing information used to authenticate the user. For example, a user may input a username and password to login to a banking website. The username may be validated by the RP server 14, and the password may be validated by the PoK server 16 (on behalf of the RP server 14) to authenticate the user. This validation may provide access to the user's secured information. As such, a user can access secured information by demonstrating proof of knowledge of a username and password.
The PoK server 16 operates to authenticate users on behalf of the RP server 14. For example, the client device 12 can communicate directly with the RP server 14 to seek access to private information via a login page of a website administered by the RP server 14. The RP server 14 requests a picture password service from the PoK server 16 to authenticate the user on behalf of the RP server 14. The PoK server 16 redirects the client device 12 to the PoK server 16 and invokes an interface at the client device 12, which is used to authenticate the picture password by the PoK server 16 on behalf of the RP server 14.
This mechanism isolates the source of secured services (e.g., the private information) at the RP server 14 from the authentication mechanism at the PoK server 16, which improves security by separating mechanisms that administer services and information from mechanisms that administer proofs of knowledge. As such, the RP server 14 knows the identity of a user and uses an identifier for that user to request an authentication for the user by using the picture password from the PoK server 16 for that user. The PoK server 16 knows the picture password, including the image for the picture password and a hash of the correct input actions used as proof of the user's knowledge. However, the RP server 14 does not know the picture password, and the PoK server 16 does not know the user's identity (e.g., the user remains anonymous to the PoK server 16).
Some embodiments of the proof of knowledge authentication system 10 involve the use of picture password that prove that the user has knowledge of a combination of input actions together with a known image such as a still picture, a motion picture with or without sound, a photograph, or the like. And in some embodiments using a picture password, the image for the picture password is tiled with an implicit grid such that a selection of a point or some other input action is determined to be one of these grid points. Sometimes a user who knows the correct picture password proof of knowledge may still select the incorrect points because of the precision of the grid points or because of the imprecision of the selecting mechanism. In these situations and in other embodiments, it may be desirable to allow error in touch placement over the grid. In one example with a square grid, the actual touch point is recorded as the center of a 3×3 square of possible touch points. Thus, when an attempt is made to redo the touch point, as with a picture password, the system can search among the nine possible grid locations to see if the actual touch point is nearby. This falls under the category of “anti-aliasing” techniques.
While these “anti-aliasing” techniques allow for increased usability of the system for the user in the form of greater error tolerance on the input actions, the techniques can quickly add complexity in terms of validating the picture password, just because a greater number of grid locations must be checked. This complexity increases further when the information being validated must be kept secret using, for example, a hash of the touch points. Complexity is also increased depending on the nature of the picture password, i.e. there is an exponential explosion of searches if the picture password involves several touches and strokes, particularly of different types as illustrated in International Application No. PCT/US10/058825 entitled “Method and System for Processor or Web Logon.” In the case of a web based picture password, the communication, as disclosed in International Application No. PCT/US14/32342 entitled “Method and System of Providing a Picture Password Proof of Knowledge as a Web Service,” is a target hash value from the server to the client, and the client must generate and submit for verification all possible hashes. Also, under anti-aliasing techniques, the entropy of the picture password is reduced by the fact that the grid size (vocabulary of the picture password) is reduced (approximately a factor of nine in the case of a square grid).
As such, a broader collection of anti-aliasing techniques and systems and methods for mitigating some of the adverse effects of anti-aliasing techniques are desired. In the present disclosure, the broader collection can be employed together or individually or in any combination to achieve improved anti-aliasing while not impacting performance, even for the positioning that may need to be checked under the above conditions using action-sequence hashes that exponentially explode in number. One technique suitable for reducing the size of the exponential explosion on square grids is to employ a hexagonal grid where the neighborhood is always seven (the center and six surrounds) instead of nine neighbor points for a square grid. This will decrease the number of possible sequences of input actions that must be hashed by the client device 12 and submitted to the PoK server 16 for verification.
However, even with a decreased neighborhood size, there are still an exponential number of hashes that must be submitted for verification. Depending on the implementation of the proof of knowledge authentication system 10, these hash submissions may add significant time to the authentication procedure and/or require significant network resources and processing time at the PoK server 16. One way of addressing this problem is presented in FIG. 2 which is a flow chart that illustrates the operation of a client device 12 in the proof of knowledge authentication system 10 during authentication of a user using a partial hash according to some embodiments of the present disclosure. It would be desirable for the client device 12 to be able to determine if a hash is incorrect and therefore not send the hash to the PoK server 16. This would reduce the network resource consumption and decrease the processing time at the PoK server 16. But, it would be considered a security violation for the server to give the client a complete copy of the hash of action-sequences it is looking for. This is because a malicious man-in-the-middle or client-robot could then perform a semi-exhaustive search over all the possible action-sequences to determine the actions or password desired for authentication or other replay or directive.
Instead of providing the entire copy of the hash, only part of the desired hash is provided to the client device 12. For example, if the hash includes N bits, then the partial hash will include only k bits where k is less than N and preferably much less than N. For example, a partial hash may include only 16 bits of the actual hash that may be 256 bits. The client device 12 can then reject possible hashes of actions without having to transmit all possible hashes to the PoK server 16 for full checking which would load both the network and the server with inefficient activity. The value of k can be determined, and the position of those k bits in the hash can be determined. The position of those k bits is usually not relevant because of the nature of most hash functions to distribute the information content of the input approximately evenly across all bits of the resulting hash. But the number of bits, k, is relevant to the possibility of clashes which can be reduced by increasing k. This results in a tradeoff where a larger value of k means that the client device 12 will be able to eliminate from consideration a larger subset of hashes. But, as the value of k increases, the security implications also increase as an attacker will be able to reduce the number of possible hashes that need to be searched.
This technique of using a partial hash can also be used without using a neighborhood of possible points such that a client device 12 may determine in some instances that a hash will not match the desired hash. This is shown in FIG. 2 where a client device 12 obtains one or more input actions for an image displayed at the client device 12 (step 100). As used herein the term “input” refers to data provided by an input device (e.g., a mouse, a touchpad, or a touch-sensitive display) to an electronic device. Inputs may generally include mouse inputs (e.g., click down, click up, and move) and touch inputs (touch down, touch up, and move). As used herein, the terms “click” or “touch” shall refer to type of input or, depending on the context, a click/touch down input that can define a “point” on a displayed image (e.g., a “grid point” on a grid that overlays a displayed image). As used herein, the term “input action” refers to a pattern of one or more inputs detected by an electronic device. An input action may be used to enter a picture password. For example, an input action may include a gesture defined by a pattern of touch inputs. Other examples of input actions include a point action that causes an electronic device to designate a point on a display, and a line action that causes the electronic device to draw a line between a start-point on a display and an end-point on a display. Some specific input actions include a stroke (or stroke action), a drag path (or drag path action), and a click/touch (a click/touch action). As used herein, the term “stroke” shall refer to an input action that includes two points on an image (i.e., two distinct points on an image). As used herein, the term “drag path” shall refer to an input action that includes a path taken between a beginning point of a stroke and an end-point of a stroke.
Returning now to FIG. 2, the client device 12 calculates a hash of the one or more input actions (step 102). The client device can then determine if a part of the hash matches a partial hash where the partial hash is a value derived from an original hash of one or more original input actions or is part of a hash used for authentication of the user (step 104). In some embodiments, this partial hash is obtained by the client device 12 from the PoK server 16. In some embodiments, this determination simply checks that each bit of the partial hash is identical to the corresponding bit in the calculated hash. If the hash matches the partial hash, the client device 12 may then send a communication to the PoK server 16 to authenticate the user based on the one more input actions (step 106). This step is needed to ensure that the input actions actually match the desired input actions and that the match with the partial hash was not just coincidental.
The client device 12 then obtains a response from the PoK server 16 indicating whether the user is authenticated based on the one or more input actions (step 108). Depending on the implementation of the proof of knowledge authentication system 10, the authentication may instead be communicated to the RP server 14.
When the technique of using the partial hash to filter known incorrect hashes is applied to the embodiments where multiple possible points are considered for the one or more input actions, the reduction of the hashes sent to and processed by the PoK server 16 is even more significant. FIG. 3 is a flow chart that illustrates the operation of a client device 12 in the proof of knowledge authentication system 10 during authentication of a user using possible points according to some embodiments of the present disclosure. A partial hash is a value derived from the original hash and sent by the PoK server 16 to the client device 12 for comparison against hashes computed by the client device 12. “Selected Point(s)” is the point, or points, that make up a single input action performed in a Picture Password such as a click, touch, stroke, or drag path. “Possible Point(s)” consist of the Selected Point(s) and any neighboring points that are to be considered. The neighborhood relation may be fixed or dynamic and may even vary across the image. As shown in FIG. 3, a user performs a Picture Password input action at the client device 12 (step 200). The client device then determines all possible points based on the selected points for the action (step 202). The client device 12 then calculates a hash based on one set of possible points (step 204). As used herein, the phrase “calculate a hash for the sequence of the one or more input actions” is used to describe calculating a hash of one of the possible sequences based on the sequence of the one or more input actions and may also include calculating a hash of the sequence of the one or more input actions.
The client device 12 then determines if part of the calculated hash matches the partial hash (step 206). If the part of the calculated hash matches the partial hash, the client device 12 sends the hash to the PoK server 16 for comparison with the full hash (step 208). If the PoK server 16 responds that the password was correct (step 210) then the user can be logged in normally (step 212). If the PoK server 16 responds that the password was incorrect, the client device 12 determines if there are any additional sets of possible points remaining (step 214). If there are, the client device 12 returns to step 204 to calculate a hash on the new set of possible points. Also, if the client device 12 determines that part of the calculated hash does not match the partial hash, the client device 12 does not send that calculated hash to the PoK server 16 and instead proceeds to step 214 to determine if there are additional sets of possible points remaining to be checked. If there are no unchecked additional sets of possible points and the user has not otherwise been authenticated, the client device 12 does nothing until the next user action (step 216). In some embodiments, this process may be incorporated into a larger process that may include such things as an enforcement of a maximum number of attempts or the ability to detect if the user is making more errors than normally expected.
FIG. 4 illustrates the operation of a proof of knowledge authentication system 10 during authentication of a user according to some embodiments of the present disclosure. The client device 12 obtains a partial hash from the PoK server 16 where the partial hash is derived from an original hash of one or more original input actions or is part of a hash used for authentication of the user (step 300). Note that while this step is shown before other steps, the timing of when and how the client device 12 obtains the partial hash is implementation dependent. The client device 12 then obtains one or more input actions for an image displayed at the client device 12 (step 302) and calculates a hash for the one or more input actions (step 304). The client device 12 determines if a part of the calculated hash matches the partial hash (step 306). If the part of the calculated hash does not match the partial hash, the client device 12 tries another possible set of input actions (step 308). If the part of the calculated hash matches the partial hatch, the client device 12 sends the full calculated hash to the PoK server 16 to authenticate (step 310). The PoK server 16 then determines if the full calculated hash matches the original hash in some suitable manner (step 312) and communicates authentication status of the user to the client device 12 (step 314).
Another form of antialiasing is antialiasing by time. This is a form of client side hysteresis. Here the problem is that even though a target point is selected, sometimes, due to aliasing induced while a touch is released (or moved as with the beginning of a stroke), the grid location moves to an undesired location. In some situations, this is due to the client device 12 computing a change in the touch point after the user selects it due to the error induced when the touch is released or moved. One way to mitigate this type of error is to keep track of where the touch was a predetermined amount of time prior to the actual release or move so that the action of the release or the action of the move does not alias the result. For example, the predetermined amount of time may be a value such as a quarter of a second for modern devices as they are commonly used. Certain devices and certain software may need longer or shorter hysteresis offsets to maximize the efficacy of the system in achieving this class of antialiasing. One example for providing antialiasing by time is illustrated in FIG. 5 which is a flow chart that illustrates the operation of a client device 12 in the proof of knowledge authentication system 10 to provide antialiasing over time according to some embodiments of the present disclosure. The process begins in the Touch/Mouse: Down state 400. In some embodiments this may be triggered when a user's finger touches the screen or mouse click down on the image. At this point, the client device 12 sets “Previous Point” equal to “Current Point” (step 402). As used herein, “Current Point” is the point that is currently being selected or the final point that was selected. This value is reported by the client device 12. “Previous Point” is the last point selected before the “Current Point” which may be the same as the “Current Point.” “Saved Point” is the last point selected that was different than the “Current Point.” “Saved Point Time” is the timestamp at which the “Saved Point” was last selected. “Required Selection Time”, is the amount of time the “Current Point” must be selected for, to be considered a valid selection. “Valid Point” is the point that's determined to be what the user had intended to select.
Returning now to FIG. 5, it is possible that the next state entered may be the Touch/Mouse: Move state 404. In some embodiments this may be triggered when a user's finger moves across the screen or mouse cursor moves while click still held down. This move may be intentional as part of performing a stroke or drag path or part of choosing the correct touch point. However, this also may be an inadvertent move. As such, the client device 12 checks if the “Current Point” is different than “Previous Point” (step 406). If it is different, the client device 12 sets “Saved Point” equal to “Previous Point”; sets “Saved Point Time” equal to the current time; and sets “Previous Point” equal to “Current Point” (step 408).
The last state that should be entered is the Touch/Mouse: Up state 410 which in some embodiments may be triggered when a user's finger is removed from the screen or mouse click released. This typically indicates the completion of the input action. The client device 12 checks whether “Saved Point” was set (step 412). If no value was set for “Saved Point” then there was no change in selection such that valid selection checks are not needed and “Valid Point” is set equal to “Current Point” (step 414). If a value was set for “Saved Point” then there was a change in selection. The client device 12 determines if “Current Point” meets “Required Selection Time” (step 416). If it does not meet the “Required Selection Time” then the most recent change in selection is treated as an inadvertent change and “Valid Point” is set equal to “Saved Point” (step 418). If it does meet the “Required Selection Time” then the most recent change in selection is treated as an intentional change and “Valid Point” is set equal to “Current Point” (step 420). In some embodiments, the determination if “Current Point” meets “Required Selection Time” in step 416 may be accomplished by defining CT=Current Time, RST=Required Selection Time, and SPT=Saved Point Time. Then, if the following inequality holds, RST has been satisfied:

CT>(SPT+RST)

In this way, inadvertent changes in the location of a touch or a click may not interfere with the successful performance of the Picture Password. As discussed above, the value for the Required Selection Time may be predetermined based on the type of client device 12 or based on the past experience of the user. In other embodiments the value may be able to be changed dynamically in response to determining that the user is making more errors than normally expected.
These antialiasing techniques along with other techniques such as determining an offset may be used to adjust how a user interacts with the proof of knowledge authentication system 10. In some embodiments, there may be some types of guidance or assistance provided to a user. This may be a form of verbal or pictorial guidance for the user or the user may be unaware of the techniques that are employed. One example is to detect if the user is making more errors than would normally be expected (in general, for that user, for that user and that device, for that device, etc.) Then guidance may try to determine if some antialiasing technique(s) need to be adjusted. This may be accomplished by taking the user through an appropriate training session or by changing one or more of the values discussed above. Guidance may also suggest the use of a stylus rather than a finger since a stylus typically provides a finer (smaller) touch point. FIG. 6 is a flow chart that illustrates the operation of the proof of knowledge authentication system 10 to detect and address excess authentication mistakes according to some embodiments of the present disclosure. The guidance may be first initiated based on either the client device 12 or the PoK server 16 determining that the user is making more errors than normally expected (step 500). This may be based on the type of mistakes the user is making and/or on the amount of mistakes being made. This step may also include determining if this is a different client device 12 or different type of device than the user typically uses. The user may then be provided with guidance and appropriate training/testing session(s) (step 502). As discussed above, this may include suggesting that the user use a stylus for more precise input. This step may also include a training session where a user is prompted to perform a specific input action. The results of the input action may inform the user about errors or misperceptions that are being made. The results may also be used to determine if any system parameters should be adjusted. For instance, it may be determined if any of the antialiasing methods need adjusted (step 504). If it is determined that no adjustments are necessary, additional guidance and/or suggestions may be provided to the user (step 506). If adjustments are determined to be necessary or desirable, the methods may be adjusted accordingly (step 508). For example, if it is determined that the user's input location is moving just prior to the selection of an input, then it may be determined to adjust the “Required Selection Time” for antialiasing by time as discussed in relation to FIG. 5 above. Or, it may be determined that the user's finger is occluding the input location and therefore an offset value should be determined or adjusted. Other values could also be adjusted depending on the implementation of the proof of knowledge authentication system 10.
FIG. 7 is a block diagram of a PoK server 16 for providing a proof of knowledge service according to some embodiments of the present disclosure. As illustrated, the PoK server 16 includes one or more processors 20 such as, for example, one or more Central Processing Units (CPUs), Application Specific Integrated Circuits (ASICs), and/or Field Programmable Gate Arrays (FPGAs), memory 22, and a network interface 24. In some embodiments, the functionality of the PoK server 16 is implemented in software stored in the memory 22 for execution by the one or more processors 20. In some embodiments, the PoK server 16 may include additional components responsible for providing additional functionality, including any of the functionality identified above and/or any functionality necessary to support the solutions described above.
In some embodiments, a computer program including instructions which, when executed by at least one processor, cause the at least one processor to carry out the functionality of the PoK server 16 according to any one of the embodiments described herein as provided. In some embodiments, a carrier containing the aforementioned computer program product is provided. The carrier is one of an electronic signal, an optical signal, a radio signal, or a computer readable storage medium (e.g., a non-transitory computer readable medium such as the memory 22).
FIG. 8 is a block diagram of a RP server 14 according to some embodiments of the present disclosure. As illustrated, the RP server 14 includes one or more processors 26 such as, for example, one or more CPUs, ASICs, and/or FPGAs, memory 28, and a network interface 30. The RP server 14 also includes an access controller 32 to control access to services administered by the RP server 14 in accordance with advanced directive(s). As illustrated, the access controller 32 may be embodied in, for example, one or more ASICs, FPGAs, or any combination of hardware and/or software components. In some embodiments, the functionality of the RP server 14 is implemented in software stored in the memory 28 for execution by the one or more processors 26. In some embodiments, the RP server 14 may include additional components responsible for providing additional functionality, including any of the functionality identified above and/or any functionality necessary to support the solutions described above.
In some embodiments, a computer program including instructions which, when executed by at least one processor, cause the at least one processor to carry out the functionality of the RP server 14 according to any one of the embodiments described herein as provided. In some embodiments, a carrier containing the aforementioned computer program product is provided. The carrier is one of an electronic signal, an optical signal, a radio signal, or a computer readable storage medium (e.g., a non-transitory computer readable medium such as the memory 28).
FIG. 9 is a block diagram of a client device 12 according to some embodiments of the present disclosure. The client device 12 is shown as an electronic device with a touch-sensitive display (e.g., a smartphone) but may be embodied as any other type of client device. As shown, client device 12 includes a control or processing system 34 that includes one or more processors 36 (e.g., CPUs, ASICs, and/or FPGAs), a memory controller 38, memory 40 (which may include software 42 such as a browser software application), and a peripherals interface 44.
The peripherals interface 44 may communicate with an external port 46, which can provide access to a power system 48. Other components in communication with the peripherals interface 44 include Radio Frequency (RF) circuitry 50 (e.g., WiFi and/or cellular communications circuitry) and audio circuitry 52 for speaker 54 and microphone 56 of the client device 12. Other components in communication with the peripherals interface 44 include the one or more accelerometers 58 and other sensors 60. The peripherals interface 44 may communicate with an Input/Output (I/O) subsystem 62, which includes a display controller 64 operable to control a touch-sensitive display system 66, which further includes the touch-sensitive display of the client device 12. The I/O subsystem 62 includes an optical sensor(s) controller 68 for one or more optical sensors 70. Lastly, a clock system 72 controls a timer for use by the disclosed embodiments as detailed above.
Accordingly, FIG. 9 shows components of the client device 12 that enable a user to interface with features of the disclosed embodiments. The client device 12 may include other components not shown in FIG. 9, nor further discussed herein for the sake of brevity. A person skilled in the art will understand the additional hardware and software included but not shown in FIG. 9. For example, the I/O subsystem 62 may include other components (not shown) to control physical buttons.
In some embodiments, a computer program including instructions which, when executed by at least one processor, cause the at least one processor to carry out the functionality of the client device 12 according to any one of the embodiments described herein as provided. In some embodiments, a carrier containing the aforementioned computer program product is provided. The carrier is one of an electronic signal, an optical signal, a radio signal, or a computer readable storage medium (e.g., a non-transitory computer readable medium such as the memory 40).
Those skilled in the art will recognize improvements and modifications to the preferred embodiments of the present disclosure. All such improvements and modifications are considered within the scope of the concepts disclosed herein and the claims that follow.

## Claims

1. A client device for authenticating a user, comprising:
one or more processors; and
memory containing instructions executable by the one or more processors whereby the client device is operable to:
display an image at the client device;
tile the image with an implicit grid comprising a plurality of grid elements;
obtain a sequence of one or more input actions for the image according to the implicit grid;
for each input action of the one or more input actions, determine one or more possible input actions;
determine a plurality of possible sequences as the combination of one of the one or more possible input actions for each input action of the one or more input actions, wherein determining the one or more possible input actions for an input action comprises determining the one or more possible input actions for the input action using neighboring points of the input action;
obtain a partial hash from a proof of knowledge server where the partial hash is part of a hash used for authentication of the user;
calculate a hash for the sequence of the one or more input actions, wherein the calculated hash for the sequence of the one or more input actions is a hash of one of the plurality of possible sequences based on the sequence of the one or more input actions;
determine if a part of the calculated hash matches the partial hash;
in response to determining that the part of the calculated hash matches the partial hash, send a communication to the proof of knowledge server to authenticate the user based on the calculated hash for the sequence of the one or more input actions; and
obtain a response from the proof of knowledge server based on the calculated hash for the sequence of the one or more input actions.

2. The client device of claim 1 further operable to:
calculate a hash of another of the plurality of possible sequences;
determine if a part of the calculated hash matches the partial hash;
in response to determining that the part of the calculated hash matches the partial hash, send a communication to the proof of knowledge server to authenticate the user based on the calculated hash of another of the plurality of possible sequences; and
obtain a response from the proof of knowledge server based on the calculated hash of another of the plurality of possible sequences.

3. The client device of claim 2 further operable to:
for each possible sequence in the plurality of possible sequences, perform the calculate, determine, send, and obtain steps for that possible sequence.

4. The client device of claim 1 wherein the neighboring points of the input action are neighboring points of the input action on the implicit grid.

5. The client device of claim 4 wherein the implicit grid is hexagonal and each input action has six neighboring points comprising the vertices of a hexagon on the implicit grid centered at the input action.

6. The client device of claim 1 wherein the hash used for authentication of the user is n bits, the partial hash is k bits of the hash used for authentication of the user, and k is less than n.

7. The client device of claim 6 wherein the partial hash is the first k bits of the original hash.

8. The client device of claim 1 further operable to, based on the response from the proof of knowledge server based on the calculated hash for the sequence of the one or more input actions, permit access to the user.