Source: https://patents.google.com/patent/US9086802
Timestamp: 2018-04-23 08:02:19
Document Index: 677147555

Matched Legal Cases: ['Application No. 61', 'art 3000', 'Application No. 11', 'Application No. 11', 'Application No. 2007342164', 'Application No. 07', 'Application No. 07', 'Application No. 07', 'Application No. 200780052020']

US9086802B2 - Method, device, and graphical user interface providing word recommendations for text input - Google Patents
US9086802B2
US9086802B2 US13559495 US201213559495A US9086802B2 US 9086802 B2 US9086802 B2 US 9086802B2 US 13559495 US13559495 US 13559495 US 201213559495 A US201213559495 A US 201213559495A US 9086802 B2 US9086802 B2 US 9086802B2
US13559495
US20120304100A1 (en )
This application is a divisional of U.S. application Ser. No. 12/165,554, filed Jun. 30, 2008, now U.S. Pat. No. 8,232,973, which claims priority to U.S. Provisional Patent Application No. 61/010,619, filed Jan. 9, 2008, “Method, Device, and Graphical User Interface Providing Word Recommendations for Text Input,” the content of which are hereby incorporated by reference in their entirety.
Also in memory 102 are one or more dictionaries 132 and a word recommendation module (or set of instructions) 134. In some embodiments, a dictionary contains a list of words and corresponding usage frequency rankings The usage frequency ranking of a word is the statistical usage frequency for that word in a language, or by a predefined group or people, or by the user of the device 100, or a combination thereof. As described below, a dictionary may include multiple usage frequency rankings for regional variations of the same language and/or be tailored to a user's own usage frequency, e.g., derived from the user's prior emails, text messages, address book, and other previous input from the user. The word recommendation module identifies word recommendations for presentation to the user in response to text input by the user.
For example, if the input sequence is “theater,” then the first character in any of the permutations generated for this input sequence is “r” (the first character in the input sequence) or any characters that are neighbors to “r” on the keyboard layout. The second character in a permutation is “h” or any neighbor thereof. The third character in a permutation is “e” (the third character in the input sequence) or neighbors thereof, and so forth.
In some embodiments, the dictionary may be customizable. That is, additional words may be added to the dictionary by the user. Furthermore, in some embodiments, different applications may have different dictionaries with different words and usage frequency rankings For example, an email application and an SMS application may have different dictionaries, with different words and perhaps different usage frequency rankings within the same language.
In FIG. 6, the input sequence 602 is “rheatre.” For prefix strings of three characters in length, the first three characters and their corresponding neighbors 604 are identified. Here, the first character is “r” and its neighbors, in accordance with the layout 502, are “e,” “d,” “f,” and “t.” The second character is “h,” and its neighbors are “y,” “u,” “g,” “j,” “b,” and “n.” The third character is “e,” and its neighbors are “w,” “s,” “d,” and “r.”
From the input characters and corresponding neighbors, the character permutations 606 are determined. Each permutation is a character combination where the first character is the first input character or a neighbor thereof, the second character is the second input character or a neighbor thereof, and the third character is the third input character or a neighbor thereof From these permutations, prefix strings are generated and compared to words in the dictionary. Examples of three-character permutations based on the input sequence 602 include “the,” “rus,” “rye,” and “due.” Words in the dictionary that have one of these strings as a prefix are identified as candidate words 608. Examples of candidate words include “theater,” “rye,” “rusty,” “due,” “the,” and “there.” In other embodiments, the character permutations may include four, five, or more characters, rather than three characters.
A Total(i)=A Visible(i)+A Hidden(i)A Visible(i) {1+[P(i)·K]}
ATotal (i)=total hit area for the adjustable hit region for character i,
Avisible (i)=visible key area on the touch screen for character i,
AHidden (i)=hidden hit area for character i,
For this example, the total hit area, ATotal (i) is never less than the visible key area, Avisible (i). The adjustable hit region for a key icon includes a visible key area displayed on the touch screen display and a hidden hit region not displayed on the touch screen display. In some embodiments, the visible key area AVisible (i) for a given key is constant, while the hidden hit area Ahidden (i) is dynamic, thereby making the total hit area ATotal (i) dynamic as well. K can be determined by trial and error by observing users interacting with a particular keyboard. K approaches zero as the size of the visible keys increases on the touch screen. In other words, if the key icons become comparable to or larger than the finger contact areas on the touch screen, hidden hit regions are no longer needed to help identify the key icon that the user probably intended to hit.
FIG. 8B depicts changes in the sizes of hidden hit regions associated with different key icons after two characters “G-O” are entered into the input field 5620. The sizes of the hidden regions for the keys have been adjusted in accordance with the previously entered characters. For example, the size of the hidden hit region for the key icon “D” increases because “God” is a common English word. Thus, the key icon “D” may be activated even if the next finger contact (as illustrated by the “+” sign in FIG. 8B) is on the visible area of the key icon “F.” In some embodiments, if the hidden hit regions of two (or more) keys overlap with the finger contact (or with a touch point position derived from a finger contact), then the key with the largest hit region ATotal (i) (including its hidden hit region Ahidden (i)) is selected. Similarly, the hidden hit regions associated with key icons “A” and “O” are also increased because each of the strings “Goa” and “Goo” leads to one or more legitimate English words such as “Goal”, “Good”, or “Goad.” In some embodiments, the hit regions of unlikely next characters (e.g., key icon “K” is unlikely because the string “Gok” is not found at the beginning of any common English words) shrink so that the hit area is less than the visible area of the key. In some embodiments, the hit regions of unlikely next characters do not shrink. Such keys will not be selected in the areas where they overlap with keys with enlarged hit regions.
Next, a second touch point input is received from the user, this time within the hit region for the key icon for the letter “h”. The device now evaluates both touch-based probabilities (Ptouch(r), Ptouch(h)), for candidate characters corresponding to the first and second touch point inputs and usage-based probabilities (Pusage(r), Pusage(h)) for the first and second touch point inputs. A combined probability for each of a plurality of candidate character sequences (e.g., Rh, Th) is determined. If there is a candidate character sequence having a probability that is greater than the probability for the displayed character sequence, and that meets any other applicable selection criteria, then a suggested character string corresponding to the candidate character sequence having the highest probability is displayed. If the displayed suggested character string (e.g., a word) is selected by the user, for example by touching the space bar or other delimiter icon (e.g., as shown in FIGS. 11A, 11B, and 12), the displayed suggested character string replaces the previously displayed sequence of characters. If the user does not select (e.g., does not touch an icon for a delimiter) the displayed suggested character string, the user can instead continue to input additional touch points. In the example shown in FIG. 9, the third touch point input is on or near the key icon for the letter “e.” At this point, the device may determine that the probability for the candidate character sequence “T-h-e” [e.g., Ptouch(t)Pusage(t)Ptouch(h)Pusage(h)Ptouch(e)Pusage(e), FIG. 9] is greater than the probability for the currently displayed character sequence, “R-h-e” [e.g., Ptouch(r)Pusage(r) Ptouch(h)Pusage(h)Ptouch(e)Pusage(e), FIG. 9], and is also greater than the probability for any other candidate character sequence that is compatible with the sequence of touch point inputs received so far. In that case, the suggested character string “The” is displayed and made available for selection by the user. If the user is actually trying to type the word “rhesus,” then in response to detecting a user touch point on or near the “s” icon key, the device will cease to display the suggested word “The.” On the other hand, in response to detecting a user touch point on or near the space bar or other delimiter icon key, the device will replace “Rhe” with the suggested word “The.”
The devices receives (1004) a sequence of individual touch points input by a user on the touch screen display. Each touch point is determined at lift off of a contact (e.g., a finger contact or a stylus contact) from the touch screen display. An image with an enlarged version of a character that will be selected as the character corresponding to an individual touch point is displayed prior to lift off of a respective contact (e.g., the letter “N” in FIG. 11A). The character image that is displayed prior to lift off is selected in accordance with the adjustable hit regions of the displayed key icons. For example, if the hidden hit regions of two (or more) keys overlap with the finger contact (or with a touch point position derived from a finger contact), then a character image that corresponds to the key with the largest hit region ATotal (i) (including its hidden hit region AHidden (i)) is selected for display.
displaying a suggested replacement complete word for the current character string in a second area of the touch screen display, wherein the second area includes a suggestion rejection icon adjacent to the suggested replacement complete word;
replacing the current character string in the first area with the suggested replacement complete word in response to detecting user activation of a key on the soft keyboard associated with a delimiter; and
keeping the current character string in the first area, without replacing the current character string in the first area with the suggested replacement complete word, and ceasing to display the suggested replacement complete word and the suggestion rejection icon in response to detecting a finger gesture on the suggested replacement complete word displayed in the second area.
2. A non-transitory computer readable storage medium having stored therein instructions, which when executed by a portable electronic device with a touch screen display, cause the device to:
display a suggested replacement complete word for the current character string in a second area of the touch screen display, wherein the second area includes a suggestion rejection icon adjacent to the suggested replacement complete word;
replace the current character string in the first area with the suggested replacement complete word in response to detecting user activation of a key on the soft keyboard associated with a delimiter; and
keep the current character string in the first area, without replacing the current character string in the first area with the suggested replacement complete word, and cease to display the suggested replacement complete word and the suggestion rejection icon in response to detecting a finger gesture on the suggested replacement complete word displayed in the second area.
4. A graphical user interface on a portable electronic device with a touch screen display, comprising:
a second area of the touch screen display that includes a suggested replacement complete word and a suggestion rejection icon adjacent to the suggested replacement complete word;
in response to detecting user activation of a key on the soft keyboard associated with a delimiter, the current character string in the first area is replaced with the suggested replacement complete word; and
in response to detecting a finger gesture on the suggested replacement complete word displayed in the second area, the current character string is kept in the first area, without replacing the current character string in the first area with the suggested replacement complete word, and display of the suggested replacement complete word and the suggestion rejection icon are ceased.
US13559495 2008-01-09 2012-07-26 Method, device, and graphical user interface providing word recommendations for text input Active US9086802B2 (en)
US12165554 Division US8232973B2 (en) 2008-01-09 2008-06-30 Method, device, and graphical user interface providing word recommendations for text input
US14800378 Continuation US20150317078A1 (en) 2008-01-09 2015-07-15 Method, device, and graphical user interface providing word recommendations for text input
US20120304100A1 true US20120304100A1 (en) 2012-11-29
US9086802B2 true US9086802B2 (en) 2015-07-21
JP2016038804A (en) * 2014-08-08 2016-03-22 富士通株式会社 Information processing apparatus, information processing method, and information processing program
JP2016045883A (en) * 2014-08-26 2016-04-04 カシオ計算機株式会社 Graph display device, program and server device
US20160357304A1 (en) * 2015-06-05 2016-12-08 Apple Inc. Language input correction
"Centroid", Available at , Apr. 28, 2006, 1 page.
"Centroid", Available at , Apr. 28, 2006, 3 pages.
"Centroid", Available at <http://faculty.evansville.edu/ck6/tcenters/class/centroid.html>, Apr. 28, 2006, 1 page.
"Centroid", Available at <http://www.pballew.net/centroid.html>, Apr. 28, 2006, 3 pages.
"Compare Keyboards with the Keyboard Compatibility Chart, Learn more About Alternative Keyboards", Solutions for Humans, Available at , Dec. 8, 2005, 5 pages.
"Compare Keyboards with the Keyboard Compatibility Chart, Learn more About Alternative Keyboards", Solutions for Humans, Available at <http://www.keyalt.com/kkeybrdp.htm>, Dec. 8, 2005, 5 pages.
"Devices", Technology Loan Catalog, Available at , Retrieved on Dec. 8, 2005, 10 pages.
"Devices", Technology Loan Catalog, Available at <http://www.tsbvi.edu/outreach/techioan/catalog.html>, Retrieved on Dec. 8, 2005, 10 pages.
"Fastap(TM) Keypads Redefine Mobile Phones", DigitWireless, Available at , Retrieved on Nov. 18, 2005, 10 pages.
"Fastap(TM)", DigitWireless, Available at , Dec. 6, 2005, 5 pages.
"Fastap™ Keypads Redefine Mobile Phones", DigitWireless, Available at <http://www.digitwireless.com>, Retrieved on Nov. 18, 2005, 10 pages.
"Fastap™", DigitWireless, Available at <http://www.digitwireless.com/about/faq.html>, Dec. 6, 2005, 5 pages.
"Four-Button Keyboard", WikiPodlinux, Available at , Retrieved on Dec. 5, 2005, 2 pages.
"Four-Button Keyboard", WikiPodlinux, Available at <http://ipodlinux.org/Four-Button-Keyboard>, Retrieved on Dec. 5, 2005, 2 pages.
"Introducing the Ultimate Smartphone Keypad", Delta II(TM) Keypads, Available at , Retrieved on Nov. 18, 2005, 2 pages.
"Introducing the Ultimate Smartphone Keypad", Delta II™ Keypads, Available at <http://www.chicagologic.com>, Retrieved on Nov. 18, 2005, 2 pages.
"LG Develops New Touch Pad Cell Phones", Textually, Available at , Retrieved on Nov. 18, 2005, 1 page.
"LG Develops New Touch Pad Cell Phones", Textually, Available at <http:/Itextually.ora/textually/ archives/2005/06/009903.html>, Retrieved on Nov. 18, 2005, 1 page.
"Microsoft New-Smart Phone Interface: Your Thumb", Textually, Available at , Retrieved on Nov. 18, 2005, 2 pages.
"Microsoft New-Smart Phone Interface: Your Thumb", Textually, Available at <http://www.textually.org>, Retrieved on Nov. 18, 2005, 2 pages.
"P900 User Guide", Sony Ericsson Mobile Communications Ab, XP002479719, Available at , Sep. 2003, 98 pages.
"P900 User Guide", Sony Ericsson Mobile Communications Ab, XP002479719, Available at <http://www.sonyericcson.com/downloads/P900-UG-R1b-EN.pdf>, Sep. 2003, 98 pages.
"Samsung Releases Keyboard Phone in US", Textually, Available at , Retrieved on Nov. 18, 2005, 1 page.
"Samsung Releases Keyboard Phone in US", Textually, Available at <http://www.textually.ora/textually/ archives/2005/11/010482.htm>, Retrieved on Nov. 18, 2005, 1 page.
"T9® Text Input for Keypad Devices", Available at , retrieved on Nov. 18, 2005, 1 page.
"T9® Text Input for Keypad Devices", Available at <http://tegic.com>, retrieved on Nov. 18, 2005, 1 page.
"Text Input (legacy)", WikiPodlinux, Available at , Retrieved on Dec. 5, 2005, 8 pages.
"Text Input (legacy)", WikiPodlinux, Available at <http://ipodlinux.org/TextInput-%28legac%29>, Retrieved on Dec. 5, 2005, 8 pages.
"Text Input Concepts", WikiPodlinux, Available at , Dec. 2005, 3 pages.
"Text Input Concepts", WikiPodlinux, Available at <http://web.archive.ora/web/20051211165254/http://ipodlinux.ora/Text-Input-Concepts>, Dec. 2005, 3 pages.
"Text Input Methods", WikiPodlinux, Available at , Retrieved on Dec. 5, 2005, 5 pages.
"Text Input Methods", WikiPodlinux, Available at <http://ipodlinux.org/Text-Input-Methods>, Retrieved on Dec. 5, 2005, 5 pages.
"You Heard of Touch Screens Now Check Out Touch Keys", Phoneyworld, Available at , retrieved on Nov. 18, 2005, 2 pages.
"You Heard of Touch Screens Now Check Out Touch Keys", Phoneyworld, Available at <http://www.phonevworld.com>, retrieved on Nov. 18, 2005, 2 pages.
CALL Centre 1999. "Word Prediction," Copyright © The CALL Centre & Scottish Executive Education Dept., pp, 63-73.
Casario, Marco, "Hands on Macromedia World: Touch Screen Keypad for Mobile Phone by DoCoMo", Available at , Retrieved on Nov. 18, 2005, 1 page.
Casario, Marco, "Hands on Macromedia World: Touch Screen Keypad for Mobile Phone by DoCoMo", Available at <http://casario.blogs.com/mmworld/2005/10/touch-screen-ke.html>, Retrieved on Nov. 18, 2005, 1 page.
Day, B., "Will Cell Phones Render iPods Obsolete?", Available at , Dec. 12, 2005, 3 pages.
Day, B., "Will Cell Phones Render iPods Obsolete?", Available at <http://weblogs.iavanet/pub/wig/883>, Dec. 12, 2005, 3 pages.
Dyslexic.com, "AlphaSmart 3000 with CoWriter SmartApplet: Don Johnston Special Needs." printed Dec. 6, 2005, 13 pages, http://www.dyslexic.com/procuts.php?catid-2&pid=465&PHPSESSID=2511 b800000f7da.
Final Office Action dated Feb. 1, 2010, received in U.S. Application No. 11/549,624, 12 pages (Mansfield).
Final Office Action dated Jun. 25, 2010, received in U.S. Application No. 11/620,641, 32 pages (Christie).
Final Office Action dated Nov. 29, 2010, received in U.S. Appl. No. 11/620,642, 16 pages (Kociendal).
Glossary of Adaptive Technologies: Word Prediction, printed Dec. 6, 2005, 5 pages, http://www.utoronto.ca/atrc/reference/techwordpred.html.
Hardy, Ed, "Apple Adds iTunes Wi-Fi Music Store to iPhone", Brighthand, Available at , Sep. 28, 2007, 1 page.
Hardy, Ed, "Apple Adds iTunes Wi-Fi Music Store to iPhone", Brighthand, Available at <http://www.brighthand.com/printArticle.asp?newsID=13379>, Sep. 28, 2007, 1 page.
International Search Report and Written Opinion dated May 8, 2008, received in International Application PCT/US2007/088872, which corresponds to U.S. Appl. No. 11/620,641.
International Search Report and Written Opinion dated May 8, 2008, received in International Application PCT/US2007/088873, which corresponds to U.S. Appl. No. 11/620,642.
MacTech, "KeyStrokes 3.5 for Mac OS X Boosts Word Prediction," printed Jan. 7, 2008, 3 pages, http://www.mactech.com/news/?p=1007129.
Masui, T., "PO Box: An Efficient Text Input Method for Handheld and Ubiquitous Computers," Proceedings of the International Symposium on Handheld and Ubiquitous Computers (HUC′99), Sep. 1999, 12 pages.
Mobile Tech News, "T9 Text input Software Updated," Dec. 8, 2005, 4 pages, http://www.mobiletechnews.com/infor/2004/11/23/122155.html.
NCIP: Word Predicion Collection, NCIP Library: Word Prediction Collection, printed Jan. 7, 2008, 4 pages, http://www2.edc.org/NCIP/library/wp/toc.htm.
NCIP: Word Prediction Coilection, "What is Word Prediction?" printed Jan. 7, 2008, 2 pages, http://www2.edc.org/NCIP/library/wp/What-is.htm.
Non-Final Office Action received for U.S. Appl. No. 11/459,606, mailed on May 28, 2009, 19 pages.
Non-Final Office Action received for U.S. Appl. No. 11/459,615, mailed on May 22, 2009, 10 pages.
Non-Final Office Action received for U.S. Appl. No. 11/620,641, mailed on Nov. 20, 2009, 20 pages.
Notice of Allowance dated Jun. 3, 2010, received in U.S. Appl. No, 11/549,624, 6 pages (Mansfield).
Office Action dated Apr. 1, 2010, received in Australan Patent Application No. 2007342164, which corresponds to U.S. Appl. No .11/620,641. 2 pages. (Christie).
Office Action dated Apr. 10, 2009, received in U.S. Appl. No. 11/549,624, 7 pages (Mansfield).
Office Action dated Dec. 7, 2010, received in European Patent Application No. 07 869 922.0, which corresponds to U.S. Appl. No. 11/620,641 5 pages (Christie).
Office Action dated Feb. 18, 2011, received in U.S. Appl. No. 11/620,642, 16 pages (Kocienda).
Office Action dated Jan. 6, 2012, received in U.S. Appl. No. 12/505,382, 36 pages (Westerman).
Office Action dated Jul. 22, 2009, received in U.S. Appl. No. 11/549,624, 9 pages (Mansfield).
Office Action dated Mar. 30, 2010, received in U.S. Appl. No. 11/620,642, 13 pages (Kocienda ).
Office Action dated May 26, 2010 received in European Application No. 07 869 922.0, which corresponds to U.S. Appl. No. 11/620,641, 5 pages (Christie).
Office Action dated May 26, 2010, received in European Application No. 07 869 923.8, which corresponds to U.S. Appl. No. 11/620,642, 4 pages (Kocienda)
Office Action dated Nov. 20, 2009, received in U.S. Appl. No. 11/620,641, 22 pages (Christie).
Office Action dated Nov. 25, 2010, received in Chinese Patent Application No. 200780052020.1, which corresponds to U.S. Appl. No. 11/620,641, 14 pages (Christie).
O'Neal, "Smart Phones with Hidden Keyboards", available at , Nov. 18, 2005, 3 pages.
O'Neal, "Smart Phones with Hidden Keyboards", available at <http://msc.com/4250-6452-16-6229969-1.html>, Nov. 18, 2005, 3 pages.
Plaisant, C., "Touchscreen Toggle Design, " video recorded January 1991, uploaded to YouTube Nov. 30, 2011, 6:39 minutes, http://www.youtube.com/watch?v=wFWbdxicvK0, 2 pages.
Pogue, David. "iPhone the Missing Manual", Aug. 2007, Pogue Press, pg. 22. *
Sears et al., "Data Entry for Mobile Devices Using Soft Keyboards: Understanding the Effects of Keyboard Size and User Tasks", Abstract, Int′l Journal of Human-Computer Interaction, vol. 16, No. 2, 2003, 1 page.
US20090174667A1 (en) 2009-07-09 application