Source: https://patents.google.com/patent/US8944824B2/en
Timestamp: 2018-12-14 03:52:45
Document Index: 483850840

Matched Legal Cases: ['Application No. 2011', 'Application No. 2011', 'Application No. 2011', 'Application No. 200980117877', 'Application No. 200980117877', 'Application No. 200980117877']

US8944824B2 - Multi-modal learning system - Google Patents
US8944824B2
US8944824B2 US12415789 US41578909A US8944824B2 US 8944824 B2 US8944824 B2 US 8944824B2 US 12415789 US12415789 US 12415789 US 41578909 A US41578909 A US 41578909A US 8944824 B2 US8944824 B2 US 8944824B2
US12415789
US20090253107A1 (en )
1. A method for instructing a student to create a plurality of target symbols, the method comprising:
capturing, by a smart pen device, a plurality of instructional modules, each instructional module comprising a sequence of target gestures made by an instructor on a dot-enabled surface, wherein a target symbol is created by the sequence of target gestures;
presenting to the student on a display of the smart pen device, a representation of the sequence of target gestures of a first instructional module;
capturing, by the smart pen device, a second sequence of gestures made by the student on the dot-enabled surface, wherein a second symbol is created by the second sequence of gestures;
comparing, by the smart pen device, the second symbol to the target symbol associated with the first instructional module and comparing the second sequence of gestures to the sequence of target gestures associated with the first instructional module;
determining, by the smart pen device, feedback based on the comparisons, wherein the feedback indicates a similarity between the target symbol associated with the first instructional module and the second symbol made by the student, and a similarity between the sequence of target gestures associated with the first instructional module and the second sequence of gestures;
presenting, by the smart pen device, the feedback to the student;
selecting, by the smart pen device, a second instructional module based on the comparisons; and
presenting to the student on the display of the smart pen device, a representation of the sequence of target gestures of the second instructional module.
2. The method of claim 1, wherein the feedback is presented on a display of the smart pen device.
3. The method of claim 1, wherein the feedback is presented through a speaker of the smart pen device.
4. The method of claim 1, wherein the feedback is presented haptically through the smart pen device.
5. The method of claim 1, wherein the feedback is presented substantially in real time as the second sequence of gestures is captured.
6. The method of claim 1, wherein the sequence of target gestures associated with the first instructional module and the second sequence of gestures are digitally captured using an imaging system in the smart pen device.
7. The method of claim 1, wherein the dot-enabled surface comprises an encoded coordinate system that is readable by the smart pen device.
8. The method of claim 1, wherein selecting the second instructional module comprises:
determining a skill level of the student based on the comparisons;
determining a difficulty of each of the instructional modules; and
selecting the second instructional module based on the determined skill level of the user and the difficulty of the second instructional module.
9. A non-transitory computer-readable storage medium storing computer program instructions for instructing a student to create a plurality of target symbols, the instructions when executed by a processor cause the processor to perform steps comprising:
capturing a plurality of instructional modules, each instructional module comprising a sequence of target gestures made by an instructor on a dot-enabled surface, wherein a target symbol is created by the sequence of target gestures;
capturing a second sequence of gestures made on by the student on the dot-enabled surface, wherein a second symbol is created by the second sequence of gestures;
comparing the second symbol to the target symbol associated with the first instructional module and comparing the second sequence of gestures to the sequence of target gestures associated with the first instructional module;
determining feedback based on the comparisons, wherein the feedback indicates a similarity between the target symbol associated with the first instructional module and the second symbol made by the student, and a similarity between the sequence of target gestures associated with the first instructional module and the second sequence of gestures;
presenting the feedback to the student;
selecting a second instructional module based on the comparisons; and
10. The non-transitory computer-readable storage medium of claim 9, wherein presenting with the smart pen device, the representation of the sequence of target gestures associated with the first instructional module includes presenting to the student, textual instructions for making the sequence of target gestures associated with the first instructional module.
11. The non-transitory computer-readable storage medium of claim 9, wherein the feedback is presented on a display of the smart pen device.
12. The non-transitory computer-readable storage medium of claim 9, wherein the feedback is presented substantially in real time as the second sequence of gestures is captured.
13. The non-transitory computer-readable storage medium of claim 9, wherein the sequence of target gestures associated with the first instructional module and the second sequence of gestures are digitally captured using an imaging system in the smart pen device.
14. The non-transitory computer-readable storage medium of claim 9, wherein the dot-enabled surface comprises an encoded coordinate system that is readable by the smart pen device.
15. The non-transitory computer-readable storage medium of claim 9, wherein the instructions causing the processor to select the second instructional module comprise instructions that when executed by the processor cause the processor to:
determine a skill level of the student based on the comparisons;
determine a difficulty of each of the instructional modules; and
select the second instructional module based on the determined skill level of the user and the difficulty of the second instructional module.
16. A smart pen device for instructing a student to create a target symbol, the smart pen device comprising:
a non-transitory computer-readable storage medium storing computer-executable program instructions, the instructions when executed by the processor to perform steps including:
capturing a second sequence of gestures made by the student on the dot-enabled surface, wherein a second symbol is creating by the second sequence of gestures;
17. The smart pen device of claim 16, wherein the feedback is presented on a display of the smart pen device.
18. The smart pen device of claim 16, wherein the feedback is presented through a speaker of the smart pen device.
19. The smart pen device of claim 16, wherein the feedback is presented haptically through the smart pen device.
20. The smart pen device of claim 16, wherein the instructions causing the processor to select the second instructional module comprise instructions that when executed by the processor cause the processor to:
US12415789 2008-04-03 2009-03-31 Multi-modal learning system Active 2031-12-22 US8944824B2 (en)
US4223608 true 2008-04-03 2008-04-03
US12415789 US8944824B2 (en) 2008-04-03 2009-03-31 Multi-modal learning system
US8944824B2 true US8944824B2 (en) 2015-02-03
US12415789 Active 2031-12-22 US8944824B2 (en) 2008-04-03 2009-03-31 Multi-modal learning system
WO (1) WO2009124219A3 (en)
JP5966750B2 (en) * 2012-08-08 2016-08-10 富士ゼロックス株式会社 Reader, an image processing system, and a reading program
KR20170096078A (en) * 2016-02-15 2017-08-23 삼성전자주식회사 Electronic device and method for providing handwriting calibration function thereof
JPH08101633A (en) 1994-09-30 1996-04-16 Fujitsu Ltd Diagnosis control system in cai device
JP2002229435A (en) 2001-01-31 2002-08-14 Fujitsu Ltd Method of carrying out adaptation type test
JP2004205962A (en) 2002-12-26 2004-07-22 Dainippon Printing Co Ltd Calligraphic training support system, computer, program, and recording medium
JP2004362483A (en) 2003-06-09 2004-12-24 Hideaki Yamane Method for recognizing character, symbol and graphic, program for this method, computer readable recording medium with this program recorded thereon and character/symbol/graphic recognition system
JP2006171249A (en) 2004-12-15 2006-06-29 Wao Corporation Information processing system, server device, and program
Japanese Patent Office, Decision to Decline the Amendment and Final Decision of Rejection, Japanese Patent Application No. 2011-503187, Dec. 24, 2013, nine pages.
Japanese Patent Office, Official Notice of Rejection, Japanese Patent Application No. 2011-503187, Dec. 25, 2012, eight pages.
Japanese Patent Office, Official Notice of Rejection, Japanese Patent Application No. 2011-503187, Jul. 2, 2013, eight pages.
PCT International Search Report and Written Opinion, PCT Application No. PCT/US2009/039366, May 20, 2009, 6 pages.
State Intellectual Property Office of the People's Republic of China, Notification of Second Office Action, Chinese Patent Application No. 200980117877.6, May 15, 2013.
State Intellectual Property Office of the People's Republic of China, Notification of the First Office Action, Chinese Patent Application No. 200980117877.6, Jul. 16, 2012, 8 pages (with English translation).
State Intellectual Property Office of the People's Republic of China, Third Office Action, Chinese Patent Application No. 200980117877.6, Sep. 6, 2013, ten pages.
Yoko et al, Machine Translation of Japanese Patent Publication No. JP 2004-205962, pp. 1-32. *
CN102067153A (en) 2011-05-18 application
US20090253107A1 (en) 2009-10-08 application
KR20100136529A (en) 2010-12-28 application
WO2009124219A2 (en) 2009-10-08 application
WO2009124219A3 (en) 2010-02-25 application
JP2011516924A (en) 2011-05-26 application
CN102067153B (en) 2014-07-09 grant
US20050125228A1 (en) 2005-06-09 Digital electronic correction pen with audio pronunciation and spell check capabilities, with built-in memory. Also calculation processing... thereof...