Patent ID: 8793118
Filing Date: 2014-07-29
Classification: G06F,G09B,G10L,H04M

Abstract:
1. A computer implemented method for assisting a user to learn and/or communicate in a visual communication language in one or more of a plurality of modes, comprising: providing a multimodal communication assist application embedded in a non-transitory computer readable storage medium executable by a processor of said user, wherein said multimodal communication assist application provides an interactive interface to said user for enabling communication of said visual communication language in said modes; providing a plurality of multimodal communication mappers to said user by said multimodal communication assist application via said interactive interface, wherein said multimodal communication mappers map a modal input in one of said modes to a modal output in another one or more of said modes; receiving a selection of one of said multimodal communication mappers from said user via said interactice interface; acquiring user-defined communication mappers by said multimodal communication assist application; adapting said multimodal communication assist application for said received user-selected one of said multimodal communication mappers and said user-defined communication mappers acquired by said multimodal communication assist application; determining characteristic information of said user by said multimodal communication assist application based on one or more of said user-selected multimodal communication mapper and said acquired user-defined communication mappers; determining a delay factor for said user based on a calculation of response times of said user for repeating each of a set of pre-stored gestures presented to said user along with a corresponding set of words, by said multimodal communication assist application, using a set of formulas: capturing said modal input in one of said modes from said user via said interactive interface based on said determined delay factor and one or more of said characteristic information by said multimodal communication assist application, wherein said multimodal communication assist application controls sampling rate of said capturing of said modal input based on user's proficiency level, and wherein said proficiency level of said user is determined by said multimodal communication assist application based on said determined delay factor using a criteria set comprising: