Plenary lecture 1: cognitive reasoning and recognition for intelligent human interaction based on mental cloning
Authors: Hamido Fujita
Venue: Proceedings of the 8th WSEAS international conference on Artificial intelligence, knowledge engineering and data bases (2009)

This plenary Lecture; is to high light on the importance of human nature collective behavior on intelligent interaction between man and machine. We have investigated on different disciplinary, (philosophical, physiological, cultural, physiognomy, and technical) views that collectively reflect the behavioral reasoning of human emotional feature interaction with machines (i.e., computer), this is essential to have mutual effective engagement between human and machine based on observing and examining the user from different views reflecting the emotional behavior of the user. The system will be sensitive to emotion related attributes that through integrated conceptual views, representing these attributes, we can be able grasp the emotional transition state of user engagement with the system. Emotion recognition is one of the most important components of emotional intelligence and it has a direct effect on our ability to make optimal decisions (along with the ability to utilize emotions to make decisions), any attempt by computer scientists to model human interaction should, at least in part, be founded on an accurate identification of affective states. It is suggested that by ignoring the emotional component intrinsic to human decision-making, we have been missing valuable information that could potentially lead to inadequate interactive models. These concepts are the basis of what we called mental cloning. A concept introduced by me through a project. This project is to establish a system as a virtual world to re-create a Miyzawa Kenji virtual world (famous Japanese writer dead on 1930) based on cognitive model of his personality and inner thinking). However, the Kenji system is currently be modified and adapted into a health care system, that this plenary lecture is trying to introduce. The objective is to have users (i.e., patients) who are attending a hospital (or they can do it from their home using computer link), to do all transaction of 1st level diagnosis before going to the actual health examination. In this level, based on mental cloning of medical doctors in that hospital, and based on their previous case studies, and experiences to examine patients the system would practice this diagnosis on patient as if the actual doctor are doing. All doctor cases studies have been collected and categorized into the system according to levels and type. The solutions or induced scenarios by the virtual doctors to the patients have been abstracted to distinguishing its central part (primary) from surrounding (secondary) parts. It first finds the solution of the central part, and then refines the solution by considering the secondary related parts. Medical doctors' knowledge has been classified according to categories. The system is been divided into our related parts. The 1st part is to create a hologram (or virtual 3D face on a display) that produce emotional character of a certain human defined personality, we use in this experiment actual employed medical doctor, the system will produce generated animated face emotionally talk and act as the medical doctor themselves, and who are currently working in the hospital. These animated characters reflecting the main interface the patient would look through and through it the virtual medical doctor would establish the best engagement to extract the current status of the subject patient. This part is working with part 4 of the system. Together part 1 and part 4 represent the mental cloning of the medical doctor. The 2nd part reflects the interaction of user (patient) emotional engagement states, by observing the user mental transition states (i.e., trace), that been recorded and analyzed by Active Appearance model system through a camera. A high resolution camera would collect images from the user (along with voice as in part 3). These frame streams of video are analyzed though what is called as active appearance model, so the system would collect user mental engagement with the doctor and accordingly, can estimate the user appearance state. The 3rd part is related to the voice reasoning, to produce with emotion a voice reflecting the context in hand, and to recognize it as it heard from the observed user. Also, this part would produce the output voice of the virtual medical doctor to speak emotionally the generated (in part 4) scenarios. Through Part 2 and Part 3 information is collected by the system (virtual doctor), to create a cognitive model of the subject patient. Such that to create the problem space that the system would use to navigate to the best match and accordingly the best scenario to use for diagnosis. When a user talk, the face emotional states, along with emotional states and the words are recognized by the system as information through it the system would find the best scenarios and corresponding cognitive model to use for interacting with the subject user. The 4th part is to produce the synthesis of the scenario that make the user and system been actively engaged. This would be based on creating a cognitive interaction between the human subject and the system based on transition analysis. This lecture is to bring into the audience the needs for such way of metaphoric thinking to bring user emotional status view to be part of the design views that to be integrated with other parts of the system.