Patent ID: 8285257

Claim:
A message system having a message storage server and at least two mobile communication terminals, each of the at least two mobile communication terminals comprising: a transmitter-receiver that transmits data to, and receives data from, the message storage server; a display that displays an image; an input receiver that receives input of speech or video from a user; and a controller that controls each of the transmitter-receiver, the display, and the input receiver, wherein the controller, in a case in which a message containing speech or video intended for another mobile communication terminal is received by the input receiver, is configured to transmit the message to the message storage server via the transmitter-receiver without any emotion recognition of the message being performed; the message storage server comprising: a message receiver that receives, from a mobile communication terminal, the message for another mobile communication terminal; a storage device that stores the message received by the message receiver; an emotion recognizer that performs emotion recognition on the message and that assigns emotion data indicating the recognized emotion to the message; and a confirmation request transmitter that transmits, as a confirmation request, emotion data assigned by the emotion recognizer to the mobile communication terminal that has transmitted the message, wherein the controller, upon receiving from the message storage server the confirmation request, displays an image corresponding to the received emotion data on the display; and wherein the emotion recognizer is further configured, in response to receipt from the mobile communication terminal of a response message indicating disapproval of the emotion data, to perform a second emotion recognition on the message, and assign revised emotion data indicating a second recognized emotion to the message, and the confirmation request transmitter further configured to transmit, as a second confirmation request, the second emotion data to the mobile communication terminal that has transmitted the message.