EMOTION EXCHANGE APPARATUS AND METHOD FOR PROVIDING THEREOF

An emotion exchange apparatus comprises: a communication unit configured to receive an emotion signal of an emotion deliverer from an external device; an output unit configured to output the emotion signal; an input unit configured to receive a counterpart emotion signal of an emotion learner in response to the emotion signal; and a controller coupled to one or more of the output unit, the input unit, and the communication unit, and configured to receive the emotion signal from the external device through the communication unit, output the emotion signal in an audible or visual manner, receive the counterpart emotion signal from the input unit, and transmit the counterpart emotion signal to the external device through the communication unit.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Exemplary embodiments of the present invention will be described in detail below with reference to the accompanying drawings. While the present invention is shown and described in connection with exemplary embodiments thereof, it will be apparent to those skilled in the art that various modifications can be made without departing from the spirit and scope of the invention.

A combination of blocks in an accompanying block diagram and a combination of operations in a flowchart may be performed by algorithms or computer program instructions which are composed of a firmware, software, or hardware. Since the algorithms or the computer program instructions may be installed on general-purpose computers, special-purpose computers, or processors of the other programmable digital signal processing devices, the instructions executed through the computers or the processors of the other programmable data processing equipment serve to create functions described in each of the blocks in the block diagram or each of the operations in the flowchart. The algorithms or the computer program instructions may be stored in computer-usable or computer-readable memories which intend to be used for the computer or the other programmable data processing equipment so as to realize the functions using a certain method. Therefore, the instructions stored in the computer-usable or computer-readable memories may be used to produce a manufacturing article including an instruction tool for executing the functions described in each of the blocks in the block diagram or each of the operations in the flowchart. Since the computer program instructions may be installed onto the computers or the other programmable data processing equipment, a series of motion operations may be performed on the computers or the other programmable data processing equipment to create processes executed on the computers. As a result, the instructions used to execute the computers or the other programmable data processing equipment can provide operations for executing the functions described in each of the blocks in the block diagram or each of the operations in the flowchart.

Also, a part of a module, a segment, or a code including one or more practicable instructions for executing a certain logical function(s) may be shown in each of the blocks or the operations.

In some alternative embodiments, it should also be noted that the functions described in each of the blocks or the operations may be exhibited out of sequence. For example, two blocks or operations shown in sequence may be executed substantially at the same time, or be often executed in a reverse sequence according to the corresponding functions.

Although the terms first, second, etc. may be used to describe various elements, it should be understood that these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of exemplary embodiments.

In this specification, when one element “transmits” data or signals to another element, one element can transmit data or signals to another element directly or one element can transmit data or signals to another element via at least one other element.

Hereinafter, various exemplary embodiments of the present invention will be described in further detail with reference to the accompanying drawings.

FIG. 1is a conceptual diagram illustrating an emotion exchange apparatus management system according to an exemplary embodiment of the present invention. Referring toFIG. 1, an emotion exchange apparatus management system100may include an external device10, a system server11, and an emotion exchange apparatus12.

The emotion exchange apparatus management system100represents a system for exchanging emotion between a user of the external device10and a user of the emotion exchange apparatus12by transmitting an emotion signal, a counterpart emotion signal, or a combination thereof between the external device10and the emotion exchange apparatus12.

In the description of the present invention, an ‘emotion signal’ represents a signal related to all emotions transmitted to a child from parents, an educator, or a doctor. In the description of the present invention, the emotion signal is a signal transmitted from the external device10to the emotion exchange apparatus12. The emotion signal may include various types of voices such as a nursery song, an effect sound, and a bedtime story, and information related to such a voice message may include lyrics of a nursery song, background sound, a still image, a moving image, and animation. In addition, the emotion signal may include both a voice and information related to the voice.

In the description of the present invention, a ‘counterpart emotion signal’ represents a signal related to all emotions being transmitted by a child to parents, an educator, or a doctor. In the description of the present invention, the counterpart emotion signal is a signal being transmitted from the emotion exchange apparatus12to the external device10. The counterpart emotion signal may include a voice, a moving image, or an emotion representation generated by selecting one of a plurality of emotion representations. The emotion representation generated by selecting one of the plurality of emotion representations will be described later in detail in conjunction with the description of the emotion exchange apparatus12.

The external device10may include at least a microprocessor, a memory, and a communication module, for example, the external device10may be a terminal or a portable terminal. In a case in which the external device10is a portable terminal, the portable terminal may be a cellular phone, a smartphone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, or accessories used in combination thereof.

In addition, the external device10may be a terminal additionally produced for exclusive use of the emotion exchange apparatus or accessories used in combination thereof rather than the existing terminals as described above. Even when a terminal produced for exclusive use of the emotion exchange apparatus is implemented as the external device10, the terminal may include all elements of the external device10that is to be described below, and the terminal may have a design that is compact when compared to other external devices and associated with the emotion exchange apparatus. However, the terminal produced for exclusive use of the emotion exchange apparatus may only include a synchronization function and a playback function. The transmission/reception, synchronization, and playback of the terminal will be described later.

Hereinafter, for convenience of description, a case in which the external device10is a smartphone will be described as an exemplary embodiment. For convenience of description, the emotion exchange apparatus management system100will be illustrated as having a single external device10, but the present invention is not limited thereto. The emotion exchange apparatus management system100may include a plurality of external terminals10by having a plurality of emotion deliverers adopted thereto.

The system server11manages various types of information related to operating the emotion exchange apparatus management system100, user registration, and authentication information to authenticate the external device10or the emotion exchange apparatus12. The authentication information may be managed through a different configuration of a system server according to another exemplary embodiment of the present invention. The emotion exchange apparatus management system100registers or authenticates the external device10or the emotion exchange apparatus12through the system server11. That is, the system server11receives an emotion signal or information from the external device10, authenticates the received signal or information, searches for the emotion exchange apparatus12that is set, and transmits the emotion signal or information to the found emotion exchange apparatus12. On the other hand, the system server11receives a counterpart emotion signal from the emotion exchange apparatus12, authenticates the received counterpart emotion signal, searches for the external device10that is set, and transmits the counterpart emotion signal to the found external device10.

Although an authentication operation between the external device10and the emotion exchange apparatus12through the system server11may be applied to all the transmission/reception operations that are to be described below, the description of the authentication operation will be omitted for the sake of convenience.

The system server11provides data and related programs required to use the emotion exchange apparatus management system100. The data and related programs required to use the system100may include webpages, smartphone applications, and customized programs.

The system server11manages the emotion signals or the counterpart emotion signals being transmitted and received, and provides the emotion signals or the counterpart emotion signals to the external device10or the emotion exchange apparatus12. The system server11stores the emotion signals and the counterpart emotion signals in a sequential order or a predetermined order to generate a series of signals, or stores the emotion signals and the counterpart emotion signals according to time periods to provide the stored emotion signals and the counterpart emotion signals to the external device10or the emotion exchange apparatus12. A detailed configuration thereof will be described later.

The system server11includes a database in which system information of the emotion exchange apparatus management system100, the emotion signal, the counterpart emotion signal, related program information, and a series of signals stored in a sequential order or a predetermined order are provided and managed.

The emotion exchange apparatus12is an apparatus configured to provide emotion exchange and emotion education to children using the emotion exchange apparatus12by transmitting and receiving the emotion signal and the counterpart emotion signal with respect to the external device10. The emotion exchange apparatus12may have a toy or a doll as a body thereof. The emotion exchange apparatus12includes a communication unit, an output unit, an input unit, and a controller, and communicates through a communication network. A detailed configuration of the emotion exchange apparatus12will be described later.

The communication between the external device10and the system server11, the communication between the system server11and the emotion exchange apparatus12, or the communication between the external device10and the emotion exchange apparatus12may be performed through a communication network in a wireless scheme. The communication network may be a high-speed backbone network of a large-scale communication network capable of a large capacity, long distance voice and data service, and a next generation wired/wireless network capable of providing the Internet or a high-speed multimedia service. In a case in which the communication network is a mobile communication network, the mobile communication network may be a synchronous mobile communication network or an asynchronous mobile communication network. As an example of the asynchronous mobile communication network, a Wideband Code Division Multiple Access (WCDMA) scheme communication network may be used. When the WCDMA scheme is used, although not shown in the drawings, the mobile communication network may include a radio network controller (RNC). Although the WCDMA network is described as an example of the communication network, the communication network according to the present invention may be a next generation communication network, such as a 3G network, an LTE network, and a 4G network, or another IP-based network.

The communication network may be Bluetooth using IEEE 802.15.1 standard. Alternatively, the communication network may be a wireless local area network (WLAN). The WLAN is technology allowing access to the Internet in a wireless scheme in a home or business or a certain servicing area using the external device10such as a laptop computer, a navigation device, and a smartphone based on radio frequency technologies.

FIG. 2is a block diagram illustrating the emotion exchange apparatus12according to an exemplary embodiment of the present invention. Referring toFIG. 2, the emotion exchange apparatus12includes a communication unit20, a controller21, an output unit22, and an input unit23.

The communication unit20includes a wireless communication unit, and using the wireless communication unit, receives an emotion signal transmitted by the external device10through the server. For example, in a case in which the communication unit20performs a communication using a wireless communication unit, the external device10may also be configured to use a wireless communication unit. The expression exchange apparatus12may receive an emotion signal through the system server11using the communication network such as the 3G network and the 4G network, the WLAN communication network, or the local area network, such as a Bluetooth connection. In addition, the counterpart emotion signal may be transmitted in the same manner as the above.

The output unit22outputs the emotion signal received from the external device10through a voice or in a visual manner. The output unit22may include a speaker outputting a voice and a display apparatus. In addition, the output unit22may indicate various types of information related to the emotion exchange apparatus12. For example, the output unit22may notify that an emotion signal is received from the external device10, in the form of an effect sound or a voice. In this case, the voice may be a voice related to an emotion deliverer delivering the emotion signal. In a case in which the sound notifying of the reception of the emotion signal is related to the emotion deliverer, more intimate emotion exchange is possible.

The input unit23generates a counterpart emotion signal from the emotion exchange apparatus12in response to the emotion signal. The input unit23may include at least one of buttons, keys, a touch panel, a joystick, a microphone, a camera, a keyboard, and a mouse. Various types of input devices may be applied to the input unit other than those described above. The counterpart emotion signal may be generated by selecting one of a plurality of emotion representations. The detailed configuration and method of generating the counterpart emotion signal will be described later.

The controller21is coupled to one or more of the communication unit20, the output unit22, and the input unit23, receives the emotion signal from the external device10through the communication unit20, audibly or visually outputs the received emotion signal, receives the counterpart emotion signal from the input unit23, and transmits the received counterpart emotion signal to the external device10through the communication unit20.

In addition, the controller21is configured to manage the authentication and registration of the emotion exchange apparatus12as described above in relation to the system server11. The emotion exchange apparatus12has a unique authentication number, is authenticated through the authentication number, and performs transmission/reception only with a registered external device10.

FIG. 3is a flowchart showing an emotion exchange method according to an exemplary embodiment of the present invention.

First, an emotion signal is generated from the external device10(S30). According to an exemplary embodiment of the present invention, the emotion signal includes a voice and information related to the voice. For example, the emotion signal may be a nursery song voice recorded by an emotion deliverer, an accompaniment sound of a nursery song, and an image related to a nursery song. Further, the emotion signal may include a bedtime story or a fairy tale voice recorded by an emotion deliverer. The bedtime story represents a fairy tale read by parents before children fall asleep. The emotion signal may further include an image related to the bedtime story or fairy tale voice. Alternatively, the emotion signal may include other signals in addition to the emotion-related signals described above.

The system server11authenticates the external device10, receives the emotion signal from the external device10, searches for the emotion exchange apparatus12that is registered, and transmits the emotion signal to the found emotion exchange apparatus12(S31). Through such an operation, the external device10transmits the generated emotion signal to the emotion exchange apparatus12. Meanwhile, the system server11separately stores the emotion signal.

The emotion exchange apparatus12receives the emotion signal and outputs the received emotion signal (S32). Thereafter, a counterpart emotion signal is generated from the emotion exchange apparatus12(S33). According to an exemplary embodiment of the present disclosure, the counterpart emotion signal may include various signals representing emotions. Herein, the emotion represents all the states of mind that are felt by a human, such as happiness, joy, surprise, inspiration, sadness, and anger. The counterpart emotion signal is generated by selecting one of a plurality of emotion representations. For example, a plurality of buttons are configured to correspond to the plurality of emotions, and by selecting one button, an emotion corresponding to the button is selected. In addition, one of the plurality of emotion representations may be selected by a joystick, or may be selected by touching an image, which is related to an emotion, being represented on a touch screen. Through this, a user of the emotion exchange apparatus12represents his or her emotion in response to the emotion signal and compares his or her own emotion with the represented emotion image, thereby recognizing the type of emotion.

The counterpart emotion signal may additionally include a voice recorded through a microphone, information related to the voice, an image captured by a camera or a moving image in addition to the signal representing emotions. The additional counterpart emotion signal may be configured to be associated with the selected emotion representation. For example, in a case in which an emotion representation corresponding to joy is selected, a camera may photograph a child, that is, a user of the emotion exchange apparatus12, with a background having an image related to joy. In a case in which an emotion representation corresponding to happiness is selected, music related to happiness is played, and a voice of the child, that is, the user of the emotion exchange apparatus12, may be recorded with a background having the music. Through this, the child may learn information associated with the emotion that the child selects, and may improve his or her ability to express his or her emotion.

Further, the counterpart emotion signal may include at least a portion of the emotion signal. For example, in a case in which the emotion signal includes an image, the emotion representation of the counterpart emotion signal described above may be indicated on the image of the emotion signal, and in a case in which the counterpart emotion signal includes an image, the counterpart emotion signal may be indicated in the form of a collage with the image of the emotion signal. Alternatively, the counterpart emotion signal may be generated as the emotion learner conducts doodling on the image of the emotion signal. The emotion learner may express himself or herself by performing doodling on the image transmitted by the emotion deliverer. Such doodling aids in recognizing the emotional state of the child, and the emotion signal and the counterpart emotion signal are connected in a series of signals, leading to one continuous story.

The system server11authenticates the emotion exchange apparatus12, receives a counterpart emotion signal from the emotion exchange apparatus12, searches for the external device10that is registered, and transmits the counterpart emotion signal to the found external device10(S34). Through such a process, the emotion exchange apparatus12transmits the generated counterpart emotion signal to the external device10. The system server11may separately store the counterpart emotion signal.

The external device10receives the counterpart emotion signal and outputs the received counterpart emotion signal (S35). Thereafter, as the above-described processes are repeated, the emotion signal and the counterpart emotion signal are transmitted and received between the external device10and the emotion exchange apparatus12.

Meanwhile, the system server11receives the emotion signal from the external device10and the counterpart emotion signal from the emotion exchange apparatus12, processes the received emotion signal and counterpart emotion signal, and manages information about the emotion signal and the counterpart emotion signal. If necessary, the system server11may record when the emotion signal is received from the external device10and which counterpart emotion signal corresponds to the emotion signal, that is, what type of emotion representation corresponds to the emotion signal.

In addition, the system server11may generate a series of signals by combining the emotion signal with the counterpart emotion signal corresponding to the emotion signal in a predetermined method, and store the series of signals (S36). For example, the emotion signal, including a nursery song recorded by parents, and the counterpart emotion signal, including a joy signal generated in response to the emotion signal, may be stored in the form of a set or in series of signals.

In addition, the system server11may store a series of signals divided according to the emotion signal or the counterpart emotion signal. For example, the system server11may store only bedtime-story-related emotion signals among a plurality of emotion signals and counterpart emotion signals, each of which corresponds to the bedtime-story-related emotion signals. The system server11may store a sadness-related counterpart emotion signal and emotion signals, each of which corresponds to the sadness-related counterpart emotion signal, in the form of a set or a series of signals.

In addition, the system server11may store the emotion signal and the counterpart emotion signal in a time series order or a sequential order. For example, the system server11may store the emotion signal and the counterpart emotion signal from one and two days previous.

The set or the series of signals stored in the system server11may be transmitted to the emotion exchange apparatus12or the external device10, and may be received and output by the emotion exchange apparatus12(S38) or by the external device10(S37). The set or the series of signals arranged by the system server11enables the emotion exchange between an emotion deliverer and a child to be stronger and more continual.

FIG. 4is a schematic view illustrating the configuration of the emotion exchange apparatus12according to an exemplary embodiment of the present invention and a sensor34communicating with the emotion exchange apparatus12. The emotion exchange apparatus12may include a speaker, a display device30, a plurality of buttons31, a playback or function button32, and a joystick35.

As described in the configuration of the emotion exchange apparatus12and the flowchart of the emotion exchange apparatus management system100, the input unit23of the emotion exchange apparatus12may include the plurality of buttons31configured to represent a plurality of emotions. In addition, the input unit23may further include the button32or the joystick35to replay the emotion signal or control the emotion exchange apparatus12. The emotion exchange apparatus12may include a speaker or the display device30, in a case in which an emotion signal is received, to notify of the reception of the emotion signal and output the emotion signal in an audible or visual manner.

Meanwhile, the sensor34communicating with the emotion exchange apparatus12is disclosed. The sensor34includes a sensor34detecting data related to the body of a child, who is a user of the emotion exchange apparatus12. For example, the sensor34may be a sensor34detecting blood pressure or a heartbeat. The emotion exchange apparatus12may receive information about the blood pressure or the heartbeat from the sensor34through a local area network, and may transmit the received information to the external device10through a communication network. Meanwhile, as described above inFIG. 3, the external device10is an external device registered by the emotion exchange apparatus12. Accordingly, a user of the external device10may be a parent or a family physician, and the parent or the family physician may receive health-related information from the emotion exchange apparatus12through the external device10. That is, the parent or the family physician may obtain continual information about the physical state of a child while simultaneously obtaining and monitoring the emotional and physical information.

Further, the emotion exchange apparatus12may receive an instruction from the external device10and deliver the received instruction to other devices. For example, a parent or a family physician, based on the health-related information described above, may transmit an instruction about an external environment which may affect the health or emotional state of a child to the emotion exchange apparatus12through the external device10. The parent or the family physician may transmit instructions about the setting on the current temperature of an air conditioner, the brightness or on/off of a lamp, the locking of doors, and the volume or on/off of music to the emotion exchange apparatus12. The emotion exchange apparatus12may transmit the instructions to a nearby device associated with the emotion exchange apparatus12according to the instruction.FIG. 5is a view showing a schematic user interface (UI) of the external device10associated with the emotion exchange apparatus12according to an exemplary embodiment of the present invention. A smartphone-purpose application, a customized program, and a website, which are provided from the system server11, may be installed or indicated on the external device10. According to an exemplary embodiment of the present invention, an emotion deliverer may generate an emotion signal by recording a bedtime story40, a voice message41, or a nursery song42through the external device10. In a case in which the bedtime story41is selected, sentences of a fairy tale may be displayed on the external device10, and the emotion deliverer may perform the recording by reading the sentences. In addition, in the middle of performing the recording, a background sound may be inserted. The voice message41or the nursery song42may be also provided together with related information that may be input in the similar manner to the bedtime story40.

FIG. 6is a view showing a schematic user interface (UI) related to continual storytelling by the emotion exchange apparatus12according to an exemplary embodiment of the present invention. The external device10according to an exemplary embodiment of the present invention is configured to display calendar information50and a counterpart emotion signal51that corresponds to a transmission date. A system server stores a date when an emotion signal received from the external device10is transmitted and a date when a counterpart emotion signal received from the emotion exchange apparatus12is transmitted. In addition, the system server arranges the counterpart emotion signals in a time series order, and transmits the calendar information50to the external device10. In this manner, the emotion deliverer may manage the date when the emotion deliverer has transmitted the emotion signal, and check what type of counterpart emotion signal51has been received in response to each emotion signal, and thereby an organic and continual emotion exchange can be experienced.

Meanwhile, the UI ofFIG. 6is illustrated only as an example, and a display method is not limited thereto in implementing the present invention as long as the display method manages the emotion signal and the counterpart emotion signal at the external device10while representing an organic and continual emotion exchange. For example, a display method through the above described classification depending on the emotion signal or the counterpart emotion signal may be possible.

FIG. 7is a schematic view of a series of signals60related to continual storytelling according to an exemplary embodiment of the present invention. The series of signals60related to the continual storytelling may be an emotion signal, a counterpart emotion signal, or a combination thereof. According to an exemplary embodiment of the present invention, the series of signals60may include a first emotion signal61, a first counterpart emotion signal62, a second emotion signal64, and a second counterpart emotion signal65. The first emotion signal61may be for example a voice message from an emotion deliverer, and the first counterpart emotion signal62may be an emotion representation signal63of joy. The second emotion signal64may be for example a nursery song, and the second counterpart emotion signal65may be an emotion representation signal of sadness. The series of signals60may be provided to the external device10or the emotion exchange apparatus12in a visual manner as shown inFIG. 7. In this case, the user may replay each signal by selecting the signal.

FIG. 8is a flowchart showing an emotion exchange method at a server end according to an exemplary embodiment of the present invention. A system server receives an emotion signal containing at least a voice and voice-related information from the external device10(S81). Thereafter, the system server transmits the emotion signal to the emotion exchange apparatus12(S82). The system server receives a counterpart emotion signal generated from the emotion exchange apparatus12(S83), and stores the counterpart emotion signal according to time periods in the storage (S84). The system server transmits the counterpart emotion signal stored according to time periods to the external device10or the emotion exchange apparatus12(S85).

FIG. 9is a flowchart showing an emotion exchange method according to another exemplary embodiment of the present invention. According to the emotion exchange method of another exemplary embodiment of the present invention, a first emotion deliverer and a second emotion deliverer use the emotion exchange apparatus12to exchange emotion. For example, a method in which two or more emotion deliverers input an emotion signal to a single emotion exchange apparatus12is provided. For convenience of description, the following description will be made in relation to the emotion exchange apparatus12.

According to the emotion exchange method according to another exemplary embodiment of the present invention, an emotion signal is input from a first emotion deliverer through the emotion exchange apparatus12(S91). The emotion signal may be input in an audible or visual manner through a microphone, a camera, a joystick, buttons, and a touch screen, and may be only a selection of an emotion expression.

A counterpart emotion signal is input from a second emotion deliverer through the emotion exchange apparatus12(S92). The counterpart emotion signal may also be input in an audible manner or visual manner through a microphone, a camera, a joystick, buttons, and a touch screen, and may be only a selection of an emotion expression.

The emotion exchange apparatus12stores emotion signals and counterpart emotion signals in a sequential order or a predetermined order to generate a series of signals (S93). The series of signals may be output by the emotion exchange apparatus12in an audible or visual manner.

That is, the emotion deliverer and the emotion learner may simultaneously generate storytelling through a single emotion exchange apparatus12. For example, the emotion deliverer selects an emotion using an input unit including a joystick of the emotion exchange apparatus12, and the emotion learner may select a counterpart emotion using another input unit. In this manner, storytelling including the emotion signal and the counterpart emotion signal may be generated at the emotion exchange apparatus12including a plurality of inputs. Through this, mutual two-way communication is achieved. Storytelling or a series of signals formed and recorded is transmitted to another external device, and induces an emotion exchange with another emotion deliverer.

As described above, the emotion exchange apparatus and the method of providing the same according to the present invention can provide a continual emotion exchange between a child and parents, as opposed to the fragmentary education or experience of emotion provided by existing emotion education dolls and learning robots, by providing an emotion exchange between parents and a child in a storytelling method.

In addition, the emotion exchange apparatus and the method of providing the same according to the present invention can enable a child to learn various emotions in a more effective way by expressing emotions through various experience methods. In addition, even if a parent or an educator is not present in the same space with a child, the emotion of the child can be conveyed, and since the emotion exchange is performed through the emotion exchange apparatus, the emotion can be delivered with no spatial limitation.