Synchronized multi-media streams including mood data

Systems and methods for generating synchronized multimedia streams including mood data are disclosed. In one embodiment, a computer-implemented method comprises: obtaining, by a computing device, one or more primary streams of data; creating, by the computing device, digital mood data that is synchronized with the one or more primary streams of data, wherein the digital mood data is configured for use by a wearable mood device; and storing, by the computing device, the digital mood data in a multimedia container with the one or more primary streams of data.

BACKGROUND

The present invention relates generally to multi-media streams including mood data and, more particularly, to systems and methods for generating and utilizing mood data in conjunction with synchronized multi-media data streams.

Wearable devices of all types have been increasing in popularity. Recently, wearable neurostimulation technology has become available to consumers, which aims at modifying a subjects' cognitive state utilizing transdermal electrical stimulation (TES).

In another technological field, technicians have developed various methods and systems for modifying streams of digital data for use with various user devices. For example, various methods have been developed for packaging synchronized video and audio data streams in multi-media containers or encapsulation units for use in displaying movies or television shows on televisions, computers and the like. Some multi-media containers include a codec for use by a user device in decoding/encoded video and/or audio data received at the device.

One technique for providing video data comprises the use of audio and video encoders to encode respective sources of audio and video data. The audio and video encoders feed video and audio data to an encapsulation unit, which assembles the synchronized audio and video data into a container for output to a destination device. The destination device then utilizes a decapsulation unit to decapsulate elements of the container into video and audio streams, and sends the video and audio streams to respective video and audio decoders for decoding. The decoded video and audio streams may then be utilized by audio and video outputs of the destination device. Such digital processing techniques enable manipulation by technicians of digital video data to enhance a consumer's viewing experience. For example, technicians may incorporate closed-captioning data, subtitling, or 3-dimensional (3-D) data that is synchronized or otherwise tied to corresponding portions of associated video and audio data.

SUMMARY

In an aspect of the invention, a computer-implemented method includes: obtaining, by a computing device, one or more primary streams of data; creating, by the computing device, digital mood data that is synchronized with the one or more primary streams of data, wherein the digital mood data is configured for use by a wearable mood device; and storing, by the computing device, the digital mood data in a multimedia container with the one or more primary streams of data.

In another aspect of the invention, there is a computer program product for generating synchronized multimedia streams including mood data. The computer program product comprises a computer readable storage medium having program instructions embodied therewith. The program instructions are executable by a computing device to cause the computing device to: obtain one or more primary streams of data; and generate mood data that is synchronized with the one or more primary streams of data, the mood data comprising: a mood stream identifier; a mood type; a mood intensity; a duration of a mood; and a timestamp for synchronizing the mood data with the one or more primary streams of data, wherein the mood data is configured to be utilized by a mood device to provide stimulation to a user.

In another aspect of the invention, there is a system for generating synchronized multimedia streams including mood data. The system includes a CPU, a computer readable memory and a computer readable storage medium associated with a computing device. The system also includes: program instructions to obtain an encoded stream of video data; program instructions to obtain an encoded stream of audio data; program instructions to create an encoded stream of digital mood data synchronized with the encoded stream of video data and the encoded stream of audio data using timestamps, wherein the digital mood data is configured for use by a mood device to provide stimulation to a user; program instructions to store the encoded stream of video data, the encoded stream of audio data, and the encoded stream of digital mood data in a multimedia container; and program instructions to store the multimedia container in a database accessible to one or more remote user computer devices, wherein the program instructions are stored on the computer readable storage medium for execution by the CPU via the computer readable memory.

DETAILED DESCRIPTION

The present invention relates generally to multi-media streams including mood data and, more particularly, to systems and methods for generating and utilizing mood data in conjunction with synchronized multi-media data streams. In embodiments, one or more mood streams are encoded/decoded using a mood codec and are stored in a multimedia container. The term multimedia container as used herein refers to a metafile format whose specification describes how different elements of data and metadata coexist in a computer file. Multimedia containers of the present invention may include multiple audio and video streams, one or more mood streams, meta-data, and synchronization information needed for playback of the various data streams together, along with any other data typical of multimedia containers (e.g., subtitles and chapter-information). Multimedia containers of the invention may include or be accompanied by codec for decoding data streams of the multimedia container. Furthermore, in embodiments, multiple mood tracks are stored in a multimedia container either individually or as a composite mood stream. In embodiments, each mood track corresponds to moods associated with a different character in a movie or show, or a mood related to the atmosphere of the current scene. Thus, embodiments of the invention enable users to choose which mood track to experience while viewing a movie, based on a character or scene in the movie. In aspects, a wearable device conveys mood information to a user based on a mood stream in a multimedia container.

Referring now toFIG. 1, a schematic of an example of a computing infrastructure is shown. Computing infrastructure10is only one example of a suitable computing infrastructure and is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the invention described herein. Regardless, computing infrastructure10is capable of being implemented and/or performing any of the functionality set forth hereinabove.

FIG. 2shows an exemplary system50in accordance with aspects of the invention. The system50includes a network55connected to a data synchronization server60. The data synchronization server60may comprise a computer system12ofFIG. 1, and may be connected to the network55via the network adapter20ofFIG. 1. The data synchronization server60may be configured as a special purpose computing device that is part of a multimedia content provider.

The network55may be any suitable communication network or combination of networks, such as a local area network (LAN), a general wide area network (WAN), and/or a public network (e.g., the Internet).

In aspects, the data synchronization server60includes one or more program modules (e.g., program module42ofFIG. 1) executed by the data synchronization server60. In embodiments, the data synchronization server60includes a data synchronization module62for synchronizing streams of mood data (e.g., neurostimulation data) with one or more primary streams of data (e.g., primary streams of data63), and storing the steams of mood data with the primary streams of data in a multimedia container (e.g., processed multimedia container64). In aspects, one or more processed multimedia containers64are stored in a database66of the data synchronization server60. In embodiments, the processed multimedia container64may contain multiple mood tracks, illustrated herein as mood track A and mood track B. Mood tracks may be in the form of separate mood data streams or a single consolidated mood data stream. In embodiments, mood track A comprises a first stream of mood data and mood track B comprises a second stream of mood data, wherein mood track A is different from mood track B. For example, the mood track A may comprise mood data associated with the changing emotions of a first character in a movie, while the mood track B may comprise mood data associated with the changing emotions of a second character in the movie.

The data synchronization server60may also include a codec module68for encoding and/or decoding the one or more primary streams of data63and/or one or more streams of mood data handled by the data synchronization module62. The data synchronization module62and the codec module68may utilize existing multimedia container packaging technology, such as technology currently utilized in the packaging of data streams for digital movies.

In embodiments, the data synchronization module62obtains one or more primary streams of data63from a data provider server70via the network55. In one example, data provider server70is a server managed by a content provider that provides the data synchronization server60with pre-packaged multimedia containers including synchronized video and audio data (e.g., movie containers) through the network55, which may then be further processed by the data synchronization server60to incorporate one or more streams of mood data to produce a processed multimedia container64of the invention.

In embodiments, the data provider server70includes a data synchronization module72for synchronizing and packaging one or more primary data streams (e.g., primary streams of data63) in a multimedia container, which may then be provided to the data synchronization server60. In aspects, the data provider server70may utilize a codec module78for encoding and/or decoding components of the one or more primary streams of data63(e.g., video data stream and audio data stream). The data synchronization module72and the codec module78may utilize existing multimedia container packaging technology, such as technology currently utilized in the packaging of data streams for digital movies.

The network55may connect the data synchronization server60with more or more user computer devices80(hereafter referred to as the user computer device80). The user computer device80may comprise components of the computer system12, and may be a desktop computer, laptop computer, tablet computer, smartphone, smart television, etc. In embodiments, the user computer device80is in communication, either directly or indirectly (wirelessly), with one or more wearable mood devices82(hereafter referred to as the mood device82). The term mood device as used herein refers to any wearable computer device configured to provide a user with stimulus associated with physiological mood changes (e.g., changes in anxiety, stress, happiness, sadness, calmness, relaxation, or the like) in humans. By way of example, a mood device82of the present invention may be in the form of a portable transdermal electrical stimulation (TES) applicator, such as a Thync Relax Pro™ from Thync, Inc, which provides electrical stimulation (neurostimulation) to effect a user's cognitive state. The present invention is not intended to be limited to particular mood changing techniques described herein, and other stimulus or combinations of stimulus determined to effect mood changes in humans may be utilized in conjunction with embodiments of the invention, such as light stimulus.

In aspects, the user computer device80is configured to receive a processed multimedia container64from the data synchronization server60or from the data provider70. In embodiments, the user computer device80and the mood device82may each include one or more program modules (e.g., program module42ofFIG. 1) executed by a respective user computer device80or mood device82to perform functions of the invention. In aspects, the user computer device80includes a data synchronization module84for processing data contained in a processed multimedia container64. In aspects, the data synchronization module84can be utilized in conjunction with a codec module86configured to encode and/or decode streams of data contained within the processed multimedia container64. The data synchronization module84and codec module86may be in the form of a television processor that receives the processed multimedia container64and is configured to extract and decode one or more primary streams of data63(e.g., video and audio data streams) and one or more streams of mood data therefrom. In aspects, the data synchronization module84works with hardware and software of the user computer device80(e.g., a smart television), such that the user computer device80is configured to present synchronized video and audio data to a user while providing one or more streams of mood data to the mood device82. With this configuration, when a video stream is watched by a user through the user computer device80while wearing the mood device82, the user receives mood information (stimulus) that matches the scene or character they are observing in the video stream.

In some embodiments of the present invention, a mood device module88of the user computer device80is configured to send one or more streams of mood data to the mood device82, and the mood device82provides stimulus to a user based on the one or more streams of mood data. In alternative embodiments, the mood device82directly receives mood data (e.g., the processed multimedia container64) from the data synchronization server60and utilizes its own data synchronization module90and codec module92(if necessary) to process the mood data.

FIG. 3shows a flowchart of a method in accordance with aspects of the invention. Steps of the method ofFIG. 3may be performed by components of the system50illustrated inFIG. 2, and are described with reference to elements shown inFIG. 2.

At step300the data synchronization server60obtains one or more primary streams of data63. The term primary stream of data as used herein refers to a stream of data utilized in conjunction with mood data to enhance a user's experience of an event (e.g., digital event), such as a movie or a piece of music. In one example, the one or more primary streams of data63comprise data streams associated with a digital video, such as a movie or television show. Such data streams may include video, audio, closed-caption, and other types of data typically associated with a movie or television show. In embodiments, the one or more primary streams of data63are in the form of a prepackaged multimedia container. For example, a movie production or post-production company (e.g., represented by data provider server70) may package streams of movie data including audio and video data streams in a multimedia container and may send or make available the prepackaged multimedia container to the data synchronization server60for further processing. Alternatively, raw or individual data streams may be provided to the data synchronization server60(e.g., from data provider server70) for processing and packaging in accordance with embodiments of the invention.

At step301the data synchronization server60decodes the one or more primary streams of data63received at step300, if necessary. In embodiments, the codec module68of the data synchronization server60performs step301. For example, if the one or more primary streams of data63received at step300are in the form of encoded data, the codec module68of the data synchronization server60may be utilized to decode the data to enable further processing in accordance with the present invention. In alternative embodiments, no decoding of the one or more primary streams of data63is necessary, in which case step301is not performed.

At step302, the data synchronization server60generates or creates mood data (digital mood data) synchronized with the one or more primary streams of data63received at step301. Mood data may be generated as a data stream. In aspects, the mood data comprises one or more of: a mood stream identifier, mood type(s), intensity (e.g., intensity of stimulus utilized to generate associated mood) duration (e.g., duration of stimulus), and timestamps for linking/synchronizing the mood data with the one or more primary data streams63received at step300. In embodiments, the mood data is encoded by the codec module68using a mood codec. In accordance with embodiments of the invention, a technician may utilize the data synchronization server60to generate a stream of mood data associated with the perceived changing moods or feelings of a character in a movie. This may comprise a technician tagging a video stream at various segments of the video stream to indicating changing moods or feelings of the character, and generating a stream of mood data associated with those changing moods or feelings. The data synchronization server60may utilize existing digital data processing methods similar to generating a subtitle data stream to generate mood data in accordance with embodiments of the invention. In aspects, the data synchronization server60may generate the mood data in the form of a multimedia container (e.g., the processed multimedia container64) including the associated one or more primary streams of data63.

At step303, the data synchronization server60stores the mood data in a database. In embodiments, the mood data generated at step302is saved in the form of a multimedia container (e.g., processed multimedia container64), along with the associated one or more primary streams of data63received at step300. A codec for decoding the mood data may be associated with the stored mood data (e.g., processed multimedia container64) to enable a device (e.g., user computer device80or the mood device82) to decode and utilize the mood data.

Optionally, at step304, the data synchronization server60may provide a list of selectable mood data options to one or more users through the network55. For example, the data synchronization server60may make a list of movies available to the user computer device80, and enable a user to select one of the movies from the list of movies for download or streaming to the user computer device80and/or mood device82. In embodiments, selectable options provided to the user include options to select one of a plurality of different mood data streams associated with one or more primary streams of data63. In one example, the selectable options enable a user to select between a mood track A associated with a first character in a movie, and a mood track B associated with a second character in the movie. In this way, a user may select the character whose mood and/or feelings the user wishes to experience while watching the movie.

At step305, the data synchronization server60receives a request for mood data. In embodiments, the data synchronization server60receives a request from the user computer device80or from the mood device82. In aspects, the request constitutes a selection of a processed multimedia container (e.g., digital movie container) including mood data, or a stand-alone mood data stream. In embodiments, the selection constitutes one of a plurality of mood streams (e.g., mood track A, mood track B) associated with a particular primary stream(s) of data63.

At step306, the data synchronization server60sends the mood data generated at step302to a user based on the request received at step305. By way of example, the data synchronization server60may send a processed multimedia container64to the user computer device80or directly to the mood device82. In an alternative example, the data synchronization server60may send a stand-alone mood data stream to the user computer device80or the mood device82. In aspects, encoded mood data is sent to a user device with an accompanying mood codec to enable the device to decode and utilize the encoded mood data. The manner in which mood data is utilized by the user computer device80and/or the mood device82is described in detail below with respect toFIG. 7.

FIG. 4is a flow diagram depicting the packaging of data in accordance with embodiments of the invention. In embodiments, step302ofFIG. 3comprises the steps of packaging encoded video data400, encoded audio data401and encoded mood data402into a processed multimedia container64of the present invention. In aspects, encoded video data400received at step300ofFIG. 3is received at a video data interface403of the data synchronization server60; encoded audio data401received at step300is received at audio data interface404of the data synchronization server60; and encoded mood data402generated by the data synchronization server60is received at a mood data interface405. The data synchronization module62packages the encoded video data400, audio data401and mood data402and outputs the data in a processed multimedia container64. The processed multimedia container64may be stored in the database66and/or may be output to the user computer device80or mood device82through an output interface406of the data synchronization server60.

FIG. 5illustrates an example of mood stream data generated using JavaScript Object Notation (JSON) formatting in accordance with the method ofFIG. 3. In the example ofFIG. 5, the “startTick” and “stopTick” represent how long (in milliseconds) to transmit the mood information relative to a start of one or more primary streams of data63(e.g., the start of synchronized video and audio streams of the movie). The “moodType” is defined as a string and can include an intensity (“intensity”). By way of example, a mood type of “RELAXED” having an intensity of 10 on a scale of 1-10 is associated with parts of a video between “startTick” 0 and “stopTick” 10000. Similarly, a mood type (“moodType”) of “SCARY” having an intensity of 4 on a scale of 1-10 is associated with parts of a video between “startTick” 50000 and “stopTick” 65000.

FIG. 6illustrates an example of multiple mood data streams generated using JSON formatting in accordance with the method ofFIG. 3. In the example ofFIG. 6, the “timeCode” represent “hours:minutes:seconds:milliseconds” from the beginning of a movie (e.g., the start of synchronized video and audio streams of the movie) and the “duration” represents how long a particular mood type (e.g., “RELAXED”) lasts from that starting point of the “timeCode”. The “identifiers” allow more than one mood stream to be encoded into a processed multimedia container64, and are referenced in the entries. In the example ofFIG. 6, the entries are written in “timeCode” order, so they can be interlaced with the one or more primary streams of data63(e.g., audio/video streams) in such a way that any primary stream segment (e.g., audio/video stream segment) has the corresponding segment of mood data. By way of example, a mood type of “RELAXED” having an intensity of 10 on a scale of 1-10 is associated with the character “alice” in parts of a video starting at “‘timeCode’: ‘00:02:17.440’” for a duration of “00:00:15.000”. Similarly, a mood type of “ENERGIZED” having an intensity of 4 on a scale of 1-10 is associated with the character “bob” in parts of the video starting at “‘timeCode’: ‘00:02:20.500’” for a duration of “00:00:20.000”. As mood enhancing technology becomes more sophisticated, multiple mood types could potentially be listed within a single entry, with an intensity value for each.

FIG. 7shows a flowchart of a method in accordance with aspects of the invention. Steps of the method ofFIG. 7may be performed by components of the system50illustrated inFIG. 2, and are described with reference to elements shown inFIG. 2.

At step700, a user selects mood data from one or more available mood data options. In embodiments, the user utilizes a user interface of the user computer device80to communicate via the network55with the data synchronization server60to view mood data that is available to the user computer device80through the data synchronization server60. For example, the user may choose from a selection of movies that are available and that include associated mood data.

At step701, the user computer device80receives the mood data requested at step700. In embodiments, the mood data is received from the data synchronization server60via the network55. In alternative embodiments, the mood data is received from another remote source (e.g., data provider server70) who obtained the mood data from the data synchronization server60. In embodiments, the mood data is provided in the processed multimedia container64and is accompanied by mood codec for decoding the mood data therein.

At step702, the data synchronization module84of the user computer device80processes the mood data received at step701. In embodiments, the data synchronization module84receives a stand-alone mood data stream and utilizes the data synchronization module84to link or synchronize the mood data stream to associated one or more primary streams of data63(e.g., video and audio data of a movie). By way of example, the user computer device80may receive a multimedia container for a movie from the data provider server70, and the mood data stream received from the data synchronization server60at step701may be processed such that it is ready for synchronized use with the playing of the movie. In such embodiments, the data synchronization module84is configured to process the mood data stream in conjunction with the one or more primary data streams of data63of the movie. In embodiments, processing the mood data in step701comprises decoding the mood data using the codec module86. In embodiments, the data synchronization module84decodes multiple mood data streams. In one example, the data synchronization module84decodes a first mood track A and a second mood track B, wherein each of the mood tracks is associated with a different series or arrangement of mood types.

Optionally, at step703, the user computer device80sends the mood data of step701to one or more mood devices82. In aspects, the mood device module88of the user computer device80sends processed mood data (e.g., decoded mood data) to the mood device82. In alternative embodiments, the user computer device80sends unprocessed or encoded mood data to the mood device82for further processing (e.g., decoding by the codec module92). In embodiments, the user computer device80streams the mood data to the mood device82as the one or more primary streams of data63associated therewith are presented to the user, such as through a display and/or speakers of the user computer device80. Mood data may be sent from the user computer device80or from another source to the mood device82through the network55, wirelessly, or through a direct connection. In embodiments, the user computer device80sends a first stream of processed mood data to a first mood device, and a second stream of processed mood data to a second mood device.

At step704, the user computer device80utilizes the one or more primary streams of data63to present information to a user, while at least one mood device82utilizes the processed mood data to stimulate the user. In embodiments, the user computer device80includes a display for presenting the information from the one or more primary streams of data63to a user at the same time the mood device82stimulates the user based on the mood data linked to the one or more primary streams of data63. For example, the one or more primary streams of data63may be in the form of a movie which is viewed by a user on the user computer device80while a mood device82utilizes the associated mood data to provide stimulation to the user to induce one or more predetermine mood types in the user. In embodiments, while the user computer device80plays a movie, mood data synchronized with the playing of the movie is streamed from the user computer device80to the mood device82to be experienced by a viewer of the movie. In aspects, the user computer device utilizes one or more primary data streams63to present information (e.g., a movie, including audio and visual information) to multiple users, while the multiple users simultaneously experience stimulation based on the processed mood data associated with the one or more primary data streams63.

FIG. 8shows an exemplary use scenario in accordance with aspects of the invention. In the scenario ofFIG. 8, multiple users (User A and User B) are utilizing aspects of the system50to watch a movie on a display of the user computer device80with mood enhancements provided by respective mood devices82A and82B. In accordance with step700ofFIG. 7, Users A and B utilizes the user computer device80to access a plurality of mood data options800available through the data synchronization server60. In the example shown, a movie entitled ADVENTURE MOVIE includes mood data options for two characters of the movie, Character A and Character B. Mood data for Character A is associated with moods that enhance a viewer's experience from the perspective of Character A, while mood data for Character B is associated with moods that enhance a viewer's experience from the perspective of Character B. For example, a scene in ADVENTURE MOVIE may include Character A in a relaxed mood and Character B in an excited mood. In this example, User A selects mood data for Character A, while User B selects mood data for Character B in accordance with step700ofFIG. 7. In response to the users' request, the data synchronization server60sends the selected mood data to the user computer device80via the network55for processing. In accordance with step701ofFIG. 7, the user computer device80receives the mood data in the form of a processed multimedia container64including the one or more primary streams of data63associated with the movie (i.e., audio data, video data, etc.). The data synchronization module84of the user computer device80processes the received data in accordance with step702ofFIG. 7. More specifically, the data synchronization module84utilizes a codec module86(depicted inFIG. 2) to decode encoded audio, video and mood data in the processed multimedia container64, and enables the user computer device80to present the one or more primary streams of data63to a user in accordance with standard video display methods. In accordance with step703ofFIG. 7, the user computer device80utilizes the mood device module88to stream mood data for Character A to the mood device82A of User A, and to stream mood data for Character B to the mood device82B of User B. In accordance with step704ofFIG. 7, the user computer device80utilizes the one or more primary streams of data63to present ADVENTURE MOVIE to the users, while simultaneously streaming the mood data for Characters A and B to respective mood devices82A and82B for processing.

In an alternative example, in response to the users' request for mood data in accordance with step305ofFIG. 3, the data synchronization server60sends the selected mood data to respective mood devices82A and82B via the network55for processing. In accordance with step701ofFIG. 7, the mood devices82A and82B receive the mood data associated with the movie, while the user computer device80receives the one or more primary streams of data63associated with the movie (i.e., audio data, video data, etc.). The data synchronization module90of each of the respective mood devices82A and82B process the received mood data in accordance with step702ofFIG. 7. More specifically, each data synchronization module90utilizes a codec module92(depicted inFIG. 2) to decode encoded mood data. In accordance with step704ofFIG. 7, the mood device82A utilizes mood data for Character A, and the mood device82B utilizes the mood data for Character B while the user computer device80utilizes the one or more primary streams of data63to present ADVENTURE MOVIE to the users.

In the scenario ofFIG. 8, the mood devices82A and82B utilize available neurostimulator technology and are configured to provide users with transdermal electrical stimulation (TES) of different types and intensities to stimulate moods or feelings in a user that are associated with corresponding moods or feelings (e.g., moodType) identified in the mood data. In embodiments, the data synchronization module90of each mood device82A and82B is configured to process the received mood data and determine the type, frequency and intensity of electrostimulation associated with the mood data. For example, a first class of cognitive effects induced by each of the mood devices82A and82B may include increased objective (i.e., physiological) energy levels, which the mood devices82A and82B may associated with the mood type “ENERGIZED” in the mood data. See, for example, the “‘moodType’: ‘ENERGIZED’” depicted in the mood data ofFIG. 6. A second class of cognitive effects induced by each of the mood devices82A and82B may include reduced physiological arousal, which the mood devices82A and82B may associated with the mood type “RELAXED” in the mood data. See, for example, the “‘moodType’: ‘RELAXED’” depicted in the mood data ofFIG. 6.

Accordingly, in one example, the mood device82A provides User A with electrostimulation to induce feelings of increased energy levels based on mood data associated with the Character A experiencing excitement in the ADVENTURE MOVIE, while simultaneously, the mood device82B provides User B with electrostimulation to induce feelings of decreased physiological arousal based on mood data associated with the Character B being in a state of relaxation in the ADVENTURE MOVIE. Thus, Users A and B have disparate enhanced movie watching experiences through the synchronization of movie data and mood data by the system50.

Advantageously, embodiments of the present invention add a novel dimension to a viewer's movie-watching experience by enhancing or changing the viewer's moods or feelings about different scenes or characters, thereby providing more realism and intensity to their movie-watching experience. For example, the system50may provide improved impact of action scenes or emotional scenes in a movie by influencing the audiences emotional state. However, it should be understood that embodiments of the present invention may be utilized in conjunction with different user experiences. For example, embodiments of the present invention can be utilized to enhance music. Music has been known to have strong ties to emotional feelings in people. Mood data or mood codec may be added to a music data track or stream, such that a listener may utilize methods of the present invention to enhanced their experience of the music. Similarly, art galleries desiring to invoke emotional responses to art work may utilize aspects of the present invention to synchronize mood data with data associated with works of art (light data, sound data, video data, etc.). In another example, the present invention could be utilized in conjunction with a real-time live user experience, such as a roller-coaster or other theme park ride.

In still another embodiment, the invention provides a computer-implemented method for generating synchronized multimedia streams including mood data. In this case, a computer infrastructure, such as computer system12(FIG. 1), can be provided and one or more systems for performing the processes of the invention can be obtained (e.g., created, purchased, used, modified, etc.) and deployed to the computer infrastructure. To this extent, the deployment of a system can comprise one or more of: (1) installing program code on a computing device, such as computing system12(as shown inFIG. 1), from a computer-readable medium; (2) adding one or more computing devices to the computer infrastructure; and (3) incorporating and/or modifying one or more existing systems of the computer infrastructure to enable the computer infrastructure to perform the processes of the invention.