# Patent

## Title
Apparatus, systems and methods for accessing and synchronizing presentation of media content and supplemental media rich content

## Abstract

Media rich content server systems and methods are operable to provide access to supplemental media rich content at a portable media device. An exemplary embodiment communicatively couples a portable media device to a media device that initially receives a media content stream comprising at least one supplemental media rich content trigger, wherein the supplemental media rich content trigger includes access information configured to access at least one media rich content server; receives a portion of the media content stream with the supplemental media rich content trigger at the portable media device; establishes a communication link between the portable media device and the media rich content server based upon the access information in the received supplemental media rich content trigger; receives supplemental media rich content from the media rich content server; and presents at least the received supplemental media rich content on a display of the portable media device.

## Background
CROSS REFERENCE TO RELATED APPLICATIONS
This application claims the benefit of and priority to U.S. utility application entitled, “Apparatus, System And Methods For Accessing And Synchronizing Presentation Of Media Content And Supplemental Media Rich Content,” having application Ser. No. 61/359,742, filed Jun. 29, 2010, and which is entirely incorporated herein by reference.


BACKGROUND
Media devices, such as a set top box, are configured to receive media content. The received media content may be presented on a media presentation device, such as a television, computer system, game system, or the like. The media content, such as a television program, a broadcast sports event, a movie or the like, is received in the form of a video stream and a synchronized audio stream. Once received and processed, the video stream is presented on a display and the associated audio stream is output from one or more speakers in a synchronized fashion.
A content access device may be employed to communicate the received media content over another system to a user's portable media device. Exemplary portable media devices include, but are not limited to, laptop computers, personal device assistants, cellular-based devices, Internet-based and/or Wi-Fi type devices. The user remotely accesses the media content received by the media device by establishing a link to the content access device. For example, the user may establish the communication link by interconnecting their portable media device to the Internet, Wi-Fi, and/or cellular system. After connectivity is established to the content access device, the media content may be communicated from the content access device to the portable media device. Accordingly, the user is able to remotely access a program, a movie, or the like, using their portable media device.
In some situations, supplemental media rich content pertaining to the presented media content may be available from other locations. This supplemental media rich content is not included in the media content communicated from the content access device to the portable media device.
Accordingly, there is a need in the arts to access and synchronize presentation of the supplemental media rich content with the remotely accessed media content.
SUMMARY
Systems and methods of accessing supplemental media rich content at a portable media device are disclosed. An exemplary embodiment communicatively couples a portable media device to a media device that initially receives a media content stream comprising at least one supplemental media rich content trigger, wherein the supplemental media rich content trigger includes access information configured to access at least one media rich content server; receives a portion of the media content stream with the supplemental media rich content trigger at the portable media device; establishes a communication link between the portable media device and the media rich content server based upon the access information in the received supplemental media rich content trigger; receives supplemental media rich content from the media rich content server; and presents at least the received supplemental media rich content on a display of the portable media device.



BRIEF DESCRIPTION OF THE DRAWINGS
Preferred and alternative embodiments are described in detail below with reference to the following drawings:
FIG. 1 is a block diagram of an embodiment of a media access system;
FIG. 2 conceptually illustrates a media content stream;
FIG. 3 is a block diagram of an alternative embodiment of the media access system; and
FIG. 4 is a block diagram of an embodiment of the media access system that employs a plurality of remotely located media rich content servers.



DETAILED DESCRIPTION
FIG. 1 is a block diagram of an embodiment of a media rich content access system 100. Embodiments of the media rich content access system 100 comprise a media device 102, a content access device 104, a media rich content synchronizer 106, and an optional media rich content server 108. Embodiments of the media rich content access system 100 are configured to access supplemental media rich content pertaining to the program of interest that is available from a remote source and that is not included in the media content stream received from the content access device 104. Access to and presentation of the supplemental media rich content is synchronized with presentation of the media content stream. Media rich content is content that pertains to the media content, but is not included as part of the received media content.
In an exemplary embodiment, the media rich content server 108 functions as a repository of supplemental media rich content pertaining to a program of interest. In exemplary embodiments, the media rich content server 108 may store supplemental media rich content for a plurality of different programs of interest. As the selected program of interest is presented to the user on their portable media device 118, embodiments of the media rich content access system 100 are configured to access and present the supplemental media rich content on the portable media device 118 based upon a supplemental media rich content trigger. The supplemental media rich content trigger includes access information that indicates a process for the portable media device 118 to access the media rich content server 108.
Examples of the media device 102 include, but are not limited to, a set top box (STB) or the like, that is configured to receive media content from a media content provider 110. The media device 102 may be located at a customer premises 112, such as their residence, office, or other suitable location. The media device 102 is typically connected to one or more media presentation devices 114. Non-limiting examples of the media presentation devices 114 include televisions (TVs), stereos, surround-sound receivers, radios, digital video disc (DVD) players, digital video recorders (DVRs), game playing devices, or personal computers (PCs). The media presentation device 114 may include a visual display device 116, such as a television (hereafter, generically a TV). Other types of output devices may also be coupled to the media device, such as an audio presentation device and/or those providing any sort of stimuli sensible by a human being, such as temperature, vibration and the like. For example, the media presentation device 114 is illustrated as presenting the video portion of a football game on the display 116.
At times, the user may wish to access the media content received at their media device 102 when they are remote from the customer premises 112. The user operates their portable media device 118 to establish a link to the content access device 104, via the network 120. Exemplary portable media devices 118 include, but are not limited to, laptop computers, personal device assistants (PDAs), netbooks, cellular-based devices, Internet accessible devices, and/or Wi-Fi accessible devices. In an alternative embodiment, the media device 102 and the content access device 104 may be integrated together.
The content access device 104 is controllably connected to the media device 102 and is configured to cause the media device 102, in an exemplary embodiment, to access a particular program of interest in accordance with a specification from the user. In an exemplary embodiment, the user may communicate instructions from their portable media device 118 to the content access device 104 to specify the channel that is providing the program of interest, to specify the station call sign of the source station that is broadcasting the program of interest, and/or to specify another suitable identifier of the program of interest. In some embodiments, the user may specify the program of interest by navigating about an electronic program guide (EPG) that is presented on their portable media device 118. The content access device 104 receives the specified program of interest from the media device 102, and transmits the program of interest to the user's portable media device 118, illustrated in FIG. 1 as a laptop computer.
The content access device 104, in some embodiments, may be configured to reformat or process the program of interest into a format that is compatible with the data requirements of the portable media device 118 and/or that is compatible with a data transmission bandwidth of the communication link to the portable media device 118. For example, the program of interest received from the media device 102 may be in a format that is suitable for presentation of a standard definition or high definition TV. In contrast, the portable media device 118 may be a cellular phone or a laptop computer with a relatively smaller display. Alternatively, or additionally, the communication link to the portable media device 118 may not have sufficient bandwidth to transmit the program of interest to the portable media device 118. In such situations, the content access device 104 processes the program of interest into a format that is suited for presentation on a smaller display and/or processes the program of interest in a format that is suited for transmission over the established link between the content access device 104 and the portable media device 118.
Some supplemental information pertaining to the program of interest may be included in the media content stream. For example, a movie producing entity may produce a movie. When the movie is available to the media content provider for distribution to its customers, the movie is processed to include the supplemental information, such as actor names, production location, date of production, or the like.
However, other supplemental media rich content pertaining to the movie may be available from other sources, such as a web site or the like. Such supplemental media rich content is not included in the media content that is communicated from the content access device 104 to the portable media device 118.
In the absence of embodiments of the media rich content access system 100, the user has to access such supplemental media rich content by separately accessing a web site or the like so that the supplemental media rich content is retrieved and then presented on their portable media device 118. For example, an internet site may provide supplemental media rich content pertaining to the currently received program, sporting event or movie. If the user is interested in accessing a web site or the like that provides supplemental media rich content related to the object of interest, or even allows purchase of the object of interest, the user may make a mental note of the object of interest so that they may later find a suitable website pertaining to the object of interest. In some situations, the user might even write themselves a descriptive note or the like so as to improve their recall of the object of interest when they later go to find and access the website.
As another example, a sports broadcasting entity may be broadcasting a football game that is communicated to the user's media device 102 and/or portable media device 118. The user may wish to view the presentation of the football game while at a remote location. The user operates their portable media device 118 to establish a link to the content access device 104 and requests presentation of the football game. The football game is communicated from the media device 102 to the content access device 104. The content access device 104 then communicates the football game, over the network 120, to the portable media device 118. The user is then presented a video image 122 of the football game on the display 124 of the portable media device 118. With respect to the received football game, the supplemental media rich content may comprise team or player statistics pertaining to the received football game. Player, team, and/or game merchandise may also be available from the web site. Thus, the player statistics and or merchandising information are then concurrently presented as graphical content 126 on the display 124. Alternatively, or additionally, the supplemental media rich content may be audio information that is heard by the user
Embodiments of the media rich content access system 100 are configured to cause the portable media device 118 to access the supplemental media rich content by accessing the media rich content server 108. Received media content includes access information that defines a process for the portable media device 118 to access the media rich content server 108. Based on the access information, the portable media device 118 establishes a separate link to the media rich content server 108, and retrieves the team or player statistics from the media rich content server 108. The supplemental media rich content, such as the team or player statistics, is then presented along with the presented football game.
To access the supplemental media rich content, exemplary embodiments of the media rich content access system 100 incorporate trigger information in a supplemental media rich content trigger that is included in the media content stream. The supplemental media rich content trigger may be embedded in the video stream, the audio stream, and/or a metadata stream of the program of interest. Alternatively, or additionally, the trigger information may be separately communicated to the portable media device 118.
In an exemplary embodiment, presentation of the graphical content 126 is synchronized with presentation of the program of interest. The supplemental media rich content trigger information includes synchronizing information that synchronizes the presentation of the program of interest and the presentation of the graphical content 126 on the portable media device 118. In an exemplary embodiment, the synchronizing information identifies, or is associated with, one or more frames of the video content of the program of interest. As the associated frame of video information is processed for presentation on the portable media device 118, the trigger information in the supplemental media rich content trigger is concurrently processed to cause the portable media device 118 to access and synchronously present the supplemental media rich content.
In an exemplary embodiment, presentation of the supplemental media rich content received from the media rich content server 108 is closely synchronized with presentation of the program of interest. For example, but not limited to, the program of interest may be presenting a live football game. The length of a completed pass play to the player (the supplemental media rich content) may be presented as text in the graphical content 126. The graphical content 126 may then be presented in real time, or near-real time, after the play is completed. Alternatively, or additionally, different views (the supplemental media rich content) of the playing field may be presented as the graphical content 126.
Alternatively, presentation of the graphical content 126 with the supplemental media rich content may be relatively loosely synchronized with presentation of the program of interest. That is, the temporal relationship between the presentation of the program of interest and the presentation of the graphical content 126 may be different. For example, but not limited to, the graphical content 126 may present replays of the most recent play, or a selected previous play, of the football game.
As another example of loosely synchronized presentation of the graphical content 126 with the supplemental media rich content, the program of interest may be a news story program that has a relatively long segment pertaining to a particular topic. The graphical content 126 may be presented at any convenient time during the segment of the news program. The duration of the presented graphical content 126 may be less, or may even be longer, than the duration of the news program segment. Thus, the presentation of the graphical content 126 may span across multiple topic segments of the news story program.
Alternatively, or additionally, the graphical content 126 may present supplemental media rich content that does not pertain to the program of interest. For example, but not limited to, the supplemental media rich content may pertain to a story or a topic that is different from the subject matter of the currently presented program of interest. For example, but not limited to, the graphical content 126 may be an advertisement or an indication of program content that will be available at some future time.
The graphical content 126 with the supplemental media rich content may be presented on the portable media device 118 using any desirable presentation format. The presentation format may depend upon the nature of the program of interest, may depend upon the nature of the supplemental media rich content, may depend upon the context of the supplemental media rich content relative to the program of interest, and/or may depend upon characteristics of the particular portable media device 118. The program of interest and the graphical content 126 with the supplemental media rich content may be presented in any suitable manner that enhances the viewing and/or listening experience of the user.
For example, the program of interest and the graphical content 126 may be presented in a side-by-side format as illustrated in FIG. 1. Alternatively, the graphical content 126 may be overlaid on top of, or over a portion of, the presented program of interest. The graphical content 126 may be presented using a watermark format wherein the supplemental media rich content is presented using some degree of transparency over the presented program of interest.
Alternatively, or additionally, embodiments may permit the user to selectively toggle between the presented program of interest and the presented graphical content 126 with the supplemental media rich content. For example, when the display 124 of the portable media device 118 is relatively small, such as on a cellular phone, PDA, or the like, there may not be sufficient area on the display 124 to show both the program of interest and the graphical content 126 with sufficient resolution and/or size. Accordingly, the graphical content 126 is presented separately from the program of interest.
Alternatively, or additionally, the graphical content 126 may be separately presented for some predefined duration and/or may be configured to await a response from the user. After expiration of the predefined duration and/or selection by the user, presentation of the graphical content 126 ends.
Alternatively, or additionally, when the graphical content 126 is separately presented, some embodiments may be configured to pause the presentation of the program of interest. Presentation of the program of interest may then be resumed after presentation of the graphical content 126 ends. Alternatively, presentation of the program of interest may resume at its real time.
Yet another presentation format may present the graphical content 126 with the supplemental media rich content in a banner form that presents text and or images. The graphical content 126 with the supplemental media rich content may even be presented as information that scrolls across the banner.
In some applications, the graphical content 126 with the supplemental media rich content may be interactive with the user. In an exemplary embodiment, the graphical content 126 may present a choice to the user that is intended to be responded to by the user. For example, the user may be able to vote on a issue or the like that is related to the presented program of interest. Or, the graphical content 126 may be an advertisement that is configured to allow the user to selectively purchase a product. The advertisement may be related to, or may not be related to, the subject matter of the presented program of interest. For example, the advertisement (the supplemental media rich content) may be targeted to the user of the portable media device 118, and may optionally replace other advertisements presented in the program of interest received from the content access device 104.
In an exemplary embodiment, the graphical content 126 with the supplemental media rich content may comprise a pop-up window and/or an interactive graphical icon. The information used to generate and present the pop-up window and/or the graphical icon may be included as part of the trigger information. Alternatively, or additionally, the pop-up window and/or the graphical icon may be provided from the media rich content server 108 after the portable media device 118 has initially accessed the media rich content server 108.
In another exemplary embodiment, the presented graphical content 126 may permit the playing of a game or the like. A special control panel, consol, or the like may be presented around the presented image of the program of interest to provide interactive capability between the user, the game, and the presented program of interest. The user may interact with the graphical content 126 with the supplemental media rich content by inputting commands and/or instructions using their portable media device 118. In some interactive game applications, the user may toggle or switch between game playing enabled by the graphical content 126 and the presentation of the program of interest.
In an exemplary embodiment, the graphical content 126 with the supplemental media rich content may include links to other sources of supplemental media rich content other than the supplemental media rich content that is available from the media rich content server 108. For example, the graphical content 126 may present a uniform resource locator (URL) or the like that is selectable by the user. Alternatively, or additionally, the graphical content 126 with the supplemental media rich content may be an entirely different program, or enable access to and presentation of an entirely different program. For example, a program that is available from a video on demand (VOD) system or another channel may be selected by the user.
Alternatively, or additionally, the supplemental media rich content may present audio information on the portable media device 118. For example, if the program of interest is a football game, the supplemental media rich content may comprise audio commentary from a commentator that is not otherwise included in the audio channel of the football game.
Some embodiments may be configured to provide the user the choice of being presented the supplemental media rich content on their portable media device 118. For example, the trigger information may cause the portable media device 118 to access the media rich content server 108. If supplemental media rich content is available, a pop-up window and/or a graphical icon may be presented to the user on the display 124 of the portable media device 118 to invite the user to receive the supplemental media rich content and/or to interactively participate in any available interactivity provided by the supplemental media rich content. Upon selection of the pop-up window and/or other graphical icon, the graphical content 126 with the supplemental media rich content is then presented on the portable media device 118. Some embodiments may present an audible alarm or audible notification that indicates to the user that supplemental media rich content is available. Upon hearing the audible alarm or audible notification, the user may then optionally operate the portable media device 118 to access the supplemental media rich content.
An identifier of the portable media device 118 may be received by the media rich content server 108. Accordingly, the format of the graphical content 126 and/or the supplemental media rich content may be tailored for presentation on that particular portable media device 118. The identifying information may be a serial number, a cellular number, a device make and/or model identifier, or another suitable identifier that indicates the type of and/or characteristics of the portable media device 118. For example, the portable media device 118 may be a very simple cellular phone with a small display 124. The media rich content server 108 may then provide the graphical content 126 and/or the supplemental media rich content that is suitable for presentation on that particular display. On the other hand, the portable media device 118 may be an advanced electronic device where the display 124 is touch sensitive and relatively large. The media rich content server 108 may then provide the graphical content 126 and/or the supplemental media rich content in a larger size, and may optionally include interactive features that are configured to be responsive to input from the touch sensitive display 124.
In some embodiments, prior received trigger information may cause the portable media device 118 to establish a connection to the remote location providing the supplemental media rich content. A second trigger may cause the portable media device 118 to then retrieve the supplemental media rich content over the pre-established link. In some embodiments, a later received trigger may end display of the graphical content 126 with the supplemental media rich content, and/or cause a change to different supplemental media rich content.
The user may, at times, be at the customer premises 112 and may be viewing (or listening to) the program of interest on the media presentation device 114. When at the customer premises 112, the user may choose to access the supplemental media rich content using their portable media device 118. For example, the user may be viewing the football game at home on their TV (the media presentation device 114). The user may concurrently access the supplemental media rich content which presents the team and/or player statistics using their portable media device 118, such as their cellular phone or laptop computer. Accordingly, the team or player statistics are presented to the user on the display of the cellular phone device or laptop computer without interfering with presentation of the football game. As another example, the user may temporarily leave the room where the media presentation device 114 is located, such as when they go to the kitchen to get a snack or go to the bathroom. The user may continue viewing the program of interest and the associated supplemental media rich content on their portable media device 118 during such times.
In the exemplary embodiment of FIG. 1, the network 120 is illustrated as a generic communication system. In an exemplary application, the network 120 comprises the Internet. Alternatively, or additionally, the communication network 120 may be a telephony system, a radio frequency (RF) wireless system, a microwave communication system, a fiber optics system, an intranet system, a local access network (LAN) system, a local network, an Ethernet system, a cable system, a radio frequency system, a cellular system, an infrared system, or a hybrid system comprised of multiple types of communication media.
In the various embodiments, the portable media device 118 comprises a suitable modem or other component that is configured to cause the portable media device 118 to connect to the Internet. Alternatively, or additionally, the portable media device 118 may have a wireless transceiver that is configured to provide connectivity to a wireless system, such as a Wi-Fi system or the like. Alternatively, or additionally, the portable media device 118 may include a RF transceiver or the like that provides connectivity to a cellular network.
To facilitate disclosure of an exemplary embodiment of the media rich content access system 100, operation of an exemplary environment that provides media content to the media device 102 is disclosed. A media content provider 110 receives media content from a plurality of local program providers (LPPs) 128 or other content providers.
The media content provider 110 receives the plurality of media content streams MCSa-MCSi from many different LPPs 128 at its programming stream receive system 130. The programming stream receive system 130 processes the received media content streams MCSa-MCSi as necessary to prepare them for transmission to the customers. For example, commercials or the like may be incorporated with a particular one of the media content streams MCSa-MCSi. Further, the media content streams MCSa-MCSi may be associated with identifiers, such as channel number and/or station call signs.
The processed media content streams MCSa-MCSi are communicated from the programming stream receive system 130 to the transport channel generation system 132. In an exemplary satellite-based media system, the transport channel generation system 132 bundles selected ones of the media content streams MCSa-MCSi into one or more transport channels 134. Then, one or more of the transport channels 134 are uplinked to a satellite 136, via a corresponding transmit antenna 138. The respective transport channels 134 are then communicated from the satellite 138 down to a receiver antenna 142 located at the customer premises 112. The received wireless signal 140 with the transport channel(s) 134 therein is then communicated to the media device 102. The receiver antenna 142 and the media device 102 may be configured to receive multiple transport channels from a plurality of satellites 138.
Alternatively, or additionally, media content may be provided to the media device 102 over other systems. For example, but not limited to, the media content system provider 110 may communicate media content over a cable-based system 144. The cable-based system 144 may use a fiber optic cable, a coaxial cable, or the like that couples the media device 102 to the cable-based system 144.
Media content and the trigger information may be communicated to the media device 102 and/or to the portable media device 118 using other media. For example, the media content and the trigger information may be communicated over the Internet.
In another situation, the media content and the trigger information may be provided from a memory medium, such as a digital video disk (DVD) or the like. When the program of interest is retrieved from the memory medium, the trigger information incorporated therein causes the portable media device 118 to access and present the supplemental media rich content.
In some embodiments, the program of interest may be saved into a storage medium or device, such as a digital video recorder (DVR) residing in the media device 102, saved into a hard drive residing in the portable media device 118, or saved into an external memory device that is coupled to the media device 102, the media presentation device 114, and/or the portable media device 118. The associated trigger information may also be saved. When the stored program of interest is accessed by the portable media device 118, then the supplemental media rich content is accessed and presented to the user based upon the stored trigger information.
The graphical content 126 and/or the supplemental media rich content may be created in a variety of manners. In an exemplary embodiment, the graphical content 126 and/or the supplemental media rich content is created by the particular LPP 128 that is originating the program of interest. The graphical content 126 and/or the supplemental media rich content is communicated from the originating LPP 128 to the programming stream receive system 130. In other situations, the graphical content 126 and/or the supplemental media rich content may be communicated from the originating LPP 128 directly to the media rich content synchronizer 106.
In an exemplary embodiment, the media rich content synchronizer 106 generates the supplemental media rich content trigger 214 based upon the access information used to establish the communication link between the portable media device 118 and the content access device 104. The access information may also specify precisely what supplemental media rich content is to be accessed from the content access device 104. Also, information is provided to the media rich content synchronizer 106 that defines where in the media content stream the generated supplemental media rich content trigger 214 is to be added. The media rich content synchronizer 106 then receives the media content and adds the supplemental media rich content trigger 214 into the media content stream at the predefined locations of the media content stream so that when the media content stream is processed by the portable media device 118, the media content and the supplemental media rich content are presented in a synchronized fashion.
In an alternative embodiment, the graphical content 126 and/or the supplemental media rich content may be communicated from the programming stream receive system 130 to the media rich content server 108. The media rich content server 108 may then save the graphical content 126 and/or the supplemental media rich content for later access by the portable media device 118.
Alternatively, or additionally, the graphical content 126 and/or the supplemental media rich content may originate from another source. The graphical content 126 and/or the supplemental media rich content originating from other sources can then be communicated to the media rich content server 108 and/or the media rich content synchronizer 106. The received graphical content 126 and/or the supplemental media rich content may then be saved for later access by the portable media device 118. Further, the trigger information may be generated based on the supplemental media rich content originating from the other source.
FIG. 2 conceptually illustrates a media content stream 202 that communicates, transports, or otherwise carries, the program of interest to the media device 102 and/or the portable media device 118. The media content stream 202 comprises a video stream 204, a corresponding audio stream 206, and a corresponding metadata stream 208.
The video stream 204 is comprised of a plurality of serially sequenced video frames 210. Each video frame 210 has data or information used to render and present a particular image of the program of interest. The video frames 210 are serially presented so as to create a moving picture. For example, the video frame 210a is used to generate the presented image that is associated with the graphical content 120.
The exemplary video frames 210 comprise a header 216, video frame data 218, supplemental media rich content trigger 214, and a footer 220. The header 216 includes information that identifies the start of each video frame 210, and may include information that identifies various characteristics of the video frame 210. The footer 220 includes information that identifies the end of each video frame 210, and may also include information that identifies various characteristics of the video frame 210. The video frame data 218 includes the video data or information that is used to render the image that is presented on the displays 116 and/or 128.
The audio stream 206 may include spoken words, music, and background sounds. The audio stream 206 is sequenced with the video frames 210 such that spoken words, music, and background sounds of the audio stream 206 correspond in time with the moving picture. Some program streams 102 may include a metadata stream 208 which contains other information of interest.
An optional closed captioning stream 212 is also conceptually illustrated as part of the media content stream 202. The closed captioning stream 212 is typically a textual presentation of the words of the audio stream 206 for hearing impaired viewers or for viewers in an area with relatively loud ambient noise levels, such as a bar or the like. The words of the closed captioning stream 212 are sequenced so as to generally correspond to the spoken words of the audio stream 206.
To provide synchronized access to the supplemental media rich content, exemplary embodiments of the media access system 100 incorporate information in a supplemental media rich content trigger 214 that resides somewhere in the media content stream 202, such as, but not limited to, in the video stream 204. When a video frame 210 is processed by the portable media device 118 for presentation, the supplemental media rich content trigger 214 is processed such that the supplemental media rich content is accessed and the graphical content 126 is presented in synchronization with the presented video frame 210.
In the illustrated exemplary embodiment, the supplemental media rich content trigger 214 is embedded or otherwise incorporated into the video frame 210. For example, recent moving picture experts group (MPEG) formats, the material exchange format (MXF), and other packetized video formats, now provide for portions in the video stream 204 that are configured to carry various non-video data. In exemplary embodiments, the supplemental media rich content trigger 214 may reside in or may be otherwise incorporated into any portion of the video frame 210.
In other embodiments, the trigger 214 may be interleaved or otherwise incorporated between video frames 210. For example, the trigger 214 may be added or inserted into the video stream 204 between the video frame 210 associated with the generated trigger and an adjacent video frame 210. Alternatively, the trigger 214 may be embedded or otherwise incorporated into the audio stream 206, the metadata stream 208, and/or the closed captioning stream 212 of the media content stream 202. Alternatively, or additionally, the trigger 214 may be separately communicated to the media device 102 and/or the portable media device 118.
In an exemplary embodiment, each particular video frame 210 that presents a scene with the associated with supplemental media rich content includes the supplemental media rich content trigger 214.
In an exemplary embodiment, the trigger information in at least one of the supplemental media rich content triggers 214 comprises information used to establish the communication link between media rich content server 108 and the content access device 104, and/or establish the communication link between the media rich content server 108 and the portable media device 118. For example, the access information included in the trigger information may comprise a web site address and/or other information to access the particular media rich content server 108 having the supplemental media rich content. When the supplemental media rich content trigger 214 having the information to establish the communication link to the media rich content server 108 is processed, embodiments automatically cause the portable media device 118 to establish the communication link to the media rich content server 108.
In some embodiments, once the communication link is established, subsequent supplemental media rich content triggers 214 do not need to have the information to establish and/or maintain the communication link so long as the communication link remains established when that subsequent supplemental media rich content trigger 214 is processed. In some embodiments, a later processed supplemental media rich content trigger 214 may have information that closes the communication link to the media rich content server 108, and/or that causes a change to different graphical content 120 presenting different supplemental media rich content.
In alternative embodiments, some of the trigger information may be embedded in or otherwise incorporated into selected portions of the audio stream 206, the metadata stream 208, and/or the closed captioning stream 212 of the media content stream 202. For example, but not limited to, the audio stream 206 may include a supplemental media rich content trigger 214 to provide synchronized access to supplemental media rich content that is related to the audio track of the presented media content.
In an exemplary embodiment, the trigger information is generated by the media rich content synchronizer 106. The media rich content synchronizer 106 receives the access information that is used to configure the portable media device 118 to establish the communication link to the media rich content server 108. Also, information is provided that specifies the particular supplemental media rich content that is to be accessed at the media rich content synchronizer 106. This information may be provided from any source(s). Then, the information is used to generate the supplemental media rich content trigger 214. The media rich content synchronizer 106 also receives the media content stream, and adds the generated supplemental media rich content trigger 214 into the media content stream at the locations where the portable media device 118 to intended to access the supplemental media rich content from the media rich content server 108. The media content stream with the supplemental media rich content trigger(s) 214 is then communicated to the media device.
The trigger information may optionally include information that is used to associate the supplemental media rich content with a particular program of interest. For example, the supplemental media rich content may include identifying information that identifies the channel, name, or other identifier of the program of interest. Further, the supplemental media rich content may identify where the supplemental media rich content may be accessed.
FIG. 3 is a block diagram of an alternative embodiment of the media rich content access system 100. In this embodiment, the program of interest is also received by the media rich content server 108. The media rich content server 108 monitors for the trigger information, and then transmits the supplemental media rich content to the portable media device 118. For example, the supplemental media rich content may be an interactive process that requires a relatively fast paced interaction with the user. By monitoring the trigger information at the media rich content server 108, the supplemental media rich content may be more quickly communicated to the portable media device 118.
In some instances, the portable media device 118 may initially establish a link to the media rich content server 108. In other instances, the media rich content server 108 may be configured to locate and establish the communication link with the portable media device 118 if such information is provided by the content access device 104 that is pushing the program of interest to the portable media device 118.
FIG. 4 is a block diagram of an embodiment of the media rich content access system 100 that employs a plurality of remotely located media rich content servers 108. The plurality of media rich content servers 108 may be located at any desired location where access to the network 120 is available. The trigger information includes sufficient information to identify the location of, and to establish a link with, the particular one of the media rich content servers 108 that has the supplemental media rich content associated with the program of interest that is being provided by the content access device 104.
In this exemplary application, the portable media device 118 is a cellular device that is configured to transmit and receive phone calls and/or to provide other media functions. In some instances, the user operates their portable media device 118 to establish a link to the content access device 104. In other instances, the trigger information automatically establishes a link between the portable media device 118 and the media rich content server 108 that is providing the supplemental media rich content associated with the program of interest. Alternatively, the user may manually establish a link to the media rich content server 108 that is providing the supplemental media rich content.
In some situations, the media rich content synchronizer 106 and/or the media rich content server 108 are located remote from the location of the media content provider 110. For example, the media rich content server 108 may be located at the LPP 128 that originates the program of interest. The user then directly accesses the media rich content server 108 located at that particular LPP 128. As another example, the media rich content synchronizer 106 may be located at the LPP 128 that originates the program of interest. The may be generated at the LPP 128 and inserted into or incorporated with the media content stream that is provided to the media content provider 110.
In the various embodiments, the media rich content servers 108 are configured to be concurrently accessible by a plurality of different ones of the content access devices 104 and/or the portable media devices 118. Thus, a single media rich content server 108 may provide the same, or may provide different, supplemental media rich content to a plurality of concurrently connected content access devices 104 and/or the portable media devices 118 based on selected objects of interest.
It should be emphasized that the above-described embodiments of the media rich content access system 100 are merely possible examples of implementations of the invention. Many variations and modifications may be made to the above-described embodiments. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.

## Claims

1. A method, comprising:
communicatively coupling a portable media device to a media device via a network,
wherein the network comprises one of an Internet system, a telephony system, a microwave communication system, a cable system, and a cellular system,
wherein the media device is located at a customer premises,
wherein the portable media device is remote from the customer premises such that the network enables the portable media device to communicatively couple to the media device,
wherein the media device initially receives a media content stream comprising at least one supplemental media rich content trigger from a media content provider, and
wherein the supplemental media rich content trigger includes access information configured to enable the portable media device to access at least one media rich content server via the network;

receiving at the portable media device a portion of the media content stream with the supplemental media rich content trigger at the portable media device from the media device, wherein the portion of the media content stream is communicated to the portable media device over the network;
establishing a communication link over the network between the portable media device and the media rich content server based upon the access information in the received supplemental media rich content trigger;
receiving supplemental media rich content at the portable media device from the media rich content server, wherein the supplemental media rich content is communicated to the portable media device over the network;
pausing presentation of the media content stream on a display of the portable media device and presenting at least the received supplemental media rich content on the display of the portable media device while the presentation of the media content stream is paused;
ending presentation of the supplemental media rich content after a predefined duration;
receiving a user selection corresponding to a request to end presentation of the supplemental media rich content, wherein the user selection is received before the end of the predefined duration;
ending presentation of the supplemental media rich content in response to receiving the user selection; and
resuming presentation of the media content stream after ending presentation of the supplemental media rich content.

2. The method of claim 1, further comprising:
concurrently presenting the received supplemental media rich content and the received media content stream on the display of the portable media device.

3. The method of claim 2, further comprising:
synchronizing presentation of the received supplemental media rich content with presentation of at least one video frame.

4. The method of claim 1, wherein the supplemental media rich content trigger is associated with at least one video frame of the media content stream, and further comprising:
presenting the media content stream on the display of the portable media device until the at least one video frame associated with the supplemental media rich content trigger is received.

5. The method of claim 1, wherein the access information configured to establish the communication link via a first network to the media rich content server is first access information configured to establish a first communication link via the first network to a first media rich content server, and wherein the presented supplemental media rich content comprises second access information configured to establish a second communication link via a second network to a second media rich content server, wherein the second network is different than the first network, and further comprising:
presenting the second access information as an active link on the display of the portable media device;
establishing the second communication link over the second network between the portable media device and the second media rich content server based upon a received user selection of the active link;
receiving second supplemental media rich content from the second media rich content server via the second network; and
presenting at least the received second supplemental media rich content on the display of the portable media device.

6. The method of claim 1, wherein the supplemental media rich content is a first supplemental media rich content, the supplemental media rich content trigger is a first supplemental media rich content trigger with first access information, the communicating link is a first communication link, and further comprising:
receiving a second supplemental media rich content trigger in the media content stream, wherein the second supplemental media rich content trigger includes second access information configured to access a second media rich content server via the network;
establishing a second communication link over the network between the portable media device and the second media rich content server based upon the second access information;
receiving second supplemental media rich content from the second media rich content server via the network; and
presenting the received second supplemental media rich content on the display of the portable media device.

7. The method of claim 6, further comprising:
ending presentation of the first supplemental media rich content; and
closing the first communication link.

8. The method of claim 6, further comprising:
continuing presentation of the first supplemental media rich content on the display of the portable media device.

9. The method of claim 1, wherein the media content stream comprises a first supplemental media rich content trigger and a second supplemental media rich content trigger; wherein the portable media device receives the second supplemental media rich content trigger after receiving the first supplemental media rich content trigger, wherein the first supplemental media rich content trigger includes information to establish the communication link between the portable media device and the media rich content server via the network, and wherein the second supplemental media rich content trigger is configured to access the supplemental media rich content via the network, and further comprising:
establishing the communication link over the network between the portable media device and the media rich content server in response to receiving the first supplemental media rich content trigger;
presenting the media content stream on the display of the portable media device;
maintaining the established communication link over the network during presentation of the media content stream; and
receiving the supplemental media rich content from the media rich content server via the network in response to receiving the second supplemental media rich content trigger.

10. The method of claim 1, wherein the supplemental media rich content is first supplemental media rich content, wherein the media content stream comprises a third supplemental media rich content trigger configured to access second supplemental media rich content, wherein the third supplemental media rich content trigger is received after a second supplemental media rich content trigger, and further comprising:
ending presentation of the first supplemental media rich content;
continuing presentation of the media content stream on the display of the portable media device;
maintaining the established communication link during the continued presentation of the media content stream; and
receiving the second supplemental media rich content from the media rich content server in response to receiving the third supplemental media rich content trigger.

11. The method of claim 10, wherein the media content stream comprises a sequentially presentable first plurality of video frames, second plurality of video frames, and third plurality of video frames, wherein the supplemental media rich content trigger is associated with the second plurality of video frames, and further comprising:
presenting the first plurality of video frames on the display of the portable media device;
presenting at least the supplemental media rich content and the second plurality of video frames on the display of the portable media device; and
presenting the third plurality of video frames on the display of the portable media device,
wherein presentation of the supplemental media rich content ends when presentation of the third plurality of video frames begins.

12. A method, comprising:
establishing a first communication link over a network between a portable media device and a media device,
wherein the network comprises one of an Internet system, a telephony system, a microwave communication system, a cable system, and a cellular system,
wherein the media device is located at a customer premises, and
wherein the portable media device is remote from the customer premises such that the network enables the portable media device to communicatively couple to the media device;

receiving a media content stream at the media device over the established first communication link, wherein the media content stream comprises at least one supplemental media rich content trigger with access information configured to establish a second communication link over the network between at least one media rich content server and the portable media device, and wherein the at least one supplemental media rich content trigger is further configured to cause the portable media device to access supplemental media rich content from the media rich content server via the network;
communicating the media content stream with the supplemental media rich content trigger from the media device to the portable media device via the network, wherein the media content stream is presented on a display of the portable media device;
pausing presentation of the media content stream on the display of the portable media device and presenting at least the received supplemental media rich content on the display of the portable media device while the presentation of the media content stream is paused in response to receiving the supplemental media rich content trigger residing in the media content stream;
ending presentation of the supplemental media rich content after a predefined duration;
receiving a user selection corresponding to a request to end presentation of the supplemental media rich content, wherein the user selection is received before the end of the predefined duration;
ending presentation of the supplemental media rich content in response to receiving the user selection; and
resuming presentation of the media content stream after ending presentation of the supplemental media rich content.

13. The method of claim 12, wherein the media content stream comprises a plurality of video frames, and further comprising:
formatting the plurality of video frames of the media content stream based on at least one characteristic of the portable media device,
wherein the formatted video frames of the media content stream and the supplemental media rich content trigger are communicated to the portable media device over the established first communication link.

14. The method of claim 13, further comprising:
associating at least one selected one of the plurality of formatted video frames with the supplemental media rich content trigger,
wherein the selected at least one formatted video frame and the supplemental media rich content trigger are communicated to the portable media device at substantially the same time over the established first communication link.

15. The method of claim 14, further comprising:
retrieving the supplemental media rich content trigger from the media content stream received by the media device over the established second communication link,
wherein the retrieved supplemental media rich content trigger is associated with selected one of the plurality video frames, and
wherein the selected one of the plurality of video frames of the media content stream corresponds to the at least one formatted video frame.

16. A method, comprising:
receiving a program of interest comprising a plurality of sequentially presentable video frames;
selecting at least one of the video frames from the plurality of video frames;
associating a supplemental media rich content trigger with the selected video frame, wherein the supplemental media rich content trigger includes access information configured to cause a portable media device to establish a first communication link between the portable media device and a media rich content server over a network, and is configured to cause the portable media device to access supplemental media rich content from the media rich content server over the established first communication link,
wherein the network comprises one of an Internet system, a telephony system, a microwave communication system, a cable system, and a cellular system,
wherein a media device is located at a customer premises, and
wherein the portable media device is remote from the customer premises such that the network enables the portable media device to communicatively couple to the media device;

communicating the program of interest and the supplemental media rich content trigger associated with the at least one selected video frame to the media device over a second communication link, wherein the second communication link is different from the first communication link;
communicating the program of interest and the supplemental media rich content trigger associated with the at least one selected video frame from the media device to the portable media device over a third communication link;
presenting the program of interest on the display of the portable media device until the supplemental media rich content trigger is received in the program of interest;
pausing presentation of the program of interest;
presenting the received supplemental media rich content on the display of the portable media device;
ending presentation of the supplemental media rich content after a predefined duration;
receiving a user selection corresponding to a request to end presentation of the supplemental media rich content, wherein the user selection is received before the end of the predefined duration;
ending presentation of the supplemental media rich content in response to receiving the user selection; and
resuming presentation of the program of interest after ending presentation of the supplemental media rich content.

17. The method of claim 16, wherein the supplemental media rich content trigger is associated with at least one video frame of the program of interest, and further comprising:
presenting the program of interest on the display of the portable media device until the at least one video frame associated with the supplemental media rich content trigger is received.

18. The method of claim 1, wherein the portable media device is one of:
a laptop computer that communicatively couples to the media device over the network that is the Internet,
a personal device assistant (PDA) that communicatively couples to the media device over the network that is the Internet,
a netbook that communicatively couples to the media device over the network that is the Internet,
a cellular-based device that communicatively couples to the media device over at least one of a telephony system and a cellular system, and
an Internet accessible device that communicatively couples to the media device over the network that is the Internet.

19. The method of claim 1, further comprising:
receiving at the media rich content server the portion of the media content stream with the supplemental media rich content trigger, wherein the portion of the media content stream with the supplemental media rich content trigger is received at the media rich content server while the portable media device is receiving the portion of the media content stream with the supplemental media rich content trigger,
wherein the media rich content server communicates the supplemental media rich content to the portable media device when the portion of the media content stream with the supplemental media rich content trigger is received at the media rich content server.

20. The method of claim 1, wherein the portion of the media content stream with the supplemental media rich content trigger is a first portion of the media content stream with a first supplemental media rich content trigger, the method further comprising:
receiving at the media rich content server a second portion of the media content stream with a second supplemental media rich content trigger, wherein the second portion of the media content stream with the second supplemental media rich content trigger is received at the media rich content server while the portable media device is receiving the second portion of the media content stream with the second supplemental media rich content trigger,
wherein the media rich content server communicates second supplemental media rich content to the portable media device when the second portion of the media content stream with the second supplemental media rich content trigger is received at the media rich content server, and
wherein the second supplemental media rich content is communicated from the media rich content server to the portable media device over the communication link over the network that was established between the portable media device and the media rich content server based upon the access information in the received first supplemental media rich content trigger.

21. The method of claim 12, further comprising:
receiving at the media rich content server the portion of the media content stream with the supplemental media rich content trigger, wherein the portion of the media content stream with the supplemental media rich content trigger is received at the media rich content server while the portable media device is receiving the portion of the media content stream with the supplemental media rich content trigger,
wherein the media rich content server communicates the supplemental media rich content to the portable media device when the portion of the media content stream with the supplemental media rich content trigger is received at the media rich content server.

22. The method of claim 12, wherein the portion of the media content stream with the supplemental media rich content trigger is a first portion of the media content stream with a first supplemental media rich content trigger, the method further comprising:
receiving at the media rich content server a second portion of the media content stream with a second supplemental media rich content trigger, wherein the second portion of the media content stream with the second supplemental media rich content trigger is received at the media rich content server while the portable media device is receiving the second portion of the media content stream with the second supplemental media rich content trigger,
wherein the media rich content server communicates second supplemental media rich content to the portable media device when the second portion of the media content stream with the second supplemental media rich content trigger is received at the media rich content server, and
wherein the second supplemental media rich content is communicated from the media rich content server to the portable media device over the second communication link that was established between the portable media device and the media rich content server based upon the access information in the received first supplemental media rich content trigger.