# Patent

## Title
Multi-device complexity broker

## Abstract

A brokering device that manages multimedia information includes an interface device having access to a network and a multimedia service provider. The interface device enables selection of multimedia information from the network, and provides the selected multimedia information to a plurality of locations without requiring the user to specify a protocol associated with the multimedia information.

## Background
This application is a continuation of, and claims priority to, co-pending U.S. application Ser. No. 14/528,443, filed Oct. 30, 2014, U.S., which is a continuation of application Ser. No. 12/254,524 filed Oct. 20, 2008 and issued as U.S. Pat. No. 8,898,257 on Nov. 25, 2014, which are incorporated by reference herein in their entireties.


BACKGROUND
Field
The present disclosure relates to a device for managing multimedia information. More particularly, the present disclosure relates to a brokering device for multimedia information.
Brief Description of the Related Art
The present disclosure relates to devices for playing and displaying multimedia information. Multimedia includes a combination of text, audio, still images, animation, video, and interactive content. Multimedia information may be recorded, played, displayed as part of a live performance, or accessed by information content processing devices, such as computerized and electronic devices. For simplicity, the word “play” will be used to refer to play, record, display, or access in this application.
There are many devices and programs for playing multimedia information available. With the vast variety of devices and content there are also many protocols and formats used to manage the multimedia information. Managing of the multimedia information includes, but is not limited to, playing, converting, sharing, storing, organizing, searching, streaming, downloading, and purchasing the content. Although many devices include hardware and software that organize, search, convert, and translate protocols and formats, the process can be time consuming and may require a user to have knowledge of protocols.
Examples of technology available include, but are not limited to, the following. A database that gathers and stores web content in a directory from a webcast center using a subscription service. (U.S. Pat. No. 6,442,598). A communication controller that establishes a connection between an electronic device with limited storage ability and a remote transport device. (U.S. Pat. No. 7,113,893). A multimedia database used in distributed network environments to do the following: select and coordinate information flow between multiple database sites and user sites, provide multimedia representations, create indexes of the multimedia information, derive a set of target multimedia database sites, and enable database queries descriptions, and final search results based on interactive dialogue between a user and multimedia database. (U.S. Pat. No. 593,218). A network server with a database containing text and multimedia information, a search agent, and a refining module. The network server that uses indexes of the database determined by user queries and distributes them to a database site, where the information from the database can be retrieved and updated. (U.S. Pat. No. 5,920,856).
Currently, many devices and software programs available enable conversion between media types. Examples of software that convert media include Digital Rapids®, Anystream Agility®, VLC, and FFmpeg.
Although the current devices and technology enable a person to do one or a combination of less than all of the following: play, convert, share, store, organize, search, and purchase media files, there is no universal device that hides the complexity of the actions using a diverse number of protocols. More specifically, people use multiple devices with multiple protocols and conversions between the different protocols, which can be difficult and time consuming for the user. Additionally, when searching for multimedia information, a user may not know the differences in quality or formats of multimedia information. Users also desire a device that chooses appropriate multimedia information for devices in the network and even determine which multimedia information is best for the specific devices.
Therefore, it would be advantageous to provide a device that provides the user with a simpler experience by decoupling the user from the technical aspects of the different protocols, and is able to provide the user with basic options that optimize the compatibility, quality, cost, or other criteria based on the user and the devices on the network.
SUMMARY
The present disclosure provides for a brokering device and a system for managing multimedia information.
The brokering device is adapted to manage multimedia information including an interface device having access to a network and a multimedia service provider. The interface device enables selection of multimedia information from the network and provides the selected multimedia information to a plurality of locations without requiring the user to specify a protocol associated with the multimedia information.
The system for managing multimedia information includes an interface device having access to a network and a multimedia service provider and a brokering device adapted to manage multimedia information. The brokering device is operatively configured to communicate with the interface device, the multimedia service provider, and the network. The interface device enables selection of multimedia information from the network, and the interface device provides the selected multimedia information to a plurality of locations without requiring a user to specify a protocol associated with the multimedia information.
Other objects and features of the present disclosure will become apparent from the following detailed description considered in conjunction with the accompanying drawings. It is to be understood, however, that the drawings are designed as an illustration only and not as a definition of the limits of the disclosure.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 depicts the basic elements of the complexity broker.
FIG. 2 depicts the architecture of the complexity broker.



DETAILED DESCRIPTION
The present disclosure provides a brokering device that allows a user to easily play and manage multimedia files using a user friendly interface, referred to as an interface device or a user interface, which hides the complexity associated with translating and identifying protocols of multimedia information, software, hardware, and network information. The brokering device may be configured to operate externally using a brokering service provider or internally using a local area network or private network, such as a home with multiple computers or servers that enables the conversion within the local area network or private network.
The brokering device contains a dual layer method of brokering multimedia information using a service layer, also referred to as a user module; and a technical layer, also referred to as a function module. The service layer abstracts the discovery, control, delivery, and server functions in a user-friendly and intuitive way by presenting the user with an interface device, such as a web interface, a computer screen, a cellular phone screen, and a television screen. The objective is to enable a user to simply use the interface device to select or input information about multimedia information, such as an artist name or a title of a song, and be able to play the multimedia information on a multimedia device, either by selecting a multimedia device to play the content or having the brokering device automatically select the device, using technologies, such as GPS, which are capable of identifying the location of the user and the location of devices in the vicinity.
Then, the technical layer of the brokering device will perform the complex functions involved with managing the multimedia information. The discussed embodiments have two technical aspects. The first is the media format conversion functionality, known also as transcoding. The second is the set of protocols that allow content discovery and identification of the functions available in a given device. The functionality includes the ability to serve content, transform content using transcoding and control content, such as selecting the source and the destination of the content and connecting them together or rendering the content. Several protocols available to accomplish this include uPnP®, DLNA®, iTunes®, and Microsoft® protocols.
By separating the service layer and the technical layer, the brokering device configuration hides the complexity involved with managing the multimedia information. Therefore, a user who is not technically savvy is able to manage and play multimedia information between protocols and multimedia devices by making simple selections and not worrying about technical details.
The benefits of using the brokering device with the brokering service provider includes the ability to use one brokering device to manage multimedia information contained on multiple databases and on multiple sources, such as hardware, software, or the internet, without requiring the user to have knowledge of technical details to manage and play multimedia information. Additionally, to use the brokering service provider with the brokering service allows a user to seamlessly change the multimedia device playing the multimedia information. For example, the user may move between different rooms in a house or between a house and a car without missing a portion of the multimedia information, having to seek the multimedia information on different multimedia devices, or carry around a copy of the multimedia information.
As used herein, the term “seek” refers to jumping to a different offset or point in the same multimedia file. In the above example, the user does not even have to pause the multimedia file on the multimedia device in the car, such as an mp3 player, because the brokering device is tracking the location/offset and the second device, such as a home stereo, can just start playing at the tracked location/offset. An additional feature includes incorporating a sensor or a GPS device in the brokering device that can determine if a person is close to the home stereo in the above example and then automatically start playing the home stereo when the user enters the home. A further capability includes using the user discovery protocol 46 to configure and provide instructions for actions to automatically occur, depending on the media hand-off scenario.
With reference to FIG. 1, the brokering device 10 is connected to a brokering service provider 11, and the brokering device 10 communicates with a user 12, a plurality of multimedia devices 14, and a multimedia content file 16 using a network 18; and contains a discovery module 20. The network 18 contemplated includes small through large networks, examples are Personal Area Networks (PAN), Local Area Networks (LAN), and Wide Area Networks (WAN), such as the internet. The brokering device 10 enables the user 12 to configure a user profile 22 that contains information about the user and commonly used multimedia devices 14. Such information may be obtained from the user and from a database 48 containing user information, such as a record of the user's 12 previous activity.
The multimedia devices 14 contemplated include, but are not limited to, stereos, televisions, computers, digital media personal recorders and players, and mp3 players. The brokering device 10 is also able to obtain and store information in a multimedia device descriptor 24. Such stored information includes the device's protocol for the multimedia content files 16. The multimedia content file 16 may include, for example, mp3 songs, DVD movies, and any other multimedia information offered by a service provider, such as AT&T®, Netflix®, or Blockbuster®. Each multimedia content file 16 may also include a multimedia content descriptor 26 that contains information about the file, such as the protocol, length of time, quality, or other attributes as specified, but not limited to, standard representations, such as MPEG-7 and MPEG-21. The discovery module 20 obtains information from each of the user profile 22, the multimedia device descriptor 24, and the multimedia content descriptor 26.
FIG. 2 outlines the details of how the brokering device 10 works. The brokering device 10 contains two distinct layers. The first layer includes a user module 28 having a user interface 30 that enables a user to select the multimedia content file 16. The second layer includes a function module 32 having a control module 34 that communicates with the user module 28 and the discovery module 20. The function module 32 is designed to receive commands from the user module 28, and issues commands to the user module 28. The commands are then displayed on an interface device via the user module 28. The protocols included within the function module 32 include, for example, DLNA®, UPNP®, and MPPT. The control module 34 is designed to communicate information from the user module 28 and the function module 32 to the brokering service provider 11.
The control module 34 may also communicate with a rule engine 36 and an execution module 38 that can communicate with the network 18. The rule engine 36 applies user preferences, external policies, such as Digital Rights Management, which are dictated by the service provider, and/or internal policies, such as a parental restriction that restricts a particular multimedia device 14 from playing multimedia content files 16 rated “R.” The execution module 38 takes the policies as a whole and identifies and executes the low-level operations that need to be applied to implement the policy. For example, the execution module 38 will allow discovery of only a limited set of servers and/or multimedia information providers depending on the rules engine 36, such as preventing a particular multimedia device 14 from accessing multimedia content files 16 rated “R.”
The discovery module 20 searches for various protocols and can also receive information from the network 18 regarding the protocols. The discovery module 20 has a self-registering feature 50 that is capable of retrieving information relating to a network discovery protocol 40, a device discovery protocol 42, a content discovery protocol 44, and a user discovery protocol 46. The discovery module 20 receives the protocols in the following manner: the network discovery protocol 40 communicates with the network 18; the device discovery protocol 42 obtains the information from the multimedia device descriptor 24; the content discovery protocol 44 obtains the information from the multimedia content descriptor 26; and the user discovery protocol 46 obtains the information from the network 18, the user profile 22 in a user database 48, or the user interface 30.
The self-registering feature 50 of the discovery module 20 allows the device discovery protocol 42 and the content discovery protocol 44 to intelligently and automatically match multimedia content files 16 and known multimedia devices 14. Within the discovery module 20 is a restriction feature 52 that determines if the multimedia content file 16 is legally obtained or obtainable. The restriction feature 52 is used to prevent the user 12 from using the brokering device 10 to illegally obtain multimedia content files 16.
Another embodiment includes a search feature 54 that will enable the brokering device 10 to search for multimedia content files 16 between multiple storage locations, including hardware and software sources. The search feature 54 may also be designed to search for multimedia content files 16 using an internet search engine, a multimedia application and distribution system, such as iTunes®, or a subscription service, such as Rhapsody®. An additional feature of this embodiment may also include a classification feature 56 that will rate multimedia information available on hardware, software, or for purchase based on price, format, quality, providers, or other criteria. The classification feature 56 may be configured to determine the best multimedia information based on different criteria or provide the user interface 30 with a list of options and rating information and allow the user 12 to select the multimedia content file 16 from listed options.
A further embodiment of the brokering device 10 connected to the brokering service provider 11 includes a media hand-off feature 58, where, for example, the self-registering feature 50 allows for the playing, stopping and seeking of the multimedia content files 16 between multiple multimedia devices 14. For example, the user can watch a movie on an iPod® then continue viewing the movie on an HDTV in their home seamlessly using the user interface 30. An additional feature includes using the media hand-off feature 58 to prorate the cost of viewing the multimedia content file 16 on different multimedia devices 14 that have different protocols. Thus, if the user watches one-half of the movie on the iPod® and one-half of the movie on the HDTV they would pay for one-half at the iPod® rate and one-half at the HDTV rate.
Another feature includes a backup feature 60 that provides a backup copy of multimedia content files 16 purchased by the user 12 in the user discovery protocol 46. The backup feature 60 may also include multimedia content descriptor 26 information, such as the time of purchase and the multimedia devices 14 capable of playing the multimedia content files 16.
A further feature includes a messaging feature 62 to send messages across the network 18 from the user's profile 22. The messaging feature 62 would be configured similar to a social network and would allow users 12 to send messages concerning multimedia content files 16 including information about the quality of the multimedia content file 16 or information about multimedia services.
A still further embodiment includes a multimedia player device 64 capable of using the brokering device 10 to play all multimedia content files 16 using the multimedia player device 64 instead of individual multimedia devices 14 for different protocols. The advantage of the multimedia player device 64 is the convenience that the user 12 only needs one multimedia device 14; the multimedia player device 64, to play all multimedia content files 16 and the multimedia player device 64 could include the brokering device 10 with the user interface 30.
The main advantage of using the broking device 10 with the brokering service provider 11 is the ability to provide a user friendly device that hides the complexity of associating multimedia content files 16 with multimedia devices 14. Another advantage is that the self-registering feature 50 enables the brokering device 10 to be intelligent and automated when matching multimedia content files 16 to multimedia devices 14, finding the least expensive provider of multimedia content files 16, and verifying the ability to obtain the multimedia content files 16 legally. In sum, the brokering device 10 with the brokering service provider 11 provides the user with a worry free approach to accessing multimedia content files 16 and makes it convenient and simple for a user to use multiple multimedia devices 14 with multiple multimedia content files 16 using the brokering device 10 to manages the multimedia content files 16 stored in hardware or software and streamed through the internet, such as podcasts.
Yet another advantage of using the brokering device 10 described above includes the ability to make dynamic adaption downstream because the brokering device 10 dynamically adapts to the hardware and software available on the network 18. This is possible because the brokering device 10 connected to the brokering service provider 11 is the single point of contact for sharing information between devices. This single point of contact with the self-register feature allows the brokering service provider 11 to be incorporated into the functionality of the brokering device 10. Incorporating the service provided by the brokering service provider 11 creates competition among multimedia content file 16 distributors.
A further advantage of portability is provided by the media hand-off feature 58, which would allow a person to access multimedia content files 16 using any network 18 and the ability to switch between different multimedia devices 14 seamlessly.
It will be appreciated that the disclosed embodiments have been described herein with reference to certain preferred or exemplary embodiments. The preferred or exemplary embodiments described herein may be modified, changed, added to or deviated from without departing from the intent, spirit and scope of the present disclosure, and it is intended that all such additions, modifications, amendment and/or deviations be included within the scope of the following claims.

## Claims

1. A brokering device that manages content information, the brokering device comprising:
an interface device that enables selection of the content information, the interface device providing the content information to a user device without requiring a user to specify a protocol associated with the content information;
a controlling device that accesses the content information on a network and provides the content information to the user device based on a policy;
a discovery device operatively coupled to the controlling device, the discovery device having a self-registering feature that is capable of retrieving information associated with a network discovery protocol, a device discovery protocol, a content discovery protocol, and a user discovery protocol; and
a rule device that communicates with the controlling device to provide the policy, the policy comprising one of an internal policy and an external policy, the policy enabling discovery of a predetermined limited set of the content information.

2. The brokering device of claim 1, further comprising an execution device operatively coupled to the controlling device, the execution device enabling implementation of the policy, the policy limiting access to providers of the content information.

3. The brokering device of claim 1, wherein the discovery device prevents the content information from being obtained illegally.

4. The brokering device of claim 1, wherein the controlling device searches for content information using one of an Internet search engine, multimedia application, and distribution system.

5. The brokering device of claim 1, wherein the controlling device rates the content information based on one of price, format, quality, and providers.

6. The brokering device of claim 1, wherein the controlling device enables one of playing, seeking, and stopping the content information on a plurality of user devices.

7. The brokering device of claim 1, wherein the controlling device enables prorating of a cost associated with the content information being viewed on different user devices.

8. The brokering device of claim 1, wherein the controlling device selects the user device to play the content information based on a location of the user.

9. The brokering device of claim 1, wherein the controlling device selects the user device to play the content information based on a location of the user device.

10. The brokering device of claim 1, wherein the controlling device selects the user device to play the content information based on a proximity of the user with respect to the user device.

11. A system that manages content information, the system comprising:
a brokering device, the brokering device comprising:
an interface device that enables selection of the content information, the interface device providing the content information to a user without requiring the user to specify a protocol associated with the content information;
a controlling device that accesses the content information on a network and provides the content information based on a policy;
a discovery device operatively coupled to the controlling device, the discovery device having a self-registering feature that is capable of retrieving information associated with a network discovery protocol, a device discovery protocol, a content discovery protocol, and a user discovery protocol; and
a rule device that communicates with the controlling device to provide the policy, the policy comprising one of an internal policy and an external policy, the policy enabling discovery of a predetermined limited set of the content information; and
a user device that receives the content information.

12. A method of managing content information, the method comprising:
providing, using an interface device, content information to a user device without requiring a user to specify a protocol associated with the content information;
providing, using a controlling device, the content information to the user device based on a policy;
retrieving, using a discovery device having a self-registering feature and operatively coupled to the controlling device, information associated with a network discovery protocol, a device discovery protocol, a content discovery protocol, and a user discovery protocol; and
providing, using a rule device that communicates with the controlling device the policy, wherein the policy comprises one of an internal policy and an external policy, and wherein the policy enables discovery of a predetermined limited set of the content information.

13. The method of claim 12, further comprising enabling, using an execution device, implementation of the policy, the policy limiting access to providers of the content information.

14. The brokering device of claim 12, further comprising searching, using the controlling device, for content information using one of an Internet search engine, multimedia application, and distribution system.

15. The brokering device of claim 12, further comprising rating, using the controlling device, the content information based on one of price, format, quality, and providers.

16. The brokering device of claim 12, further comprising enabling, using the controlling device, one of playing, seeking, and stopping the content information on a plurality of user devices.

17. The brokering device of claim 12, further comprising enabling, using the controlling device, prorating of a cost associated with the content information being viewed on different user devices.

18. The brokering device of claim 12, further comprising selecting, using the controlling device, the user device to play the content information based on a location of the user.

19. The brokering device of claim 12, further comprising selecting, using the controlling device, the user device to play the content information based on a location of the user device.

20. The brokering device of claim 12, further comprising selecting, using the controlling device, the user device to play the content information based on a proximity of the user with respect to the user device.