Abstract:
A method and apparatus for dynamically segmenting and pricing segments of a premium media asset. The method and apparatus is operable to price content centrally or locally according to a factor or a combination of factors, such as topic, age, popularity, or duration.

Description:
[0001]    This application claims priority from U.S. Provisional Application No. 61/668,177 filed Jul. 5, 2012. 
     
    
     BACKGROUND OF THE INVENTION 
       [0002]    When a user consumes media using a television, computer, mobile device, set top box, or the like, the user typically will be watching a video media asset such as a movie, television show, short streamed video, and the like. Such video programming usually is accompanied with an audio information and information which describes the audio information. For example, a television program in the United States is transmitted with closed caption information which displays as text the spoken words that are part of the audio information. Other types of auxiliary information such as teletext information, Uniform Resource Locators which point to internet related websites/media, and the like can be transmitted with the video programming, as well. 
         [0003]    A user consuming a video asset may attempt to find more media that is related to asset currently being consumed. To do this, a user can access the program guide information that accompanies that video asset and attempt to reference such information against other program guide information for video programming. The problem with this approach however is that program guide information provides a “macro” view of view programming where only generalized information can be gleaned. 
         [0004]    Recently, ranked retrieval has become popular data access paradigms for various kinds of data, such as web pages and relation databases. Given a user request, the system identifies, ranks, and returns a ranked list of relevant matches by exploiting the statistics of data. Due to the extensive works in this area, ranked retrieval paradigm has been successfully used in many application domains. For example, most of commercial database systems support the ranked retrieval of data, based on user provided scoring functions. However, a parallel development is not observed in video retrieval systems: most of video retrieval systems fail to support the mechanisms which enable user to find relevant videos in an effective manner. While it is a challenge for all types of video retrievals, the problem is most evident with television news. Since TV news contains a series of independent stories, it is essential that the retrieval system for television news should identify related segments within a full video, and return only relevant segments to a user. Consider a user who is watching live television news on a specific event. This user, who may have not been aware of the event in the past, wants to know more about this event. Assuming that news providers store a large collection of news videos which were broadcasted in the past in an accessible server, the user may wish to access this stored content to learn more about the present event. In other words, we consider a scenario where a user who is watching television news in a specific topic is interested in finding more related news in a server. In such a scenario, it would be useful for the systems to be able to recommend a set of news videos to a user, based on the topic similarity. 
         [0005]    Further, if the desired news content is part of a premium media program available for purchase, such programs would typically have to be purchased completely in order for a user to access the content in such programs. Given the above scenario, it would be desirable to allow a user to purchase the respective topics/segments of interest of a program where such pricing will be done dynamically. 
       SUMMARY OF THE INVENTION 
       [0006]    A method and apparatus for dynamically segmenting and pricing segments of a premium media asset. The method and apparatus is operable to price content centrally or locally according to a combination of factors. 
     
    
     
       DETAIL DESCRIPTION OF THE DRAWINGS 
         [0007]    These and other aspects, features and advantages of the present disclosure will be described or become apparent from the following detailed description of the preferred embodiments, which is to be read in connection with the accompanying drawings. 
           [0008]    In the drawings, wherein like reference numerals denote similar elements throughout the views: 
           [0009]      FIG. 1  shows a block diagram of an embodiment of a system for delivering content to a home or end user. 
           [0010]      FIG. 2  presents a block diagram of a system that presents an arrangement of media servers, online social networks, and consuming devices for consuming media. 
           [0011]      FIG. 3  shows a block diagram of an embodiment of a set top box/digital video recorder; 
           [0012]      FIG. 4  shows a method for obtaining topics that are associated with a media asset; 
           [0013]      FIG. 5  shows a block diagram of multiple tuners that receive a plurality of video content from different channels/sources; 
           [0014]      FIG. 6  is an embodiment of an system which for performing video segmentation 
           [0015]      FIG. 7  shows an exemplary timeline of a news video program; and 
           [0016]      FIG. 8  shows a flowchart depicting a method of pricing a media segment. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0017]    It should be understood that the elements shown in the figures can be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which can include a processor, memory and input/output interfaces. Herein, the phrase “coupled” is defined to mean directly connected to or indirectly connected with through one or more intermediate components or signal paths. Such intermediate components can include both hardware and software based components. 
         [0018]    The present description illustrates the principles of the present disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its scope. 
         [0019]    In the description, the presence of metadata in the form of auxiliary information is expected to accompany a video asset, as an example of a media asset. A media asset can be video, audio, a mixture of both, and the like. Metadata as auxiliary information can be teletext, closed captioning information, text, uniform resource locators that point to additional media, triggers, and the like. In most of the embodiments described below, the auxiliary information described will be closed captioning information, even though other types of auxiliary information can be processed using the described principles as well. 
         [0020]    One video asset that presents a challenge to vendors of premium video assets are news programs. During a news broadcast, many different topics or segments are presented (such as politics, sports, weather, local interest, national news, trivia, and the like). A user may not wish to purchase an entire news program for only one segment. These exemplary embodiments are described in connection with a news program to illustrate the dynamic nature of how the topics within the same video asset can change. 
         [0021]    This description is not limiting in that other video assets such as music concerts, movies, dramas, comedies, YouTube videos, and the like can have the described principles applied to such assets as well. 
         [0022]    Turning now to  FIG. 1 , a block diagram of an embodiment of a system  100  for delivering content to a home or end user is shown. The content originates from a content source  102 , such as a movie studio or production house. The content can be supplied in at least one of two forms. One form can be a broadcast form of content. The broadcast content is provided to the broadcast affiliate manager  104 , which is typically a national broadcast service, such as the American Broadcasting Company (ABC), National Broadcasting Company (NBC), Columbia Broadcasting System (CBS), etc. The broadcast affiliate manager can collect and store the content, and can schedule delivery of the content over a deliver network, shown as delivery network  1  ( 106 ). Delivery network  1  ( 106 ) can include satellite link transmission from a national center to one or more regional or local centers. Delivery network  1  ( 106 ) can also include local content delivery using local delivery systems such as over the air broadcast, satellite broadcast, cable broadcast or from an external network via IP. The locally delivered content is provided to a user&#39;s set top box/digital video recorder (DVR)  108  in a user&#39;s home, where the content will subsequently be included in the body of available content that can be searched by the user. 
         [0023]    A second form of content is referred to as special content. Special content can include content delivered as premium viewing, pay-per-view, or other content not otherwise provided to the broadcast affiliate manager. In many cases, the special content can be content requested by the user. The special content can be delivered to a content manager  110 . The content manager  110  can be a service provider, such as an Internet website, affiliated, for instance, with a content provider, broadcast service, or delivery network service. The content manager  110  can also incorporate Internet content into the delivery system, or explicitly into the search only such that content can be searched that has not yet been delivered to the user&#39;s set top box/digital video recorder  108 . The content manager  110  can deliver the content to the user&#39;s set top box/digital video recorder  108  over a separate delivery network, delivery network  2  ( 112 ). Delivery network  2  ( 112 ) can include high-speed broadband Internet type communications systems. It is important to note that the content from the broadcast affiliate manager  104  can also be delivered using all or parts of delivery network  2  ( 112 ) and content from the content manager  110  can be delivered using all or parts of Delivery network  1  ( 106 ). In addition, the user can also obtain content directly from the 
         [0024]    Internet via delivery network  2  ( 112 ) without necessarily having the content managed by the content manager  110 . In addition, the scope of the search goes beyond available content to content that can be broadcast or made available in the future. 
         [0025]    The set top box/digital video recorder  108  can receive different types of content from one or both of delivery network  1  and delivery network  2 . The set top box/digital video recorder  108  processes the content, and provides a separation of the content based on user preferences and commands. The set top box/digital video recorder can also include a storage device, such as a hard drive or optical disk drive, for recording and playing back audio and video content. Further details of the operation of the set top box/digital video recorder  108  and features associated with playing back stored content will be described below in relation to  FIG. 3 . The processed content is provided to a display device  114 . The display device  114  can be a conventional 2-D type display or can alternatively be an advanced 3-D display. It should be appreciated that other devices having display capabilities such as wireless phones, PDAs, computers, gaming platforms, remote controls, multi-media players, or the like, can employ the teachings of the present disclosure and are considered within the scope of the present disclosure. 
         [0026]    Delivery network  2  is coupled to an online social network  116  which represents a website or server in which provides a social networking function. For instance, a user operating set top box  108  can access the online social network  116  to access electronic messages from other users, check into recommendations made by other users for content choices, see pictures posted by other users, refer to other websites that are available through the “Internet Content” path. 
         [0027]    Online social network server  116  can also be connected with content manager  110  where information can be exchanged between both elements. Media that is selected for viewing on set top box  108  via content manager  110  can be referred to in an electronic message for online social networking  116  from this connection. This message can be posted to the status information of the consuming user who is viewing the media on set top box  108 . That is, a user using set top box  108  can instruct that a command be issued from content manager  110  that indicates information such as the &lt;&lt;ASSETID&gt;&gt;, &lt;&lt;ASSETTYPE&gt;&gt;, and &lt;&lt;LOCATION&gt;&gt; of a particular media asset which can be in a message to online social networking server  116  listed in &lt;&lt;SERVICE ID&gt;&gt; for a particular user identified by a particular field &lt;&lt;USERNAME&gt;&gt; is used to identify a user. The identifier can be an e-mail address, hash, alphanumeric sequence, and the like. 
         [0028]    Content manager  110  sends this information to the indicated social networking server  116  listed in the &lt;&lt;SERVICE ID&gt;&gt;, where an electronic message for &amp;USERNAME has the information comporting to the &lt;&lt;ASSETID&gt;&gt;, &lt;&lt;ASSETTYPE&gt;&gt;, and &lt;&lt;LOCATION&gt;&gt; of the media asset posted to status information of the user. Other users who can access the social networking server  116  can read the status information of the consuming user to see what media the consuming user has viewed. 
         [0029]    The term media asset can be a video based media, an audio based media, a television show, a movie, an interactive service, a video game, a HTML based web page, a video on demand, an audio/video broadcast, a radio program, advertisement, a podcast, and the like. 
         [0030]      FIG. 2  presents a block diagram of a system  200  that presents an arrangement of media servers, online social networks, and consuming devices for consuming media. Media servers  210 ,  215 ,  225 , and  230  represent media servers where media is stored. Such media servers can be a hard drive, a plurality of hard drives, a server farm, a disc based storage device, and other type of mass storage device that is used for the delivery of media over a broadband network. 
         [0031]    Media servers  210  and  215  are controlled by content manager  205 . Likewise, media server  225  and  230  are controlled by content manager  235 . In order to access the content on a media server, a user operating a consumption device such as STB  108 , personal computer  260 , table  270 , and phone  280  can have a paid subscription for such content. The subscription can be managed through an arrangement with the content manager  235 . For example, content manager  235  can be a service provider and a user who operates STB  108  has a subscription to programming from a movie channel and to a music subscription service where music can be transmitted to the user over broadband network  250 . Content manager  235  manages the storage and delivery of the content that is delivered to STB  108 . Likewise, other subscriptions can exist for other devices such as personal computer  260 , tablet  270 , and phone  280 , and the like. It is noted that the subscriptions available through content manager  205  and  235  can overlap, where for example; the content comporting for a particular movie studio such as DISNEY can be available through both content managers. Likewise, both content managers  205  and  235  can have differences in available content, as well, for example content manager  205  can have sports programming from ESPN while content manager  235  makes available content that is from FOXSPORTS. Content managers  205  and  235  can also be content providers such as NETFLIX, HULU, and the like who provide media assets where a user subscribes to such a content provider. An alternative name for such types of content providers is the term over the top service provider (OTT) which can be delivered “on top of” another service. For example, considering  FIG. 1  content manager  110  provides internet access to a user operating set top box  108 . An over the top service from content manager  205 / 235  (as in  FIG. 2 ) can be delivered through the “internet content” connection, from content source  102 , and the like. 
         [0032]    By a content manager  205 ,  235 , a subscription is not the only way that content can be authorized. Some content can be accessed freely through a content manager  205 ,  235  where the content manager does not charge any money for content to be accessed. Content manager  205 ,  235  can also charge for other content that is delivered as a video on demand for a single fee for a fixed period of viewing (# of hours). Content can be bought and stored to a user&#39;s device such as STB  108 , personal computer  260 , tablet  270 , and the like where the content is received from content managers  205 ,  235 . Other purchase, rental, and subscription options for content managers  205 ,  235  can be utilized as well. 
         [0033]    Online social servers  240 ,  245  represent the servers running online social networks that communicate through broadband network  250 . Users operating a consuming device such as STB  108 , personal computer  260 , tablet  270 , and phone  280  can interact with the online social servers  240 ,  245  through the device, and with other users. One feature about a social network that can be implemented is that users using different types of devices (PCs, phones, tablets, STBs) can communicate with each other through a social network. For example, a first user can post messages to the account of a second user with both users using the same social network, even though the first user is using a phone  280  while a second user is using a personal computer  260 . Broadband network  250 , personal computer  260 , tablet  270 , and phone  280  are terms that are known in the art. For example, a phone  280  can be a mobile device that has Internet capability and the ability to engage in voice communications. 
         [0034]    Turning now to  FIG. 3 , a block diagram of an embodiment of the core of a set top box/digital video recorder  300  is shown, as an example of a consuming device. The device  300  shown can also be incorporated into other systems including the display device  114 . In either case, several components necessary for complete operation of the system are not shown in the interest of conciseness, as they are well known to those skilled in the art. 
         [0035]    In the device  300  shown in  FIG. 3 , the content is received in an input signal receiver  302 . The input signal receiver  302  can be one of several known receiver circuits used for receiving, demodulation, and decoding signals provided over one of the several possible networks including over the air, cable, satellite, Ethernet, fiber and phone line networks. The desired input signal can be selected and retrieved in the input signal receiver  302  based on user input provided through a control interface (not shown). The decoded output signal is provided to an input stream processor  304 . The input stream processor  304  performs the final signal selection and processing, and includes separation of video content from audio content for the content stream. The audio content is provided to an audio processor  306  for conversion from the received format, such as compressed digital signal, to an analog waveform signal. The analog waveform signal is provided to an audio interface  308  and further to the display device  114  or an audio amplifier (not shown). Alternatively, the audio interface  308  can provide a digital signal to an audio output device or display device using a High-Definition Multimedia Interface (HDMI) cable or alternate audio interface such as via a Sony/Philips Digital Interconnect Format (SPDIF). The audio processor  306  also performs any necessary conversion for the storage of the audio signals. 
         [0036]    The video output from the input stream processor  304  is provided to a video processor  310 . The video signal can be one of several formats. The video processor  310  provides, as necessary a conversion of the video content, based on the input signal format. The video processor  310  also performs any necessary conversion for the storage of the video signals. 
         [0037]    A storage device  312  stores audio and video content received at the input. The storage device  312  allows later retrieval and playback of the content under the control of a controller  314  and also based on commands, e.g., navigation instructions such as fast-forward (FF) and rewind (Rew), received from a user interface  316 . The storage device  312  can be a hard disk drive, one or more large capacity integrated electronic memories, such as static random access memory, or dynamic random access memory, or can be an interchangeable optical disk storage system such as a compact disk drive or digital video disk drive. In one embodiment, the storage device  312  can be external and not be present in the system. 
         [0038]    The converted video signal, from the video processor  310 , either originating from the input or from the storage device  312 , is provided to the display interface  318 . The display interface  318  further provides the display signal to a display device of the type described above. The display interface  318  can be an analog signal interface such as red-green-blue (RGB) or can be a digital interface such as high definition multimedia interface (HDMI). It is to be appreciated that the display interface  318  will generate the various screens for presenting the search results in a three dimensional array as will be described in more detail below. 
         [0039]    The controller  314  is interconnected via a bus to several of the components of the device  300 , including the input stream processor  302 , audio processor  306 , video processor  310 , storage device  312 , and a user interface  316 . The controller  314  manages the conversion process for converting the input stream signal into a signal for storage on the storage device or for display. The controller  314  also manages the retrieval and playback of stored content. Furthermore, as will be described below, the controller  314  performs searching of content, either stored or to be delivered via the delivery networks described above. The controller  314  is further coupled to control memory  320  (e.g., volatile or non-volatile memory, including random access memory, static RAM, dynamic RAM, read only memory, programmable ROM, flash memory, EPROM, EEPROM, etc.) for storing information and instruction code for controller  214 . Further, the implementation of the memory can include several possible embodiments, such as a single memory device or, alternatively, more than one memory circuit connected together to form a shared or common memory. Still further, the memory can be included with other circuitry, such as portions of bus communications circuitry, in a larger circuit. 
         [0040]    To operate effectively, the user interface  316  of the present disclosure employs an input device that moves a cursor around the display, which in turn causes the content to enlarge as the cursor passes over it. In one embodiment, the input device is a remote controller, with a form of motion detection, such as a gyroscope or accelerometer, which allows the user to move a cursor freely about a screen or display. In another embodiment, the input device is controllers in the form of touch pad or touch sensitive device that will track the user&#39;s movement on the pad, on the screen. In another embodiment, the input device could be a traditional remote control with direction buttons. 
         [0041]      FIG. 4  describes a method  400  for obtaining topics that are associated with a media asset. Although the method begins with a step  405  of extracting keywords from auxiliary information associated with a media asset, this step is not the final processing for this method, unlike other keyword extraction techniques. One approach which can use a closed captioning processor (in a set top box  108 , in a content manager  205 / 235 , or the like) which reads in the EIA- 608 /EIA- 708  formatted closed captioning information that is transmitted with a video media asset. The closed captioning processor can have a data slicer which outputs the captured closed caption data as an ASCII text stream. 
         [0042]    It is noted for different broadcast sources will be arranged differently, where the closed captioning and other types of auxiliary information can be configured to extract the data of interest depending on the way how the data stream is configured. For example, an MPEG-2 transport stream that is formatted for broadcast in the United States using an ATSC format is different than the digital stream that is used for a DVB-T transmission in Europe, to an ARIB based transmission that is used in Japan. 
         [0043]    In step  405 , this step begins with the outputted text stream is processed in step to produce a series of keywords which are mapped to topics. That is, the outputted text stream is formatted into a series of sentences. Each sentence is processed to eliminate stop words where the remaining words are denoted as being keywords. The stop words are commonly used words that do not add to the semantic meaning of a sentence (e.g. of, on, is, an, the, etc.). Stop word lists for English language are well known. A pre-processing step, which can be part of step reads the stop words from such a list and removes them from the text stream. 
         [0044]    The keywords are further processed in step  415  by mapping extracted keywords to a series of topics (as query terms) by using a predetermined thesaurus database that associates certain keywords with a particular topic. This database can be set up where a limited selection of topics are defined (such as particular people, subjects, and the like) and various keywords are associated with such topics by using a comparator that attempts to map a keyword against a particular subject. For example, thesaurus database (such as Word Net and the Yahoo Open Directory project) can be set up where the keywords such as money, stock, market, are associated with the topic “finance”. Likewise, keywords such as President of the United States, 44th President, President Obama, Barack Obama, are associated with the topic “Barack Obama”. Other topics can be determined from keywords using this or similar approaches for topic determination. Another method for doing this would be use Wikipedia (or similar) knowledge base where content is categorized based on topics. Given a keyword that has an associated topic in Wikipedia, a mapping of keyword to topics can be obtained for the purposes of creating as thesaurus database, as described above. 
         [0045]    Once such topics are determined for each sentence, such sentences can be represented in the form of: 
         [0000]    &lt;topic_ 1 :weight_ 1 ;topic_ 2 ;weight_ 2 , . . . ,topic_n,weightN,ne_ 1 ,ne_ 2 , . . . ,ne_m&gt;. 
         [0046]    Topic_i is the topic that is identified based on the keywords in a sentence, weight_i is a corresponding relevance, Ne_i is the named entity that is recognized in the sentence. Named entities refer to people, places and other proper nouns in the sentence which can be recognized using grammar analysis. 
         [0047]    It is possible that some entity is mentioned frequently but is indirectly referenced through the use of pronouns such as “he, she, they”. If each sentence is analyzed separately such pronouns will not be counted because such words are in the stop word list The word “you” is a special case as in that is used frequently. The use of name resolution will help assign the term “you” to a specific keyword/topic referenced in a previous/current sentence. Otherwise, “you” will be ignored if it can&#39;t be referenced to a specific term. To resolve this issue the name resolution can be done before the stop word removal. 
         [0048]    If several sentences discuss the same set of topics and mention the same set of named entities, an assumption is made that the “current topic” of a series of sentences is currently being referenced. If a new topic is referenced over a new set of sentences, it is assumed that a new topic is being addressed. It is expected that topics will change frequently over the course of a video program. 
         [0049]    These same principles can also be applied to receipt of a Really Simple Syndication (RSS) feed that is received by a user&#39;s device, which is typically “joined” by a user. These feeds typically represent text and related tags, where the keyword extraction process can be used to find relevant topics from the feed. The RSS feed can be analyzed to return relevant search results by using the approaches described below. Importantly, the use of both broadcast and RSS feeds can be done at the same time by using the approaches listed within this specification. 
         [0050]    When a current topic is over ( 405 ) and a new topic starts, such a change is detected by using a vector of keywords over a period of time. For example, in a news broadcast, many topics are discusses such as sports, politics, weather, etc. As mentioned previously, each sentence is represented as a list of topic weights (referred to as a vector). It is possible to compare the similarity of consecutive sentences (or alternatively between two windows containing a fixed number of words). There are many known similarity metrics to compare vectors, such as cosine similarity or using the Jaccard index. From the generation of such vectors, the terms can be compared and similarity is performed which notes the differences between such vectors. These comparisons are performed over a period of time. Such a comparison helps determine how much of change occurs from topic to topic, so that a predefined threshold can be determined where if the “difference” metric, depending on the technique used, exceeds the threshold, it is likely that the topic has changed. 
         [0051]    As an example of this approach, a current sentence is checked against a current topic by using a dependency parser. Dependency parses process a given sentence and determines the grammatical structure of the sentence. These are highly sophisticated algorithms that employ machine learning techniques in order to accurately tag and process the given sentence. This is especially tricky for the English language due to many ambiguities inherent to the language. First, a check is performed to see if there are any pronouns in a sentence. If so, the entity resolution step is performed to determine which entities are mentioned in a current sentence. If no pronouns are used and if no new topics are found, it is assumed that the current sentence refers to the same topic as previous sentences. For example, if “he/she/they/his/her” is in a current sentence, it is likely that such terms refer to an entity from a previous sentence. It can be assumed that the use of such pronouns will have a current sentence refer to the same topic as a previous sentence. Likewise, for the following sentence, it can be assumed that the use of a pronoun in the sentence refers to the same topic as the previous sentence. 
         [0052]    A change ( 405 ) between topics is noted when there is a change between the vectors of consecutive sentences, where the difference between two vectors varies by a significant difference. Such a difference can be changed in various embodiments, but it is noted that a large number (in a difference) can be more accurate in detecting a topic change, but using a large number imparts a longer delay of the detection of topics. A new query can be submitted with this new topic in step  420 . 
         [0053]    After detecting a current topic, more information can be determined for such a topic by using a search engine or news website where topics can be inputted to return news stores and websites in step  430 . Specifically, the topics can be used to create a query term. Ideally, keywords such as proper nouns that are identified as people&#39;s names, organizations, locations, and the like (are given priority in the formation of a query. That is, these types of topics when entered into a search website such a GOOGLE or BING return better results than topics associated with common nouns. 
         [0054]    A query can be fashioned in a format that is specific to the search engine being accessed when different search engines use different limiting criteria. For example, a query can be submitted that puts in criteria that specifies that the query results refer to a specific format (news stories, web pages, URLs, and the like), that the query results come from a specific source (e.g., news source such as Reuters/CNN, specific website, and the like), and other types of limitations. 
         [0055]    The resulting query can be delivered in a format which can be parsed by the device that receives such results. For example, the results can be delivered in an XML format with various fields representing the head and the body of a news story which is returned as a “hit”. The results can also be returned as an RSS feed. As an optional, the results can also include website URLs that are returned in response to a submitted query. Other formats of how results can be returned can be implemented by those of the ordinary skill in the art. These are various forms of query results. 
         [0056]    Another approach is to use both the most frequently named entity (proper noun) and the keyword that is most related to the topic during topic detection. Many search engines use keywords for searching, but using a topic alone may not be enough. Hence, the use of a topic and a frequently used keyword can provide specific results than by using a topic as the basis of a search, by itself. For example, determined topic “finance” may not provide any meaningful hits because of the reliance on an external search engine. If a query were offered with “finance” and a frequently used keyword associated with finance “money”, a search engine can provide better results especially when trying to return news stories. 
         [0057]    The results of either approach described above are returned and ranked according to the relevance of a current topic in step  450 . Such a ranking can be calculated by determining the amount of keywords that are shared between a video asset that is being analyzed and the news stories that are returned from a search engine (after a query is formulated). A covariance can be determined between the video asset and the text of such news story. The vector approach mentioned above can be used for performing such a comparison. 
         [0058]    If a topic is very popular, many stories can be returned which are similar to each other. Therefore, the removal of redundant stories from returned search results is desirable (in step  440 ). One approach to eliminate such duplication is to apply a bag-of-word representation of each document and compare the amount of common words among multiple documents. If many words are common, it is determined that such documents are similar and one of them will be removed. 
         [0059]    Another redundancy problem is related to the length of news stories. That is, it is desirable not to use news stories that are long and will take a long time to view. Likewise, it is desirable not to display search results for a long time as such results will appear to be stale. Hence, a threshold value update_duration is used when a topic does not change after a period of time denoted in this value, the detection of a new topic is performed or a new query is submitted. From the results of the new query, the news stories that were created the most recently will be displayed over other news articles (this can be done by analyzing time information with the article). 
         [0060]    Alternatively, all of the topics over a period of time can be stored with the news stories that were previously matched. When the topic is repeated during this time period, other news stories are presented that matched but was not previously presented. This can be performed if the update_duration value exceeds a certain threshold for a particular topic. A second topic and its associated news stories can be presented during this time. 
         [0061]    The principles above can be scaled in a manner consistent with  FIG. 5  which shows a block diagram  500  of multiple tuners ( 510   a, b, c . . . n ) that receive a plurality of video content from different channels/sources (over the air broadcast, cable, satellite, IPTV, and the like). The auxiliary information associated with each of the tuners is processed in  520  by a closed captioning and RSS feed extractor to generate relevant keywords/metadata. The RSS feeds from  530  represent different sources of queries that can be parsed in a similar manner as a broadcast channel. This helps allow that idea of having both RSS feeds and video content be processed at the same time. 
         [0062]    A user profile  540  affects how the topics can be selected and represented as in  FIG. 6  (as shown for step  460 ). For example, a user can request that sources specific sources of information be used for presenting various news stories. For example, in 
         [0063]      FIG. 6 , an interface is shown where both CNN ( 605 ) and FOX NEWS ( 610 ) have their news stories presented in response to the auxiliary information processed from the CNN analyzed video as shown in video frame  620 . Additional sources of video channels can be selected by selecting the tabs at  630  (by selecting FOX, CBS, ABC, etc.), but the news sources (CNN, FOX NEWS) would stay the same unless the user profile was adjusted to select other sources (ESPN, GOOGLE NEWS, and the like). 
         [0064]    User profile  540  can also be iteratively adjusted in response to the news stories that a user selects. That is, a preference engine can be used to select what search results are going to be more relevant (when represented) from the ones that are not likely to be used. For example, if a topic such as “SPORTS” is on the main screen, the user profile can indicate that news stories that focus on football be presented, over other sports. Likewise, the profile can reflect that a user would prefer sports scores over text about players who play specific sports. Other variations of how the user profile  540  can be adjusted can be performed in accordance with the principles described herein. 
         [0065]    Topic extractor  550  is used for determining relevant topics from keywords, whereby the individual topics can be outputted in a manner as shown for  560   a,    560   b ,  560   c.  These topics can then be submitted to a search engine for search results which can then be presented to a viewer. 
         [0066]    Turning now to  FIG. 6 , an overview of a proposed system which for performing video segmentation is shown. In this exemplary embodiment, segmentation and indexing of a news video program is performed. First news video data may be retrieved a broadcast source, such as a satellite source, an over the air transmission, or an internet connection  610 . After receiving the news video data, the data is segmented according to topic and appropriate information units are generated which will be used for indexing, ranking and retrieval  620 . The system is then operative to determine the top news segments which may be of interest to the user  630 . The top-k processing algorithm may be used for efficiently retrieving related news videos in a real time. The system then presents these recommendations to the user  640 . 
         [0067]    Index structures are subsequently built in to support efficient run-time retrieval of news video segments  650  and for closed captioning segments  660 . For identifying related news video, a system according to this exemplary embodiment may rely on the cosine similarities between CC-data. This indexing and segmentation data is collected and stored in either a local or online memory location. This information may then be gathered by a common entity, such as a service provider and used to benefit other users. Either of these steps may be preformed either offline or online. For this exemplary embodiment, the recommendation phase is an online process, the indexing and data collection phase is processed offline as shown in  FIG. 6 . It should be noted that while the previous exemplary embodiment was described as being performed at a users premises, it may be performed at a head end, or service provider location. 
         [0068]    Additionally, online audio and video data may be stored in a remote location accessible by the system  680 . The content provider would remotely segment and index  670  this content and add the data to the index structures of the segments. Thus, remotely located audio and video programming can be accessed by the system. The index structures may be optionally populated by either the locally generated index entries, the remotely generated index entries, or both the locally generated index entries and, the remotely generated index entries 
         [0069]    Turning now to  FIG. 7 , an exemplary timeline  700  of a news video program is shown. In this exemplary embodiment, the news video program comprises segments of local LA stories, world news, sports, weather, and human interest. The timeline  700  shows the news program segmented by topic which has been segmented into 5 minute blocks based on using a closed captioning topic extraction technique. The segments of a program however can be divided into any number of segments which can have different time segments, for example one segment being 1 minute and a second segment being 3 minutes. The segments, as divided, may also have metadata inserted into the segments which indicate for example the name of the program, the actors/newscasters involved, the date and time of the program, and the specific topic of the segment. For example, metadata indicating “local LA stories” would be used for the 5 minute segment. Additional details extracted from the segment may also be indicated as metadata, such as the LA Kings, Hurricane Francis, or the like. 
         [0070]    Returning now to  FIG. 6 , the system  600  is operative to segment each news video to facilitate indexing, ranking, retrieval and presentation of appropriate units to the user. For the segmentation of news video, the system performs topic detection and tracking (TDT), which mainly focuses on detecting and tracking events in streaming news data. TDT systems monitor continuously updated news stories and try to detect the first occurrence of a new story; i.e., an event significantly different from those news events seen before. To detect the first story, current TDT systems compare a new document with the past documents and make a decision regarding the novelty of the story based on the content-based similarity values. 
         [0071]    Given a news video and a corresponding closed-caption text, the system may decode closed caption text as sentence streams, and identifies close caption segments, {CC], CC2,CC j, . . . , ccn}, based on sentence level topic detection. 
         [0072]    News video segments, {VS], VS 2 , VS 3 , . . . , vSn}, are subsequently determined by the time data embedded in CC-segments. By exploiting CC-data, each news video, which usually contains a small number of independent stories, is segmented in coherent units based on the topics. 
         [0073]    Once news video segments and corresponding CC-segments are identified, the is next step is to build index structures to support content-based news video retrieval in a real-time. Given a collection of CC-segments, {CC], CC 2 , CCj, . . . , ccn}, the system treats each segment as a document and creates a corresponding m×1 document-keyword matrix, D, where 1 is the number of distinct keywords of segments. In order to support sorted-access, for each keyword an inverted list is maintained &lt;i, Wjj&gt; where Wjj is the weight of keyword, tj , of CC-segment, CCj. This inverted index for this exemplary embodiment is maintained in descending order of weights for supporting sorted access. The overhead of creating and maintaining such sorted lists is low since this may be performed as an offline process and the sorted list for each keyword may be implemented using an efficient B+-tree index supported by most database systems, such as MySQL, PostgreSQL, and Berkeley DB. 
         [0074]    Given a collection of news video segments, {vs I, VSz, VSJ, ·. . ···, vSn}, the system then creates a video-table, V T(id, location, start_time, end_time}, where id is an identifier of news video (or CC-) segment, location corresponds to a location of news video file, and start_time and end_time represent the starting-time and the ending-time of news video segments respectively. A video-table, VT, is indexed using a B+-tree index on id for efficiently supporting random-access. 
         [0075]    The real-time nature of television news necessitates an efficient mechanism that enables to a system to locate the best news segments in a database that match a current news story which a user is watching through TV. One exemplary method is to compute the cosine similarity using CC-segments, and then recommend news video segments whose CC-segments have the top-k highest scores. As closed captions contain contextual cues about television program, they may be used in various applications, including video abstraction, segmentation and TV program trailer. Content information provided by closed captions may be exploited to identify related news stories in a database. It may be determined whether the incoming closed caption stream of the current news is sufficiently different from the previous streams to be marked as a new story. For example, if the incoming CC-stream is identified to introduce a new topic, this stream can be used as a topic boundary. Subsequently a current CC-segment, CCq, may be treated as a query and sent to the sever for retrieving related news video segments. Then, a new CC-segment, CCq; is created with the current incoming CC-stream. Alternatively, the system may incrementally update a current CC-segment, CCq, by adding the current CC-stream. The current CC-segment, CCq, will be used as a user query in the next phase. 
         [0076]    It is desirable to have an efficient method for processing top-k video retrievals with the cosine scoring function and CC-data. An exemplary approach may be to scan the vectors of the entire CC-segments in a database, compute the cosine similarity with a query CC-segments, and maintain only the k-best solutions. Alternatively, a second approach may take advantage of inverted files commonly used in IR systems. An inverted file index is an access structure containing all the distinct words that one can use for searching. 
         [0077]    Turning now to  FIG. 8 , a method of pricing a media segment  800  is shown. A user may find it desirable to purchase only a portion of a video program. The first step is to segment the video  810 . Segmentation can be done manually (based on the script that is used for a broadcast) or automatically as described previously. The output of this step will be a segmented program. This may permit a user to consecutively watch segments concerning ice hockey for example, while not watching content related to other topics. 
         [0078]    The second step of the invention takes the divided media segments and uploads such segments to a media server, where such segments may be purchased  820 . For example, the segments may be uploaded to a service provider such as HULU, Amazon, and/or the website of a particular broadcaster like CBS.com/TBS.com/BCC.com. The media segments would have DRM protection and could be purchased by using things such as a credit card, PayPal, micropayments, gift card, and the like. 
         [0079]    Alternatively, if the media segmentation is done on a user premises, rather than upload the segmented media, the metadata concerning the segments may be transmitted to a service provider. The service provider may then dynamically generate a price for the content based on the metadata and permit a user to access the content in response to a payment  830 . 
         [0080]    Different approaches for pricing the media segments can include, which can vary the price of the media segments upon different applications. The content provider may use a fixed price approach. The content provider may determine an optimal fixed price for a segment, or may fix the price depending on the length of the segment. For example, a 1 minute segment may cost 10 cents, where a 3 minute segment may cost 30 cents. 
         [0081]    The content provider may use base the price of a segment in response to past purchases of users. For example, more popular sports segments are priced higher than local news stories. In addition, a segment that has been purchased more often may be priced either higher or lower than a segment that has not been accessed often. 
         [0082]    The content provider may use the profile of users who will be accessing the content to determine the price of the segment. This approach takes into the actual profiles of the users who will be accessing content. For example, a user in California may pay more for a segment concerning California legislature than a user in Pennsylvania. Additionally, a user who access a large number of segments may pay a different price per segment than a user who infrequently accesses content. Thie user profile may be based on a generic profile that a user fills out or is generated from collected data, it is determined that the users accessing a particular website prefer sports programming over local news. The pricing or the segments for the sports programming would be priced differently than that of local programming. Likewiseif it is determined that a subtopic, for example actor, would be more popular across profiles, a segment involving a popular actor in a recent news story would be priced differently than an actor who is featured in a “where are they now” news segment. 
         [0083]    The content provider may use time value pricing so that the longer a segment exists, or the more related segments that are generated in a particular time, the price of the segment to decrease or increase. For example, a segment comporting to a football game this week is priced at 30 cents while the same segment next week decreases down to 22 cents. A linear or logarithmic decrease in price can be used. 
         [0084]    The content provider may use web based normalization to dynamically determine price. The pricing of a segment can be compared against other segments available on the internet which gauge the popularity of a particular segment against other sources. For example, the pricing can be based off of similar segments that are available through Youtube, where a content provider like CBS can run a mathematical model to determine against topic, length of time of a segment, how many hits such a segment has received. The more popular segments would be worth more than a less popular segments. 
         [0085]    The web based normalization technique may be supplemented with monitoring keyword tags from social networking sites like Facebook and Twitter. The more often a keyword is used, such as CBS and PET VIDEO, would indicate that a segment tagged with such information is worth more than CBS and POLITICAL SPEECH. Additionally, this normalization approach can use multiple sources for determining price and a statistical model can be built off these inputs.