Abstract:
Disclosed is a system for selective modification of transport data for enhanced video content. Video transport data is received in a video signal or an external source and a configurable processor uses criteria to selectively modify units of the video transport data. Disclosed criteria included a rule based pattern matching/replacement as well as criteria for denial, acceptance, or modification of particular units of video transport data. The modified video transport data stream created by the processor can be re-encoded in the video signal and provided to an external monitor.

Description:
RELATED SUBJECT MATTER  
         [0001]    Subject matter in this application may be used in conjunction with subject matter described in a disclosure entitled “A Method, Apparatus, And System for Overlapping Enhancement Control” which is attached hereto as Annex A and which is incorporated herein in its entirety by this reference.  
         FIELD  
         [0002]    Features in the disclosure relate generally to systems for interactive video and more particularly to integration of video with internet-based enhancements.  
         BACKGROUND  
         [0003]    An increasingly popular set of technologies for interactive video involves encoding Uniform Resource Locators (“URLs”) in a video signal that is distributed to viewers, for instance, via broadcast. A viewer with an integrated video receiver and HTTP client may then enjoy an interactive enhanced video production through an HTTP session based on the URLs encoded in the video production.  
           [0004]    A video production typically passes through several levels of a distribution hierarchy before being provided to the viewer. At each level, the entity typically has the right to control portions of the video production for enhanced video transport. For entities in the distribution hierarchy, and others such as broadcasters and viewers, it would be desirable for a means to exist that allowed for practical arrangements to be made to control enhanced video transport portions of the video production. It is possible to simply remove all enhanced video transport, however this precludes video enhancements and denies their benefits. It would also be beneficial for a tool to exist that allowed for the intelligent and selective modification of enhanced video transport data in a video production. Such an ability would allow entities in the video distribution hierarchy capability perform agreements respecting the content of the enhanced video transport and further prevent unauthorized distribution enhanced video transport.  
           [0005]    Conventional technology provides an inadequate degree of control over units of video transport data. Some existing devices, e.g. closed captioning encoders, are directed towards encoding an additional data program (closed caption information) to accompany a video program. Others have the ability to write a closed captioning data program from a first channel on a second channel. The existing devices provide no mechanism for selective modification of units of video transport data. A method of providing this type of control is highly desirable for entities in the distribution hierarchy and operators of server systems providing enhancements, for instance, because of the greater degree of control it could provide.  
           [0006]    The greater control server system operators have over URLs in the video program, the better able they are to provide desired interactive enhancing resources. At a minimum, it is desirable there be some coordination between the URL stream encoded in the video program and the server system operator. However, with conventional techniques, coordination can be difficult, and in some instances, impossible. With conventional techniques, there is, at a minimum, a time lag between the time of encoding the URLs and distribution to viewers (and the accompanying requests for enhancing resources). It would be desirable for a means to exist allowing server operators on-line and near real-time control over data for enhancing resources in a video production near the time of distribution to viewers.  
         SUMMARY  
         [0007]    In order to provide a solution to the forgoing and additional problems, aspects the present invention provide a method and system for video enhancement transport alteration.  
           [0008]    One aspect of the invention are computer-controlled methods for selectively encoding video transport data. An illustrative method includes receiving a video signal and a video transport data stream. The video transport data stream is selectively modified forming a modified video transport data stream. The modified video transport data stream is combined with the video signal, forming an output video signal. The output video signal is provided, where it can undergo later use. In a variation, the video transport data stream is encoded in the video signal. Yet another variation involves receiving the stream of enhanced video transport data across a data network from a remote source; the data network could include a portion of the internet. In yet another variation, selectively modifying the video transport data stream includes detecting a first video transport data unit. A rule with a condition portion and an action portion is examined for determining whether the first video transport data unit satisfies the condition portion. The action portion executes for modifying the video transport data stream when the condition matches. The first video transport data unit can include a URL, an attribute associated with a URL, ATVEF Transport B data, or other data associated with the video signal.  
           [0009]    Actions that could be taken by a rule include, for instance, allowing the first video transport data unit to be encoded in the modified video transport data stream, preventing the first video transport data unit from being encoded in the modified enhanced video transport data stream, encoding a second video transport data unit in lieu of the first video transport data unit, or generating a notification of the encoded or modified video transport data stream.  
           [0010]    In another variation, the video signal also includes closed captioning information. In this instance, a further feature includes extracting the closed caption information and the video transport data stream from the video signal and reencoding the closed caption information in the video signal in near real-time for retaining synchronization of the closed caption information and the video signal.  
           [0011]    The video signal can include a vertical blanking interval and the video transport data be encoded in the vertical blanking interval. The video signal could be, for instance, encoded in an MPEG format, a Serial Digital Video format, as a Synchronized Multimedia Integration Language presentation, or as a streaming media type. Also, the modified video transport data stream could be provided to a remote monitoring client system.  
           [0012]    In another variation, selectively modifying the video transport data stream includes inserting an identifier of a video program enhancement. Then, in this variation, the video signal is received at a plurality of receiver locations and the identifier detected. This variation could also include receiving information from the one or more of the receiver locations detecting the identifier and preparing summary information regarding the video program enhancement based on the information. The information could be supplemented by information received by an enhancing resource server system receiving requests for enhancements. The summary information could also be based on this.  
           [0013]    Yet another aspect of the invention are systems for video enhancement transport alteration. An illustrative system includes an input for receiving a video transport data stream and an encoder for encoding a modified video transport data stream in an output video signal. This system also includes a video transport data modification processor. It is operatively coupled with the encoder, and the input, and is configured for receiving a video transport data stream from the input. The video transport data modification processor selectively modifies the enhanced video transport data stream for creating the modified video transport data stream, and provides the modified video transport data stream to the encoder.  
           [0014]    In a variation, this system further includes a decoder for receiving an input video signal where the input video signal includes a video transport data stream and the decoder is configured for extracting the video transport data stream. In another variation, the video transport data modification processor includes a set of rules (having a condition portion and an action portion) and a pattern matching module. The pattern matching module identifies whether a video transport data unit in the enhanced video transport data stream matches the condition portions of members of the set of rules. The video transport data unit could include, for instance, a URL, an attribute of a URL or ATVEF Transport B data.  
           [0015]    Yet another aspect of this system involves the encoder encoding identifiers of a video program enhancement. This system also includes a receiver network where the receiver network is configured for detecting the predetermined identifiers in a broadcast of the output video signal. This system could also include a server system configured for receiving a requests for a resource associated with an identifier in the modified video transport data stream, where the request includes one of the identifiers. An additional aspect of this system could include a data processing system for generating summary reports responsive to receiving the identifiers—either from just the output video signal or the output video signal and the received requests.  
           [0016]    Another variation on the illustrative system involves adding a computer system configured for providing an video transport data stream to the input across a data network. In another variation, an output is added for providing the enhanced video transport data stream to a data network; and a monitoring computer system configured for receiving the modified video transport data stream across the data network is also added.  
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0017]    These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:  
         [0018]    [0018]FIG. 1 depicts an enhanced video distribution hierarchy in which embodiments of the invention could be beneficially employed;  
         [0019]    [0019]FIG. 2 depicts an operational process flow diagram; and  
         [0020]    [0020]FIG. 3 depicts concurrent handling of closed captioning data in connection with translation of the video transport data stream. 
     
    
     DETAILED DESCRIPTION  
       [0021]    Operating Environment  
         [0022]    Features of the invention operate in connection with systems for video having associated enhancing resources. In some embodiments, the enhancing resources (the term “enhancement” is used interchangeably herein) are provided through an internet-based response network. The viewer (client) side of the response network typically involves a device that incorporates a television receiver with a Hypertext Transfer Protocol (“HTTP”) client (or “web browser”) and logic for rendering a video image incorporating both a telecast and enhancing resources received by the HTTP client. Many such devices are commercially available.  
         [0023]    Given its current ubiquity, the most common form of enhanced video is enhanced television. One standard for the transport of data for enhancing resources has been promulgated by the Advanced Television Enhancement Forum (“ATVEF”) of El Dorado Springs, Colo. See Enhanced Content Specification, Advanced Television Enhancement Forum (the “ATVEF Specification”). It is contemplated that enhanced video transmitted over networks using the Internet Protocol will grow in popularity, and features of the invention could be implemented in such an environment.  
         [0024]    The ATVEF Specification defines two mechanisms for the transport of data for enhancing resources in connection with a video signal. The first mechanism (“ATVEF Transport A”) involves the transport of real-time triggers which include a Uniform Resource Locator (“URL”), optional Attribute-Value pairs, and an optional checksum. The second mechanism (“ATVEF Transport B”) involves the delivery of both triggers and enhancing resource data as part of the video signal. ATVEF Transport A is for delivery of triggers by a forward path and the pulling of data by a return path (typically a portion of the Internet). ATVEF Transport B is for delivery of triggers and data by the forward path where the return path is optional.  
         [0025]    Illustrative embodiments of the invention operate in connection with video productions including transport data for enhanced content (“video transport data”). In some embodiments, video transport data is conforming to the ATVEF Specification—either ATVEF Transport A or ATVEF Transport B could be used.  
         [0026]    Depending on the transport mechanism, the meaningful video transport data unit may vary. In some embodiments it could be a trigger, in others a packet, in others delimited by start/stop indicators, in others a predetermined number of bits, and in still others based on time unit. A collection of successive video transport data units forms a video transport data stream.  
         [0027]    Description of Figures  
         [0028]    [0028]FIG. 1 depicts an enhanced video distribution hierarchy in which embodiments of the invention could be beneficially employed. Conventionally, a video production passes through the control several entities between creation and actual viewing. Each of these entities may desire to encode a video transport data stream in the video production. Moreover, each may desire to modify the video transport data stream previously encoded in the video production.  
         [0029]    A video production developer or producer  1200  may initially encode a first video transport data stream  1100  at creation-time of the video production. When the video production moves down the distribution hierarchy, programming networks  1300  desire a second video transport data stream  1110  be encoded with the video production. The second video transport data stream  1100  could include modifications to the first video transport data stream  1100 , additional video transport data, or deletions of selected portions of the first video transport data stream  1100 .  
         [0030]    From the programming networks  1200  the video production continues along the distribution hierarchy to a distribution point  1400 . The distribution point  1400  represents a last controlling entity before the video production reaches the viewer&#39;s premises equipment  1500 . The distribution point  1400 , too, may desire that a third video transport data stream  1200  be encoded with the video production. The third video transport data stream  1120  could be a modification of the previously-encoded video transport data stream, include additional video transport data, or delete previously-encoded video transport data.  
         [0031]    As depicted in FIG. 1, the developer or producer  1200  and the programming networks  1300  are upstream from the distribution point  1400 . The particular entities and arrangement of the distribution hierarchy is not fundamental. Rather, a greater or lesser number of entities could exist. Further, features of the invention are not limited to operation in the context of a distribution hierarchy.  
         [0032]    Embodiments of the invention could be used at any level of the distribution hierarchy, although particular benefits are obtained through use at or near the distribution point  1400 . One illustrative embodiment involves an enhancing resource server system operator employing features of the invention at the distribution point  1400 . In this embodiment, the operator could, on behalf of some or all upstream entities in the distribution hierarchy, manage the encoding video transport data. This frees the upstream entities from having to attend to encoding video transport data and provides the server system operator greater flexibility.  
         [0033]    Still further, localization can be provided that would be impractical with conventional techniques. For instance, the programming networks  1200  can provide a generic video transport data stream which, at the distribution point  1400  in localities, can be translated to provide localized enhancing resources. For instance, a national advertiser could arrange for an advertisement to be run on a nationwide broadcast. The programming networks  1200  encode the generic video transport data stream. At the distribution point  1400  of each local affiliate of the programming network, the generic video transport data stream is transformed to provide, for instance, information related to the local outlets of the national advertiser.  
         [0034]    [0034]FIG. 2 depicts an operational process flow diagram in an illustrative embodiment. Process flow initiates where a input video signal  2010  is received by a decoder  2020 . The input video signal  2010  typically includes a video transport data stream encoded along with video data. This is not particularly important, however, and the input video signal  2010  could have no video transport data. When present, the video transport data stream need not be continuous throughout an entire video production and, rather, may start and stop a number of times.  
         [0035]    The decoder  2020  decodes the video transport data stream from the input video signal  2010  when present. In some embodiments, the video transport data stream is encoded in line 21 channel 1 of the vertical blanking intervals of an NTSC television signal in accordance with Electronics Industry Association standards. See EIA-608, Recommended Practice for Line 21 Data Service; EIA-746A Proposal for Sending URLs over EIA 608 T2. Norpak TES encoder/decoders (Norpak Corporation, Kanata Ontario, Canada) and Text Grabber (SunBelt Industries Technologies Group, Inc., Jacksonville, Fla.) are suitable devices for VBI decoding.  
         [0036]    In some embodiments, other video signal formats could be used if the video transport data stream is suitably encoded in the video signal. Suitable formats include, for instance, MPEG-based formats, a Serial Digital Video format, streaming video formats, PAL or SECAM, high definition television formats. It is contemplated that other formats could be used as well. Generally, whatever the format of the input video signal  2010 , the decoder  2020  should have the ability to decode the video transport data stream when encoded therein. The decoder  2020  outputs the video transport data stream to an enhanced video (“EV”) transport processor  2050  (described below) and outputs the input video signal to a encoder  2090  (also described below).  
         [0037]    A remote transport data source  2040  may also supply the video transport data stream across a first data network  2030 . In some embodiments, the remote transport data source  2040  is a general purpose computer and the first data network  2030  includes a portion of the internet. Other hardware/software platforms available to one skilled in the field could be used for the remote transport data source  2040 . Further the first data network  2030  could be either a public or private network, and use either the TCP/IP protocol suite or other protocols.  
         [0038]    Central to process flow is the EV transport processor  2050 . The EV transport processor  2050  receives the video transport data stream, for instance from the decoder  2020  or the remote transport data source  2040 . The EV transport processor  2050  includes software executing on hardware for altering the video transport data stream to create a modified video transport data stream for encoding in the input video signal  2010  to form an output video signal  2110 . In some embodiments, the EV transport processor  2050  is implemented as a collection of JAVA classes and operates in a Solaris operating environment on workstations from SUN Microsystems, although the platform-independence of JAVA allows flexibility with respect to operating environment. In other embodiments, the ETV transport processor  2050  could be implemented in a special-purpose hardware environment. It could be integrated in the same hardware platform as an encoder, a decoder, or both.  
         [0039]    An application properties file  2060  includes global information about the runtime properties of the EV transport processor  2050 . An encoder/decoder properties file  2080  includes information about the decoder  2020  and the encoder  2090  to be used in connection with transport translation. The information is for configuring the input and output streams of the encoder and decoder (respectively). The configuration format and values will typically vary with the particular decoder  2020  and encoder  2090  used. A conventional JAVA properties file could be used for application properties file  2060  and/or the encoder/decoder properties file  2080 .  
         [0040]    The EV transport processor  2050  also operates with a collection of filter rules  2070 . The filter rules determine which video transport data units in the video transport data stream are altered in creating the modified video transport data stream. Members of the set of filter rules  2070  are generally of the form that if one or more conditions are satisfied, then an action is taken with respect to a unit of the video transport data stream. In an illustrative embodiment, a condition is specified by a regular expression to which the unit of the video transport data stream matches. In this embodiment, actions available include:  
         [0041]    (a) translating a unit matching a regular expression pattern into a string defined by a target pattern;  
         [0042]    (b) allowing only those units of the video transport data stream matching the regular expression to be re-encoded to form the modified video transport data stream; and  
         [0043]    (c) allowing all but those units of the video transport data stream matching the regular expression to be re-encoded to form the modified video transport data stream.  
         [0044]    Using conventional Perl regular expression syntax, see e.g., Jeffrey E. F. Friedl, Mastering Regular Expressions (O&#39;Reilly &amp; Assoc. 1997), in this illustrative embodiment, lines of the collection of filter rules should match to one of the following expressions:  
                                                                                           Expression   Indication                       {circumflex over ( )}\s*(/.+|.+)\s*$   Tag           {circumflex over ( )}\s*\&lt;.+\&gt;\s*$   Begin Tag           {circumflex over ( )}\s*\&lt;/.+\\s*$   End Tag           {circumflex over ( )}((\s*(//|#).*\s*) || (\s*))$   Comment           {circumflex over ( )}\s*(allow|allowonly|allowgroup)\s+“.+”\s*$   Allow           {circumflex over ( )}\s*translate\s+\“.+\”\s+to\s+\“.+\”\s*$   Translate           {circumflex over ( )}\s*(musthave|always|mandatory)\s+“.+”\s*$   Must have           {circumflex over ( )}\s*(mustnothave|never|forbidden)\s+“.+”\s*$   Must not have                        The general form of filter rules in this embodiment is:                version #           &lt;trigger&gt;                [ translate “RE” to “literal” ] . . .           [ (musthave | always | mandatory) “RE” ] . . .           [ (mustnothave | never | forbidden) “RE” ] . . .           [ (allow | allowonly | allowgroup) “RE” ] . . .                &lt;/trigger&gt; . . .                      
 
         [0045]    Notationally, “RE” and “literal” are placeholders for a regular express, and a string literal, respectively. Elements with a trailing ellipsis ( . . . ), can occur any number of times. The angle-bracket tags are scope tags. The particular embodiment identified above indicates scope with “trigger” which in this instance, refers to an ATVEF trigger. The parentheses and alteration, e.g., (x|y|z), have their ordinary meaning with respect to scope. See Friedl. The semantics could vary and any number of scope identifiers could be used. “translate” “musthave” “always” “mandatory” “mustnothave” “never” “forbidden” are reserved keywords having their ordinary meaning.  
         [0046]    It is not particularly fundamental that regular expressions be used, or that translations expand directly to a literal. One skilled in the art having the benefit of this disclosure will appreciate many possible variations on the above illustrative filter rule format also within the scope and spirit of the present invention. Further, the above syntax is merely illustrative; many others could be used. In some embodiments, the condition portion could have multiple components, could be based on scoring. In other embodiments, the condition portion could be based on date and/or time criteria: for instance all enhanced video transport data could be filtered out during a particular time window or all enhanced video transport data could be left unmodified during a particular time window. More generally, other mechanisms available to one skilled in the art could be also used for controlling selective modification of the video transport data stream.  
         [0047]    By way of illustration, in connection with the above illustrative embodiment, several examples are provided below:  
         [0048]    Example (1) allow example:  
         [0049]    &lt;trigger&gt; 
         [0050]    allowonly “^ .*\.respondtv\.com” 
         [0051]    allowonly “^ .*\.weather\.com” 
         [0052]    &lt;/trigger&gt; 
         [0053]    This filter rule denies all triggers except for those explicitly allowed. The result is that only respondtv.com and weather.com will be allowed; all others are rejected.  
         [0054]    Example (2) deny example:  
         [0055]    &lt;trigger&gt; 
         [0056]    never “^ .*\.msnbc\.com” 
         [0057]    never “^ .*\.weather\.com” 
         [0058]    &lt;/trigger&gt; 
         [0059]    This trigger filter allows all triggers except those explicitly denied. The result is that msnbc.com and weather.com are denied; all others are allowed.  
         [0060]    Example (3) Enforced presence example  
         [0061]    &lt;trigger&gt; 
         [0062]    musthave “http://” 
         [0063]    always “\.com” 
         [0064]    mandatory “v:t” 
         [0065]    &lt;/trigger&gt; 
         [0066]    This trigger filter use the synonyms musthave, always, and mandatory. The result is that triggers must contain http://, .com, v:t. All others are denied.  
         [0067]    Example (4) Translation example.  
         [0068]    &lt;trigger&gt; 
         [0069]    translate “itv.weather.com.*&gt;” to “etv.respondtv.com/c/bloomberg05/&gt;” 
         [0070]    &lt;/trigger&gt; 
         [0071]    This trigger filter will translate portions of URLs from itv.weather.com to etv.respondtv.com. The result is that URLs containing itv.weather.com will be replaced with etv.respondtv.com/c/bloomberg05/.  
         [0072]    Example (5) Insertion example.  
         [0073]    &lt;trigger&gt; 
         [0074]    translate “&gt;” to “&gt;[nid:1234]” 
         [0075]    &lt;/trigger&gt; 
         [0076]    This trigger filter will insert attribute after a URL (ending in &gt;) in a trigger. The result is that a network identifier (nid:1234) attribute is inserted after the URL.  
         [0077]    No particular order of evaluation of filter rules is required. Evaluation order can vary. In some embodiments, rule evaluation takes place in the order of the general filter above, i.e., (1) translations (2) ‘musthaves’ (3) ‘mustnothaves’, and (4) ‘allowonlys’. Conveniently when any filter rule denies a particular regular expression, remaining rules need not be evaulated. Further, ‘allowonly’ filter rules could be grouped and evaluated as a group. If no regular expression of the ‘allowonly’ group is matched, then the data unit may be discarded.  
         [0078]    In some circumstances, e.g. ATVEF transport A, units of the video transport data may include a checksum. In some embodiments when an invalid checksum is detected the associated unit of video transport data is discarded. When modifying units of video transport data that have an associated checksum, the checksum is modified to appropriately reflect the modified video transport data.  
         [0079]    When processing the video transport data stream, the EV transport processor  2050  generates logs. An input log  2180  records the unmodified video transport data stream. An output log  2200  records the modified video transport data stream. An activity log  2190  records arrival of video transport data as well as the alterations performed to the modified video transport data stream though operation of the filter rules.  
         [0080]    The EV transport processor  2050  outputs the modified video transport data stream to the encoder  2090 . The encoder  2090  creates an output video signal  2110  by encoding the modified video transport data stream in the input video signal  2010 . In some embodiments, the encoder  2090  and the decoder  2020  are integrated in the same hardware unit.  
         [0081]    The EV transport processor  2050  can also provide an output of the modified video transport data stream to a network device. A remote monitor  2110  may then be used to monitor the modified video transport data stream from across a second data network  2100 . The first data network  2030  and the second data network  2100  may be interconnected and could be the same network. In some embodiments, the remote monitor  2110  can retrieve the input log  2180 , the activity log  2190 , and/or the output log  2200 .  
         [0082]    Still further, in some embodiments the EV transport processor  2050  output units of video transport data to achieve a desired presentation. For instance, when a unit of video transport data includes an ATVEF Transport A trigger, it can be expected that some of the current generation of user-agents will present the URL in the trigger on the viewer&#39;s display upon receipt of the trigger. Some of the current generation of user-agents have a 32 character horizontal display. To present URLs in a form more conducive to presentation in such environments, in some embodiments the EV transport processor  2050  encodes non-printing characters in URLs to force the URL to wrap to such  32  character displays. This achieves a displayed presentation of the trigger URL to viewers with user-agents of the above-mentioned type with a more “user-friendly” presentation.  
         [0083]    Features of the invention are not limited to operation with one video transport data stream or one video signal. In some embodiments, the EV transport processor  2050  could receive more than one video transport data stream and/or more than one video signal. For instance, plural video signals could be simultaneously processed with an EV transport processor  2050 . Further, plural channels in a single video signal could be simultaneously processed with one EV transport processor  2050 ; additionally, each of the plural channels could be received as a separate video signal and the plural video signals processed simultaneously as mentioned above. Each of plural video signals (or channels in a single video signal) could have a corresponding video transport data stream encoded within. Further, a single video transport data stream could be received by the EV transport processor  2050  for processing and then be encoded in plural output video signals. Still further, the video transport data streams could be combined and encoded in one (or more) output video signal. The examples given are illustrative, one skilled in the art having the benefit of this disclosure will appreciate modifications, permutations, and adaptations of the examples and these are also within the scope and spirit of the present invention.  
         [0084]    [0084]FIG. 3 depicts concurrent handling of closed captioning data in connection with translation of the video transport data stream in an illustrative embodiment. As noted above, in some embodiments, the video transport data stream is encoded in the vertical blanking interval of an NTSC video signal. Closed captioning information is also commonly encoded in the vertical blanking interval. Certain encoder/decoders operate in a manner such that all data in the vertical blanking interval is rewritten. When a video signal has both closed captioning (“CC”) and video transport data, processing of the video transport data could introduce latency which would destroy synchronization between the underlying video images and the CC data accompanying those images.  
         [0085]    Concurrent handling of both CC data and video transport data is accomplished as shown in connection with FIG. 3. Illustratively, the input video signal  2010  is shown as being made up of several “frames,” i.e., time-based elements. As shown in FIG. 3, the input video signal  2010  includes CC data and video transport data indexed by the same time element as the frame with which they are associated. For instance, Frame 2, CC2, EV 2. Notationally, when discussing FIG. 3, reference will be made to, for instance, CC1 or EV4, to indicate the frame of the input video signal  2010  from which the CC or EV data was extracted.  
         [0086]    Process flow initiates where the decoder  2020  (not shown) extracts CC1 and EV1  3010 . The EV transport processor  2050  promptly writes EV1  3015  to the input log  2180 . The EV transport processor  2050  then writes CC1  3020  to the output video signal  2110  and to the output log  2200 . The EV processor  2050  then enqueues  3030  EV1 in a queue  3035 .  
         [0087]    The EV processor  2050  dequeues video transport data from the queue  3035 . Next the collection of filter rules  2070  are applied to EV1 in a process transport step  3050 . The EV transport processor  2050  then encodes EV1  3060  (possibly modified by the filter rules) into the output video signal  2110 . It will be appreciated that, as illustrated in FIG. 3, EV1 is encoded in Frame 3 of the output video signal  2110 , reflecting that passage of time in the queue  3035  and during the process transport step  3050 . The output log  2200  records the modified video transport data stream and the activity log  2190  records the alteration affected in connection with the process transport step  3050 .  
         [0088]    One particularly beneficial application of the present invention enables the monitoring of the distribution of enhancing resources in connection with a video production. As noted above in connection with FIG. 1, a video production may pass through the control of several entities before ultimate distribution. At each point in the distribution hierarchy, the controlling entity has the opportunity to alter the video transport data. These alterations may not be authorized in all instances and it would be desirable for a system to exist that allowed for the monitoring of unauthorized alteration of video transport data. Still further certain entities, for instance, advertisers, typically pay broadcasters to provide their content (video and/or enhancing resources) to consumers. It would be desirable for such entities to have means to monitor the actual distribution to consumers of video transport data for the enhancements.  
         [0089]    An application of the present invention can provide these features. Returning to FIG. 2, a network of receivers  2130  can be placed at the end of the distribution hierarchy  2120 . The receivers  2130  monitor the modified video transport data stream and log the video transport data. The receivers  2130  could be placed around in any geographic regions of interest.  
         [0090]    The EV transport processor  2050  is used on behalf of, for instance, an advertiser to include identifiers in the modified video transport data stream. The identifiers could be of a particular video program, of enhancements desired to accompany the video program. The identifiers could be encoded, for instance, as attributes to ATVEF Transport A URLs, as ATVEF Transport B data, or in other formats. The receivers  2130  monitor the output video signal  2110  at the time of distribution, e.g. broadcast. The receivers  2130  detect and log the presence of the identifiers (or implicitly detect their absence). The log data is then provided to generate report data  2170  of the distribution of the advertiser&#39;s video program and/or accompanying enhancements.  
         [0091]    The above-described application can provide still further beneficial information. In addition to the receivers  2130  the output video signal is received by enhanced video equipment at users&#39; premises  2140 . When the user requests enhancing resources, requests are submitted to an enhancing resource server system  2160  across a response network  2150 . The requests received by the enhancing resource server system  2160  can also be used to create the report data  2170 . Thus it will be appreciated that the receivers  2130  contribute information about the distribution of enhancements, while the enhancing resource server system  2160  contributes information about the actual requests for the enhancing resources that are made.  
         [0092]    Yet another application of the present invention can be found in connection with the invention entitled “Method, Apparatus and System for Overlapping Enhancement Control” filed concurrently herewith by attachment hereto. In some embodiments, operation in connection with overlapping enhancement control is achieved as follows. The EV transport processor  2050  creates a modified video transport data stream that includes ATVEF triggers. The trigger URLs in the triggers are the same. The EV transport processor  2050  also creates a LOAD directive in the SCRIPT field of the triggers in the modified video transport data stream. The URL attribute of the LOAD directive is to a next (in time) enhancing resource.  
         [0093]    Although the present invention has been described in terms of features illustrative embodiments, one skilled in the art will understand that various modifications and alterations may be made without departing from the scope of the invention. Accordingly, the scope of the invention is not to be limited to the particular embodiments discussed herein, but should be defined only by the allowed claims and equivalents thereof.