Source: https://patents.google.com/patent/CA2818757A1/en
Timestamp: 2019-12-12 04:47:24
Document Index: 342247354

Matched Legal Cases: ['application no. 61', 'arty 104', 'arty 104', 'arty 104', 'arty 104', 'arty 104', 'arty 104']

CA2818757A1 - Tracking user interaction from a receiving device - Google Patents
CA2818757A1
CA2818757A1 CA2818757A CA2818757A CA2818757A1 CA 2818757 A1 CA2818757 A1 CA 2818757A1 CA 2818757 A CA2818757 A CA 2818757A CA 2818757 A CA2818757 A CA 2818757A CA 2818757 A1 CA2818757 A1 CA 2818757A1
CA2818757A
2011-11-22 Priority to PCT/US2011/061773 priority patent/WO2012071377A1/en
2012-05-31 Publication of CA2818757A1 publication Critical patent/CA2818757A1/en
239000011159 matrix materials Substances 0 abstract claims description 108
230000002123 temporal effects Effects 0 abstract claims description 38
This Patent Cooperation Treaty patent application claims priority to United States application no. 61/417,076, filed November 24,2010, entitled "Tracking User Interaction From a Receiving Device", the contents of which are incorporated herein by reference, in their entirety TECHNICAL FIELD
2 Generally, embodiments discussed herein permit tracking user interaction with a television receiver, such as a set-top box, cable box, or other electronic device appropriately configured to receive, decode and display audiovisual information. For example, certain embodiments may be configured to track user interaction with a computing device, such as a desktop computer, laptop computer, tablet device, mobile telephone, personal digital assistant and the like. Further, embodiments discussed herein may generally distinguish between user interactions at different points in time and track the time of the various interactions. Such tracking may be accomplished through the use of a matrix code displayed on a display device along with audiovisual content; the matrix code may be captured by a reader device that processes the matrix code to retrieve data embedded therein. The data may be transmitted from the receiving device to a monitoring party who, in turn, may process the data to track user interaction, audience participation, the time at which audiovisual content was viewed and/or stored, and the like.
Certain embodiments may receive an information code as part of, or along with, audiovisual content. The information code may be a two-dimensional code (also referred to as a "matrix barcode") containing various data regarding the audiovisual content, content provider, content recipient, time of transmission, and the like. The information code may be integrated with the audiovisual content or may be sent separately. If integrated, the code is typically part of the video or graphical portion of the content. If sent separately, it may be transmitted as metadata or in a separate data stream associated with the audiovisual content. As one example, if the audiovisual content is transmitted across a satellite network to a set-top box, the information code may be transmitted in a stream having packets tagged with a packet identifier (P ID) that indicates the stream and its contents are associated with the audiovisual content. The stream carrying the information code may carry additional data or may be dedicated to the code.
One embodiment may take the form of a method for audience metering, including the operations of: receiving audiovisual content; receiving data relating to the audiovisual content; determining a time; creating an electronic construct from the data relating to the audiovisual content and the time; and displaying the electronic construct with the audiovisual content.
3 Another embodiment may take the form of a method for tracking a time at which audiovisual content is viewed, including the operations of: receiving the audiovisual content; receiving data related to the audiovisual content;
storing the audiovisual content; receiving a command to play the stored audiovisual content; in response to the command, determining a time; and generating an electronic construct containing a data set, the data set including the data related to the audiovisual content and the time; wherein at least one of the electronic construct and the data set is used by a monitoring party to determine the time at which the audiovisual content is replayed.
Fig. 1 depicts a sample embodiment in a sample operating environment.
Fig. 2 is a flowchart depicting a sample method of operation for generating, capturing and processing a matrix code in order to measure audience metrics and/or participation.
4 I. Introduction Generally, embodiments discussed herein permit tracking user interaction with a television receiver, such as a set-top box, cable box, or other electronic device appropriately configured to receive, decode and display audiovisual information. For example, certain embodiments may be configured to track user interaction with a computing device, such as a desktop computer, laptop computer, tablet device, mobile telephone, personal digital assistant and the like. Further, embodiments discussed herein may generally distinguish between user interactions at different points in time and track the time of the various interactions.
Typically, the code may be overlaid on the video portion of audiovisual content by the television receiver, so that it is displayed in a portion of a display screen associated with the television receiver. Thus, if the receiver obtains the two-dimensional (or "matrix") code in a dedicated PID, it may overlay that code on the video prior to transmitting it to a display. Likewise, if the television receiver obtains metadata or other information from which it may construct a matrix code, the constructed matrix code may be overlaid on video that is then sent to an associated display device.
In several embodiments, the matrix code may contain time and/or date information ("temporal data"). This may be included in the video transmission, as metadata or retrieved by the television receiver and inserted into the matrix code.
Typically, although not necessarily, the temporal data includes the date/time on which the audiovisual content was transmitted to the television receiver, the date/time on which the audiovisual content was played by the television receiver, or
5 both. These dates and times may be different, for example, when the television receiver stores the audiovisual content on a storage device such as a hard drive. In such an instance, the temporal data for the transmission of the content may be stored with the content, while temporal data for playback of the content may be added to the matrix code by the television receiver upon playback.
Matrix codes containing temporal data may be used for a variety of purposes, many of which are described herein in more detail. Temporal data may be used to track or limit the timing of voting or audience interaction. As one example, a matrix code may be shown on a display screen during an audience participation segment of an audiovisual program. Watchers may capture an image of the matrix code with a smart phone, digital camera and the like ("reader device") and transmit it across a network to a recipient. The recipient, in turn, may process the matrix code in order to facilitate audience participation.
As one example, many television shows permit a watcher to vote for a favorite television actor, dancer, and the like. A unique matrix code may be presented to viewers for each voting option. The viewer may capture the matrix code corresponding to their desired vote with an appropriately-configured reader device.
The matrix code may contain not only the voting information, such as a name or other designation of the person for whom the viewer is voting, but also instructions that may be interpreted by the reader device; such instructions may order the reader device to access a certain web site, Internet location and the like and record the viewer's vote. Alternately, the instructions may facilitate the reader device transmitting the vote through a telephone network, perhaps as a SMS or other text message. Ultimately, data included in the matrix code may be transmitted to a monitoring party who may use that data to study audience participation, voting, viewing habits and so forth. The temporal data in the matrix code may be used by the monitoring party to determine when an audience member watched the audiovisual content, when the audience member replayed the audiovisual content, when the audience member captured an image of the matrix code, and the like.
6 some embodiments, the matrix code itself may be relayed by the reader device to the monitoring party.
II. System Overview Figure 1 is a block diagram illustrating a system 100 for facilitating user participation with audiovisual content through use of a matrix code. The system 100 may include a television receiver 101 (which may be any kind of appropriately-configured electronic device such as a television, a television receiver, a digital video recorder, a digital video disc player, a computing device, a mobile telephone, a video game system, and so on), at least one display device 102 (which may be any kind of display device such as a cathode ray tube display, a liquid crystal display, a television, a computer monitor, and so on), and a reader device 103 (which may be any kind of device capable of detecting and decoding a matrix code such as a telephone equipped with a camera, a mobile computing device that includes a camera, and so on). The system may also include a monitoring party 104.
The television receiver 101 may receive data across a network from a content provider; the content provider may be the same as the monitoring party 104 in certain embodiments. The receiver 101 may include one or more processing units 105, one or more one or more non-transitory storage media 106 (which may take the form of, but is not limited to, a magnetic storage medium; optical storage medium;
magneto-optical storage medium; random access memory; erasable programmable memory; flash memory; and so on), and one or more output components 107. The storage medium 106 may store audiovisual content that is received by the television receiver 101 for review at a later time. (The receiver may include various elements, components, hardware and the like that permit it to receive transmitted content, process that content and display it; such components are not shown for purposes of simplicity.) Additionally, although the display device 102 is illustrated as separate from the television receiver, it is understood that in various implementations the display device may be incorporated into the television receiver. The processing unit of the television receiver may execute instructions stored in the non-transitory storage medium to derive information specific to the television receiver that relates to operation of the television receiver, dynamically generate one or more matrix codes (such as one or more OR codes) that include the information specific to the
7 television receiver as well as temporal data related to the date and/or time on which audiovisual content was received and/or played back, and transmit the dynamically generated matrix code to the display device utilizing the output component.
Such instructions may take the form of a matrix code module that may be executed by the processor to perform the foregoing functions. Alternately, the matrix code module may be implemented in hardware or firmware.
The reader device may include one or more processing units 109 which execute instructions stored in one or more non-transitory storage media 111 in order to perform the above described functions. The reader device may also include an optical input device 110 (such as a camera, a barcode scanner, and so on) for detecting the matrix code displayed In some implementations, the television receiver 101 may dynamically generate the matrix codes upon a viewer (e.g., user) viewing audiovisual content either in a live fashion or during playback from a storage device. Matrix codes may be generated from metadata or
8 101 may use such data to create the matrix code and overlay it on a video stream prior to transmitting the video stream to the display device. In this manner, a viewer perceives the matrix code generated by the television receiver as part of the audiovisual content experience. If the television receiver 101 creates the matrix code, it may include temporal data therein.
Alternatively, the television receiver 101 may transmit the one or more matrix codes by themselves to the display device 102 via the output component 107 for the display device to display only the one or more matrix codes when the audiovisual content is selected for viewing.
III. Audience Metering and Participation A time encoded matrix code may be useful for audience metering and/or participation. Such matrix codes may be used when voting (for example, for a contestant on a reality show), as an indication of support for a particular measure or point of view (for example, during debates on news channels), when selecting from among competing products (for example, during competitive advertising soliciting viewer feedback) and in many other instances.
As a general example, consider a reality show that permits viewers to vote for or otherwise support contestants. Rather than calling a telephone number or sending a text message, embodiments discussed herein may permit audience participation by displaying a matrix code that may be captured by a viewer.
The matrix code may instruct the receiving device to transmit data included in the code to a monitoring party for registration as a vote for a particular contestant.
In one embodiment, a number of different matrix codes may be shown during display of audiovisual content, each of which may contain different data. In the reality show voting example, the matrix code data may encode the name of each contestant. At different intervals during the audiovisual content, a matrix code encoding the name of each contestant may be shown. A viewer may capture the matrix code associated with the contestant the viewer desires to support. The data therein may be transmitted to the monitoring party by the reader device 103 and registered as a vote for the particular contestant.
Alternately, the matrix codes may omit any information identifying a particular contestant (or option, choice, participation information and the like).
9 series of matrix codes may be displayed, each varying from the other codes by having different temporal data encoded therein. For example, a matrix code may encode the time at which it is displayed on the screen. The matrix code may be overlaid, integrated with or otherwise displayed with audiovisual content that identifies a particular option for which an audience member may vote. The member may capture the matrix code with a reader device 103 as previously described, and transmit the data in the code to the monitoring party 104. Since the monitoring party receives the temporal data indicating when the matrix code was displayed and/or captured, it needs only match the timestamp of the temporal data to a window of time during which an option was displayed. Each option may have a different window of time associated with it, which generally reflects the time during which the corresponding matrix code was displayed. Accordingly, if the time the matrix code was captured is known, the option supported by the viewer may be determined.
Fig. 2 is a flowchart depicting a sample method of operation for generating, capturing and processing a matrix code in order to measure audience metrics and/or participation. It should be appreciated that the flowchart of Fig. 2 is an overview of a general method in which individual operations may be performed by different entities or elements. In the instant flowchart, operations 205 ¨ 225 are typically performed by the television receiver 101, operation 230-235 are typically performed by the reader device 103 and operations 240-245 are typically performed by the monitoring party 104. The activities of multiple entities or elements are shown in a single flowchart to provide an overview of the method that is generalized and easy to follow.
In operation 215, the television receiver may generate a matrix code from the data received in operation 205 and the temporal data retrieved in operation 210.
Thus, the matrix code typically includes the temporal data although in some embodiments it may be omitted. It may also include data identifying the audiovisual content and/or a viewer/user/receiver (such as a receiver number or subscriber number). In some embodiments, geographic data identifying a region or area in In operation 220, the television receiver receives an indicator that the matrix code is to be displayed. Accordingly, in operation 225, the receiver outputs the code and audiovisual content. Typically the code and content are outputted together, but In operation 230, the reader device 103 may capture the matrix code from the associated display 102. The matrix code may be deciphered and data therein processed by the reader device, after which at least a portion of the data stored in the code may be transmitted to the monitoring party 104 in operation 235. (As part reader device 103 may add this information to the transmitted data, if it was not included in the matrix code.
In operation 240, the monitoring party 104 may receive the data from the receive device 103. Next, in operation 245 the monitoring party may process the IV. Replay Monitoring As discussed above, embodiments may receive a matrix code as part of, or associated with, reception of audiovisual content. In some cases the audiovisual content may be stored for later viewing or interaction. When content is stored, the associated matrix code (or data used to generate a matrix code) may likewise be stored.
Still other embodiments may use temporal data to open or close windows of opportunity for viewers, and permit viewers to participate in these windows by relaying data in a matrix code displayed on the display. As one example, an item may be placed on sale for a specific period of time that is longer than the duration of a live broadcast. If a viewer captures the matrix code shown during replay of the content and within the period, he or she may qualify for the sale. This qualification may be tracked through the temporal data in the matrix code. Similar methodologies may be used for contests, prize qualifications, and so forth.
In alternative embodiments, the television receiver 101 may omit temporal data from any matrix code it generates for display. Instead, the receiver 101 may include a counter indicating how many times a particular piece of audiovisual content has been played back. A user capturing the matrix code and transmitting it to a monitoring party may thus indicate the number of times the content has been viewed. This may be useful in determining a viewer's tastes and/or preferences. It may also be useful in determining how long (e.g., how many replays) it takes for a user to respond to a matrix code-enabled offer. Some embodiments may include both temporal information and a counter for audiovisual content in a single matrix code.
Generally, then, it may be useful to modify a matrix code upon playback of stored audiovisual content. Fig. 3 depicts a sample method for such modification.
The method 300 begins in operation 305, where a replay command is received by the television receiver 101. Typically, such a command is initiated by a user.
Next, in operation 310 the television receiver 101 retries the current time and/or date information.
In operation 315, the television receiver 101 determines if a matrix code is present in the audiovisual content as stored. That is, the receiver determines if the matrix code is a portion of the video signal or is to be overlaid on a video signal. If the code is not a portion of the video signal, the television receiver may execute operation 320 and generate a matrix code having temporal and/or replay counter data therein from metadata or other data stored and associated with the audiovisual content. Following operation 320the process continues to operation 340 as described below.
If the matrix code is included in the audiovisual content, operation 325 is executed. In operation 325, the television receiver determines if the matrix code can be modified. The code may be modified, for example, if it may be stripped from the video or an overlay can be generated to be placed atop all or part of the matrix code as necessary. If the code cannot be modified, then the original, unmodified matrix code is displayed along with the audiovisual content in operation 330.
If the matrix code can be modified, it is updated with temporal and/or replay counter data in operation 335. Next, in operation 340, the updated code is displayed along with the audiovisual content.
V. Conclusion Although the foregoing has been described with respect to particular physical structures, methods or operation and data structures, it should be appreciated that alternatives to any of these exist and are embraced within the scope of this disclosure. As one example, a linear bar code may be used in place of a matrix code. As another example, data relating to multiple captured matrix codes may be stored by the reader device 103 and transmitted in a burst fashion rather than serially and as captured. Accordingly, the proper scope of protection is set forth in the following claims.
1. A method for audience metering, comprising:
creating an electronic construct from the data relating to the audiovisual content and the time; and displaying the electronic construct with the audiovisual content.
2. The method of claim 1, wherein the time is a time at which the audiovisual content is received.
3. The method of claim 1, wherein the time is a time at which the electronic content is to be displayed.
4. The method of claim 1, wherein the electronic construct is a matrix code.
receiving a data set embedded in the electronic construct; and processing the data set to determine a viewer preference.
generating a digital construct containing a data set, the data set including the data related to the audiovisual content and the time; and outputting the digital construct to a display device for display; wherein at least one of the electronic construct and the data set is used by a monitoring party to determine the time at which the audiovisual content is replayed.
receiving, from the monitoring party, a remote command to display the digital construct; and in response to the remote command, performing the operation of outputting the digital construct to a display device for display.
processing the digital construct to obtain a time and an identifier associated with the content; and using the time and identifier to track viewing of the content.
11. The method of claim 10, wherein the digital construct includes data identifying a viewer.
12. The method of claim 11, wherein the data identifying the viewer is stored with the time and the identifier associated with the content.
the digital construct includes a geographic identifier corresponding to a geographic locale at which the content was viewed; and aggregating the geographic identifier with a plurality of geographic identifiers retrieved from the plurality of additional digital constructs, thereby creating a geographic distribution of where the content was viewed.
17. The method of claim 16, further including the operations of aggregating the vote with a plurality of votes extracted from a plurality of digital constructs; and determining a winner based on the vote and the plurality of votes.
correlating the time to an offer; and transmitting the offer to the receiver.
a matrix code module operatively connected to the processing unit, the matrix code module operative to generate a matrix code including a temporal identifier and a content identifier; and an output component operative to display the content and the matrix code.
CA2818757A 2010-11-24 2011-11-22 Tracking user interaction from a receiving device Pending CA2818757A1 (en)
CA2818757A1 true CA2818757A1 (en) 2012-05-31
CA2818757A Pending CA2818757A1 (en) 2010-11-24 2011-11-22 Tracking user interaction from a receiving device
BR (1) BR112013012368A2 (en)
AT185634T (en) 1992-05-26 1999-10-15 United Parcel Service Inc Camera reader for various kodes
JP3980294B2 (en) 2001-06-04 2007-09-26 株式会社日立製作所 Application reception system, application reception device, communication terminal with application function
JP4376477B2 (en) 2001-07-17 2009-12-02 富士通株式会社 Information notification method, information notification program, and information notification server
JP4117550B2 (en) 2003-03-19 2008-07-16 ソニー株式会社 Communication system, payment management apparatus and method, portable information terminal, information processing method, and program
JP4192819B2 (en) 2004-03-19 2008-12-10 ソニー株式会社 Information processing apparatus and method, recording medium, and program
US8131478B2 (en) 2004-04-28 2012-03-06 Arkray, Inc. Data processing apparatus, measurement apparatus and data collection method
EP1751709B1 (en) 2004-05-10 2008-07-23 Philips Electronics N.V. Method of detecting watermarks
JP4293111B2 (en) 2004-10-27 2009-07-08 株式会社デンソー Camera driving device, camera driving program, geometric shape code decoding device, and geometric shape code decoding program
WO2006121135A1 (en) 2005-05-11 2006-11-16 Sony Corporation Server device, device-correlated registration method, program, and recording medium
JP4577085B2 (en) 2005-05-17 2010-11-10 ソニー株式会社 Video processing apparatus and video processing method
JP4049174B2 (en) 2005-07-22 2008-02-20 コニカミノルタビジネステクノロジーズ株式会社 Image forming system, image forming apparatus, and data processing method in image forming apparatus
ES2496590T3 (en) 2006-09-29 2014-09-19 United Video Properties, Inc. Systems and methods for a modular media guide dashboard application
WO2008093782A1 (en) 2007-02-02 2008-08-07 Sony Corporation Information processing device, method, and program
EP2220840B1 (en) 2007-10-30 2014-01-08 Telecom Italia S.p.A. Method of authentication of users in data processing systems
DE202008018372U1 (en) 2007-11-16 2013-04-26 Google, Inc. System for tracking the reaction to ads
WO2009125495A1 (en) 2008-04-11 2009-10-15 株式会社シリウステクノロジーズ Advertisement display method, advertisement display system, and advertisement display program
JP4506876B2 (en) 2008-05-22 2010-07-21 ソニー株式会社 Upload device, server device, upload system, and upload method
WO2010077255A1 (en) 2008-12-31 2010-07-08 Abbruzzese Jared E Mobile set top box
2011-11-22 BR BR112013012368A patent/BR112013012368A2/en active Search and Examination
BR112013012368A2 (en) 2019-10-01
WO2012071377A1 (en) 2012-05-31
US8408466B2 (en) 2013-04-02 Assisting matrix code capture by signaling matrix code readers