# Patent

## Title
Detecting and thwarting imaging systems at theatrical performances

## Abstract

A system and method of detecting and thwarting the use of unauthorized imaging systems at theatrical performances. Sensors are deployed at a theatrical event to detect a focusing signal and/or the RF signal of an unauthorized imaging device. De-focusing signals are used to disrupt the auto focus system of imaging devices that do not use IR focusing systems. A thwarting signal comprising invisible light frequencies may be combined to produce a thwarting signal that is received by the CCD of an imaging device as white light thereby rendering the recorded image unusable. Emission signatures of imaging devices are stored in a datastore and distributed to users of thwarting systems via a network. Emission signatures are associated with thwarting signals to allow detection and thwarting systems to respond quickly to the use of an unauthorized imaging device.

## Background
This application is a continuation in part of U.S. application Ser. No. 11/122,425, filed May 5, 2005, now U.S. Pat. No. 7,020,383 which is a continuation in part of U.S. application Ser. No. 10/816,970, filed Apr. 2, 2004, now U.S. Pat. No. 6,977,366 which is a continuation in part of U.S. application Ser. No. 10/294,273, filed Nov. 14, 2002, now U.S. Pat. No. 6,861,640, all of which are hereby incorporated by reference for all purposes and from which priority is claimed.


BACKGROUND
The present invention relates generally to the field of entertainment. More specifically, the present invention is a system and method of detecting and thwarting the use of unauthorized imaging systems at theatrical performances.
Entertainment is a multibillion-dollar business. Movies, plays, and concerts represent investments that have both a time value and an intellectual property value. The time value of an entertainment asset is usually very high, but reflects the reality that over time the demand for an entertainment asset will decline as access to the asset increases or as competition from other entertainment assets increases. For example, a movie is most valuable when it is first released to theaters and the potential audience is exposed to advertising and hype about the movie. The movie declines in value over time as the audience has viewed the movie and as other movies are released.
Entertainment assets also have an intellectual property value. A movie, for example, that has completed its theater run has potential value as a video for sale or rental purposes. The movie is a copyrighted asset and that asset can be sold or licensed. Similarly, a live performance has its own copyright that is highly valuable and requires protection.
Increasingly, entertainment assets are subject to piracy. Theaters and other venues that admit patrons to movies, concerts, and plays forbid the motion picture filming, video recording or still photograph recording of performances. However, it is difficult to police such conditions of admission. Finding a video camera or other imaging system in a large, dark theater is a significant challenge. It is also the case that within days or even hours of the release of a new movie, pirated copies of varying quality are available for sale on the street. Such copies are frequently the result of an unscrupulous individual taking a video camera into the theater and simply filming or recording the movie. Copies can then be rapidly made in a “boiler room” environment and sold on the street. And this does not only apply to movies. Live concerts and performances are equally protected by the copyright laws and, unfortunately, are equally as vulnerable to this form of pirating. Additionally, a still camera can image a performer in concert even when such taking of pictures is prohibited. What is needed is a means of detecting, locating and/or thwarting the use of an imaging system that is being used to surreptitiously film a theatrical performance.
SUMMARY
An embodiment of the present invention is a system and method of detecting, locating and/or thwarting the use of an imaging system that is being used to surreptitiously film a theatrical event. For purposes of this application, the phrase “imaging system” is used to describe any still or movie camera whether digital or tape based having a storage medium capable of recording and reconstructing a theatrical perform. The term “thwarting” is used to describe any action that either detects that a recording is being made, stops the recording or renders the recording useless, or any combination thereof.
It is an aspect of the present invention to detect and locate an imaging system that is being used to surreptitiously film a theatrical event.
It is another aspect of the present invention to detect the infrared auto focus beam emitted by an imaging system being used to surreptitiously film a theatrical event.
It is yet another aspect of the present invention to detect the radio frequency signature of an imaging system being used to surreptitiously film a theatrical event.
It is still another aspect of the present invention to detect both still and video imaging systems.
It is an aspect of the present invention to thwart the recording of a theatrical event by an imaging system by interfering with the recording process or rendering the recording useless for viewing.
It is another aspect of the present invention to “blast” an image recording system when any focus beam is detected.
It is another aspect of the present invention to periodically blast the viewing area to thwart recording even when a focus beam is not detected.
It is still another aspect of the present invention to halt a theatrical experience upon detection of a focus beam.
It is a further aspect of the present invention to precisely record the focus beam in use, and characterize that beam to produce a more effective thwarting signal and for later forensic analysis.
These and other aspects of the present invention will become apparent from a review of the detailed description that follows.
In general terms, the system and method of the present invention detects the auto focus function of an imaging system and provides signals that thwart the recording of any images by that system. Further, the present invention does not require that an auto focus system be detected. For example, and without limitation, a thwarting signal may be continuously sent out over an audience at a theatrical event to adversely affect the functioning of an imaging system.
An embodiment of the present invention provides a system for detecting the pirating of a theatrical experience. A sensor is arranged spatially proximate to the area wherein the theatrical experience is taking place and connected to a network. The sensor is adapted to sense an auto focus emission from an imaging system and to send a signal in the event an auto focus emission is received. Alternative embodiments allow for the distribution of multiple sensors to detect the auto focus emission(s). In still another alternate embodiment, the plurality of sensors is further adapted to receive radio frequency emissions from an imaging system. In another embodiment of the present invention, the sensor(s) adapted to receive radio frequency emissions is located in audience seating fixtures. Hence, when the application refers to the term “sensor” it will be understood by those skilled in the art that this is not meant as a limitation. Multiple sensors may also be used to effect the detection of surreptitious recording as noted herein.
A processor connected to the network and adapted to receive the signal from the sensor(s) initiates a “remedial action” if a focusing signal is received from an imaging system. For purposes of this application, the term “remedial action” means an alert provided to managers of the performance or venue that an unauthorized recording is taking place. Alternatively, the “remedial action” is a flag or trigger created upon sensing of the unauthorized recording that in turns triggers an automated response in the form of the thwarting signal that disrupts the recording.
In one embodiment of the present invention the processor comprises a computer program for determining the location of the imaging system from which the emission emanates. In an embodiment of the present invention, the area wherein the theatrical experience is taking place is a room and the sensor is located on the interior walls defining the room. In another embodiment of the present invention, the area wherein the theatrical experience is taking place is an outdoor theater and the sensor is mounted on structures arranged spatially so as to surround a space occupied by an audience.
In an embodiment of the present invention, a method of detecting the pirating of a theatrical experience is provided. A sensor is located proximate to the area in which the theatrical experience is taking place. The sensor receives auto focus emissions from an imaging system. A processor receives the output of the sensor. If auto focus emissions from an imaging system are detected, an alarm is initiated that alerts appropriate authorities and/or which serves to initiate an automated response by the system of the present invention in the form of a thwarting signal. Optionally, the sensor receives radio frequency emissions of an imaging system. Additionally, the processor may further comprise software means for determining the location of the source of auto focus emissions received by the sensor. Through the use of well known triangulation techniques, a physical location of an imaging system from which an auto focus emission is occurring can be determined.
In yet another embodiment of the present invention, a method of thwarting the pirating of a theatrical experience is provided. A thwarting signal generator is located proximate to the area in which the theatrical experience is taking place. The thwarting signal generator may, for example, be near the stage aimed into the audience, or be located on the walls of a room or at a various other points whereby the signal will cover the audience area from which the auto focus signal is emanating. The thwarting signal that is emitted is preferably visible to the imaging system but not visible to the human eye. Unauthorized imaging systems may be, without limitation, a still camera, a moving picture camera, a CCD array camera, and a cellular telephone camera. In one embodiment of the present invention, the thwarting signal is in the infrared region of the spectrum.
In another embodiment of the present invention, the thwarting signal is a short duration visible light signal not visible to the human eye. In still another alternative embodiment, the thwarting signal may be in the RF region of the electromagnetic spectrum. Alternatively, the thwarting signal is emitted from a thwarting signal generator attached to on-stage equipment. In another embodiment of the present invention, the thwarting signal is emitted from a thwarting signal generator attached to the periphery of a stage. In yet another embodiment of the present invention, the thwarting signal is emitted from a thwarting signal generator positioned behind a screen. It will be apparent to those skilled in the art that other locations for the thwarting signal generator(s) are a matter of design choice based upon the configuration of the audience to be covered and the signal strength needed or dictated by laws and regulations.
In one embodiment of the present invention, the thwarting signal generator may be configured to emit known infrared and/or RF commands designed to stop, or interfere with, an illicit recording. Most recording devices provide an infrared interface for controlling the recording device. Thus, for example, along with projecting a pattern to recording devices, the projectors could also emit all known stop, rewind, eject, etc. commands for recording devices, and do so repetitively many times per second. Thus, to an unsophisticated thief, the recording device would appear to malfunction. A given thwarting signal generator may have multiple emitters to inure good coverage of any venue. Further, single thwarting signal generator of the present invention may simultaneously interfere with many image recording devices of differing brands to degrade the image being recorded while also emitting differing control commands to interfere with the normal operation of a multitude of different types of image recording devices.
In another embodiment of the present invention, a method of thwarting the pirating of a theatrical experience is provided. A plurality of thwarting signal generators are located proximate to the area in which the theatrical experience is taking place. A thwarting signal that is detectable by the unauthorized imaging system but that is not visible to the human eye is emitted.



DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a block diagram of a thwarting system configured for use during a theatrical performance according to an embodiment of the present invention.
FIG. 2 illustrates an emission signature storage and distribution system according to an embodiment of the present invention



DETAILED DESCRIPTION
In one embodiment of the present invention, infrared (IR) sensors are installed on the performance area (i.e., a stage or screen) where the theatrical event is being performed and on structures to the sides and back of the performance area, and on structures above the audience. The IR sensors are sensitive to IR energy emitted by range finders (auto focus devices) used in imaging system equipment. This IR light is generally emitted by an imaging system as a main beam at a target. The target reflects the light back to the imaging system where it is received and processed to determine the distance of the target from the imaging system.
The IR light transmitters on an imaging system not only emit a main beam of IR light, but also emit less powerful side lobes that can be detected by IR sensors of the present invention located on either side of the imaging system. Alternatively, IR sensors can be placed on stage, at the back of a stage, on equipment or scenery that is on stage in order to capture the fact that the main IR beam is being used to focus on performers at a performance. In the case of a movie screen, a “pinhole” aperture in the screen may also be used with a detector behind the screen to again capture the fact that an IR beam (or other energy) is being used to focus on the screen. Such a pinhole aperture would be unseen by the audience but allow energy to be sensed.
Further, the present invention provides IR sensors located behind the imaging system for detecting the IR radiation reflected from the target. These sensors are placed in fixed locations on the back wall of the theatre, for example, or in the case of so-called “stadium” seating, on the front walls of the various tiers of the theater. Sensors in the ceiling may also be used to pick up IR scattered by the target.
Not all IR emitters emit in precisely the same way. Thus part of the present invention is to not only detect that a focusing signal is present, but to record and characterize that signal. Thus for forensic purposes, one could then later reconstruct the type of imaging system used, and potentially, even the brand of IR emitter used and even the precise emitter. Since copyright violations are criminal in nature, this information can be used for later prosecution efforts. Additionally, this analysis of the IR signal can be used in real time to send a thwarting signal tuned or adapted to the emitter that is detected so that a more effective thwarting signal can be created.
According to an embodiment of the present invention, emissions from imagining devices are stored in a datastore of imagining device “emission signatures” that may be used for detection, thwarting, and forensic study. Emission signatures may be “pre-characterized” or collected at sites of theatrical events. According to an embodiment of the present invention, the emission signatures are associated with a thwarting signal and made available to users of the thwarting systems describe herein via a network.
Some video cameras do not use IR for auto focus but rely on the incoming light for optimization of imaging being recorded. In these imaging systems, a CCD image sensor and an associated processor will sense incoming wave forms of light reflected from, for example, a screen in movie theater and will create an image as sharp as possible. Because the sharpest image possible requires the highest possible frequency, the system tries to find the highest frequency in the incoming image and adjust the position of the CCD to optimize reception of this frequency. In another embodiment of the present invention, a de-focusing signal is used to disrupt this type of auto focus system.
In this embodiment, the de-focusing signal is a high frequency light pulse that is emitted from a source that is in front of or behind the performance area, thereby causing the imaging system to misfocus the recorded image or to cause the imaging system to constantly change in focus point. In another embodiment, a plurality of de-focusing signals is used at various focal points to disrupt the recording process. Again, the sources for such energy can be at the periphery of a venue, on equipment that is on-stage or directly behind the performers or other locations where the energy can be aimed at an audience for image disruption purposes.
A passive auto focus system uses contrast to determine when focus of an image has been achieved. The microprocessor in an imagining devices looks at a strip of pixels and looks at the difference in intensity among the adjacent pixels. If the image is out of focus, adjacent pixels have very similar intensities. The microprocessor moves the lens, looks at the CCD's pixels again and sees if the difference in intensity between adjacent pixels improved or got worse. The microprocessor then searches for the point where there is maximum intensity difference between adjacent pixels—that is the point of best focus.
In an embodiment of the present invention, a thwarting signal comprises a brief pulse of light that causes the contrast of an image to change, thereby affecting the ability of the auto focusing system to determine a proper focus of the scene. In an embodiment of the present invention, the pulse rate is faster than the human eye can respond, thereby making the pulse “invisible” to humans even if the light frequency is within the visible spectrum.
In still another embodiment of the present invention, a “thwarting signal” comprises a light source emitting energy in the light spectrum that is not visible to the human eye but which is detectable by the CCD of a digital imaging system. By way of example and not as a limitation, many CCDs used in video cameras are sensitive to IR energy. A thwarting signal comprising IR energy would be seen in a recording as a white light. Other invisible light frequencies may be combined to produce a thwarting signal of this kind. As new CCDs are developed, the thwarting signal may thus be adjusted to accommodate the spectral sensitivity of the CCD to achieve the thwarting objectives previously described. In another embodiment, the thwarting signal is projected onto a screen from a movie projector. In another embodiment, the thwarting signal is projected outward from the performance area of a live performance.
In addition, with new generations of imaging cellular telephone, the potential for a “non-focusing” system is even more present. The thwarting signals of the present invention operate to disrupt the imaging capabilities of such devices.
Because the human eye cannot detect short duration pulses of light, a thwarting signal may comprise light energy in the visible spectrum. In this embodiment, light is pulsed at high energy, but not sufficiently high to be detected by the human eye. In another embodiment, a thwarting signal comprises both light from the visible and invisible spectrum and is pulsed to thwart a recording of a theatrical event.
FIG. 1 illustrates a block diagram of a thwarting system configured for use during a theatrical performance according to an embodiment of the present invention. Referring to FIG. 1, a theatrical performance is performed on performance area 10 and viewed by audience 15. A member of the audience is filming the theatrical performance using an imaging system 20. The imaging system 20 emits both a focusing signal 22 and an RF signature 24. In an embodiment of the present invention, the focusing signal is an IR light signal. However, the present invention is not so limited. Other focusing signals may be utilized without departing from the scope of the present invention. The focusing signal is reflected 26 from the focal object. Additionally, side lobes of the focusing signal produced by the auto focus system of the imaging system are radiated perpendicular to the direction of the lens. Sensors 30 are placed at the performance area (out of view of the audience), to the sides of the audience, and at the back of the audience to receive both the focusing signal and the RF signature of the imaging system. An RF-only sensor 32 is deployed in a seat of the audience. In a preferred embodiment, each seat would be equipped with an RF-only sensor 32.
Thwarting signal generators 40 and defocusing signal generators 45 are also illustrated forward and behind imagining system 20. However, the present invention is not so limited. Thwarting signal generators 40 and defocusing signal generators 45 may be place to the side of and overhead of the imaging system 20.
In an embodiment of the present invention, the IR sensors are connected to a processor through a network. When the processor receives data from the IR sensors the data may be used to mathematically triangulate the approximate location of the imaging system using means known in the art.
In another embodiment of the present invention, RF detectors are used in lieu of or in addition to IR sensors. In this embodiment, the RF detectors scan the audience for an RF signature that matches a fingerprint of a digital camera. In another embodiment of the present invention, the RF detectors are used in conjunction with the IR sensors and allow the IR sensors to be focused on a suspected operating camera. Additionally, RF detectors may be installed in the audience seating fixtures.
In still another embodiment, thwarting signal generators 40 and defocusing signal generators 45 are deployed without detectors.
The system of the present invention is moveable. For example, it is envisioned that a touring theatrical event can uninstall the system at one event and transport it to the next event and install it there. Thus the producers of that theatrical event can have some assurances that protection will be afforded to the performance wherever it goes.
FIG. 2 illustrates an emission signature storage and distribution system according to an embodiment of the present invention. In an embodiment of the present invention, thwarting systems 205, 210, and 215 are controlled by thwarting system control server 220. By way of illustration and not as a limitation, thwarting systems 205, 210, and 215 and thwarting system control server 220 may be installed in a movie theater complex to protect theatrical performances presented in multiple theaters. Thwarting control server 220 accesses local signature library 225 to determine whether an “emission” signature detected by a thwarting system is indicative of an imaging device and to associate the emission signature with at least one thwarting signal. By way of illustration and not as a limitation, emission signatures comprise IR emissions, electromagnetic emissions, and RF emissions.
If an emission signature is not in local signature library 225, thwarting control server 220 may refer the unknown emission signature to local signature identification processor 230 for analysis. Detected emission signatures are stored in local datastore 235 and may be used for thwarting and forensic study at a later time. An emission signature that is associated with an imaging device and with a thwarting signal by local signature identification processor 230 is added to local signature library 225.
Emission signatures may be “pre-characterized” using a central signature identification processor 260 or collected at sites of theatrical events where thwarting systems 205, 210, and 215 are in use. The emission signatures are associated with an imaging device and a thwarting signal and made accessible to users of thwarting systems 205, 210, and 215 via a network 250. Access to central signature library 255 is provided through central control server 265. According to an embodiment of the present invention, central control server 265 provides secured access to the emission signature data held in central signature library 255 and to central signature identification processor 260. In another embodiment of the present invention, central control server 265 manages automatic updates to the emission signature data held in local signature library 225 used by thwarting systems 205, 210, and 215 via a network 250.
In one embodiment of the present invention, the thwarting signal generator may be configured to emit known infrared commands designed to stop, or interfere with, an illicit recording. Most recording devices provide an infrared interface for controlling the recording device. Thus, for example, along with projecting a pattern to recording devices, the projectors could also emit all known stop, rewind, eject, etc. commands for recording devices. Thus, to an unsophisticated thief, the recording device would appear to malfunction. Assuming multiple emitters within a thwarting signal generator, a single thwarting signal generator may simultaneously interfere with image recording while also emitting control commands. The control commands for a particular imaging device may be stored in the local signature library 225 and/or the central signature library 255 and associated with an emission signature. In one embodiment of the present invention, the control commands for all known imaging devices may be broadcast continuously when the presence of an imaging device is detected thus interfering with the normal operation of those imaging devices.
A system and method of detecting and thwarting the use of unauthorized imaging systems at theatrical performances has now been illustrated. It will be understood by those skilled in the art of the present invention that the systems and methods of the present invention can be used with or without detecting a focusing signal. Thus the invention will be useful in providing periodic “blasts” of energy to thwart the recording of a theatrical event even when detection of a focusing signal has not occurred. Whether or not a focusing signal has been detected, a variety of thwarting signals in the visible, near-IR and RF frequencies may be used to disrupt the imaging on an event. Further, although the claims herein discuss a single sensor or thwarting signal generator, this is not meant as a limitation. The present invention anticipates that multiple sensors and thwarting signal generators are to be used in preferred embodiments, the number and strength of which will vary depending on the size and shape of the venue in which the theatrical experience is taking place. Additionally, the systems and methods may be embodied in other specific forms without departing from the scope of the invention disclosed and that the examples and embodiments described herein are in all respects illustrative and not restrictive. Those skilled in the art of the present invention will recognize that other embodiments using the concepts described herein are also possible.

## Claims

1. A system for preventing the pirating of a theatrical experience comprising:
a local network;
a local signature library adapted to:
store emission signatures of imaging devices; and
store thwarting measures associated with the emission signatures;

a thwarting system connected to the local network, wherein the thwarting system comprises:
a sensor arranged spatially proximate to an area wherein the theatrical experience is taking place and adapted to receive emission signals within the area wherein the theatrical experience is taking place; and

a local thwarting system control server connected to the local network, wherein the local thwarting system control server is adapted to:
receive the emission signals from the thwarting system;
determine if the emission data is indicative of the presence of an imaging device;
if the emission data is indicative of the presence of the imaging device, determine whether the emission data matches an emission signature of an imaging device stored in the local emission signature library; and
if the emission data matches the emission signature stored in the emission signature library, then take a remedial action associated with the emission signature as stored in the emission signature library.

2. The system of claim 1 further comprising:
a thwarting signal distribution network (TSDN);
a central emission signature library;
a central control server, wherein the central control server communicates with the local thwarting system control server via a thwarting signal distribution network (TSDN) and wherein the central control server is adapted to:
access the central emissions signature library;
acquire new emissions signatures and associated new thwarting signals from the central signature library; and
send the new emissions signatures and the associated new thwarting signals to the local thwarting control server; and

wherein the local emissions signature library stores the new emissions signatures and the associated new thwarting signals from the local thwarting system control server.

3. The system of claim 2, wherein the TSDN is the internet.

4. The system of claim 2, wherein the TSDN is a wireless network.

5. The system of claim 2, wherein the TSDN is a wired network.

6. The system of claim 1, wherein the remedial action comprises transmitting a control instruction to affect operation of the imaging device.

7. A method for preventing the pirating of a theatrical experience comprising:
receiving emission signals from a sensor arranged spatially proximate to an area wherein the theatrical experience is taking place and adapted to receive emission signals within the area wherein the theatrical experience is taking place;
sending the emission signals to a local thwarting system control server connected to the local network'
determining at the local thwarting system control server if the emission data is indicative of the presence of an imaging device;
if the emission data is indicative of the presence of the imaging device, determining whether the emission data matches an emission signature of an imaging device stored in a local emission signature library; and
if the emission data matches the emission signature stored in the emission signature library, then taking a remedial action associated with the emission signature as stored in the emission signature library.

8. The method of claim 7 further comprising:
accessing a central emissions signature library;
acquiring new emissions signatures and associated new thwarting signals from the central signature library; and
sending the new emissions signatures and the associated new thwarting signals to the local thwarting control server via a thwarting signal distribution network (TSDN);
storing the new emissions signatures and the associated new thwarting signals from the local thwarting control server in the local emissions signature library.

9. The method of claim 8, wherein the TSDN is the internet.

10. The method of claim 8, wherein the TSDN is a wireless network.

11. The method of claim 8, wherein the TSDN is a wired network.

12. The method of claim 7, wherein the taking the remedial action comprises transmitting a control instruction to affect operation of the imaging device.