Abstract:
A method and apparatus provides immediate audience interaction and participation with a movie while the movie is being shown to the audience, either in a public theater or at home. Theatre patrons are provided the option of responding to prompts on their handheld communication/computing devices to vote on upcoming pre-staged scene selections, thereby enabling majority voting audience participation to control a movie flow.

Description:
BACKGROUND 
       [0001]    The present invention relates generally to methods and apparatuses for viewing movies and more particularly to a method and apparatus for viewing a movie in both large public venues and private venues. 
         [0002]    With the advent of high definition and three dimensional television sets concomitant with the development of fiber optic high-speed residential internet service, movie theaters are seeking ways to remain competitive with home theaters. To compete, traditional movie theatres are seeking new ways to attract movie goers by enhancing the overall experience at the movie theatre for their customers. 
         [0003]    The present invention is therefore directed to the problem of developing a system and method to enhance a patron&#39;s experience at a movie theatre. 
       SUMMARY OF THE INVENTION 
       [0004]    The present invention solves these and other problems by providing a method and apparatus for providing immediate audience interaction and participation with a movie while the movie is being shown to the audience, either in a public theater or at home. Patrons are provided the option of responding to prompts on their handheld communication/computing devices to vote on upcoming pre-staged scene selections, thereby enabling majority voting audience participation to control a flow of the movie. 
         [0005]    According to one aspect of the present invention, an exemplary embodiment of an apparatus for enabling a movie viewer to interact with a movie being displayed by a display device includes a processor, storage and a downloadable software application. The storage is to store an interactive movie including one or more interaction points. Each interaction point is associated with multiple alternative movie segments. Each alternative movie segment for a given interaction point has an identical number of frames as all other alternative movie segments for the same interaction point. Moreover, each alternative movie segment has an equal run time as all other alternative movie segments for same interaction point. Each alternative movie segment is assigned a code uniquely identifying the alternative movie segment. The storage is to store the multiple alternative movie segments in association with their unique code. The processor is to couple to the storage and to cause the storage to output one of the alternative movie segments to the display device. The software application is storable on a computer readable media and is downloadable to a mobile computing device. The software application enables a user of the mobile computing device to register with the processor using the mobile computing device and to receive a prompt from the processor on the mobile computing device and to respond to the prompt using the mobile computing device. The processor is to send an interactive message prompt prior to each interaction point to request registered users to vote on which one of the alternative movie segments should be included in the movie being displayed. The processor also receives votes from the registered users regarding the interactive message prompt, tallies all received votes from registered users regarding the interactive prompt and causes the storage to output one of the alternative movie segments based on the tally of the votes to the display device. 
         [0006]    According to one possible variant of the above exemplary embodiment, in the exemplary apparatus a wireless network may be used to communicate with one or more mobile computing devices of one or more users. 
         [0007]    According to another possible variant of the above exemplary embodiment, in the exemplary apparatus the mobile computing devices may include: a smart phone, an iPhone, an iPad, an iPod touch, a blackberry, a cell phone, a mobile phone, a handheld computer, a laptop computer, or a mobile gaming device. 
         [0008]    According to yet another possible variant of the above exemplary embodiment, in the exemplary apparatus the processor may deliver real time input prompts to one or more registered mobile computing devices through the downloadable software application, which has been installed on the one or more mobile computing devices. The processor may receive one or more input responses from the one or more registered mobile computing devices. The processor may also analyze and tabulate the input responses in real-time by a running sum routine, in which each received input response is tallied by a response type, the response type counts are compared and rank ordered, based on a total number of input responses, from most input responses to least input responses. The processor may make an immediate determination as to which one of the two or more alternative movie segments, received the most input responses, and should be output from the storage to the digital display device. 
         [0009]    According to still another possible variant of the above exemplary embodiment, in the exemplary apparatus a synchronized content clock may receive run time data from the display device and run time data from the storage and then in combination with the processor may insert one or more movie segments dynamically at exactly a right time to prevent latency or delay in a story flow in the interactive movie being displayed. 
         [0010]    According to yet another possible variant of the above exemplary embodiment, in the exemplary apparatus the storage may comprise a relational database, wherein each alternative movie segment is stored in relation to its unique code. 
         [0011]    According to still another possible variant of the above exemplary embodiment, in the exemplary apparatus the display device may comprise: a movie projector, a television, a digital display, an LED display, a plasma display, a computerized screen in a public arena, or an AppleTV. 
         [0012]    According to yet another possible variant of the above exemplary embodiment, in the exemplary apparatus the display device may include a set top box. 
         [0013]    According to another aspect of the present invention, an exemplary embodiment of a method for enabling a movie viewer to interact with a movie being displayed by a display device includes storing in memory an interactive movie including one or more interaction points and associating each interaction point with multiple alternative movie segments. Each alternative movie segment for a given interaction point has an identical number of frames as all other alternative movie segments for the same interaction point, and an equal run time as all other alternative movie segments for the same interaction point. The exemplary embodiment of the method may also assign a code uniquely identifying each alternative movie segment and store each alternative movie segments in memory in relation to the assigned code. The exemplary embodiment of the method may also send an interactive message prompt prior to each interaction point to request registered users to vote on which alternative movie segments should be included in the movie being displayed, receive votes from registered users regarding the interactive message prompt, tally all received votes from the registered users regarding the interactive prompt and output one of the alternative movie segments based on the tally of votes to a display device. 
         [0014]    According to one possible variant of the above exemplary embodiment, the exemplary method may include communicating with one or more mobile computing devices of one or more users using a wireless network. 
         [0015]    According to another possible variant of the above exemplary embodiment, in the exemplary method the mobile computing device may include: a smart phone, an iPhone, an iPad, an iPod touch, a blackberry, a cell phone, a mobile phone, a handheld computer, a laptop computer, or a mobile gaming device. 
         [0016]    According to yet another possible variant of the above exemplary embodiment, the exemplary method may include delivering real time input prompts to registered mobile computing devices through the downloadable software application, which has been installed on the mobile computing devices. The exemplary method may also include receiving one or more input responses from the registered mobile computing devices, and analyzing and tabulating the input responses in real-time by a running sum routine, in which each received input response is tallied by response type, the response type counts are compared and rank ordered, based on a total number of input responses, from most input responses to least input responses. The exemplary method may also include determining which alternative movie segment received the most input responses, and should be output from the storage to the digital display device. 
         [0017]    According to still another possible variant of the above exemplary embodiment, the exemplary method may include maintaining synchronization of the interactive movie and the alternative movie segments using a synchronized content clock that receives run time data from the display device and run time data from the storage and in combination with the processor may insert one of the alternative movie segments dynamically at exactly a right time so there is no latency or delay in story flow of the interactive movie being displayed. 
         [0018]    According to yet another possible variant of the above exemplary embodiment, in the exemplary method the storage may comprise a relational database, in which each alternative movie segment is stored in relation to its unique code. 
         [0019]    According to still another possible variant of the above exemplary embodiment, in the exemplary method the display device may comprise: a movie projector, a television, a digital display, an LED display, a plasma display, a computerized screen in a public arena, or an AppleTV. 
         [0020]    According to yet another possible variant of the above exemplary embodiment, in the exemplary method the display device may include a set top box. 
         [0021]    According to yet another aspect of the present invention, an exemplary embodiment of a method for creating an interactive movie includes establishing one or more interaction points within the movie, associating each interaction point with multiple alternative movie segments, and preparing each alternative movie segments for a given interaction point so that each alternative movie segments for the same interaction point has an identical number of frames as all other alternative movie segments for the same interaction point. 
         [0022]    Moreover, the exemplary embodiment of the method may also include preparing each alternative movie segment for a given interaction point so that each alternative movie segment for the same interaction point has an equal run time as all other alternative movie segments for the same interaction point. 
         [0023]    The exemplary embodiment of the method may also assign a code uniquely identifying each alternative movie segment. 
         [0024]    According to one possible variant of the above exemplary embodiment, the exemplary method for creating an interactive movie may include segmenting the interactive movie so that movie segments may be pre-staged in a content repository, so that a processor may determine which alternative movie segment is most popular to viewers, and may then trigger a dynamic serving of the most popular alternative movie segment. 
         [0025]    According to another possible variant of the above exemplary embodiment, in the exemplary method for creating an interactive movie one of the alternative movie segments may be designated a default movie segment, which is selected if no user inputs are received and processed in time. 
         [0026]    According to yet another aspect of the present invention, an exemplary embodiment of an interactive movie may be produced according to the aforementioned exemplary method for creating the interactive movie. 
         [0027]    Other advantages and aspects of the various embodiments of the present invention will be apparent upon review of the following drawings and description. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0028]      FIG. 1A  depicts an exemplary embodiment of a block diagram of a system for enabling audience participation in a movie presentation in a public venue, such as a movie theatre or sports arena, according to one aspect of the present invention. 
           [0029]      FIG. 1B  depicts an exemplary embodiment of a block diagram of a system for enabling audience participation in a movie presentation in a private venue, such as a home or office, according to another aspect of the present invention. 
           [0030]      FIG. 2  depicts an exemplary embodiment of a block diagram of a system for enabling multiple viewer audience participation in a movie presentation in a private venue or home theatre according to still another aspect of the present invention. 
           [0031]      FIG. 3  depicts an exemplary embodiment of a block diagram of an Interactive Movie Network Appliance for use in a system for enabling audience participation in a movie presentation in a public theatre according to yet another aspect of the present invention. 
           [0032]      FIG. 4  depicts an exemplary embodiment of a block diagram of an Interactive Movie Network Appliance for use in a system for enabling audience participation in a movie presentation in a private venue or home theatre according to still another aspect of the present invention. 
           [0033]      FIG. 5  depicts an exemplary embodiment of a process in a block diagram format for enabling audience participation in a movie presentation in a public or home theatre according to still another aspect of the present invention. 
           [0034]      FIG. 6  depicts an exemplary embodiment of a process for developing dynamic interactive movie content which enables audience participation in a movie presentation in a public or home theatre according to yet another aspect of the present invention. 
           [0035]      FIGS. 7-9  depict a method for enabling insertion of audience selected scenes in a movie according to still another aspect of the present invention. 
           [0036]      FIG. 10  depicts an exemplary embodiment of a user screen presented to a user on a mobile device according to one aspect of the present invention. 
           [0037]      FIG. 11  depicts an exemplary embodiment of a block diagram of a system for enabling audience participation in a movie presentation in a public or home theatre according to one aspect of the present invention. 
           [0038]      FIG. 12  depicts an exemplary embodiment of a method for viewing an interactive movie using an iPad according to yet another aspect of the present invention. 
           [0039]      FIG. 13  depicts an exemplary embodiment of a method for viewing an interactive movie using an Apple TV according to yet another aspect of the present invention. 
           [0040]      FIG. 14  depicts an exemplary embodiment of a method for viewing an interactive movie in a public theatre according to yet another aspect of the present invention. 
       
    
    
     DETAILED DESCRIPTION 
       [0041]    In-Theatre Embodiment Overview 
         [0042]    One exemplary embodiment of the present invention creates a dynamic interactive movie viewing experience in a commercial movie theatre environment (or large sporting arena or performance venues) by allowing movie patrons to use their wireless mobile device (e.g., smart phone, tablet, touch screen, or music and gaming device) to interact with a movie being publicly displayed on the venue&#39;s screen or screens. This embodiment of the present invention works in conjunction with video/audio content that has been produced using a specific technique set forth herein for interactive audio/video content production. 
         [0043]    As a result of the present invention, audio and video content being displayed reacts to changes based on audience input responses to system generated prompts. Prompts are delivered to audience members&#39; handheld devices and their responses are collected by the exemplary embodiment of the present invention, which then dynamically delivers, in real time, audio and video content to the venue&#39;s projection equipment. 
         [0044]    Turning to  FIG. 1A , an exemplary embodiment  10  of the present invention includes a Network Appliance/Content Server  11 , which establishes a wireless local area network using standard WIFI and Bluetooth protocols. Once the wireless network is established, the Server  11  interacts with mobile devices  12  of movie viewers  13  in a client-server mode. 
         [0045]    Each movie viewer&#39;s mobile device  12  can establish a WIFI connection or other wireless link  14  to the wireless network in the usual manner by downloading an interactive movie application  111  (see  FIG. 13 ) in advance in a known manner. This interactive movie application  111  enables the mobile device  12  to connect to the in-theatre network vie WIFI connection  14  and communicate with the content server  11 . The mobile device  12  registers with the server  11 , which in turn communicates messages with each registered mobile device  12 . 
         [0046]    Messages are exchanged between the server  11  and registered devices  12  via WIFI and Bluetooth wireless protocols. “Registered” in this case, means a mobile device  12  with the Application  111  installed that has identified itself to the Network Appliance  11  as viewing a specific program or movie. 
         [0047]    The Server  11  is sufficiently powerful, fast and employs sufficient memory to establish and sustain connections to as many as 100,000 concurrent users/mobile devices. An exemplary server  11  is configured with: Dual Xeon 2.8 GHz processors, 64 GB 1333 MHz memory, 4 TB Hard Drive Storage (4×1TB drives, 7.2K RPM) with RAID, redundant internal power supply, 802.11 WIFI, Bluetooth, video card with HDMI, DVI and VGA output. The Server  11  stores video content being displayed on the movie screen or screens and outputs audio and video content to digital projection equipment  15  (e.g., an LED/LCD movie projector) in a known manner. File formats supported are consistent with the Digital Cinema System Specification and include MXF compliant for still and moving images, and the Broadcast Wave (.wav) file format for audio files. Additionally, the server supports all standard audio and video file formats commonly used on the Internet. The server is capable of outputting video content with an image pixel array of 4096×1716. 
         [0048]    Software and algorithms running on the Network Appliance  11  deliver real time input prompts to registered mobile devices  12  through the installed application  111  on the mobile device  12 . The Network Appliance Software receives input responses from each registered mobile device  12 , and analyzes and tabulates all input responses in real-time. This is accomplished through a running sum routine, in which each received view response is tallied by response type. The response type counts are compared and rank ordered, based on the total number of responses, from most user responses to least. The Network Appliance Software makes immediate determinations as to which one of several possible pre-staged audio and video content segments  16  (which correspond to the user response options) should be sent from the Content Server  11  to the digital projection equipment  15 , based on all received input responses from user&#39;s mobile devices  12 . 
         [0049]    In-Home Embodiment 
         [0050]    Referring to  FIG. 1B , another exemplary embodiment  20  of the present invention creates a dynamic interactive movie viewing experience in the home (or other private venue, such as an office or waiting room) by allowing movie viewers  24  to use their wireless mobile device  21  (e.g., smart phone, tablet, touch screen music and gaming device) to interact with the movie  25  playing on their set top box device  22  or internet connected television  23  (e.g., Apple TV). This embodiment  20  of the present invention works in conjunction with video/audio content  25  that has been produced using a technique set forth herein for interactive audio/video content production (see  FIG. 6 ). Each mobile device  21  is connected to the set top box  22  via a WIFI connection  26  or other wireless link. 
         [0051]    Turning to  FIG. 2 , this exemplary embodiment  29  includes a software application  27  that runs on an Internet connected television  23 , such as an Apple TV, or set top box  22 . The software application  27  utilizes the wireless networking capability of the set top box  22  or internet connected television  23  using standard WIFI and Bluetooth protocols. The software application  27  allows multiple movie viewers  28  with mobile devices  21  (with the mobile device application discussed previously and which has been downloaded to their mobile device) to connect to the set top box  22  or internet connected television  23 . 
         [0052]    The software application  27  communicates with each registered mobile device  21 , stages video and audio content  25  on the set top box  22  or internet connected television  23 , and delivers real time input prompts to registered mobile devices  21  through the installed application on the mobile device  21 . The software application  27  also receives input responses from all registered mobile devices  21  and analyzes/tabulates input responses in real time. The software application  27  then makes an immediate determination as to which one of several pre-staged audio and video content segments  25  to send to the display  23 , based on all received input responses, and then outputs audio and video content to the display  23  based on the aforementioned determination. This is accomplished through a running sum routine where each received view response is tallied by response type. The response type counts are compared and rank ordered, based on the total number of responses, from most user responses to least. 
         [0053]    Exemplary Embodiment of Interactive Movie Network Appliance 
         [0054]    Referring to  FIG. 3 , shown therein is an exemplary embodiment  30  of an Interactive Movie Network Appliance. Interactive movies create a two way communication between the movie and the movie audience. This two-way communication centers primarily on the story being told through the movie, but can also include communication for the purposes of building affinity, social networking or facilitation of commerce. 
         [0055]    Two-way communication is established between movie content  31  and movie viewers by way of handheld wireless devices  32 , such as an Apple iPhone, iPad and iPod Touch devices. 
         [0056]    Specially produced content  31  is required to be developed and pre-staged. Within the specially produced and staged movie content  31  are coded Interaction Points  81  (see  FIG. 8 ), where the user is prompted, through their wireless device  32 , to provide some feedback. Interaction Points  81  trigger the delivery of user prompts. Users then have a short period of time to provide their responses, through their wireless devices  32 . 
         [0057]    As an example of an Interaction Point  81 , an animated character may walk into their garage and see three vehicles parked there—a unicycle, a racecar, and a horse drawn wagon. On the bottom of the primary viewing screen text appears which reads, “What should Joe use to get to his grandmothers house?” At this moment viewers will see the three vehicle choices on their wireless touch screen devices and will touch one of the three choices. The selection is immediately transmitted to the Interactive Movie Network Appliance  30 . 
         [0058]    All received user responses are gathered and tabulated and movie content is displayed based on those user responses. Software algorithms are used to determine which response options are the most popular, and to then trigger the dynamic serving of pre-staged content, from a set of content options. 
         [0059]    The Interactive Movie Network Appliance  30  is a hardware component which includes storage space for interactive audio and video content in a repository  33  as well as an interface to the internet via which the Interactive Movie Network Appliance  30  provides internet connectivity (thorough either a wired or wireless connection). The Interactive Movie Network Appliance  30  creates an interface between mobile devices  32  and interactive content  31  by establishing and maintaining a wireless connection over which user prompts can be sent to handheld wireless devices  32 , and user responses can be sent from wireless devices  32  to the Interactive Movie Network Appliance  30 . The Interactive Movie Network Appliance  30  houses a Content Server and Decision Engine  33  and outputs movie content to display devices  34  (movie projection systems, televisions, computer monitors, wireless displays) over a hardwired or wireless connection. Content  31  can be delivered from the Interactive Movie Network Appliance  30  to the display  34  through a variety of connections including: HDMI, DVI, Component Video, VGA, SVGA, S-video and optical audio. 
         [0060]    Content Repository 
         [0061]    The content repository  33  is storage space on the Interactive Movie Network Appliance  30  where interactive audio and video content is stored and is available for delivery to displays as directed by the Decision Engine. The Content Repository  33  includes a relational database that stages content for immediate and seamless delivery to projection and display devices. The timing of content delivery is based on ongoing multi-directional communication between the Interactive Movie Network Appliance  30  and the projection system. 
         [0062]    One element of this communication to ensure seamless delivery of content is a synchronized content clock that uses run time data from the projection system and run time data from the content repository to insert content segments dynamically at exactly the right time so there is no latency or delay in the story flow on screen. 
         [0063]    Decision Engine for Interactive Movie Content Delivery 
         [0064]    The Decision Engine is a software application running on the Interactive Movie Network Appliance  30 . The Decision Engine uses algorithms to process multiple incoming user inputs from mobile devices and dynamically trigger the Content Server  33  to deliver pre-staged audio/video content for display. Routines used include a modified sum-product algorithm for counting and summing received responses. The Decision Engine also has the ability to infer response inputs from registered users whose prompts were not received. This is done using a marginal distribution algorithm to calculate the probability of the value of the responses not yet received, based on 1) the received responses for the particular interaction point and 2) prior received responses during the same movie session. The Decision Engine is able to process user inputs and trigger content serving without introducing latency into the on-screen viewing experience of the movie audience by: (1) providing a default segment that is used if viewer responses are not received in time, and by using segments that are each the same number of frames and are synchronized with the movie via a continuous timing count. 
         [0065]    The Decision Engine establishes a movie session by date, time, movie title and unique session identification number. Then the Decision engine associates registered wireless devices with an active movie session by date, time, movie title and unique session identification number. This association is captured and stored in a relational database  33 , which resides on the Interactive Movie Network Appliance  30 . The Decision Engine sends input prompts to all registered and available devices. Input prompts are in the form of instructions given to the user signaling to them to take an action on their wireless touch screen device. Input prompts use a combination of written text, vibration alerts, sound alerts and on screen iconography to guide the user in providing feedback. 
         [0066]    Referring to  FIG. 10 , as an example, the user may be prompted to indicate the color of shirt a character on screen should choose from their closet. On the primary viewing screen  100  the viewers will see a text prompt  102  saying, “What color shirt should Joe wear? Make a selection on your touch screen now.” On their handheld device  12  each user sees three different color shirts  103 - 105 . Whichever one they touch becomes their response input. All registered devices inputs are received and tabulated by the Decision Engine, which then signals the Content Server to send one of several pre-staged content segments to the primary viewing screen. Certainly, more involved interaction is possible, including by way of example, plot conclusions, character development and other movie options limited only by the creativity of the movie creator. 
         [0067]    Next, the Decision Engine receives input responses from all registered devices. The Decision Engine receives the inputs that users submit through their wireless devices, in response to input prompts sent by the viewer(s). The user input is initially in the form of an answer to a multiple choice question, a selection from a set of pre-determined choices, a hand or finger gesture using the touch screen, a movement of the wireless device so as to activate the internal accelerometer (which detects motion), use of the camera and/or microphone on the wireless device. 
         [0068]    The Decision Engine processes all received input responses from wireless devices. All received user inputs from registered wireless devices are received and stored in a relational database. Initially, while an interactive movie is running, input responses are stored in an active queue so that they are available for immediate processing by the Decision Engine. Once the Interaction Point for which the queued inputs are required has passed, the inputs are loaded into the relational database. 
         [0069]    The Decision Engine retrieves indicated audio and video content (from repository) based on input responses. Multiple versions of the same content segment are produced in advance and staged on the Content Server. Each version of a content segment is produced to be the same number of frames, and therefore takes the same amount of time to run. Each segment is tagged with a time-based unique identifier that indicates the beginning time of that segment. The time is based on the location in the movie relative to the first frame of the movie. 
         [0070]    Referring to  FIG. 7 , the first frame 71, i.e., frame 1 occurs at 0:00:00 (zero hours, zero minutes, zero seconds). The last frame 72, e.g., frame 172,800 occurs at time 1:59:59. Time synchronization between the Interactive Movie Network Appliance, the Decision Engine, the Content Server and the projection system is achieved using the Precision Time Protocol (PTP) version 2, and the NST Timer Interval Method for iOS. This exemplary embodiment is assuming a frame speed of 24 frames per second, however, other frame speeds could be used without departing from the scope of the present invention. 
         [0071]    Turning to  FIG. 8 , each staged content segment  91 - 93  is also assigned a letter designation, beginning with the letter A and following in alphabetical order. As an example, an Interaction Point  81  that occurs forty-two minutes and 17 seconds into an interactive movie may have three possible content segments  91 - 93 . These content segments  91 - 93  are produced in advance and staged on the Content Server  94  (see  FIG. 9 ). The content segments  91 - 93  are tagged with the identifiers: 0:42:17A, 0:42:17B and 0:42:17C, respectively. The A, B and C identifier corresponds to the three choices viewers are able to make at that Interaction Point. The unique identifier, the number of frames and the frame number range for each content segment is stored as metadata in the content repository. The Decision Engine  94  determines what content segment is to be played, based on the user inputs received. The content segment  91  stored with the A designation is the default segment, which will play automatically if no user inputs are received, or if there is a latency problem in the receipt or processing of user responses. 
         [0072]    Thus, interaction point  81  begins at frame number 60,888 (element  82 ) and ends at frame number 61,416 (element  83 ). The beginning time is 0:42:17 and the end time is 0:42:39, with a frame length of 528 frames. Each content segment  91 - 93  is produced to have the exact number of frames to ensure synchronization with the movie. 
         [0073]    The Decision Engine  94  delivers audio and video content to display screen (at home this is a television, in theatre or other commercial venue it is the digital projection system). Once the Decision Engine  94  has selected the pre-staged content and triggered delivery, that content segment is served by the Content Server  94  directly to the projection system or display. The entire process runs without any interruption in the flow of the movie and what the viewer sees on the screen. Because one pre-staged content segment is always designated as the default, there are no delays caused by the Interactive Movie Network Appliance or any of its components. 
         [0074]    The Decision Engine operates in a “fail safe” way, meaning that the movie will continue to play even if no user responses are received, or if the system is unable to process received responses. This fail safe play is accomplished by designating one of the pre-staged content options as the default selection in each instance. 
         [0075]    The Decision Engine stores all input response data in a relational database. 
         [0076]    Dynamic Interactive Movie Application for Set Top Box and Internet Connected Television 
         [0077]    A Dynamic Interactive Movie is different than a traditional movie viewing experience, in that there is real-time input solicited from the movie audience and that real-time audience input dynamically changes what is seen on screen. In an interactive movie sounds can also be dynamically selected and changed. In theatres with specialized equipment installed, other elements perceived by the senses, such as smells, temperature and wind can also be dynamically created and changed based on audience input. 
         [0078]    Dynamic Interactive movies solicit audience input through the handheld wireless devices the viewers already own and carry. The application works with the Apple iPhone, iPad and iPod Touch devices, as well as other similar devices. 
         [0079]    Referring to  FIG. 4 , shown therein is an exemplary embodiment  40  of a dynamic interactive movie app for a set top box and internet connected television. The Dynamic Interactive Movie Application  40  is a software application, which is downloaded and installed on a set top box device (e.g. Apple TV), or an Internet connected television. The Dynamic Interactive Movie Application  40  uses an existing Internet connection of the set top box or Internet connected television to connect to online sources for audio and video content and stores interactive audio and video content in a repository. The Dynamic Interactive Movie Application  40  provides internet connectivity through either a wired or wireless connection. The Dynamic Interactive Movie Application  40  creates an interface  42  between mobile devices and interactive content. The Dynamic Interactive Movie Application houses a Content Server and Decision Engine  42  and outputs movie content  41  to display devices (e.g., movie projection systems, televisions, computer monitors, wireless displays). 
         [0080]    Content Repository 
         [0081]    The content repository  43  is storage space on the set top box, Internet connected television or local network where interactive audio and video content is stored and is available for delivery to displays as directed by the Decision Engine. 
         [0082]    Decision Engine for Dynamic Interactive Movie Content Delivery 
         [0083]    The Decision Engine is a software component of the Dynamic Interactive Movie Application. The Decision Engine establishes a movie session by date, time, movie title and unique session identification number. The Decision Engine then associates registered wireless devices with an active movie session by date, time, movie title and unique session identification number. The Decision Engine sends input prompts to all registered and available devices, receives input responses from all registered devices and processes all received input responses from wireless devices. The Decision Engine retrieves indicated audio and video content from the repository based on input responses and delivers audio and video content to display screen (at home this is a television, in theatre or other commercial venue it is the digital projection system). The Decision engine stores all input response data. 
         [0084]    Downloadable Mobile Device Application 
         [0085]    Turning to  FIG. 5 , one aspect of the present invention includes a software application (App)  51  for a mobile wireless device  52  (e.g. smart phone, tablet, touch screen music or gaming device) that facilitates an Dynamic Interactive Movie experience, where audio and video content is dynamically displayed on the main viewing screen based on input and feedback from movie viewers, collected on the input screen (the mobile wireless device). The invention supports Dynamic Interactive Movie experiences BOTH in home and in commercial movie environments, such as movie theatres, auditoriums, sports stadiums and performance venues. 
         [0086]    The app  51  serves as an interface between a movie viewer and the movie being watched through a series of prompts and responses. The mobile device application  51  prompts the viewer to answer a question or make a selection relevant to the movie storyline and then delivers the user responses to a device or application for analysis and consolidation with other real time responses. Based on viewer input pre-staged content is then dynamically selected and served to the viewing screen. 
         [0087]    The Dynamic Interactive Movie Mobile Device Application (APP)  51  is software that is downloaded onto a handheld wireless device  52  such as a smart phone, tablet computer, audio or gaming device. The software application is written in the Objective C, C and C++ languages, and are executed on the Apple iPhone, iPad and iPod Touch using the OS Web Kit engine. 
         [0088]    The frameworks that are used in the software application include Game Kit, which contains the interfaces for managing peer-to-peer connectivity, and UIKit framework, which contains classes and methods for the iOS application user interface layer. The software application also includes the Foundation framework, which contains interfaces for managing strings, collections, and other low-level data types; MediaPlayer framework, which contains interfaces for playing full-screen video; and CoreMedia framework, which contains low-level routines for manipulating audio and video. 
         [0089]    Additionally, the software application includes CoreBluetooth framework, which is a back up to the GameKit and which allows the app to use BlueTooth. The software application also includes CFNetwork framework, which contains interfaces for accessing the network via Wi-Fi and cellular radios; System Configuration framework, which contains interfaces for determining the network configuration of a device; MessageUl framework, which contains interfaces for composing and queuing email messages; and CoreData framework, which contains interfaces for managing the application&#39;s data model. 
         [0090]    The software application also has the ability to operate in one of two modes—paired mode or independent play mode. 
         [0091]    Paired Mode 
         [0092]    The application has the ability to pair the Apple iPad displaying the Dynamic Interactive Movie with an Apple iPhone or 2nd generation iPod Touch (second screen). In paired mode the app can display content at full screen resolution, connect wirelessly to a second screen paired device, receive input prompts from primary screen (iPad), display input prompts on second screen, and receive user inputs from second screen. 
         [0093]    The pairing process is active and secure so that an unauthorized second screen within range cannot connect to the application without the user&#39;s knowledge or consent. 
         [0094]    Independent Play Mode 
         [0095]    When not paired with a second screen the application can operate in independent play mode. In this mode all app controls, user prompts and user inputs happen on the primary screen (iPad). 
         [0096]    This dual-mode capability is made possible by the application architecture which utilizes one universal application bundle with two distinct components—the base application component for the primary screen device (iPad) and the second screen application component for the handheld wireless device (Apple iPhone/iPod Touch). 
         [0097]    Nominally, there is one single application which is downloaded and installed on BOTH the iPad and the iPhone/iPod Touch. This is the universal application bundle. The bundle is able to determine which hardware device it is running on and activate the appropriate component automatically. 
         [0098]    The mobile App allows the user to create and store a user profile including name, photo, address, phone, email and a variety of personal preference information relating to movie going/viewing and can store credit card payment information related with the user profile. The mobile app has the ability to integrate the user profile with web-based social media systems, such as for example, Facebook, Twitter, or Linked-in. 
         [0099]    Moreover, the mobile app determines the location of the mobile device, relative to the movie screen using WIFI location based services (LBS), and allows the user to identify the section, row and seat number they are in at a commercial venue through WIFI location based services (LBS), or through direct user input in venues where row and seat numbers are marked. 
         [0100]    Additionally, the mobile app tracks a movie session by date, time, movie title and unique session identification number and communicates wirelessly with a Decision Engine  53  for Dynamic Interactive Movie Content Delivery. The mobile app receives input prompts from the Decision Engine  53  for Dynamic Interactive Movie Content Delivery, and delivers input responses to the Decision Engine  53  for Dynamic Interactive Movie Content Delivery. 
         [0101]    The mobile app also can integrate with the venue&#39;s concession and ticket point of sale systems to facilitate purchases by displaying concession options available at the commercial venue the user is in, enabling the user to place a concession order for pick up or delivery to the user&#39;s seat (in venues where that service is available); and enables the user to make a payment for ordered concessions using stored payment information. Additionally, the mobile app may allow the user to purchase (gift) concessions for another user in the same active movie session and notify them of the purchase by on-screen message. 
         [0102]    Still further, the mobile app may at the conclusion of a movie, prompt the user to provide a rating and review of the movie. 
         [0103]    The mobile app includes the capability to enable a user to request a chat session with another device in the same active movie session and to permit a user to choose to accept or decline a chat session request. 
         [0104]    The Interactive Movie mobile App is a software application that allows a user to interact with an movie  112  (either animated or non-animated) playing either in a public movie theatre, on an Apple iPad  113  or on an Apple TV device  114  (See  FIG. 11 ). 
         [0105]    Turning to  FIG. 12 , shown therein is an exemplary embodiment of a method  120  for interacting with a movie using an iPAD or similar mobile device. First, the mobile App is downloaded by the user and installed on an Apple iPhone, iPod Touch and/or iPad in step  121 . The primary function of the mobile App is to facilitate multi-directional communication between the movie (specially produced interactive animated content) and movie viewers. 
         [0106]    Next, the user views the movie on an iPad in step  122 . During the movie, input prompts are displayed on the iPAD in step  123 . In step  124 , the user responds to the prompts as directed on the user interface screen or on a paired secondary device, such as an iPhone or iPod touch. The optional steps  125  of use of a paired secondary device include downloading the mobile App onto an iPhone or iPod touch. The user then pairs the iPad (which is the primary viewing screen) with his or her secondary device, such as an iPhone or iPod touch. 
         [0107]    Turning to  FIG. 13 , shown therein is an exemplary embodiment of a method  130  for interacting with a movie being displayed on an Apple TV. First, the mobile App is downloaded by the user and installed on the Apple TV in step  131 . 
         [0108]    The Apple TV app prompts the users to download and install the mobile All onto their iPad, iPhone or iPod touch in step  137 . 
         [0109]    Next in step  132 , the users download the mobile App onto their iPad, Iphone or iPod touch. In step  138 , the mobile App on the user&#39;s iPad, iPhone or iPod touch prompts the users to pair with the Apple TV and register for an Interactive Movie Session, and in step  133  the user&#39;s pair their mobile device with the Apple TV. 
         [0110]    Next, the user starts the movie in step  134 . During the movie, input prompts are displayed on a screen (of their mobile device or Apple TV or both) in step  135 . In step  136 , the user responds to the prompts on the paired/registered iPad, iPhone, or iPod touch as directed on the user interface screen. 
         [0111]    Turning to  FIG. 14 , shown therein is an exemplary embodiment of a method  140  for interacting with a movie being displayed on movie theatre. First prior to the movie starting, the mobile App is downloaded by the user and installed on the his or her iPhone, iPad or iPod touch in step  141 . 
         [0112]    Next in step  142 , the user opens the App and completes a user profile. In step  143 , in the theatre the user opens the mobile App on the user&#39;s iPad, iPhone or iPod touch and registers on the in-theatre Interactive Movie Network 
         [0113]    Next, during the movie, input prompts are displayed on a movie screen in step  144 . In step  145 , the user responds to the prompts as directed on the user interface screen of the registed mobile device. 
         [0114]    The mobile App can connect to: another instance of the mobile App installed on a separate device; an Apple TV device; or an Interactive Movie Network Appliance installed in a public viewing venue such as a movie theatre, concert hall, sporting arena, or similar large venues. 
         [0115]    Multi-directional communication and interaction consists primarily of on-screen prompts for viewer input, and viewer responses to on-screen prompts. Input Prompts and Input Responses are exchanged wirelessly using standard WIFI and Bluetooth protocols. 
         [0116]    Production Process for Dynamic Interactive Movie Content 
         [0117]    Referring to  FIG. 6 , an exemplary embodiment of a process  60  for interactive audio/video content production is shown therein. Dynamic Interactive Movie content production happens in both the content development phase, writing phase, and in the production and editing phases. 
         [0118]    Writing Phase 
         [0119]    When movie content is written in the form of a screenplay, Interaction Points are identified in the script  61 . These interaction points are places where feedback/input from the audience is collected, tallied and used to determine what is seen on the screen or heard through speakers, or detected through other senses, in the physical movie viewing environment. 
         [0120]    Production and Editing Phase 
         [0121]    Interaction points are established by shooting or creating (in the case of animated movies), multiple versions of the same scene  62 . These scene versions are then staged for delivery to the display, based on the inputs received from the audience  63 .