Patent Description:
This discussion is believed to help provide the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it is understood that these statements are to be read in this light, and not as admissions of prior art.

Theme parks, amusement parks, theaters, movie theaters, stadiums, concert halls, and the like have been created to provide guests with various immersive experiences. These entertainment venues may include show attractions (e.g., movies, plays, rides, games) that provide the guests with the immersive experiences. For example, traditional show attractions may utilize various combinations of physical show elements (or props), staging, and lighting to create various visual effects from the guest's perspective. One commonly utilized visual effect may be referred to as a Pepper's Ghost illusion. For example, a traditional Pepper's Ghost system may employ a primary stage (a first scene), a secondary stage (a second scene), and an optical beam splitter (e.g., a pane of glass) positioned to essentially combine images from each scene when viewed from an audience's point of view. Imagery from the second scene may be reflected from the beam splitter (e.g., reflected from a glass surface) toward the audience, while imagery from the first scene is transmitted through the beam splitter (e.g., transmitted through the glass). Stage lighting may be controlled to illuminate aspects of the scenes but not the beam splitter. This may increase visibility of desired scene features and limit or prevent observation of the beam splitter itself by the audience. This creates an illusion of a physical presence on the primary stage that is actually a mere reflection of the secondary stage.

Document <CIT> discloses an interactive Pepper's Ghost system involving a character on stage within one of projector screen locations, using a handheld device to write/draw in the air. A position/ orientation sensor on the handheld device feeds sensor information back to a control system so that the writing appears on a second projector screen. The resultant image is visible to the viewers by means of reflection from a mirror and appears to be located at a selected location.

While well-established effects, such as a traditional Pepper's Ghost effect, are effective illusions, it is now recognized that these traditional effects lack meaningful audience interaction. For example, the audience, which may include one or more guests, generally have no control over various aspects of a show built around such effects. In other words, the audience in such traditional systems is passive. In today's environment, in which guests are accustomed to more interaction (e.g., via video games), such passive interaction can cause a loss of interest. Further, even in shows employing audience interaction, it is presently recognized that technological limitations may cause audience interaction to be overly expensive, inaccurate, inconsequential, or any combination thereof. Accordingly, improved show attractions are desired.

Indeed, the present disclosure may encompass a variety of forms that may be similar to or different from embodiments set forth below.

According to the invention, an interactive Pepper's Ghost system comprises a sensor configured to detect a parameter indicative of an orientation of a handheld device, and a controller configured to receive, from the sensor, sensor feedback corresponding to the parameter indicative of the orientation of the handheld device, determine, based on the sensor feedback, a location at which the handheld device is pointed, and generate to control a Pepper's Ghost visual effect at the location. based on the sensor.

In an embodiment, an entertainment system includes a transparent or translucent screen, a plurality of light emitters directed toward the transparent or translucent screen, a handheld device, a sensor configured to monitor an orientation of the handheld device, a controller configured to receive sensor feedback from the sensor indicative of the orientation of the handheld device, wherein the controller is configured to select at least one light emitter of the plurality of light emitters based on the sensor feedback and to activate the at least one light emitter to emit light onto the transparent or translucent screen such that a Pepper's Ghost effect is created from a perspective at the handheld device.

In an embodiment, an interactive Pepper's Ghost system includes a handheld device configured to be held by an operator, a sensor configured to monitor an orientation of the handheld device, a microphone configured to detect voice audio from the operator, a transparent or translucent screen, and a controller. The controller is configured to receive first data feedback indicative of the orientation of the handheld device from the sensor, and determine, based on the first data feedback, a location of the transparent or translucent screen toward which the handheld is pointed. The controller is also configured to receive second data feedback indicative of the voice audio from the operator, and determine, based on the second data feedback, a voice command of a plurality of available voice commands. The controller is also configured to activate, based on the location determined by the controller and the voice command determined by the controller, at least one light emitter of a plurality of light emitters such that the at least one light emitter emits light onto the location of the transparent or translucent screen to generate a Pepper's Ghost effect.

The present disclosure relates generally to an interactive Pepper's Ghost system and method for entertainment venues (e.g., theme parks, amusement parks, theaters). More particularly, the present disclosure relates to a system that controls a Pepper's Ghost effect based on interaction from a guest.

Various entertainment venues may provide guests with a number of immersive, interactive experiences. For example, entertainment venues may include show attractions that utilize various combinations of physical show elements (or "props") and lights to cause various visual effects. However, in certain traditional embodiments, these show attractions may lack audience interaction. Further, in traditional show attractions that do employ audience interaction, the audience interaction may not exert or cause any control over the show attraction. For example, a story told by the show attraction may be fixed and the audience may lack meaningful control over changing certain aspects of the story.

In accordance with the present disclosure, an interactive Pepper's Ghost system may enable audience interaction that, for example, enables some control over aspects of a scene or story. The audience control may be enabled by monitoring guest movement (or movement of a device controlled by the guest) and propagated or facilitated at least in part by a Pepper's Ghost visual effect. In accordance with the present disclosure, "Pepper's Ghost" may refer to a visual effect enabled by various staging/lighting structures and techniques that include a primary stage (a first scene), a secondary stage or dark room (a second scene), and an optical beam splitter (e.g., a pane of glass) positioned to essentially combine images from each scene when viewed from the guest's point of view. Imagery from the second scene (e.g., from the dark room, which may not be directly visible to the audience) may be reflected from the beam splitter (e.g., reflected from a glass surface) toward the audience, while imagery from the first scene is transmitted through the beam splitter (e.g., transmitted through the glass). Stage lighting may be controlled to illuminate aspects of the scenes but not the beam splitter. This may increase visibility of desired scene features and limit or prevent observation of the beam splitter itself by the audience. This creates an illusion of a physical presence on the primary stage that is actually a mere reflection of the secondary stage.

The interactive Pepper's Ghost system in accordance with the present disclosure includes a controller and a handheld device. The handheld device may be, for example, a confetti cannon, a wand, a key, a console controller, a cell phone, or some other handheld device. An orientation of the handheld device (and in some embodiments a position of the handheld device) may be monitored by the controller. In some embodiments, infrared light detection may be employed to enable the controller to monitor the orientation of the handheld device. For example, in an embodiment, the handheld device may include an infrared light emitter, and the controller may be communicatively coupled with an infrared sensor (or array of infrared sensors) configured to detect the infrared light emitted from the infrared light emitter of the handheld device. In another embodiment, the handheld device may include an infrared light reflector, a separate infrared light emitter may emit infrared light toward the infrared light reflector of the handheld device, and the controller may be communicatively coupled with an infrared light sensor (or array of infrared sensors) configured to detect infrared light reflected by the infrared light reflector of the handheld device. In yet another embodiment, different aspects of the handheld device may be detected (e.g., a shape, barcode, reflective coating), such as by a camera. Further, gyroscopes and/or accelerometers located at the handheld device may also be employed to monitor an orientation and location of the handheld device.

Based on the sensor feedback received by the controller from the infrared light sensor or other sensors (e.g., camera, gyroscope, accelerometer), the controller may determine the orientation of the handheld device, such as a toy magic sword. For example, the controller may determine a direction in which the handled device (e.g., toy magic sword) is directed or pointed. While infrared light detection or other sensor devices may be used to determine a position of the handheld device, in some embodiments the position of the handheld device is fixed (e.g., in a pre-defined zone) such that the position of the handheld device is known relative to the other components of the system. Based on the orientation and position of the handheld device, the controller may control a Pepper's Ghost effect that simulates a visual effect perceived by the guest as though it is caused by the handheld device. For example, if the handheld device is a toy magic sword as previously described, the controller may control a Pepper's Ghost visual effect to simulate a spell cast by the magic sword. The Pepper's Ghost visual effect is described in detail below and may be defined as an illusion of the presence of a feature (e.g., an image, object, item, prop or the like) in a scene, wherein the feature is actually reflected from a separate scene that is not directly viewable by an audience positioned to observe the Pepper's Ghost visual effect.

The interactive Pepper's Ghost system may include various features that enable the Pepper's Ghost effect. For example, the interactive Pepper's Ghost system may include a stage and a transparent or translucent screen (e.g., beam splitter) disposed between the handheld device and the stage. In general, a more transparent screen (e.g., beam splitter) may enable a more authentic effect than a less transparent screen. For conciseness, the transparent or translucent screen may be referred to in certain instances below as "screen. " In general, the screen may be invisible or mostly invisible from a perspective of an operator (e.g., guest) holding the handheld device. In some embodiments, the handheld device, the transparent or translucent screen, and the stage may be disposed in a row or straight line. That is, a line of sight from the handheld device, or the guest controlling the handheld device, may extend from a location of the handheld device, through the transparent or translucent screen, and into the stage. A dark room may be disposed adjacent to the transparent or translucent screen and may be offset from the above-described line of sight. The dark room may include dark walls and a number of controllable lights configured to project or direct light toward the transparent or translucent screen. Further, the dark room may not be directly visible to an operator of the handheld device and other guests in the audience. In some embodiments, the controllable lights may be disposed in a grid, and certain ones of the controllable lights may be triggered or activated by the controller based on the above-described sensor feedback to project or direct light toward certain areas of the transparent or translucent screen. The transparent or translucent screen may be disposed at an angle, such as a <NUM>-degree angle, with respect to the above-described line of sight, and an additional angle, such as an additional <NUM>-degree angle, with respect to a direction of the light provided via the lights disposed in the dark room.

Angling the screen as described above enables the light directed from the dark room toward the screen to appear, from a perspective of a guest at or adjacent to the handheld device, as though it corresponds to a visual effect occurring on the stage. That is, while the light from the dark room is projected onto the screen between the handheld device and the stage, the light reflecting off the screen appears to the guest as though it is a visual effect occurring behind the screen, which is invisible or mostly invisible to the guest, and on the stage. In some embodiments, physical items may be disposed in the dark room and the above-described lights disposed in the dark room may cause an illumination of the physical items and corresponding reflection onto the transparent or translucent screen, thereby giving the impression that the physical items in the dark room also exist in the stage behind the transparent or translucent screen. In other embodiments, the above-described lights may directly simulate visual effects onto the transparent or translucent screen without any other physical items disposed in the dark room.

In accordance with the present disclosure, the handheld device may include a toy cannon that simulates shooting confetti, water, smoke, or the like onto the stage behind the transparent or translucent screen. In some embodiments, the stage may include various show elements, or props, that interact with the Pepper's Ghost effect. For example, a visual effect may simulate a particular appearance or disposition associated with one of the props (e.g., confetti landing on a chair). In some embodiments, the controller may cause a physical effect to the prop corresponding to, or working in conjunction with, the visual effect. For example, the visual effect caused by the lights from the dark room and corresponding to the orientation of the handheld device may simulate an appearance of fire, smoke, vapor, electricity, lighting, water, snow, or the like being emitted from the handheld device, and the controller may move the prop to correspond to the visual effect (e.g., forward movement, backward movement, side-to-side movement, rotation, breaking, splitting, joining). In general, the above-described system enables a guest to operate the handheld device to cause a visual Pepper's Ghost effect that simulates guest interaction with the stage, props on the stage, and a scene or story conveyed by the stage and props.

In some embodiments, a microphone is employed to capture a voice command by the operator (e.g., guest) of the handheld device (e.g., confetti cannon). The controller may be communicatively coupled with the microphone and configured to receive data feedback from the microphone. The voice command may correspond to a particular visual effect of a number of available visual effects stored to a memory of the controller. For example, a first voice command may cause a first visual effect (e.g., red, orange, and yellow light graphics or light simulating fire) and a second voice command may cause a second different visual effect (e.g., blue, white, and gray graphics or light simulating water). Accordingly, the system causes a Pepper's Ghost visual effect at a location corresponding to an orientation of the handheld device, and having aesthetic characteristics (e.g., color) corresponding to a voice command. These and other features are described in detail below.

Continuing with the drawings, <FIG> is an overhead view of an embodiment of an interactive Pepper's Ghost system <NUM>. In the illustrated embodiment, the system <NUM> includes an audience compartment <NUM> in which a handheld device <NUM> (e.g., a confetti cannon), is disposed, a stage compartment <NUM> in which show elements <NUM>, <NUM> (or props) and at least one projector <NUM> are disposed, a midsection compartment <NUM> in which a transparent or translucent screen <NUM> (referred to as "screen" below) is disposed, and a dark compartment <NUM> in which effect lights <NUM> (e.g., LED lights, a display, a television screen) are disposed. As described in detail below, the system <NUM> may utilize the above-described compartments <NUM>, <NUM>, <NUM>, <NUM> (referred to in certain instances below as "rooms") and corresponding components to simulate a visual effect in the stage compartment <NUM> caused by the handheld device <NUM>. That is, the visual effect may coincide with a position and orientation of the handheld device <NUM> such that the position and orientation of the visual effect is aligned with the positioned and orientation of the handheld device <NUM> such that, for example, the effect appears to have originated from the handheld device <NUM>.

The system <NUM> may also include a controller <NUM> having a processor <NUM> (e.g., processing circuitry) and a memory <NUM> (e.g., memory circuitry), an infrared sensor <NUM> (e.g., a camera), an infrared emitter <NUM>, and an infrared reflector <NUM>. The memory <NUM> may include instructions stored thereon that, when executed by the processor <NUM>, cause the controller <NUM> to perform various functions. While the controller <NUM>, the infrared sensor <NUM>, and the infrared emitter <NUM> are illustrated in the midsection compartment <NUM> of the system <NUM> (i.e., adjacent to the screen <NUM>), it should be understood that the controller <NUM>, the infrared sensor <NUM>, and the infrared emitter <NUM> may be disposed in other compartments of the system <NUM>. Further, any one of the controller <NUM>, the infrared sensor <NUM>, or the infrared emitter <NUM>, if disposed in the midsection compartment <NUM>, may be disposed in an area that does not substantially block a line of sight from the handheld device <NUM>, through the screen <NUM>, and into the stage compartment <NUM>. In an embodiment, the controller <NUM>, the infrared sensor <NUM>, and the infrared emitter <NUM> may be small enough to be positioned within the above-described line of sight without substantially reducing an experience of an operator (e.g., guest) of the handheld device <NUM> or other guest positioned in the audience compartment <NUM>.

In the illustrated embodiment, the infrared emitter <NUM> may be configured to emit infrared light toward the handheld device <NUM>, and an infrared reflector <NUM> on the handheld device <NUM> may reflect the infrared light. The infrared reflector <NUM> may include a mechanism, such as a filter, that reflects light (e.g., infrared light) having a wavelength within a particular range of wavelengths (e.g., between approximately <NUM> nanometers and <NUM> millimeter). The infrared sensor <NUM> may be configured to detect the reflected infrared light. In some embodiments, the infrared sensor <NUM> may include a grid of sensors configured to detect the infrared light. In some embodiments, no infrared reflector is employed at the handheld device <NUM> and instead the infrared emitter <NUM> is disposed at the handheld device <NUM>, such that the infrared light emitted by the infrared emitter <NUM> of the handheld device <NUM> is detected by the infrared sensor <NUM>. In either case, the controller <NUM> may receive sensor feedback from the infrared sensor <NUM> indicative of an orientation of the handheld device <NUM>. In some embodiments, the sensor feedback may also be indicative of a position of the handheld device <NUM> (e.g., including any combination of X, Y, and Z coordinates). However, in the illustrated embodiment, the handheld device <NUM> is disposed at or within a zone <NUM> whose coordinates are known by the controller <NUM> (e.g., as the zone <NUM> is positioned a pre-defined and known distance <NUM> from the infrared sensor <NUM>), such that an approximate position of the handheld device <NUM> is known and need not be monitored. Other position and orientation monitoring is also possible, such as via gyroscopes, accelerometers, shape recognition cameras, communication signals (e.g., Bluetooth), and the like employed at the controller <NUM> and/or the handheld device <NUM>.

Based on the above-described sensor feedback (e.g., infrared feedback, camera feedback, gyroscope feedback, accelerometer feedback), the controller <NUM> may control the lights <NUM> disposed in the dark room <NUM> which, when directed toward the screen <NUM>, simulate a visual effect perceived by a guest in the audience compartment <NUM> as though it occurs in, or interacts with, the stage <NUM>. For example, the lights <NUM> may be disposed in a grid (e.g., via an array of LED lights). Further, the lights <NUM> may include an array of screens or LED panels that can provide detailed graphic effects (e.g., an animated explosion). The controller <NUM> may utilize the above-described sensor feedback to trigger certain of the lights <NUM> in the grid such that the triggered ones of the lights <NUM> cause visual effects associated with the position and orientation of the handheld device <NUM>. For example, a guest may point the handheld device <NUM> toward the show element <NUM> in the stage compartment <NUM> of the system <NUM>. The controller <NUM> may determine at least the orientation of the handheld device <NUM> based on the above-described sensor feedback. The controller <NUM> may then trigger certain ones of the lights <NUM> to direct light toward certain areas of the screen <NUM>. The screen may be disposed at an angle <NUM> (e.g., approximately <NUM>-degree angle +/- <NUM> degrees) relative to a line of sight <NUM> through the audience compartment <NUM>, the midsection compartment <NUM>, and the stage compartment <NUM>. The screen <NUM> may also be disposed at an angle <NUM> (e.g., approximately <NUM>-degree angle +/- <NUM> degrees) with respect to a line of sight <NUM> from the dark compartment <NUM> toward the midsection compartment <NUM>.

Due to the above-described angles <NUM>, <NUM> of the screen <NUM>, and the fact that the screen <NUM> includes a transparent or translucent material, the light reflected onto the screen <NUM> from the lights <NUM> in the dark room (e.g., triggered by the controller <NUM>) may cause a visual effect that appears to an operator of the handheld device <NUM> as though it occurs in the stage compartment <NUM>, aligned with the show element <NUM> toward which the handheld device <NUM> is pointed. Accordingly, from the perspective of an operator of the handheld device <NUM>, or any other guest positioned in the audience compartment <NUM> of the system <NUM>, a visual effect is perceived as though it occurs in the stage compartment <NUM> and originates from the handheld device <NUM>. As previously described, a more transparent material for the screen <NUM> may improve an authenticity of the visual effect. Other than the controlled actuation of the lights <NUM> in the dark compartment <NUM>, the dark compartment <NUM> may include a dark (e.g., black) material that reduces any undesired light reflection onto the screen <NUM> (e.g., light other than the light directed toward the screen <NUM> via the lights <NUM> in the dark compartment <NUM>).

In some embodiments, a microphone <NUM> communicatively coupled with the controller <NUM> may also be employed to trigger the visual effect. For example, the microphone <NUM> may detect a voice command (e.g., from an operator of the handheld device <NUM>) indicative of a command to cause a visual effect. The microphone <NUM> and/or controller <NUM> may include voice recognition software configured to determine the voice command and an effect type associated with the voice command. Several commands and corresponding different visual effects may be possible. For example, if the handheld device <NUM> is an effect cannon, several voice or audio commands may correspond to several different types of virtual effect material (e.g., water, confetti, fireworks) that can be expelled by the cannon. The visual effect associated with the various different types of visual effect material can be simulated as though they are cast from the handheld device <NUM> (e.g., cannon) toward or onto various show elements <NUM>, <NUM> or other areas of the stage compartment <NUM>. Thus, the controller <NUM> may monitor the orientation of the handheld device <NUM> and may trigger, based on voice commands detected by the microphone <NUM> and the orientation of the handheld device <NUM>, the appropriate lights <NUM> in the dark compartment <NUM> to cause the appropriate visual effect (e.g., water) perceived by the operator as occurring at the appropriate show element(s) <NUM>, <NUM> or other areas in the stage compartment <NUM>. That is, the controller <NUM> may determine which lights <NUM> to trigger based on the orientation monitoring of the handheld device <NUM> (e.g., via the sensor <NUM>), and the controller <NUM> may determine when to trigger the lights based on the audio or voice command (e.g., via the microphone <NUM> feedback). In some embodiments, each light <NUM> may include various colored lights. For example, each light <NUM> may include multiple LED lights corresponding with multiple different colors. As described above, various types of different visual effects may be caused in response to various types of different audio or voice commands. A first audio command corresponding to a first spell may cause a first visual effect having a first color or combination of colors, and a second audio command corresponding to a second spell may cause a second visual effect having a second color or combination of colors. Accordingly, feedback from the microphone <NUM> may be employed to determine the spell (e.g., desired visual effect), and the controller <NUM> may control the lights <NUM> such that the appropriate color(s) corresponding to the determined spell are directed toward the screen <NUM>.

As previously described, at least on projector <NUM> may be disposed in the stage compartment <NUM>. While two projectors <NUM> are illustrated in <FIG>, any number of projectors is possible. The projectors <NUM> may be configured to illuminate the stage <NUM> and corresponding show elements <NUM>, <NUM> (e.g., at all times during the show or attraction). Further, actuation assemblies <NUM>, <NUM> may be employed to cause movement of the show elements <NUM>. For example, the actuation assembly <NUM> associated with the show element <NUM> may include a motorized track-and-trolley that moves the show element <NUM> laterally <NUM> across a track, as shown. The actuation assembly <NUM> may include a motorized fastener that is disengaged (e.g., via control by the controller <NUM>) to cause the corresponding show element <NUM> to break into two pieces <NUM>, <NUM>. Other actuation assemblies are also possible in accordance with the present disclosure.

Control of the show elements <NUM>, <NUM> (e.g., via the actuation assemblies <NUM>, <NUM>) may coincide with control of the lights <NUM> in the dark room <NUM> based on the sensor feedback associated with the orientation of the handheld device <NUM> and/or voice commands. For example, the controller <NUM> may simulate the visual effect via the lights <NUM> such that the visual effect appears to occur at the show element <NUM> as the show element <NUM> is moved laterally <NUM> via the actuation assembly <NUM>. In one example, the guest may direct the handheld device <NUM> toward the show element <NUM> and provide a command intended to move the show element <NUM> as though the handheld device <NUM> can control gravity. The controller <NUM> may receive sensor feedback from the infrared sensor <NUM> (or some other orientation monitoring sensor) corresponding to the orientation of the handheld device <NUM> and feedback from the microphone <NUM> corresponding to the command by the guest. The controller <NUM> may cause the visual effect, via actuating certain of the lights <NUM> to direct light toward certain areas of the screen <NUM>, such as simulating an appearance of electricity being emitted from the handheld device <NUM> toward the show element <NUM>. Additionally, the controller <NUM> may instruct movement of the show element <NUM> to correspond with the visual effect. It should be noted that the above-described information exchange components (e.g., at least the controller <NUM>, the infrared sensor <NUM>, the microphone <NUM>, the lights <NUM>, and the show elements <NUM>, <NUM>) may be wirelessly connected via an network system <NUM> (e.g., an Internet system). Certain of these components may be additionally or alternatively wire-connected.

<FIG> is an overhead perspective view of an embodiment of the interactive Pepper's Ghost system <NUM> of <FIG>. In the illustrated embodiment, the lights <NUM> included in the dark compartment <NUM> of the system <NUM> may be arranged in a grid <NUM>, as previously described. It should be noted that, for clarity, the lights <NUM> (e.g., individual lights, LED arrays or panels, display screens) are illustrated through a backside of a dark wall <NUM> of the dark compartment <NUM>. However, it should be understood that the lights <NUM> may not be visible through the backside of the dark wall <NUM> and are instead positioned inside the dark compartment <NUM> and directed toward the screen <NUM>. In general, the dark compartment <NUM> may include dark walls (e.g., the dark wall <NUM>, a dark wall <NUM>, and a dark wall <NUM>) that reduce undesired reflections of light onto the screen <NUM>. The system <NUM> may also include multiple other walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM> defining the various compartments <NUM>, <NUM>, <NUM> of the system <NUM>. In some embodiments, the wall <NUM> may traverse the stage compartment <NUM>, the mid-section compartment <NUM> having the screen <NUM>, and the audience compartment <NUM>. In other embodiments, the wall <NUM> may include three separate walls (or panels) for each of the compartments <NUM>, <NUM>, <NUM>. The walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> will be described in detail with reference to later drawings.

The grid <NUM> of the lights <NUM> corresponding to the dark compartment <NUM> may include columns C1, C2, and C3 and rows R1, R2, and R3. A first light <NUM> may be disposed at C1, R1, a second light <NUM> may be disposed at C2, R1, a third light <NUM> may be disposed at C3, R1, a fourth light <NUM> may be disposed at C1, R2, a fifth light <NUM> may be disposed at C2, R2, a sixth light <NUM> may be disposed at C3, R2, a seventh light <NUM> may be disposed at C1, R3, an eight light <NUM> may be disposed at C2, R3, and a ninth light <NUM> may be disposed at C3, R3. The lights <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be collectively referred to as the lights <NUM>. Further, it should be noted that each one of the lights <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may include multiple lights having multiple different colors, or may include a single light capable of emitting multiple different colors. For example, the light <NUM> may be capable of emitting red, green, and blue light, among others.

In the illustrated embodiment, the screen <NUM> may include a grid <NUM> corresponding to the grid <NUM> of the lights <NUM> in the dark compartment <NUM>. For example, control of the first light <NUM> disposed in C1, R1 of the grid <NUM> may cause the first light <NUM> to direct light to a corresponding area of the grid <NUM> associated with the screen <NUM>. Of course, the grid <NUM> associated with the screen <NUM> is not visible and simply corresponds to the physical locations of the various lights <NUM> in the dark compartment <NUM>. Further, a grid <NUM> in the stage compartment <NUM> may correspond with the grid <NUM> of the screen <NUM> and the grid <NUM> of the lights <NUM> in the dark compartment <NUM>. Again, the grid <NUM> in the stage compartment <NUM> is not visible and instead simply corresponds to the physical locations of the various lights <NUM> in the dark compartment <NUM>. By controlling, for example, the first light <NUM> in C1, R1 of the grid <NUM>, light is directed toward the corresponding area of the grid <NUM> of the screen <NUM>, and the light is reflected by the screen <NUM> to simulate a visual effect, from the perspective of a guest in the audience compartment <NUM>, occurring in a corresponding area of the grid <NUM> of the stage compartment <NUM>. Control of the lights <NUM> in the dark compartment <NUM> may be conducted in the manner described above with respect to <FIG>.

Referring back to <FIG>, it should be noted that only one controller <NUM> having one processor <NUM> and memory <NUM> is illustrated. However, it should be understood that multiple controllers may be employed to communicate with each other to achieve the above-described effects. For example, the controller <NUM> in <FIG> may be representative of any number of controllers, such as a first controller configured to receive sensor feedback from the infrared sensor <NUM> and the microphone <NUM>, a second controller communicatively coupled with the first controller and configured to activate various ones of the lights <NUM>, and a third controller configured to control operation of the stage compartment <NUM> and the corresponding show elements <NUM>, <NUM>. Other control schemes are also contemplated in accordance with the present disclosure.

For example, <FIG> is a schematic block diagram illustrating an example of a control scheme <NUM> for controlling the interactive Pepper's Ghost system <NUM> of <FIG>. In <FIG>, a single controller <NUM> is illustrated. However, the single controller <NUM> may be representative of multiple controllers working in conjunction to cause the various effects described with respect to <FIG>. For example, in <FIG>, the "controller <NUM>" may include four separate controller components, including an input manager <NUM>, an LED manager <NUM>, a stage projector manager <NUM>, and a physical object manager <NUM>. Each of the control components (or managers) <NUM>, <NUM>, <NUM>, <NUM> may include a dedicated processor and memory. That is, the processor <NUM> and memory <NUM> illustrated in <FIG> may be representative of dedicated processors and memories for each of the control components (or managers) <NUM>, <NUM>, <NUM>, <NUM> illustrated in <FIG>.

The input manager <NUM> in <FIG> may be configured to receive a device orientation input from the infrared sensor <NUM> (or some other input sensor, such as a camera, gyroscope, accelerometers, or the like) and an audio input <NUM> from the microphone <NUM>. The input manager <NUM> may determine various control features based on the inputs <NUM>, <NUM> as previously described. The input manager <NUM> may include, for example, a video game console. The LED manager <NUM> may be configured to receive data from the input manager <NUM> based on the processing by the input manager <NUM> of the orientation input <NUM> and the audio spell input <NUM>. For example, the input manager <NUM> may indicate to the LED manager <NUM>, via the data communicated thereto, the orientation of the handheld device <NUM> of <FIG> and the operation intended to be implemented based on the audio spell input <NUM>. The LED manager <NUM> may then control the appropriate ones of the lights <NUM> (LEDs in the illustrated embodiment) to simulate the Pepper's Ghost effect in accordance with the orientation input <NUM> and the audio input <NUM>, as previously described. The LED manager <NUM> may also communicate data to the physical object manager <NUM> indicative of which lights <NUM> will be, or are being, activated. The LED manager <NUM> may also indicate the type of effect being activated to the physical object manager <NUM>. The physical object manager <NUM> may then control the show elements <NUM>, <NUM> (referred to as physical objects in <FIG>) in accordance with the data received from the LED manager <NUM>. For example, if an effect corresponds to a spray of high pressure water, the object manager <NUM> may control a prop to move in response to impact by the virtual stream of water.

The input manager <NUM> may also communicate data to the stage projector manager <NUM>. As previously described, one or more stage projectors <NUM> may be used to illuminate a stage visible to an operator of the handheld device <NUM> (e.g., wand) of <FIG>. In certain embodiments, the projectors <NUM> may be controlled to increase or decrease a brightness of light emitted from the projectors <NUM>. Control of the projectors <NUM> may improve an authenticity of the Pepper's Ghost visual effect provided in accordance with the discussion above. Further, the projectors <NUM> may be selectively controlled to correspond to the various types of spells being simulated by the system. For example, one spell may cause the stage visible to the guest to go dark or darker, namely, by controlling the projectors <NUM> to reduce a brightness of the light or negate the light emitted from the projectors <NUM>. The above-described control scheme is one example of various control components (e.g., the input manager <NUM>, the LED manager <NUM>, the stage projector manager <NUM>, the physical object manager <NUM>) that may communicate with each other to achieve the desired Pepper's Ghost effect discussed in detail with reference to <FIG> and <FIG>. However, other schemes are also possible.

<FIG> is an overhead perspective view of an embodiment of a foldable housing <NUM> for the interactive Pepper's Ghost system <NUM> of <FIG>. The foldable housing <NUM> may include the various walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> illustrated in <FIG> defining the various compartments <NUM>, <NUM>, <NUM>, <NUM> (or rooms) illustrated in <FIG>. The wall <NUM> illustrated in <FIG> is removed in <FIG>, but in certain embodiments, the foldable housing <NUM> of <FIG> may include the wall <NUM> of <FIG>.

In the embodiment illustrated in <FIG>, the various walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be connected at joints <NUM>. Further, the wall <NUM> may include three separate walls (or panels) <NUM>, <NUM>, <NUM> connected via the joints <NUM>. The joints <NUM> may include hinges <NUM> (represented by circles in the illustrated embodiment) configured to enable the walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> (including the panels <NUM>, <NUM>, <NUM> of the wall <NUM>) to fold relative to each other. In some embodiments, the screen <NUM> utilize to generate the Pepper's Ghost effect may be removed from the foldable housing <NUM> before the foldable housing <NUM> is folded into a stack. In other embodiments, the screen <NUM> may attach to one of the walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> or panels <NUM>, <NUM>, <NUM> and/or may be sized to be folded into the stack. Further, it should be noted that the sizes and dimensions of the features of the foldable housing <NUM> and screen <NUM> in <FIG> are mere examples and should not be taken as exact. In certain embodiments, all the walls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> and panels <NUM>, <NUM>, <NUM> may include similar widths (e.g., distance <NUM> between two joints <NUM>). The foldable housing <NUM>, one example of which is illustrated in <FIG>, may enable mobility and easier storage of the system.

<FIG> is a process flow diagram illustrating an embodiment of a method <NUM> of operating the interactive Pepper's Ghost system <NUM> of <FIG>. The method <NUM> includes detecting (block <NUM>) an orientation of a handheld device. For example, as previously described, the orientation of the handheld device, such as a toy magic sword, may be monitored via an infrared light assembly described with respect to <FIG> or other monitoring devices (e.g., shape detecting cameras). Additionally or alternatively, other sensors such as gyroscopes and accelerometers employed at the handheld device may be utilized to detect the orientation of the handheld device. A controller may receive data feedback from the sensor or sensors described above, and may determine the orientation of the handheld device (e.g., a direction the handheld device is pointed, or a location or object at which the handheld device is pointed).

The method <NUM> also includes detecting (block <NUM>) a voice command by an operator of the handheld device. For example, as previously described, a number of voice commands corresponding to various types of visual effects may be possible. The above-described controller may include voice recognition software that determines the voice command from the number of voice commands available. For example, a voice command of "fire" may cause a first visual effect (e.g., an effect that looks like fire or a stream of fire) and a voice command of "water" may cause a second visual effect (e.g., an effect that looks like a stream of water). A microphone may detect the voice command and the controller may receive data feedback from the microphone indicative of the voice command.

The method <NUM> also includes selecting (block <NUM>) a visual effect from a number of available visual effects based on the orientation of the handheld device and the voice command. For example, as previously described, the voice command may be utilized by the controller to determine an aesthetic of the visual effect (e.g., fire, smoke, vapor, electricity, lighting, water, snow). The orientation of the handheld device may be utilized by the controller to determine a location at which the visual effect is created. For example, as previously described, the system may include the handheld device, a stage across from a zone of the handheld device (e.g., audience seating), and a transparent or translucent screen disposed between the handheld device and the stage. The operator may point the handheld device toward a location of the stage and/or a show element or prop (e.g., physical object) disposed on the stage. The operator may announce instructions (e.g., a spell). Based on the detected orientation of the handheld device, the controller may activate at least one light disposed in a dark room or compartment to direct light toward an appropriate area of the transparent or translucent screen. From the perspective of the operator of the handheld device, the light reflected off the transparent or translucent screen may cause a Pepper's Ghost effect that simulates a visual effect occurring in the stage area at the location (or show element) toward which the handheld device is pointed.

The method <NUM> also includes controlling (block <NUM>) the above-described show element or prop on the stage to correspond to the selected visual effect caused by activation of the at least one light in block <NUM>. For example, control of the show element may coincide with the visual effect. Indeed, the visual effect directed toward the show element may coincide with a movement (e.g., lateral movement, back and forth movement, breaking, splitting, joining) of the show element. The controller may time activation of the at least one light and the movement of the show element such that they occur substantially simultaneously and/or in an order that gives the operator of the handheld device the impression that handheld device and spell caused the visual effect and the movement of the show element.

The above-described interactive Pepper's Ghost system may enable improved audience interaction with a show attraction at an entertainment venue. Improved audience interaction, which may enable the audience (e.g., a guest) to control various aspects of the show attraction may improve guest attentiveness and entertainment.

While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art, as soon as such modifications and changes fall within the scope of the invention as defined by the appended claims.

Claim 1:
An interactive Pepper's Ghost system (<NUM>), comprising:
a sensor configured to detect a parameter indicative of an orientation of a handheld device (<NUM>);
and
a controller (<NUM>) configured to:
receive, from the sensor, sensor feedback corresponding to the parameter indicative of the orientation of the handheld device (<NUM>);
determine, based on the sensor feedback, a location at which the handheld device (<NUM>) is pointed; and
generate a Pepper's Ghost visual effect at the location.