Patent Description:
Since the early twentieth century, amusement parks (or theme parks) have substantially grown in popularity. Accordingly, there has been an increased demand and an accompanying increase in competition with respect to amusement parks. It is therefore desirable to add more entertaining and larger numbers of attractions to amusement parks. The addition of large attractions, such as rides and shows, generally provides an amusement park with additional capacity to handle a larger number of guests. However, such attractions tend to draw more visitors and become hubs for guest traffic. Further, the addition of traditional rides without an added layer of intrigue may be insufficient to garner sufficient guest interest to address either guest traffic issues or provide an advantage over competitors. Accordingly, it is now recognized that systems and methods that facilitate distribution of guest traffic and/or provide increased levels of entertainment value are desirable.

<CIT> discloses a system for controlling operation of a device based on gestures performed with a pen that is moved in free space. To facilitate detection of the pen trajectory with a camera, the pen comprises a spherical marker with a pattern of alternating stripes of retro-reflective material and light absorbing material.

<CIT> discloses a system for controlling operation of objects (e.g. unmanned airborne vehicles) through human gestures. The system comprises a plurality of articles (e.g. gloves) with retro-reflective markers worn by a user and a camera-based motion tracking system configured to monitor position and orientation of the articles. A gesture recognition module of the system is configured to analyse the captured position and orientation data and interpret which commands are being signalled by the user.

<CIT> discloses a game system that allows a user to perform input by moving an article with a retro-reflective sheet in a predefined manner in free space. The path traversed by the article is captured with a camera.

<CIT> discloses a gesture recognition system for remote controlling a television.

<CIT> discloses a system for providing interactivity to a guest of a theme park, based on gestures performed by the guest.

<CIT> discloses an interactive projection display having passive input devices with a retro-reflector. Different types of retro-reflectors placed within an infrared illumination region can be distinguished, wherein their discrimination allows to command different functions, such as a "right click" and "left click".

<CIT> discloses a motion controlled hand-held device including a control module operable to track movement of the device, identify a potential gesture, compare the potential gesture against gestures in a gesture database, and determine whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold. In some embodiments, the precision required for gesture input may be varied, wherein different levels of precision may be required for different users, and the users may be able to set the level(s) of precision required for some or all gestures.

According to the present invention there is provided a system according to Claim <NUM> and a method according to Claim <NUM>. Preferred embodiments of the invention are defined in Claims <NUM> to <NUM>. In the following description, embodiments will be described. These embodiments fall within the scope of the present invention only if they are in accordance with Claim <NUM> or Claim <NUM>.

In accordance with one aspect of the present invention, a system comprises a source of electromagnetic radiation configured to emit electromagnetic radiation into an area. The system also includes a sensing device configured to receive, at a plurality of times, the electromagnetic radiation after being reflected from a retro-reflective material of an article positioned in the area, wherein the retro-reflective material is one of a plurality of different types of retro-reflective materials having different characteristics. The sensing device is further configured to generate data based on the received reflected electromagnetic radiation. Further, the system includes a controller configured to process the data generated by the sensing device to determine, for each of the plurality of times, a corresponding position of the article; identify, based on the plurality of positions of the article, a path through which the article has moved within the area; determine whether the path correlates to a stored path of a plurality of stored paths representing pre-defined gesture, comprising identifying the characteristic of the retro-reflective material, and applying a tolerance level, of a plurality of tolerance levels, with respect to determining correspondence between the path and the stored path, based on the characteristic identified, wherein each retro-reflective material of the plurality of different types of retro-reflective materials has a corresponding tolerance level and output a control signal to actuate a corresponding effect in response to determining that the path correlates to the stored path of the plurality of stored paths representing pre-defined gestures.

In another aspect of the present invention, a method includes emitting electromagnetic radiation into an area via a source of electromagnetic radiation. The method also includes receiving, at a plurality of times, at a sensing device, the electromagnetic radiation after being reflected from a retro-reflective material of an article positioned in the area, wherein the retro-reflective material is one of a plurality of different types of retro-reflective materials having different characteristics. Further, the method includes generating data, via the sensing device, based on the received reflected electromagnetic radiation; determining, via a controller, for each of the plurality of times, a corresponding position of the article; identifying, based on the corresponding positions of the article, a path through which the article has moved within the area; determining whether the path correlates to a stored path of a plurality of stored paths representing pre-defined gesture, comprising identifying the characteristic of the retro-reflective material, and applying a tolerance level, of a plurality of tolerance levels, with respect to determining correspondence between the path and the stored path, based on the characteristic identified, wherein each retro-reflective material of the plurality of different types of retro-reflective materials has a corresponding tolerance level; and outputting a control signal from the controller to actuate an effect in response to determining that the path correlates to the stored path of the plurality of stored paths representing pre-defined gestures.

It has now been recognized that it is desirable to provide small interactive attractions throughout an amusement park that economically entertain the guests while also diverting traffic from major attractions. It has also been recognized that all attractions, whether large or small, may benefit from an interactive component or layer. Accordingly, present embodiments are directed to a passive article tracking system that is capable of tracking movement of a passive article (e.g., wand) and actuating certain effects based on an identified article or wand path corresponding to a defined gesture.

The disclosed wand tracking system may be implemented as or with amusement park attractions including shows, restaurants, rides, shops, and so forth. Present embodiments enable implementation in outdoor and indoor environments, which facilitates implementation in a variety of scenarios. Further, present embodiments include economical and theme-oriented components and characteristics of operation. For example, an actuation tool in accordance with present embodiments includes a passive wand, which has no actively functioning components (e.g., no light emitting diodes, gyroscopes, or radio frequency identification transmitter). This serves to keep the operational aspects of the wand a mystery, which is in keeping with a magical theme and also makes the wand more economical. For example, the passive wand does not include electronics or require batteries, which adds intrigue with respect to its operation while, more practically, saving expenses associated with including electronic components and batteries. By employing the passive wand detection system as an attraction or along with an attraction in an amusement park, guests are incentivized to visit the amusement park and are further enabled to immerse themselves in the thematic experience provided by the amusement park.

<FIG> is a perspective view of a system <NUM> in accordance with present embodiments. The system <NUM> may incorporate material and functional features such as disclosed in <CIT>, which is hereby incorporated by reference. The system <NUM> is designed to detect relative positioning of an illuminated component having a properly correlated retro-reflective material and to utilize the relative positioning to identify whether a correlation exists between predefined gestures and a path traced by the illuminated component. If a proper correlation is found to exist, the system is capable of actuating an effect (e.g., activate a motor, ignite a flame, or open a valve) to provide entertainment to amusement park guests. In one embodiment, if a proper correlation is found, an output may be provided to a computer, display, or monitoring device. Specifically, the system <NUM> includes an emitter <NUM>, a sensing device <NUM>, a controller <NUM>, and an effect device <NUM>. In the illustrated embodiment, the system <NUM> is completely disposed behind a window <NUM> and components of the system are hidden from view through the window by camouflaging material <NUM> (e.g., mirrored glass, netting, or textured plastic) to make the system invisible to participants. However, different arrangements of components of the system <NUM> and implementations in different environments are included in the present disclosure.

The emitter <NUM> operates to emit electromagnetic radiation, which is represented by an expanding light beam <NUM> for illustrative purposes, to bathe or flood an active playing area <NUM> in the electromagnetic radiation. The light beam <NUM> may be representative of multiple light beams being emitted from different sources. Further, the light beam <NUM> is emitted at a frequency that has a correspondence to a material defining a retro-reflective tip <NUM> on a wand <NUM> that is being wielded by a guest <NUM>. The retro-reflective tip <NUM> may include a coating of retro-reflective material disposed on a body <NUM> of the wand <NUM> or a solid piece of material coupled with the body <NUM> of the wand <NUM>. The retro-reflective tip <NUM> may coordinate with the light beam <NUM> to reflect electromagnetic radiation back towards the sensing device <NUM> to facilitate identification of a location of the retro-reflective tip <NUM> by the system <NUM>. This location information (obtained based on the reflected electromagnetic radiation) may then be utilized by the controller <NUM> to determine whether the effect device <NUM> or a component of the effect device should be actuated, such as causing a fake flower <NUM> of the effect device <NUM> to move. It should be noted that, in some embodiment, the retro-reflective material may be positioned at different locations on the wand <NUM> other than the tip. Further, in some embodiments, the light beam <NUM> represents a limited number of light beams or light emissions (provided in series or simultaneously) that are used to identify the position of the wand <NUM>, which may be facilitated by the retro-reflective tip <NUM>. Indeed, the retro-reflective tip may operate or be designed to always or essentially always return radiation (e.g., light) to its source.

Specifically, in operation, the sensing device <NUM> of the system <NUM> may function to detect the light beam <NUM> bouncing off of the retro-reflective tip <NUM> and provide data associated with detection to the controller <NUM> via cables <NUM> for processing. It should be noted that while in the illustrated embodiment the various components of the system <NUM> are communicatively coupled with electric cabling <NUM>, in other embodiments the components may communicate wirelessly. Once the controller <NUM> receives the data from the sensing device <NUM>, the controller <NUM> may utilize a processor <NUM> and/or a memory <NUM> to determine a location of the retro-reflective tip <NUM>. Indeed, the controller <NUM> may employ known visual boundaries or an established orientation of the sensing device <NUM> to identify a location (e.g., coordinates) corresponding to the detected retro-reflective tip <NUM>.

The process of emitting the light beam <NUM>, sensing of the reflected light from the retro-reflective tip <NUM>, and determining a location of the retro-reflective tip <NUM> may be performed by the controller <NUM> numerous times over a short period in order to identify a series of locations of the retro-reflective tip <NUM>. Indeed, such procedures may essentially be performed continuously to facilitate identification of a path <NUM> through which the retro-reflective tip <NUM> has moved within the active playing area <NUM> during a particular timeframe or simply in continuous series. Once the path <NUM> has been detected, a determination is made by the controller <NUM> as to whether the path <NUM> properly correlates to a pattern or gesture identified by the system <NUM> as corresponding to actuation of the effect device <NUM>. For example, the system <NUM> may perform a comparison of the path or identified path <NUM> with stored paths <NUM> (such as illustrated in <FIG>) to determine whether one or more actions should be performed by the effect device <NUM>. For example, if the identified path <NUM> correlates to a particular one of the stored paths <NUM>, the controller <NUM> may actuate the effect device <NUM> such that the flower <NUM> is made to move. This gives the illusion that a guest properly performing a wand movement is magically causing the flower to move or grow. It should be noted that a correspondence between the identified path <NUM> and particular stored paths <NUM> may result is different types of actuation (e.g., a first wand movement may cause the flower to appear to shrink and a second wand movement may cause the flower to appear to grow). It should be noted that some embodiments may perform interpolation between identified positions as a component of identifying the path <NUM>.

In the embodiment illustrated by <FIG>, the emitter <NUM> and the sensor or sensing device <NUM> are integral features such that a plane of operation associated with the sensing device <NUM> is essentially overlapping with a plane of operation associated with the emitter <NUM>. However, the sensing device <NUM> (e.g., an infrared camera) may be positioned in a different location with respect to the emitter <NUM>, which may include an infrared light bulb. For example, as illustrated in <FIG>, the emitter <NUM> and sensing device <NUM> are separate and positioned in different locations. Specifically, the emitter <NUM> of <FIG> is positioned outside of the window <NUM> of a storefront containing other components of the system <NUM>. The sensing device <NUM> of <FIG> is positioned away from the emitter <NUM> but still oriented to detect light reflected from the retro-reflective tip <NUM> and originating from the emitter <NUM>. For illustrative purposes, arrows <NUM>, <NUM> represent a light beam being emitted from the emitter into the active playing area <NUM>, reflected by the retro-reflective tip <NUM>, and detected by the sensing device <NUM>. The light beam represented by the arrow <NUM> is merely one of numerous light beams that flood or otherwise selectively illuminate the active playing area from the emitter <NUM>.

As in <FIG>, the system of <FIG> utilizes a series of detected emitter light reflections (e.g., <NUM>) from the retro-reflective tip <NUM> to identify and/or track wand positioning. The sensing device <NUM> generates data based on the reflected electromagnetic radiation (e.g., <NUM>) and a series of detections may correspond to the detected wand path <NUM>. The controller <NUM> assembles this data and determines whether certain patterns were formed by the detected path <NUM> traced by the retro-reflective wand tip <NUM> during a certain timeframe or in a continuous series despite the timeframe. If certain known or stored patterns <NUM> correlate (e.g., match) with the detected path <NUM>, the controller <NUM> may actuate the effect <NUM>, such as activate a motor <NUM> to move a fake rabbit <NUM> out of a hat prop <NUM>.

<FIG> illustrates a block diagram of the system <NUM> and certain details of a processing engine <NUM> of the controller <NUM> in accordance with present embodiments. The system <NUM> performs data acquisition with the detector or sensing device <NUM> and then the controller <NUM> utilizes the data to classify gestures or movement paths of the retro-reflective wand tip <NUM>. Specifically, the processing engine <NUM> may perform certain pre-processing tasks on data received from the sensing device <NUM> with a pre-processing module <NUM>. This pre-processing module <NUM> may function to facilitate robust performance when operating in various different light conditions (e.g., the active playing area <NUM> is in broad daylight). Next, a feature extraction module <NUM> may function to extract certain features from the data acquired from the sensing device <NUM> and pre-processed by the pre-processing module <NUM>. This extraction of features may include determining wand positions within a frame, tracking multiple wands (e.g., identify and track ten different wand gestures simultaneously), identifying gesture temporal segmentation with motion trajectories between static wand positions considered to be potential gestures, and trajectory interpolation. For example, <FIG> illustrates a plot of detected locations <NUM> of the retro-reflective wand tip within a frame and interpolations <NUM> between the detected locations <NUM>. The detected locations <NUM> and interpolation <NUM> cooperate to form a pattern <NUM>, which is essentially the detected wand path <NUM>. This detected wand path <NUM> is then analyzed by a gesture recognition module <NUM> to determine whether the detected wand path <NUM> correlates to a stored wand path <NUM>. If there is sufficient correspondence between the detected wand path <NUM> and one of the stored wand paths <NUM>, the processing engine <NUM> or controller <NUM> will actuate an associated output <NUM>. This may include directly activating an effect device <NUM> or instructing a separate controller (e.g., a programmable logic controller) to perform the task. It should be noted that the controller <NUM> may include a computer or any of various different industrial automation controllers.

Present embodiments include a wand-based gesture recognition system and method for use in an amusement park. In particular, the embodiments illustrated in <FIG> and <FIG> are generally representative of implementations in a storefront environment. However, in other embodiments, the system <NUM> may be employed to add a layer of entertainment to other entertainment features. For example, as illustrated in <FIG>, the system <NUM> may be employed in conjunction with a ride to add to guest enjoyment and immersion in the ride environment. Specifically, for example, <FIG> illustrates guests <NUM> on a ride vehicle <NUM> utilizing the system <NUM> to actuate activation of a water fountain <NUM> integrated in the ride environment. As described above, the system is projecting light <NUM> and receiving reflected light <NUM> to identify gestures made with the wand <NUM> or, more precisely, the retro-reflective wand tip <NUM>.

Present embodiments include the system being capable of detecting a passive wand with a retro-reflective material that allows a guest to manipulate the wand to control various effects when proper gestures are made within an active playing area. The system functions without any active features on the wand. That is, the wand does not include a gyroscope, light emitter, radio frequency transmitter, or any other functional component. This not only simplifies the system for users but also provides a cost benefit. Further, present embodiments enable operation in a wide range of lighting conditions (including broad daylight), whereas traditional gesture recognition technologies do not function well in broad daylight due to interference from electromagnetic radiation from the sun. Present embodiments allow an amusement park to add small venues for guest entertainment and diversify other attractions.

Claim 1:
A system (<NUM>) comprising:
a source (<NUM>) of electromagnetic radiation configured to emit electromagnetic radiation into an area (<NUM>);
a sensing device (<NUM>) configured to:
receive, at a plurality of times, the electromagnetic radiation after being reflected from a retro-reflective material (<NUM>) of an article (<NUM>) positioned in the area; wherein the retro-reflective material is one of a plurality of different types of retro-reflective materials having different characteristics; and
generate data based on the received reflected electromagnetic radiation; and
a controller (<NUM>) configured to:
process the data generated by the sensing device to determine, for each of the plurality of times, a corresponding position of the article (<NUM>);
identify, based on the plurality of positions of the article, a path through which the article has moved within the area; determine whether the path correlates to a stored path of a plurality of stored paths representing pre-defined gestures, comprising identifying the characteristic of the retro-reflective material, and applying a tolerance level, of a plurality of tolerance levels, with respect to determining correspondence between the path and the stored path, based on the characteristic identified, wherein each retro-reflective material of the plurality of different types of retro-reflective materials has a corresponding tolerance level;
and
output a control signal to actuate a corresponding effect in response to determining that the path correlates to the stored path of the plurality of stored paths representing pre-defined gestures.