Synchronized motion simulation for virtual reality

Embodiments of the invention provide for a motion-synchronized virtual reality experience. In particular, in some embodiments, the invention includes a motion platform to impart a shared motion experience to a plurality of passengers, individual head-mounted displays providing for personalized viewpoints, and a variety of immersion-enhancements. A common ride model to controls the motion platform in order to simulate a ride for a plurality of passengers. The passengers' virtual-reality headsets depict the progress of the ride through the virtual-reality world. These headsets track the individual passenger's head or gaze to allow the user to adjust their angle of view in the virtual world simply by looking around. As such, different passengers can be looking in different directions simultaneously, allowing a much greater immersion than the single fixed perspective of prior ride simulations.

BACKGROUND

Embodiments of the invention generally relate to virtual reality and, more particularly, to virtual reality rides with synchronized motion and individualized virtual viewpoints for each passenger.

2. Related Art

Traditionally, motion simulated rides have, of necessity, been limited to presenting a single, shared viewpoint for all passengers. Typically, a screen is placed at the front of a motion platform and all passengers are oriented to face towards the screen, which presents a single video perspective to which the motion platform can be synchronized. However, this greatly limits the passengers' perspectives.

By contrast, virtual reality systems have typically been limited to single-user, fixed installations due to the inherent difficulty in synchronizing the displays for multiple uses, the lack of uniformity in content display and presentation, and the inherently isolating experience of wearing a head-mounted virtual reality display. As such, what is needed is a system that can provide a synchronized, shared ride experience to a group of passengers with the enhanced immersion provided by synchronized motion simulation. Immersion can further be improved through the additional enhancements made possibly in a ride environment, such as high-fidelity shared audio, rumble-enabled seats, and shared atmospheric effects.

SUMMARY

Embodiments of the invention address the above-described need by providing for a motion-synchronized virtual reality experience. In particular, in a first embodiment, a system for providing a motion-synchronized virtual reality ride for a plurality of passengers, comprises a motion platform supported by a plurality of actuators, a plurality of passenger seats mounted upon the motion platform, a plurality of passenger head-mounted displays, and a ride model programmed to control the plurality of actuators in accordance with the ride model, and communicate information regarding progress of the ride to each of the passenger head-mounted displays, wherein each of the passenger head-mounted displays combine the information regarding progress of the ride with passenger gaze information to display a personalized viewpoint for each passenger of the plurality of passengers.

In a second embodiment, a system for providing a motion-synchronized virtual-reality ride for a plurality of passengers comprises a plurality of motion platforms, each platform supported by a plurality of actuators, wherein each motion platform of the plurality of motion platforms comprises at least one seat mounted thereon, a plurality of passenger head-mounted displays; and a ride model programmed to control the plurality of actuators for each of the plurality of motion platforms in accordance with the ride model, and communicate information regarding progress of the ride to the plurality of passenger head-mounted displays, wherein each of the plurality of passenger head-mounted displays combine the information regarding the progress of the ride with passenger gaze information to display a personalized viewpoint for each passenger of the plurality of passengers.

In a third embodiment, a system for providing a motion-synchronized virtual-reality ride for at least one passenger comprises at least one motion platform supported by a plurality of actuators, wherein the at least one motion platform comprises at least one seat, at least one passenger head-mounted display, at least one ride control configured for a user input, and a ride model programmed to receive information indicative of a state of a drone, control the plurality of actuators in accordance with the ride model and the ride control, wherein the ride model includes of a set of characteristics associated with the drone, control the at least one motion platform in accordance with the information indicative of the state of the drone, the ride model, and the user input, and communicate information regarding progress of the ride to the at least one passenger head-mounted display, wherein the at least one passenger head-mounted display combines the information regarding the progress of the ride with passenger gaze information to display a personalized viewpoint for the at least one passenger.

DETAILED DESCRIPTION

At a high level, embodiments of the invention use a common ride model to control a motion platform simulating a ride for a plurality of passengers. The passengers are equipped with virtual-reality headsets that depict the progress of the ride through the virtual-reality world. These headsets may be equipped with head-tracking or gaze-tracking features to allow the user to adjust their angle of view in the virtual world simply by looking around. As such, different passengers can be looking in different directions simultaneously, allowing a much greater immersion than the single fixed perspective of prior ride simulations.

The subject matter of embodiments of the invention is described in detail below to meet statutory requirements; however, the description itself is not intended to limit the scope of claims. Rather, the claimed subject matter might be embodied in other ways to include different steps or combinations of steps similar to the ones described in this document, in conjunction with other present or future technologies. Minor variations from the description below will be obvious to one skilled in the art, and are intended to be captured within the scope of the claimed invention. Terms should not be interpreted as implying any particular ordering of various steps described unless the order of individual steps is explicitly described.

Turning first toFIG. 1, an exemplary hardware platform for certain embodiments of the invention is depicted. Computer102can be a desktop computer, a laptop computer, a server computer, a mobile device such as a smartphone or tablet, or any other form factor of general- or special-purpose computing device. Depicted with computer102are several components, for illustrative purposes. In some embodiments, certain components may be arranged differently or absent. Additional components may also be present. Included in computer102is system bus104, whereby other components of computer102can communicate with each other. In certain embodiments, there may be multiple busses or components may communicate with each other directly. Connected to system bus104is central processing unit (CPU)106. Also attached to system bus104are one or more random-access memory (RAM) modules. Also attached to system bus104is graphics card110. In some embodiments, graphics card104may not be a physically separate card, but rather may be integrated into the motherboard or the CPU106. In some embodiments, graphics card110has a separate graphics-processing unit (GPU)112, which can be used for graphics processing or for general purpose computing (GPGPU). Also on graphics card110is GPU memory114. Connected (directly or indirectly) to graphics card110is display116for user interaction. In some embodiments no display is present, while in others it is integrated into computer102. Similarly, peripherals such as keyboard118and mouse120are connected to system bus104. Like display116, these peripherals may be integrated into computer102or absent. Also connected to system bus104is local storage122, which may be any form of computer-readable media, and may be internally installed in computer102or externally and removeably attached.

Finally, network interface card (NIC)124is also attached to system bus104and allows computer102to communicate over a network such as network126. NIC124can be any form of network interface known in the art, such as Ethernet, ATM, fiber, Bluetooth, or Wi-Fi (i.e., the IEEE 802.11 family of standards). NIC124connects computer102to local network126, which may also include one or more other computers, such as computer128, and network storage, such as data store130. Generally, a data store such as data store130may be any repository from which information can be stored and retrieved as needed. Examples of data stores include relational or object oriented databases, spreadsheets, file systems, flat files, directory services such as LDAP and Active Directory, or email storage systems. A data store may be accessible via a complex API (such as, for example, Structured Query Language), a simple API providing only read, write and seek operations, or any level of complexity in between. Some data stores may additionally provide management functions for data sets stored therein such as backup or versioning. Data stores can be local to a single computer such as computer128, accessible on a local network such as local network126, or remotely accessible over Internet132. Local network126is in turn connected to Internet132, which connects many networks such as local network126, remote network134or directly attached computers such as computer136. In some embodiments, computer102can itself be directly connected to Internet132.

Turning now toFIG. 2, a block diagram illustrating certain components making up one embodiment of the invention is depicted and referred to generally by reference numeral200. A first component present in such embodiments is ride model202. A driver204may use ride controls206to communicate with the ride model202. The driver204may be riding on a ride in which the ride model uses actuators to move a motion platform208with passengers210. The diver204and passengers210may also wear head-mounted displays212that present images to the driver204and passengers210to further immerse the users into the virtual reality.

Broadly speaking, ride model202contains the information used to generate the digital model of the ride. For example, if the ride is a simulated roller coaster, then ride model202would contain information describing the shape of the track, the physics of the roller coaster, the background scenery, and so forth. If the ride is a free-path simulated trip through a virtual world, ride model202may contain a three-dimensional model of the virtual world, capabilities of the virtual vehicle, models and behaviors for virtual actors in the virtual world, and so forth. In some embodiments, ride model202further controls the ride during operation by modeling the virtual objects in the virtual world and their interactions. For example, in an adventure ride where the passengers210can shoot simulated monsters, ride model202may be responsible for controlling the behaviors of the monsters, tracking where the passengers210are aiming, determining whether a shot hits a monster and modeling the result, and so forth. Further, ride model202may incorporate information from remote data sources. For example, the ride model202may receive data from an unmanned vehicle (not shown) such as, for example, video from a camera, motion, and orientation information. The ride model202may incorporate this information into a dynamic model of the unmanned vehicle and present a simulation to the passengers210of the ride. The dynamic model of the unmanned vehicle may be a set of characteristics or parameters that define the motion and orientation of the unmanned vehicle when commanded and uncommanded inputs act on the unmanned vehicle.

In the creation of the virtual world, the ride model202may also add in representatives of the passengers210of the ride. For example, the passengers210may be imaged before riding. The image information may be processed and the processor may be programmed to create a representative figure in the virtual world. The representative figure may be dependent on the type of ride. For example, in the monster shooting ride described above, a photograph of a driver204may be taken and the image used to create a representative image of the driver204that may be a realistic image or may be a virtual representation such as, for example, a type of superhero or military figure. The driver204may also be given options of characters or representations to use during the ride or outfits for the driver representatives to be dressed in.

In some embodiments, the progress of the ride may be controlled by a dedicated passenger such as driver204using ride controls206. Ride controls206may include a physical or virtual control interface operable by driver204and communicate with ride model202. For example, if the ride is an African safari, then driver204may be provided with a steering wheel and set of pedals to control where a safari vehicle goes. In some embodiments, these controls may be virtualized. For example, motion-tracking software can track the hands of driver204as they operate a purely virtual steering wheel shown in a head-mounted display. In still other embodiments, a conventional gaming controller (such as a joystick or gamepad) can be used to control the progress of the ride. In some embodiments, ride controls206are instead operated by a dedicated ride operator rather than a passenger. In other embodiments, more than one passenger is provided with ride controls206. In still other embodiments, the ride controls may be operated by a remote vehicle such as an autonomous vehicle with a predefined or adaptable trajectory. The ride model204may receive information from the autonomous vehicle to provide a simulation to the driver204. The path of the vehicle may also be altered by the driver204such that the ride model202uses a combination of the driver input via the ride controls206and the autonomous vehicle telemetry information to provide a simulation to the driver204.

In some embodiments, ride model202and ride controls206communicate to jointly control motion platform208. Broadly speaking, motion platform208provides high-fidelity motion simulation for passengers210and/or driver204. For example, passengers210may be seated in chairs that are attached to a platform that is in turn supported by a plurality of hydraulic actuators. By appropriately activating the hydraulic actuators, the platform upon which passengers210are seated can be raised, lowered, and tilted. In some embodiments, motion platform208may also be mounted on a turn table or otherwise allow rotations of the platform. One, two, or three turn tables may be used in combination to provide rotation about any axis.

In still other embodiments, the motion platform208or individual passenger seats may be mounted on three-axis gimbal system to allow free three-dimensional rotation on any axis. Such gimbal systems can be used alone or in combination with hydraulic actuators to provide for the broadest ranges of motion. The gimbal system can also be in combination with a boom that may provide translation in any three-dimensional direction. The gimbal system may also be attached to a track or rails to provide translational motion to the motion platform208.

In some embodiments, the seats for passengers210are provided with individual tilt controls alone or in combination with those for motion platform208. The combination of actuators controlling all seats and actuators controlling individual seats allows the ride model202and the passengers210to provide both combined experiences for all passengers210and individual experiences to the ride.

Additionally, each passenger210may be provided with a head-mounted display212providing a personalized view of the virtual world. Such head-mounted displays can track the motion of the user's head and update their display in accordance with the motions of the user and also with the ride. Returning to the above-described example of a virtual roller coaster, the joint operation of ride model202, motion platform208, and head-mounted display212can be described. When ride model202determines that the virtual ride begins, the virtual cars of the roller coaster ascend the first lift hill. Because the roller-coaster cars are parallel to the tracks at any given point in the ride, ride model202determines that motion platform208should tilt the platform upon which passengers210are seated by raising the front side and lowering the rear side. As such, hydraulic actuators at the front of platform extend and hydraulic actuations at the rear of the platform collapse to tilt the platform appropriately. Simultaneously, ride model202communicates this tilt to the head mounted displays. Causing the viewing angle of the simulated display to rise towards the skies. In other embodiments, the head-mounted displays212have orientation sensors and transmit orientation and motion information to the ride model202that in turn projects the rise toward the sky based on the information from the head-mounted displays212. In some embodiments, head-mounted displays212are opaque, displaying only the simulated environment. In other embodiments, head-mounted displays212are partially transparent augmented reality displays, overlaying a display on the user's actual field of view.

In some embodiments, the motion platform208may move along a track. In this case, the platform may be on a turntable as described above. The motion platform208may be programmed to rotate on the turntable at specific times during the course of the ride. For example, the ride may be the roller coaster described above and traversing a jungle scene as presented via the head-mounted displays212. The roller coaster goes down a hill and the virtual reality image shows a scene of the passengers going under water. The motion platform208rotates to face a shark in the water. The rotation of the motion platform208faces the passengers212in a direction where an event is taking place, however, the passengers are wearing the head-mounted displays212and still have the freedom to look in any direction providing a personalized experience.

In some embodiments, ride model202communicates a change to the head-mounted displays212directly. In other embodiments, head-mounted displays212include gyroscopes and/or accelerometers to determine that the passenger's head has moved with the motion platform208and update the view based on the change in orientation of the passenger's head. In still other embodiments, both of these techniques may be used. For example, the head-mounted displays212may measure the movement of the user's head with respect to the motion platform208, and display changes not reflected in the orientation of the motion platform208(for example, rotations) can be communicated directly to the head-mounted displays212. Thus, for example, if a simulated roller coaster executes a banking turn to the right, motion platform208may tilt in the appropriate direction (i.e., to the right), while ride model202instructs head-mounted displays212to rotate the perspectives of passengers210accordingly.

Importantly, however, the individual viewpoints of each passenger can also be respected. Thus, for example, one passenger is looking to their left as the roller-coaster executes the above described turn, their head-mounted display would initially show a leftward view (with respect to the roller-coaster car), which would swing right through the turn, eventually facing the original direction of travel of the rollercoaster as the turn continues. Thus, in this example, the current direction of travel of the virtual roller-coaster car would set the base direction of the viewpoint for all passengers210, which could then be adjusted based on the orientation of each passenger's head relative to the platform. In this way, the passengers210can enjoy a joint ride without being restricted to the single viewpoint of a fixed screen.

In order to further increase user immersion, a variety of additional effects may be integrated into motion platform208. For example, the seat for each passenger210may integrate a rumble unit to simulate the vibration of a ride. In some embodiments, each passenger gets the same rumble, while in other embodiments, the rumble for each passenger is determined by their position on motion platform208, the user's point of view, or other factors specific to a particular passenger. Other immersion features, such as fans to provide simulated wind and fog or mist machines may also be included and synchronized into the simulation. Audio effects may also be provided based on the ride model202. For example, a ride may simulate going through a waterfall causing water to be dropped or sprayed from an overhead system controlled by the ride model202. The ride may travel through a burning building, causing heat to be provided from a heater and fan next to the motion platform208while sound effects representing the sound of fire are crackling from speakers on the motion platform208, mounted strategically throughout the ride, or through headphones worn by the passengers210. Any combination of real effects mixed with virtual reality is contemplated.

Turning now toFIG. 3, a second exemplary embodiment of a motion-synchronized virtual reality ride is depicted and referred to generally by reference numeral300. The motion-synchronized virtual reality ride, as depicted, consists of driver motion platform302including driver ride controls304and driver306, and passenger motion platform308including passenger ride controls310and passenger312. The driver motion platform302and driver ride controls304are connected to the ride model314as are passenger motion platform308and passenger ride controls310. Driver306and passenger312are seated in driver motion platform302and passenger motion platform308respectively. Driver306is wearing driver head-mounted display316and passenger308is wearing passenger head-mounted display318.

In some embodiments, driver motion platform302and passenger motion platform308includes actuators and controls that move driver motion platform302and passenger motion platform308independently. When driver306provides input to the driver ride controls304, driver motion platform302may be actuated in response to the input and passenger motion platform308may not receive the input. However, a representation of driver motion platform302with driver306may be depicted in the passenger head-mounted display318of passenger312and the depiction may move relative to the inputs of driver306. Motions of the driver306may also be recorded by motion detecting cameras and sent to the ride model202and processed and depicted in the passenger head-mounted display318.

The ride model314may connect to the driver motion platform302and the passenger motion platform308such that representative models of the driver motion platform302and the passenger motion platform308and the driver306and the passenger312are displayed in the head-mounted displays. Any movement of the driver motion platform302and the passenger motion platform308caused by inputs from the passengers, a person running the ride, or provided by the ride model314may be depicted in the head-mounted displays. This creates a unique experience for each driver306and passenger312that has a combination of sensory experiences that both diver306and passenger312experience and individual sensory experiences that each experience independently.

In some embodiments, driver306and passenger312may be playing a game using their respective motion platforms connected to the ride model314. Driver306and passenger312may be connected to the ride model314and both may experience the same game or same environment but acting independently. For example, driver306may be operating the driver ride controls304and flying a spaceship, aircraft, boat, or any other vehicle as simulated by the ride model314and viewed through the head-mounted displays316. Passenger312may be a gunner on the vehicle and acting independently. The seat that the gunner (passenger312) is in moves relative to the inputs of the controls of the passenger312while both driver306and passenger312seats move relative to the actions and inputs of driver306. In this case, the seat of passenger312moves in accordance with the motion of the vehicle that driver306is controlling as well as the motion that passenger312is controlling. This creates a joint objective but independent gaming experience.

Alternatively, in some embodiments, both or each of the driver motion platform302and the passenger motion platform308may be controlled by a person not on the ride300. For example, the ride300may be run by a venue employee and the driver306and the passenger312may not have control or may have limited control. For example, the ride300may be a safari ride in which the driver306and the passenger312are taken on an African safari. An African landscape and animals are viewed through the driver head-mounted display316and the passenger head-mounted display312. The African surroundings may be viewed by the driver306and the passenger312looking to either side to see different surroundings. The head-mounted displays have sensors that detect motion and orientation and transmit the information to the ride model314. The ride model314then displays the images associated with the orientation of the head-mounted displays. The venue employee may conduct the ride and navigate the African terrain while explaining the different sights and sounds of the safari to the driver306and the passenger312.

The driver306and the passenger312may provide input to the head-mounted displays to further control the ride. Continuing with the African safari example described above, the driver306may see a lion in the distance, which is too far away to see with clarity. The driver306may provide user input to the driver head-mounted display316such as through a button, switch, knob, or any other input causing the display to zoom in on the animals, simulating the effect of binoculars. The driver head-mounted display316continues to display images associated with the driver's gaze but with a zooming effect.

In yet another example the ride model314may be remotely connected to or in communication with a vehicle and simulate the motion and orientation of the vehicle while displaying the vehicle environment or a virtual environment. For example, the ride model314may communicate wirelessly with an unmanned system such as a land vehicle, a submarine, or an unmanned aerial vehicle (UAV), (collectively, “drones”). The UAV may be controlled by a pilot outside of the motion platforms, a ride director, the driver306, or the passenger318and either connected or not connected to the ride model314. The UAV may have a camera attached and a transmitter that transmits the video captured to the ride model314along with telemetry data of the UAV. The ride model314may use the telemetry data to simulate the actions of the UAV on the driver motion platform302and the passenger motion platform308. The video data may be used by the ride model314and the head-mounted displays to show the video scene associated with the orientation of the head-mounted displays. In certain embodiments, the video data from the UAV may also be sent directly to the head-mounted displays. The UAV can have sensors onboard such as a gyroscope, accelerometer, GPS, air pressure sensor, or any other sensors that may record telemetry information such as motion and orientation information of the UAV. The telemetry information may be received in real-time or stored and later recalled for use in ride300. The telemetry information may be sent to the ride model314and a visual representation of the UAV may be displayed via the head-mounted displays. The driver306and the passenger312may also view the images from the camera or a simulated virtual reality. The driver306and the passenger312may also provide input via the ride controls that control the UAV and simultaneously control the ride while viewing input from the camera on the UAV via the head-mounted displays and feeling a representative motion of the UAV via the motion platforms. The simulation of the UAV may be performed by a three, six, or any other degree of freedom dynamic model of the UAV and incorporate the telemetry information for a realistic simulation. The ride model314may have a stored database of aircraft and UAV dynamic models or may access an online database for simulation of the aircraft and UAVs. For example, the driver316flies a quadcopter style UAV, or drone, through an obstacle course in a race against other drones controlled by other users. The drone has a camera and sensors recording and transmitting telemetry data to the ride model314. The driver motion platform308moves according to the telemetry data such that all driver inputs are actuated as well as uncommanded inputs. Uncommaned inputs may be wind gusts, bumps from other drones, collisions with obstacles, or any other input to the drone that is not commanded by the driver306. The passenger312may be another drone operator in the same race and may be connected to ride model314such that all drones in the race utilize the same ride model314. In some embodiments, the driver306and the passenger312connect to the drones through different ride models that are not connected.

Turning now toFIGS. 4A-Cdepicting exemplary embodiments of a mobile motion platform. The motion platform may be self-powered or may ride on a mobile device providing a mobile platform that may be relocated as desired. In this manner, the motion platform may move from location to location to different events quickly and easily. The mobile motion platform may also provide new and exciting experiences for the passengers.

FIG. 4Adepicts and exemplary embodiment of a mobile motion platform generally referred to by reference numeral400. As depicted a motion platform402is mounted in a trailer404such that the motion platform402may be moved from location to location. The motion platform402has independent seats for multiple passengers406wearing head-mounted displays408. For example, motion platform402may be mounted inside the trailer404and the trailer404may be attached to a vehicle (not shown). In some such embodiments, motion platform402moves relative to (i.e., independently of) the trailer404. In other embodiments, motion platform402utilizes the suspension of the trailer404to provide a tilting motion. In still other embodiments, motion platform402provides for a “stowed” configuration where it fits compactly inside the trailer, and a “deployed” configuration, where motion platform402is supported independently from the trailer404(for example, by deployable struts) which provide for the tilting and/or other motions of motion platform402. Further, motion platform402may be capable of both translation and rotation within the trailer404.

In some embodiments, the motion platform402may be one integrated platform supporting multiple passengers406using one ride model or there may be multiple independent motion platforms each with separate ride models supporting multiple passengers406.

The trailer404may be taken to a manned or unmanned airshow such as the Red Bull Air Race World Championships where telemetry information from a manned vehicles flying through an obstacle course may be transmitted to the ride model controlling the movement of the motion platforms402in the trailer404. The head-mounted displays408may display information from cameras onboard the aircraft and the telemetry data from the aircraft may be fed through an aircraft simulation model provided by the ride model such that the motion platforms402move in accordance with the aircraft to provide a realistic experience to the passengers406. In this way spectators at the airshow may experience what the pilot is experiencing in the aircraft. Similarly, the trailer404may be taken to model aircraft show. Data may be taken from unmanned aircraft and displayed via the head-mounted displays and through the motion platform such that the passengers406may experience similar motion of the unmanned aircraft. The ride model and ride controls in the trailer404may also be used to control the unmanned aircraft. The ride model may contain or may access an online database of aircraft dynamic model representations for three or six degree-of-freedom simulations.

FIG. 4Bdepicts an exemplary embodiment of a ride generally referred to by reference numeral410including a motion platform412seating multiple passengers414and traversing a track or rail system416. The motion platform410may be moving along a preset and timed path in communication with and controlled by a ride model. The ride model may present information to the head-mounted displays418and the head-mounted displays418may also communicate orientation, gyroscopic, and acceleration information to the motion platform412and the ride model. The motion platform412may also provide the passengers414with controls such that the passengers414may provide input. For example, the ride may be a roller coaster with stops and questions provided throughout the experience, and which the ride continues based on the answers to the questions. The ride may continue along different paths in a choose-your-own-adventure manner or the controls may be handed to the passenger that answered a question correctly and the quickest. This may block some passengers from controlling the ride and switch between different controls presented to the passengers418.

FIG. 4Cdepicts an exemplary embodiment of a ride generally referred to by reference numeral420including multiple motion platforms422controlled independently but providing imagery of the same environment to multiple passengers424. As depicted the passengers424are engaged in a game of bumper cars where the motion platforms422are cars. The cars may run as normal bumper cars and the imagery of the bumper cars environment may be provided by head-mounted displays426. This may provide the passengers424with an experience beyond the normal bumper cars game. For example, the passengers424may view all passengers participating in the game via the head-mounted displays. The location and motion may be provided by wireless communication through a central ride model. The ride model may also provide the riders with extra games such as soccer or hockey using a virtual ball or puck and virtual goals through the head-mounted displays426. The ride model may also provide a virtual team playing against the passengers424or each passenger may be on a different team and is playing alongside virtual teammates.