Enhanced environment simulator for proxy robot handlers

An omnidirectional treadmill environment simulator is disclosed. The omnidirectional treadmill environment simulator includes a circular simulator stage area, a plurality of transport mechanisms that maintain an object at or near the center of a circular simulator stage area and at least one processor. The processor is configured to collect position data of the object and process the position data to control the transport mechanisms. Also included is a receiver for receiving data from a remote location and a terrain analysis computer for processing the data received from the remote location. The terrain analysis computer collects the data received from the remote location to form an accurate simulation of an upcoming condition at the remote location. The omnidirectional treadmill environment simulator includes a transmitter for transmitting the position data to a remote location.

CLAIM OF PRIORITY

The present invention claims priority to provisional U.S. Application No. 61/831,370 filed on Jun. 5, 2013, entitled “Enhanced Environment Simulator for Proxy Robot Handlers.”

FIELD OF THE INVENTION

The present claimed invention generally relates to robotics. More specifically the present invention relates to human proxy robot systems and environment simulators for the human handlers of proxy robots.

BACKGROUND OF THE INVENTION

This specification is about human telepresence in space. During his or her turn in control of a given proxy robot, the human handler sees and feels and acts through the “person” of that robot: guiding the proxy in exploring; mining; doing science experiments; constructing; observing the earth, planets or stars; launching spaceships to further destinations; rescuing other robots or humans; or simply enjoying an earthrise over the moon's horizon. To maximize this interface, the human handler should have access to an environment simulator that replicates the conditions of the proxy robot's remote location to the greatest possible extent.

In the prior art are several patents dealing with omni-directional and spherical treadmills, all involving simulated virtual reality (VR) generated by a computer program as opposed to the simulation of the actual environment being experienced by a proxy robot in its remote environment as taught in the present invention. Carmein U.S. Pat. No. 5,562,572 discloses ways to make an omni directional treadmill for VR and other purposes, but the methods and apparatus employed do not anticipate the specification to follow. Nor are his treadmill designs very stable, with the human constrained by balance cuffs, support struts, hand grips and the like just to stay upright.

Carmein '572 also makes brief mention of how the omni-directional treadmill of his invention may be utilized in telepresence in a one-paragraph description of FIG. 18 (FIG. 39 in C.I.P. '256 below), but fails to claim or adequately teach how a human can be productively linked in practice to a robot in some remote location. In the present specification and a companion application pertaining to handler environment simulation, prior art weaknesses, defects and “science fiction” will be overcome as methods and apparatus for a complete human handler-proxy robot system are disclosed.

Latypov U.S. Pat. No. 5,846,134 features a spherical shell inside of which a human walks in treadmill fashion, but this concept is quite distinct from the spherical treadmill disclosed in the current application, where the human handler of a proxy robot stands and moves on the top exterior of a sphere with diameter sufficiently large (typically 30 feet in diameter) that the handler, to all intents and purposes, is moving on a flat surface if that is the remote terrain being simulated.

U.S. Pat. No. 5,980,256, also by Carmein, is a continuation-in-part of '572 above and U.S. Pat. No. 5,490,784. The latter pertains to spherical capsules within which humans can walk (albeit uphill) in any direction, but does not apply to the present invention. The circular form in Carmein's ('256) FIG. 23 does not denote a turntable, but rather defines a circular track unlike the current invention. While Carmein's FIG. 37 and description are somewhat akin to the motion simulator in the current specification's FIG. 7, the point is moot in any case since such motion simulators are well-established in the prior art.

Butterfield U.S. Pat. No. 6,135,928. This patent, which expired in 2008, discloses a spherical treadmill for VR gaming, but it is so small at 6-7 ft. diameter as to never seem flat to its human “rider,” who requires a restraining harness and support system just to stay upright. In the Butterfield patent, the sphere basically represents a human-powered trackball, operating in exactly that manner to input x- and y-axis orientation and movement to a VR game on a computer.

Put another way, Butterfield's focus is virtual reality, for fantasy games, while the application below is all about the best-possible simulation of actual reality in a remote location. As a consequence, the Stephens specification does not utilize a small, inflatable sphere as a computer trackball or mouse as taught by Butterfield, but rather uses a much larger and firmer motor-driven spherical treadmill to replicate the terrain upon which a proxy robot is walking, climbing or carrying out various tasks. (Butterfield does depict how a “hill” can be created by moving the user off-center, but the problem with such a small sphere is that there is a constant “hill” created by the small-diameter sphere itself.)

These and other distinctions over the current art will become evident from study of the specification and drawings to follow, which discloses novel systems, methods and apparatus to simulate the environment present at the proxy robotic mission site and thus assure the best possible outcome for that mission.

OBJECTS OF THE INVENTION

One object of the present invention is to describe a viable methodology for human space exploration utilizing proxy robot surrogates in space controlled by humans in environment simulators on earth or elsewhere.

A second object of the present invention is to provide human telepresence on the moon and other locations near earth utilizing proxy robots capable of being controlled by one or more human handlers in real or approximated real time.

A third object of the present invention is to achieve human telepresence on the moon and other locations in space utilizing proxy robot surrogates for humans in simulated environments back on earth or at some other location.

A fourth object of this invention is to provide a viable methodology for space exploration utilizing proxy robots, proxy robot-driven vehicles and robotic vehicles in space controlled by humans on Earth, including a terrain analysis computer which generates an approximated real time video display that allows the human handler to control the movements of each robot or robotic vehicle, as well as data streams representing “terrain just ahead”, handler heading, handler step distance, and handler step moment which are fed to circuitry to turns said data into signals to drive motors controlling the roll, pitch and yaw of an environment simulator to maximize the reality of the human handler's environment as the handler controls every move of a remote proxy robot.

A fifth object of this invention is a method and apparatus for the establishment of a surveillance grid through the provision of a plurality of pole cameras which can be dropped onto a body in space from an orbiting spacecraft, satellite, or a balloon or other aircraft.

A sixth object of the present invention is to provide a treadmill for the human handler with provision for changing the pitch and roll of the treadmill to match conditions in the remote location of the proxy robot, where pitch, roll and other positional data are continually adjusted in the handler environment by mechanisms driven by a computer that continually analyzes video and other data from the proxy robot and its remote environment.

A seventh object of the present invention is to provide a method and apparatus for a circular treadmill utilizing a plurality of conveyors to maintain a human handler centered in a simulator staging area.

An eighth object of this invention is further to object seven, wherein an array of cylinders, each housing one or more ball bearing feet and capped with a tile in the shape of an equilateral triangle, can be impelled to move in treadmill fashion along various axes on a staging area.

A ninth object of this invention is further to the circular treadmill of object seven, wherein data representing human handler heading, step distance and step moment is analyzed by a computer that send appropriate signals to the various conveyor mechanisms that constitute the circular treadmill to compensate for handler movement by re-centering the handler on the stage.

A tenth object of this invention is a method and apparatus for varying the pitch and roll of a treadmill by housing that treadmill and a human proxy robot handler in a modified or custom made motion simulator, complete with gravity harness and large video screen, and wherein pitch and/or roll can be modified by signals from a computer that act to vary the length of four or more large hydraulically extending arms supporting the motion simulator, said computer continually monitoring and analyzing video and other data from the remote environment of a proxy robot.

An eleventh object of the present invention is a method and apparatus for varying the momentary elevation as well as the pitch and roll of a vehicle simulator in time with the actual movements and aspect of a vehicle in a remote or off-earth location operated by at least one proxy robot, wherein the vehicle's elevation, pitch and roll are controlled by hydraulic means in communication with data from the remote location signifying the pitch, roll and such path conditions as roughness, bumps and obstacles experienced by the off-earth vehicle; and “follow me” commands from human handler motion sensing means and control monitoring means located within the vehicle simulator to guide the every move of the proxy robot operating the said remotely-located vehicle.

A twelfth object of the present invention is the provision of an environment simulator including a treadmill with variable pitch and roll and infinitely variable heading; wherein the treadmill takes the form of a large sphere which rests upon several large bearings and is rotated by a plurality of rollers in contact with the surface of the sphere so as to turn the sphere in any direction when commanded by circuitry monitoring both the steps of a human handler and the pitch and roll of terrain immediately ahead in the remote location.

A thirteenth object of the present invention is further to object twelve, wherein the spherical treadmill itself moves the handler to a location on the surface of the sphere which exhibits pitch and roll matching terrain conditions in the remote location of the handler's proxy robot.

A fourteenth object of the present invention is further to object twelve, with the added feature of the simulator receiving data from sources on the “person” of the proxy robot as well as surveillance video and stored information from other sources at the remote site that can be analyzed to maximize the simulated environment experience of the handler.

A fifteenth object of the present invention is the provision of a spherical treadmill environment simulator as in object twelve above, wherein the handler is performing tasks in approximated real time such that the handler's “follow me” commands anticipate the position of a proxy robot at some time in the future due to path delay.

A sixteenth object of the present invention is to create an accurate simulation of the terrain in a remote environment by analyzing that terrain on a computer; computer-generating a three-dimensional bar chart of the terrain; and producing a physical rendering of that bar chart by mechanical means.

A seventeenth object of the present invention is further to object fifteen, wherein the mechanical means constitute piston rods that extend and retract hydraulically from signals received by the computer that generates the three-dimensional bar chart.

SUMMARY OF THE INVENTION

Disclosed herein are apparatuses that provide simulation of remote environments in order to enable control of a robotic device in the remote environment.

Pursuant thereto an omnidirectional treadmill environment simulator is disclosed. The omnidirectional treadmill environment simulator includes a circular simulator stage area, a plurality of transport mechanisms that maintain an object at or near the center of a circular simulator stage area and at least one processor. The processor is configured to collect position data of the object and process the position data to control the transport mechanisms. Also included is a receiver for receiving data from a remote location and a terrain analysis computer for processing the data received from the remote location. The terrain analysis computer collects the data received from the remote location to form an accurate simulation of an upcoming condition at the remote location. The omnidirectional treadmill environment simulator includes a transmitter for transmitting the position data to a remote location.

Further disclosed is a remote vehicle simulator. The remote vehicle simulator includes a plurality of extendable legs configured to extend and contract to simulate the contours of a surface terrain of a remote location. The remote vehicle simulator also includes a terrain analysis computer, wherein the terrain analysis computer is configured to receive terrain data of the surface terrain of the remote location and wherein the computer is enabled thereby to construct upcoming terrain conditions for use in the remote vehicle simulator and a processor that is configured to receive terrain data of the surface terrain of the remote location. The processor processes the terrain data to control the plurality of extendible legs to simulate the surface terrain of the remote location. The processor is also configured to collect operational data of a vehicle mounted on the plurality of extendible legs. The terrain analysis computer receives terrain data of the surface terrain of the remote location and the computer is enabled thereby to construct upcoming terrain conditions for use in the remote vehicle simulator and the simulator includes a transmitter for transmitting the operational data to a robotic device at the remote location.

Further disclosed is an omnidirectional treadmill environment simulator in which the circular simulator stage is a spherical platform. The spherical platform includes an upper support from which the spherical platform protrudes through a circular opening in the upper support, a boundary between the spherical platform and the upper floor which facilitates movement of the spherical platform and a lower support upon which the spherical platform rests and allows the spherical platform to rotate with a minimal of resistance.

Further disclosed is an immersive environment simulator apparatus that includes a plurality of cylindrical telescoping piston mechanisms configured to extend and retract to simulate a three-dimensional physical terrain and a computer that receives data of an actual physical terrain and generates a data matrix of the simulated three-dimensional physical terrain. A control unit is included that is in communication with the computer that provides commands to the plurality of the cylindrical telescoping piston mechanisms to extend and/or contract the plurality of the cylindrical telescoping piston mechanisms to correspond to the simulated three-dimensional physical terrain and a plurality of tiles resting on each of the plurality of the cylindrical telescoping piston mechanisms upon which an object is placed. Furthermore, the received data is continuously streamed such that as the object moves along the simulated three-dimensional physical terrain provided by the plurality of the cylindrical telescoping piston mechanisms, the object movement along the simulated three-dimensional physical terrain mimics the actual physical terrain.

DETAILED DESCRIPTION OF THE INVENTION

The description set forth below in connection with the appended drawings is intended as a description of various configurations and is not intended to represent the only configurations in which the concepts and features described herein may be practiced. The following description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. In some instances, well known circuits, structures, techniques and components are shown in block diagram form to avoid obscuring the described concepts and features.

FIGS. 1A-1H and 2A-2Mdepict methods and apparatus for achieving a novel “circular” or omnidirectional treadmill incorporating three two-way conveyor mechanisms. Specifically,FIG. 1Aillustrates the active area of the entire apparatus, with a handler40standing in the middle of a circle41that defines the simulator stage.

Vertical lines42-43are over the width of that active area along horizontal line44-45generatingFIG. 1B, a cross-section diagram of one of three transport mechanisms used to maintain handler46at or near the center of the simulator stage. A representative line of ball bearings48capped with tile sections47contact the top of stage table surface55. At each end of the tile transport mechanism is a roller49, which may also take the form of a paddle-wheel or gear with offset sections to conform to individual tile-bearing elements (seeFIG. 1Ebelow).

A guide structure50wraps around the transport mechanism and bottom portion of the conveyor. As individual bearing-tile elements leave the stage they are flipped over and slide tile-down through the guide structure, with their bearings rolling on the top. To facilitate this upside-down transit, the inner bottom surface of the guide structure should have a hard, slippery surface like a coating of Teflon® or similar material.

FIG. 1Cis a magnified view of portion51inFIG. 1B, with tile elements52are visible atop cylinder52aand on the bottom of cylinders52b. Tiles52aand52bslide against ball bearings2,3between them and the entire guide structure1not active as the treadmill surface. InFIG. 1Bthis guide structure is labelled50. Each cylinder in turn houses one or more ball bearings facing away from the tile surface, perFIGS. 1F and 1Gbelow. Also shown inFIG. 1Cis stage support table55a, roller or gear mechanism53, and the bottom portion of the stage table56, and an exemplary position4where the conveyor might be halted in perfect alignment with the other conveyors. This will be discussed more fully inFIG. 2MandFIG. 2Nbelow.

FIG. 1Eshows an elongated gear54alternative to roller transport mechanism53. The width of the “paddle wheel” gear is proportional to the width of the conveyor (see59,59cinFIG. 1D), and each paddle can be angled or broken into individual sections to better accommodate individual cylinder elements.

FIG. 1Fis a further magnified view of one ball bearing cylinder63, including triangular tile surface57, cylindrical bearing cup65, and large ball bearing element64.

A presently preferred bearing housing is depicted inFIG. 1G, including a lower profile cylinder68that supports three ball bearings67rather than the single, larger bearing depicted elsewhere for simplicity. The advantage of the three-bearing housing is that each such element is stand-alone, so that any weight exerted on triangular tile66will be equally distributed on the three bearings and maintain the entire element stable and level at all times.

FIG. 1Dillustrates the environment simulator concept, including a circular stage area62covered by a plurality of tiles60, individually shaped as equilateral triangles57which mesh together to form the floor of the simulator stage. The simulator includes three conveyor mechanisms, all powered by pressure rollers58or paddle wheel gears like the one54shown inFIG. 1E.

One conveyor is powered by transport mechanisms59,59cin the 3 o'clock-9 o'clock position on the circle. This conveyor compensates for any handler movement along a 90 degree-270 degree line, moving in either direction to continually keep the handler centered on this axis.

Another conveyor has transport mechanisms59aand59dat the 150 and 330 degree positions on the circle, and similarly acts to continually compensate for any handler movement along this axis. The third conveyor's transport mechanisms59eand59bare at the 30 and 210 degree positions on the circle, similarly moving the handler's floor in one direction or the other to compensate for movements off center.

Beneath the entire tile surface60depicted is a second tile surface61, directly corresponding to the surface above but inverted (upside down) from the top surface. This lower surface constitutes the bottom side of each of the three conveyors depicted, with each forming a continuous loop of tile/cup/bearing elements as shown inFIGS. 1B and 1C.

FIG. 1Hshows a modified form of the conveyor mechanism depicted inFIG. 1C, wherein the housing ball bearings2aextend only around the portion of the housing1athat extends beyond the active treadmill stage area (62inFIG. 1D). In the configuration ofFIG. 1H, the bearing area is replaced by a smooth sliding surface5extending under the entire stage area to result in smoother conveyor motion.

FIG. 2Ais a more detailed look at the omnidirectional treadmill simulator ofFIG. 1, showing a mesh of individual equilateral triangular tiles70completely filling the active stage area. Point83marks the center of the stage, and defines the general area where the proxy robot human handler is to be maintained by compensating movement of one or more of the three treadmill conveyors.

Assuming the top of the page to be north for this discussion, one conveyor mechanism71,74spans between rollers or paddle wheel gears77-78and compensates for handler movements in either a northeast or southwest direction (30 degree-210 degree axis). A second conveyor mechanism72,75is located between rollers or gears79and80, and compensates for handler movements to either the east or west (90 degree-270 degree axis). The third conveyor mechanism73,76is located between transport rollers or gears81,82, and compensates for handler movements to the northwest or southeast (150 degree-330 degree axis). A line35,35aperfectly bisects conveyor72,75, passing through the center point83on the stage. A second line36,36asimilarly bisects conveyor73,76, while a third line37,37abisects remaining conveyor71,74.

FIGS. 2A and 2Billustrate the operation of the circular treadmill. If the handler steps from stage center83directly to the east (right on the figures), the conveyor that will become active is the one highlighted inFIG. 2B, running between 90 degrees and 270 degrees, i.e., between motorized rollers79and80inFIG. 2A. Since the handler moved a step to the east, this conveyor will move toward the west in approximately the same amount, but come to rest in a position where all the tiles align once again. This is absolutely necessary to the operation of the circular treadmill, since all tiles must be in alignment so that conveyors in the other directions can similarly activate (seeFIG. 2Ebelow).

If the handler moves to the northwest76or southeast73onFIG. 2A, this will activate the conveyor highlighted inFIG. 2C. Conveyor motors on that axis will compensate for the handler's steps, maintaining handler position near center83at all times.

What happens when the handler travels in a north (or south) direction, a position between conveyors71,74and76,73? In this case, the processor95will assign priority to one conveyor; for example first moving the handler along axis71,74to center the handler on line37,37a; and next along axis76,73to center that conveyor on line36,36a. The reasons for this two-step process are 1) that only one conveyor can move at a time; and 2) any handler movement off center can be corrected by the compensating movement of two conveyors. When each of the two effected conveyors have moved that handler to their particular center line, the handler will once again be located in the center of the stage.

If the handler moved to the west rather than the east, the same conveyor79,80would activate, but the motors would turn their rollers in the opposite direction, causing that conveyor to travel to the east. Likewise, the handler might move to the northeast or southwest, causing conveyor71,74to activate and reposition the handler to center point83. This conveyor is depicted inFIG. 2D.

FIG. 2Eshows how the circular treadmill ofFIGS. 2A-2Lfunctions electronically. Motion capture cameras or other monitor means90turn essential movement on the treadmill into “follow me” commands for the proxy robot, and may also be utilized in keeping the handler centered on the circular simulator stage. Specifically, handler step motion data91can be broken into handler heading (yaw or bearing) information92, handler step distance93, and step moment or velocity94.

This data is fed into processor95, which produces signals that ultimately control the current driving conveyor1motor pairs77,78; conveyor2motor pairs79,80; and conveyor3motor pairs81and82; from conveyor1motor control circuit96; conveyor2motor control circuit97; and conveyor3motor control circuit98, respectively.

Processor95also receives data from park sensor means99, which monitors each conveyor's movement and continuously feeds alignment data to the processor95, enabling that processor to signal each conveyor to park (stop) at a point where all tiles line up.

FIGS. 2F, 2H and 2Kfurther illustrate conveyor park operation, utilizing the northwest-southeast conveyor ofFIG. 2Cas an example in each case. InFIG. 2F, the referenced conveyor320ais moving in a southeast direction (arrow) to compensate for a handler step.

The insert ofFIG. 2Gdepicts a magnified view321bof the junction between tiles at location321a, a point where all three conveyors converge. Pattern322is the required park position of the various tile edges: note that the actual conveyor tile position at point321bis considerably off-alignment from the necessary pattern322.

InFIG. 2H, conveyor320bcontinues to move to the southeast (arrow), and relative tile positioning at the same point323ais considerably closer to alignment now, per magnified view323bin insertFIG. 2J. But the tiles are not yet aligned as they must be in pattern322, so conveyor movement continues.

InFIG. 2K, conveyor320chas reached the point of alignment, as depicted at point324aand the magnified view324bofFIG. 2L. At this point, park sensor99notifies processor95of correct alignment, and processor95commands conveyor320cto stop via treadmill3motor control circuit98.

FIG. 2Millustrates how the park sensor99inFIG. 2Ecan achieve the objective of parking one of the conveyors in perfect alignment with the other two via a number of means. InFIG. 2M, tiles326top the simulator stage, comprising conveyors that keep a handler relatively centered at all times. One way to stop a conveyor in correct alignment is to cause “paddle-wheel” gear327inFIG. 2Mto stop with a tile in some precise position, as, for example, when a paddle of wheel327is between two tiles at exact right angles to the horizontal stage328supporting the handler.

Such alignment may also be achieved through pattern recognition, as by watching tiles on the moving conveyor for a dot, circle or “x” etched or painted at the center of each tile and stopping the belt when the mark is observed. A stop of this sort may be accomplished by halting paddle wheels327or drive roller49(FIG. 1B) in proper position, and/or through the employment of a braking mechanism like pads against the correct tile as it passes by roller49.

In another configuration, a mask or reference pattern such as322inFIG. 2Gis compared with an area321bbetween tiles. When the monitored pattern coincides with the reference, as inFIG. 2L(324b,322), the park sensor99sends a “stop” signal to processor95which in turn commands the appropriate treadmill motor control circuit to stop its motors.

A presently preferred mechanical stop apparatus embodiment employs a a semi-flexible blade325which can be commanded to protrude from a cylinder331. The cylinder331may represent electro-mechanical solenoid or other means, with the protruding blade scraping against a passing line of tiles326which are upside-down on the lower portion of conveyor328(c.f. position4inFIGS. 1C and 4ainFIG. 1H).

In this case, a small port in the underside330of the conveyor housing can be positioned to coincide with a specific position where tiles from all conveyors intersect. This would be like the position shown inFIGS. 2G, 2J and 2L, but 180-degrees removed to the bottom of the unit such as to cause no interference with the active (topside) portion of the simulator stage. Into this small port, the blade325ofFIG. 2Mcould be made to protrude through some combination of electromagnetic, spring or hydraulic means in cylinder331, with flexible blade element325flapping against moving tiles as they pass upside-down along the bottom329of the conveyor loop, until the blade fits snugly between two tile sets, causing the moving conveyor to stop in precisely the proper position.

FIG. 2Nshows the circled area332inFIG. 2Min amplified detail, including an electro-mechanical portion represented by cylinder331a; a line of tiles334passing in directions335; and a blade element325amoving up and down line333upon command from park sensor99inFIG. 2E.

To achieve such a stop, semi-flexible blade325amight be made of spring steel or a strong plastic compound, or the blade might protrude only sufficiently to stop a powered-down conveyor's final momentum. In this latter case, a conveyor would cease being powered as the handler's position approaches stage center. Thereafter, when the handler moves in some direction creating a need for a conveyor to compensate, blade325awould retract until the handler has been re-centered on the treadmill stage.

FIG. 2Pillustrates another omnidirectional treadmill arrangement utilizing square tiles340and two conveyor mechanisms. One conveyor moves between the 6 o'clock and 12 o'clock positions by means of motor-driven rollers or paddle-wheel gears342aand342b, while the other conveyor moves between 3 o'clock and 9 o'clock positions via rollers or paddle-wheel gears341aand341b. Although simpler to manufacture and operate, the square-tile, two conveyor configuration ofFIG. 2Pis not currently preferred due to the jerky movements necessary to keep a handler centered on the treadmill stage. Otherwise, this treadmill would generally incorporate elements discussed heretofore inFIGS. 1 and 2with one exception:

FIG. 2Qdepicts that exception: treadmill motor control means for two rather than three conveyors. In this diagram, motion capture cameras or other monitor means343turn essential movement on the treadmill into “follow me” commands for the proxy robot, and may also be utilized in keeping the handler centered on the circular simulator stage. Specifically, handler step motion data344can be broken into handler heading (yaw or bearing) information345, handler step distance346, and step moment or velocity347.

This data is fed into processor348, which produces signals that ultimately control the current driving conveyor1motor pairs341aand341b, and conveyor2motor pairs342aand342b: from conveyor1motor control circuit349and conveyor2motor control circuit350, respectively.

Processor348also receives data from park sensor means351, which monitors each conveyor's movement and continuously feeds alignment data to the processor348, enabling that processor to signal each conveyor to park (stop) at a point where all tiles line up.

FIG. 3illustrates one exemplary method and apparatus for the addition of pitch and roll to a circular treadmill simulator for human proxy robot handlers, wherein legs120under an ommnidirectional treadmill108like the one shown in1B above are firmly mounted to the floor of a modified or custom made motion simulator101. Motion simulators are typically costly devices, with pitch, roll and various vibratory sensations (like earthquakes, rocket engines or runaway trains) are created by varying the length of four or more large hydraulically extending arms102-105resting on large floor pads106,107, and a large wrap-around video screen112creates the appropriate visual environment.

As a consequence, the goggles113worn by the handler in this drawing are likely for 3-D viewing, while a two-way headset114may still be employed for mission and team communication as well as voice commands like “Freeze, Freeze.” Although the same ends could be accomplished via a microphone and speakers not directly connected to the person of the handler, the headset114serves the additional purpose of isolating the handler from ambient noise including operational sounds of the motion simulator.

As she walks or otherwise moves on the circular treadmill108, the handler is held in place by a gravity harness109with bungee cords or springs110which hang from hooks111in the top of the motion simulator capsule101and provide lift to her suited body sufficient to equal the weight of the proxy robot on Mars or some other location in space.

Let us turn now to meeting the challenges of long path delay, as in the case of Earth-Mars. As we have explored in the description of previous figures, the approximated real time (ART) video generating terrain analysis computer153receives streaming video and other data from multiple sources151at the remote location (e.g., Mars), and combines this information with data152already stored and fully accessible to the terrain analysis computer.

While the most major function of the terrain analysis computer is the generation of accurate ART video157for the proxy robot handler as well as an ongoing stream of “terrain just ahead” data156to warn and otherwise guide that handler's every move, the terrain analysis computer can also supply data to a processor155that controls the environment simulators in which handlers perform their functions.

In the case of motion simulator capsule101, processor155can feed signals to hydraulic leg pumps121-124, where each hydraulic pump controls the height of an extendable-contractible leg. So, for example, pump121controls the amount of extension in leg104, while pump122controls the same function in leg105. In practice, any normally-encountered amount of pitch (tilt forward or backward) roll (tilt from one side to the other) or combination thereof can be replicated via signals originating in incoming data from a remote location such as Mars together with stored mapping data that becomes an augmented virtual reality view of the time in the future when “follow me” data from the handler will reach the proxy robot. Put another way, the terrain analysis computer is not only providing a handler with video that is 10 minutes or more in the future, but also replicating the terrain conditions that handler will be encountering at that moment in time.

FIG. 3Adepicts an exemplary embodiment of an omnidirectional treadmill125, under which are four legs128-131extendable via hydraulic, pneumatic or other means from a relatively flat profile132to many times that height128. When all legs are in their compacted state, the plane of treadmill125is flat, without tilt in any direction, but this state can be altered by signals originating at the terrain analysis computer153and passing through processor155and the four hydraulic leg pumps121-124.

Let us first consider pitch. If we want to tilt the treadmill up from front to back145, front legs129and130should be in their compressed state, while back legs128and131will be totally or partially extended to achieve the desired rise to the rear of the treadmill. Front-up, rear-down pitch146is achieved by doing the opposite: extend front legs129and130and compress back legs128and131.

In the case of roll, we can tilt (roll) the treadmill downward toward the right side149by compressing legs130and131while extending legs128and129, or conversely tilt downward toward the left side150by compressing legs128and129while extending legs130and131.

The accurate simulation of some remote terrain might involve a degree of both pitch and roll: for example, as the proxy robot climbs an irregular incline. Simulating this condition might involve fully compressing left rear leg128, fully extending right front leg130, and partially extending legs129and131—all in accordance with terrain data received from video and sensors on the proxy robot.

FIG. 3Billustrates an exemplary method and apparatus for a remote vehicle simulator in a capsule300, wherein pitch, roll and various vibratory sensations may be created by varying the length of four or more large hydraulically extending legs268-271resting on large floor pads273, with the extension of each leg controlled by a hydraulic valve272connected to a pump and motor287-290.

The employment and utilization of proxy robots for missions on remote locations like space environments permits the use of vehicles of the sort that can be operated and driven by humans as opposed to robotic vehicles in a space location that are programmed and/or remotely operated from earth or some other control point. In the proxy robotic case, it is the proxy robot295that actually drives and operates the remote vehicle296, in concert with a human handler260who “drives and operates” a simulation261of the proxy's vehicle from the safety of the simulator in capsule300.

Controls like steering, brake and throttle302in the remote vehicle296are precisely replicated262in simulated vehicle module261. The human handler260can either control the remote vehicle296by viewing a large wrap-around video screen263or via goggles264in a head-mounted display. Either or both create the exact visual environment perspective of the remote proxy robot295at an upcoming future point in time when the operational data reaches the remote vehicle296.

Terrain analysis computer282receives video, positional data and other information from aggregator281which aggregates streaming video299from the camera “eyes”298of proxy robot295, look-ahead video from mast camera297and other video and data from multiple sources301at the remote location (e.g., the moon or Mars). This information from the remote location is combined with data283already stored in and fully accessible to the analysis computer282.

A primary function of terrain analysis computer282is the generation of accurate approximated real time (ART) video294for the proxy robot handler as well as to a “terrain just ahead” processor285that generates an ongoing stream of data291to warn and otherwise guide that handler's every move.

The terrain analysis computer282also supplies data to a processor286that controls the pitch, roll and replicates other conditions like a rough or bumpy environment being experienced by the remote vehicle296and its proxy robot driver295.

In the case of vehicle motion simulator capsule300, processor286feeds signals to hydraulic leg valves272a-d, where each hydraulic valve controls the height of an extendable-contractible leg. For example, pump287and valve272dcontrol the amount of extension in leg269, while pump288and valve272ccontrol the same function in leg270.

In practice, any normally-encountered amount of pitch (tilt forward or backward) roll (tilt from one side to the other), rough or bumpy ride, or combination thereof can be replicated via signals originating in incoming data from a remote location such as Mars together with stored mapping data that becomes an augmented virtual reality view of the time in the future when “follow me” data from the handler will reach the proxy robot vehicle operator. Thus, terrain analysis computer282is not only providing a handler on Earth with video that is 10 minutes or more in the future in the case of Mars, but also is replicating the terrain conditions that the proxy robot's remote vehicle will be encountering at that very moment in time.

“Follow me” commands from human handler “driver” to proxy robot driver are a composite of data from several sources. Positional information from the handler, including head angles, hand and foot positions and so forth, are collected by a plurality of motion capture cameras266-267and aggregated in handler data circuit279. Control and reading data274from the vehicle simulator, including steering position and vehicle heading information275; throttle position and vehicle velocity276; gear and braking data277are fed into vehicle data module278, along with other information such as blade or backhoe position, depending on the vehicle and the mission requirements.

Handler data279and vehicle data278are weighed and combined in a “follow me” data processor280which uses both sources to send the most precise position commands possible over path uplink304to the remotely-located proxy robot operator295of vehicle296on the surface of the moon, Mars, or some other location remote from mission control. It should be pointed out that the definition of a remote location does not exclude locales on the Earth, like disaster sites, under sea projects, natural event locations like volcanoes, tsunami and tornados as well as survey vehicles, mining, and even the movement of goods and services from one place to another.

In like manner, data and readings from vehicle data292and terrain just ahead293modules are routed to mission control, including panel265or a portion of either wrap-around video screen263or handler head-mounted display264to maintain the handler informed to the greatest possible extent.

FIG. 4illustrates an example of a spherical treadmill with variable pitch, roll and infinitely variable heading. In this novel approach, the treadmill takes the form of a large sphere190, with a diameter many times average human height; e.g., at least three times but preferably five or more times human height. The diameter of sphere190in this figure is approximately 30 feet, but the simulator staging area typically occupies only the top 25% to 35%, as depicted by floor line170. The sphere protrudes from a circular opening in upper floor170, and a small area194where floor meets sphere is magnified195to depict Teflon® or a flexible, renewable material such as bristles, rubber or plastic between the two surfaces. In addition to keeping debris from falling through the floor, this junction195serves to stabilize the sphere and smooth its motion.

The sphere190can be made of a lightweight but strong material such as plastic, aluminum or composite coated with rubber or a similar no-slip substance. It rests upon three or more large bearings164, with each bearing seated in a socket164awhich is mounted firmly in place to the support floor under sphere190. Bearings164and their lubricated sockets164aassure movement of the sphere with minimum friction, allowing pressure wheel motors161and163to be relatively small and economical.

In the upper (simulator stage) portion of the sphere190, a human handler165is taking a step to direct her proxy robot's course. As this takes place, data indicating handler heading171, step distance172and step moment (time duration and velocity)173is sent to handler step motion circuitry166which sends appropriate data representing each parameter to both the proxy robot as part of a “follow me” data string169and to a processor167that feeds either digital or analog data to motor control circuitry168a,168bas well as to boom control189.

If the proxy robot is walking on flat terrain, the human handler will occupy position165aat the very top, center of sphere190. Although that handler will be atop a very slight rise equal to the rise atop that section of the sphere, the simulation from a sphere five times the human's height will be of a relatively flat surface.

But if the robot is walking up a rise akin the slope inFIG. 3C, this positive (nose up) pitch of around 10 degrees can be simulated by situating the handler in position165bon the sphere. A more severe forward pitch of approximately 20 degrees is shown as position165con the sphere, while at position165dnear floor level, rise in pitch approaches 45 degrees. Positive (upward) pitch is represented by arrow174in the drawing, while downward or negative pitch is represented by arrow175.

Downward pitches on the same heading at −10, −20 and −45 degrees can be simulated from positions to the left of the sphere, at165e,165fand165g, respectively. If the handler's position moves left in the direction of arrow176, there will be leftward roll (left tilt) in that position. For example, position165hwould exhibit severe roll, tilting some 25 degrees to the left. Moving the operating stage in the opposite direction (hidden from view) will result in roll to the right (right tilt). From the foregoing, it can be seen that any conceivable combination of pitch and roll can be found at various locations on the surface of the spherical treadmill190.

Since the pitch and roll conditions in the simulator beneath the human controller are determined by feedback181from the proxy robot's remote location, suitable means must be present to change the location of the handler staging area to one matching the average pitch and roll of the remote terrain. Positional and other data is received from sources on the “person” of the proxy robot, including both near- and far-field 3-D video from its various camera “eyes” and possibly even a long-range 360-degree view from a camera system on top of the robot's head (c.f.FIG. 2) Video and other data come as well from sources external to the proxy robot: orbiting satellites, balloons, pole cameras, buoy cameras and other robots.

The video feed from the remote location is routed to display devices for the analysis of mission personnel, but it does little good for the handler, since it is delayed on the order of 3-22 minutes from Mars. All video and data161from the remote locale moves over this communication path before being routed to a Terrain Analysis Computer185which generates a highly-precise augmented virtual reality view of the terrain and setting of the proxy robot at 10 minutes into the future when signals from the handler actually arrive at the mission site on Mars. Computer185also uses the stored and incoming information to generate data186about terrain just ahead184for the information and use of the handler.

The “terrain just ahead” data186, heading171, step distance172, and step moment173data are bundled and fed to a processor167which turns all the input data streams into meaningful signals to drive motor control circuitry168a,168band boom control189.

Motor control circuits168aand168bconvert the data from processor167into positive or negative direct current to drive motors161and163and their respective pressure rollers161aand163ain either direction when so instructed by processor167, causing the sphere to turn under the handler's feet to compensate for steps the handler takes forward, backward or in any direction whatever. But since it is also acting from signals representing such upcoming terrain conditions as pitch174-175and roll176, it is the function of the roller motors to effectively move the sphere under the handler as each step is taken to place that person in average pitch and roll conditions matching the remote terrain to the greatest extent possible.

Motor mounts162are illustrated to show a possible position for a pressure solenoid that can activate whenever a roller motor is called into service, pushing, for example motor161and its attendant roller161aharder into the sphere to gain traction. The advantage of using solenoids in this manner is that the non-active roller(s)—from motor163and its roller163ain the example—provides less drag for the active motor and roller to overcome. Of course there may be instances when both roller motors (or two or more motors from a multiplicity of roller motors spaced at even intervals around the sphere) may be called into action simultaneously. But in this case there will be less drag to overcome as motion overcomes inertia, even with all solenoids pushing the motors' rollers into the sphere. Although roller motors161and163are depicted as mounted against the upper floor170, they can also be mounted at the sphere's equator or in any other convenient position.

In the simulator, the human handler would be strapped into a gravity harness suspended from a platform178,179by a number of bungee cords or cables with springs177. A rotation collar179aallows the platform to rotate freely in any direction. As the handler is effectively moved about on the staging surface of the upper sphere, it is important that the gravity harness follow those movements to maintain the handler's correct effective weight, by lifting from a position directly above the handler and harness. In the drawing, three handler positions are depicted:165awhich is relatively flat,165bwith a positive pitch 10 degrees, and165cwith a forward incline of some 20 degrees.

Roller motors161and163can place the handler in any of the above positions or virtually anywhere else on the simulator stage, but an additional mechanism is needed to move the gravity harness as the handler is moved. This mechanism is an extendable boom or robotic arm192shown at the top of the drawing, which provides overhead lift as well as positional correctness directly over whatever handler's position. The boom or robotic arm depicted is for illustrative purposes only, as it can be appreciated that other combinations of tracks, motors and cables can place the handler at the required positions.

At the tip of the boom is a winch191. The motorized winch maintains constant torque (upward pull) on the handler at some predetermined level. For example, if the handler is to match the 76 lb. weight on Mars of a 200 lb. robot, that handler's weight should be effectively 76 lbs. So a 160 lb. human handler would require a constant upward pull of 84 lbs., and a downward pull by gravity of 76 lbs. It is the job of winch191to maintain this effective weight. The winch pays out as much cable180as necessary to constantly maintain the desired upward pull on the handler, and it receives data from processor167via boom motor control circuit189. The cable positions180,180aand180bare maintained directly over handler positions165a,165band165c, respectively, by lateral movement of the boom, which can extend/retract; swing right or left, and tilt up or down in accordance with data instructions from processor167and boom motor control189.

Maintaining constant torque solves one problem; namely, that the length of cable180must change the further the handler is moved from the “flat” position165aat top center. So when processor167and roller motors161,163act to place the handler in position165c, for example, the length of cable180would leave the handler dangling in mid-air. But not really, since such dangling weight would equal 160 lbs downward. Immediately, the constant torque mechanism would tell the winch to let out more cable until the handler once again exerts 76 lbs downward and 84 lbs upward.

Boom192does more than extend and retract to replicate various up and down levels of pitch, however. In response to instructions from processor167, which in turn receives “terrain just ahead” data184and other position and mapping information from the terrain analysis computer185, boom192can also move from side to side to replicate roll—the sideways tilt of the place where the proxy robot will be walking some ten minutes in the future. Together, these boom movements account for both pitch and roll: two of the three movements possible in three-dimensional space.

The third element is yaw—in this case the direction the handler is facing or moving on a 360-degree plane. This element is determined by the handler, and is translated into heading signals171, which, together with step distance172and step moment173data, are packaged and translated by Handler Step Motion Data electronics166into “follow me” proxy robot language169to guide the proxy's every move. The “follow me” data that travels over an uplink path to Mars or whatever remote mission location, arriving at the exact moment anticipated by Terrain Analysis Computer185.

FIG. 5Aillustrates a scene on the moon, rendered pictorially, whileFIG. 5Bdepicts the same scene in 3D bar chart form. In the photographic version of the scene200(top), we see two hills with summits201and205, with a saddle203between them. In front of these two hills is a smaller hill with summit204, and two low or valley areas202and206.

This same terrain can be computer-rendered into a three-dimensional bar chart like210inFIG. 5B, where individual bars209in a matrix represent the elevation at each charted point. For example, the summit of the first hill201inFIG. 5Ais represented by point211inFIG. 5B; higher hill summit205is represented by bar215; saddle203by bar213; front hill summit204by bar214; valley202by bar212; and valley206by bar216.

Programs already exist to make such 3D bar chart renderings, but the purpose of the figure and description to follow is to bring the bar chart into material reality through the creation of physical hills and valleys as part of a highly immersive environment simulator.

FIG. 6Adepicts a matrix similar to that of the 3D bar chart inFIG. 5Babove, but with physical piston rods replacing each bar in the drawing. InFIG. 6A, a matrix array220of piston rods221are enclosed in individual cylinder housings223of some uniform height222. Each individual piston rod can be controlled hydraulically to extend above its cylinder by an amount either equal to the height of the cylinder224or even greater if the rod portion uses telescoping means such as224aand224b.

The plane area225defines the floor of an environment simulator, with tiles atop the embedded rod elements221forming a three-dimensional surface. Immediately beneath cylinder matrix220in area227is an array of hydraulic valves that connect to each individual cylinder. Beneath this is another area228reserved for one or more hydraulic motors, pumps and the electronic equipment that connects to a valve under each cylinder.

FIG. 6Bshows four adjacent cylinder-rod assemblies in greater detail, where the simulator floor230corresponds to plane225inFIG. 6A, and rods231,233,235and237are depicted in various stages of extension above that floor. While widely-varying positions are shown for rod ends239, in actual practice adjacent rods would be only slightly removed one from the other, creating a smooth incline or decline in the overall 3D environment. Rods231,233,235and237inFIG. 6are basically pistons that move up and down from their positions in cylinders232,234,236and238, respectively.

The non-shaded portion in each of these cylinders represents space filled with the hydraulic fluid that displaces each piston. For example, piston237is shown fully extended, so its cylinder is completely full of hydraulic fluid, while cylinder323is extended about 65%. It should be noted thatFIG. 7Butilizes non-telescoping cylinder elements, a presently preferred configuration.

A complete three-dimension environment can be created when the terrain analysis computer240described in previous figures is harnessed to provide a terrain-generating data stream241in addition to approximated real time (ART) video and other outputs. The terrain-generating data is fed to hydraulic array driver electronics241which produce elevation signals243for each individual hydraulic cylinder-piston element in the electronically-operated hydraulic valve array246. The number of these cylinder-piston elements may be large indeed. For example, a 40 ft×40 ft simulator room with 2 inch×2 inch tiles would require 40×6=240 tiles per side, or 57,600 tiles total, translating to 57,600 individual cylinders and pistons, 57,600 hydraulic valves, and 57,600 circuit connections from hydraulic array driver electronics242.

FIG. 6Bshows four such valves247-250. Each of these receives signals from hydraulic driver array electronics242that cause each valve to open and permit a designated pressure and volume of fluid from hydraulic pump and fluid tank244to enter the cylinder and push the piston rod to the elevation called out by terrain analysis computer240.

InFIG. 6C, a single section of cylinder252, piston rod253, hydraulic fluid intake254, electrically-controlled hydraulic valve255, electronic signal256, and hydraulic fluid pipe257connect together to fill chamber258to the level that generates the required elevation for that particular cylinder-piston rod element.

In sum, the circuitry and apparatus described inFIG. 6can rapidly generate a physical replica of a mission area on the moon, Mars, or other locations in space or on earth with the physical integrity to support the weight of human handlers, robotic “follow me” vehicles and the like, to ensure the accuracy and maximize the productivity of a proxy robotic mission to that area. When it is time for the proxy robots or robotic vehicles to move on, a new physical landscape can rapidly be generated and put to good use by human handlers on the earth and their robotic counterparts at some remote location.

The various features associate with the examples described herein and shown in the accompanying drawings can be implemented in different examples and implementations without departing from the scope of the present disclosure. Therefore, although certain specific constructions and arrangements have been described and shown in the accompanying drawings, such embodiments are merely illustrative and not restrictive of the scope of the disclosure, since various other additions and modifications to, and deletions from, the described embodiments will be apparent to one of ordinary skill in the art. Thus, the scope of the disclosure is only determined by the literal language, and legal equivalents, of the claims which follow.