IMPROVED METHOD AND APPARATUS FOR CREATING VIRTUAL WORLDS

Abstract: A computer receive animated images together with real world images. The computer then superimposes the graphical image onto the real world image. The result is a combination animated/real image which forms the virtual world. The image is capable of moving as the user's head moves. Thus, complicated virtual worlds may be created without the programming complexity which would result if the entire image were animated.

Description: IMPROVED METHOD AND APPARATUS FOR CREATING VIRTUAL WORLDS 5 BACKGROUND OF THE INVENTION This invention relates to virtual reality systems and, more particularly, to a method and apparatus for creating virtual worlds. Users of computer systems are now able to create 10 virtual realities which they may view and interact with. One type of virtual reality system is disclosed in U.S. patent application No. 535,253, filed June 7, 1990, entitled "Virtual Reality Network," the disclosure of which is incorporated herein by reference. One task which must be 15 performed is the creation of the virtual worlds within which the users interact. This can be a very tedious task, since a complete description of all virtual objects in the virtual world, including their constraints of motion, hierarchy, color, texture and other attributes must be made and entered 20 into the virtual reality computer. Thus, it is desirable to make virtual world creation as simple as possible. SUMMARY OF THE INVENTION The present invention is directed to a virtual 25 reality system wherein graphical images are superimposed upon real world images to create virtual worlds. In one embodiment of the present invention, a computer receive animated images together with real world images. The computer then superimposes the graphical image onto the real 30 world image. The result is a combination animated/real image which forms the virtual world. The image is capable „ of moving as the user's head moves. Thus, complicated virtual worlds may be created without the programming i complexity which would result if the entire image were 35 animated. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram of an apparatus for combining animated and real images according to the present invention. BRIEF DESCRIPTION OF THE APPENDICES Appendix 1 is a source code listing of a program used for combining animated and real world images. DETAILED DESCRIPTION OF THE SPECIFIC EMBODIMENTS The purpose of VideoSphere is to add a realistic-looking video background to the computer generated graphics of a Virtual Reality (VR) system. The video image moves in synchronization with the computer graphics to seem be part of the same image. The usual VPL VR system consists of a control computer which receives input from a DataGlove and location sensors worn by the user. There is a location sensor on the DataGlove and a second one is worn on the EyePhone mounting. These readings are used to construct commands which are sent to the graphics computers, which in turn produce images which are fed to the user via the EyePhones. For the VideoSphere system, several pieces of equipment are added. The control computer has two video boards added internally, each video board provides a video signal to a Digital Video Effects (DVE) processor. The output from the DVE is sent to a Matting or Overlay processor, where it is combined with the a signal from one of the graphics computer. This combined signal is finally fed to the EyePhones, and seen by the user. The readings from the second location sensor, which indicates the direction in which the user is looking, are used in the VideoSphere system. The connections between the components used in the VideoSphere system are shown in fig 1 t (Note that, for simplicity, this does not show the complete VR system which would also include the DataGlove and its location sensor.) As the user's head moves, the viewpoint in the VR graphics changes. For these graphics the user can move in location in three dimensions (left/right, forward/backward, and up/down), and can also tilt her head up and down (pitch), rotate it from side to side (yaw), or rotate it around the viewing axis (roll) The VideoSphere graphics are presented as if on the horizon, so are only subject to the pitch, yaw, and roll movements. They must, of course, perform these movements to the same extent as the VR graphics do. 10 Yaw and a part of pitch are handled within the video boards. These are configured so as to hold a 360 degree view of the video scene. At any instant, depending on the location of the head as read from the head sensor, the portion of this panoramic view that is actually visible is selected for output from the video boards. 15 Roll and the remainder of pitch are handled in the DVE processors. The control computer sends signals to these processors instructing them to rotate the video image, and to raise or lower it, as required to by the user's head movements. The software program in the control computer reads the position of 20 the user's head and commands the appropriate view from the video boards and the DVE processors. The matting processors receive two inputs: one from the DVE processors, and one from the graphics computers. The computer graphics are placed on top of the video images, and the composite 25 image is sent to the EyePhones. To provide the viewer with stereo, two complete video generation systems are required. The important parts of this system are: 30 The video frame buffers and the yaw (horizontal) and pitch (vertical) scrolling that occurs within them. The DVE processors that control the roll and part of the pitch. 3 5 The matting that combines the background and the graphics video. The software programs in the control computer that control the operation of the video frame buffers and the DVE processors. While the above is a complete description of a preferred embodiment of the present invention, various modifications may be employed. Consequently, the scope of the invention should not be limited except as described in the claims.

Claims: WHAT IS CLAIMED IS; 1. An apparatus for creating virtual worlds comprising: animated image receiving means for receiving data representing an animated image; real image receiving means for receiving a real world image; image combining means, coupled to the animated image receiving means and to the real image receiving means, for creating a composite image wherein the animated image is superimposed ont he real image. 2. The apparatus according to claim 1 further comprising image display means, disposed in the line of sight of a user, for displaying the composite image to the user.

Inventors: ABRAHAM ARTHUR, BUMGARNER JOHN OWEN, ABRAHAM, ARTHUR, BUMGARNER, JOHN, OWEN
Applicants: VPL RESEARCH INC, VPL RESEARCH, INC.
Application year: 1991
Main classification: G06F3
IPC codes: G06F3, G06T17, G09B9