Stereoscopic image processing on a computer system

A preferred embodiment of the invention permits a user to load two images into a computer system so that two images may be combined into a stereoscopic image pair. An additional embodiment permits a user to load a single 2D image into the system to be combined into a stereoscopic image pair. An additional embodiment permits a user load a single 2D image to be loaded into a computer to be morphed into a stereoscopic image pair. The term “morphing is derived from the term metamorphis. Morphing refers to the process of gradually changing one visual image to another or merging two or more images into a single image.

BACKGROUND OF INVENTION

The present invention relates to stereoscopic image processing on a computer system. In particular the system permits a user to create a stereoscopic display from a 2D image or manipulate two images into a stereoscopic display of the two images.

SUMMARY OF THE INVENTION

A preferred embodiment of the invention permits a user to load two images into a computer system so that two images may be combined into a stereoscopic image pair. An additional embodiment permits a user load a single 2D image to be loaded into a computer to be morphed into a stereoscopic image pair. The term “morphing is derived from the term metamorphis. Morphing refers to the process of gradually changing one visual image to another or merging two or more images into a single image.

DETAILED DESCRIPTION

A preferred embodiment of the invention, as illustrated inFIG. 1, permits a user to load two images into a computer system so that two images may be combined into a stereoscopic image pair. The process begins by first accessing a web page or application software containing the software to combine the two images102. Images may be loaded from an internal server, from the end user's computer or from another location or device that is connected to the Internet.

Image #1and Image #2104and106are loaded into computer containing the software or the web page connection. End users can start by using images that are stored on the remote server along with the web pages, server code, etc. Additionally, the images may be stored on any device that is connected to the Internet, and then loaded into the remote server for manipulation. The works in progress, or final images can be saved on the remote server, the end-user's computer or on any other device on the Internet.

An Auto-Color Balance/Match Process108is performed on the two images to have the color balance between the images.

The user then can select an option of an Automatic or Manual stereo alignment of the images110. If the user selects the Automatic stereo alignment the system automatically select common points in each image and then align them as a stereoscopic image pair112. The auto alignment system will adjust the stereo effect based upon placement of the zero parallax point and the desired viewing method. For example the negative and positive parallax for optimum viewing can be adjusted via projection or CRT. The disparity between the left and right fields will intentionally be greater on a CRT than projection. The algorithm will find the best alignment given the constraint or direction specified by the user.

Zero parallax is defined to mean a point that appears to be at the screen level. A negative parallax is point that appears to be out of the screen nearer the viewer and positive parallax is a point that appears to be into the screen and further from the viewer.

As an alternative, the user may use a manual alignment process where the user manually selects the alignment points114. The manual alignment occurs by selecting a zero parallax registration point in both image one and image two. The software will align the two images according to their registration points. After the registration points are selected, the aligned result is displayed116. If the stereo image pair by the manual process or the automatic process requires further alignment, the user may continue to adjust the points in either or both images.

A return loop permits the system to take the result from the refinement stage and process it though steps110-112or110,114, and116again to further refine the process.

The system takes the result from the refined alignment and applies certain cross talk reduction algorithms to reduce any cross talk between the images124. As a final process the user may adjust the stereo image depending upon the type of display being used. One display system uses glasses that work on a shutter glass principle where each side of the glasses are switched on and off in time synchronization with the displayed image. A second type of display uses gray anaglyph approach with red and blue portions of the glasses. A third type is a color anaglyph approach also using red and blue portions of the glasses. Each of these display modes requires its own unique color and contrast attribute correction of the displayed image.

As a final step, the system displays the image for the viewer on the color monitor or other display device.

An additional embodiment permits a user to load a single 2D image into the system to be combined into a stereoscopic image pair.

An additional embodiment permits a user load a single 2D image to be loaded into a computer to be morphed into a stereoscopic image pair. The term “morphing is derived from the term metamorphis. Morphing refers to the process of gradually changing one visual image to another or merging two or more images into a single image. 3D Morphing will take one image and turn it into a stereoscopic image. Applying a depth map to the picture does this. Real-time modification of depth map will allow an iterative customization of a 2D image into a stereoscopic 3D image. Regions selected for positive or negative parallax will be morphed to round edges—this is in addition to the depth map. The additional morphing step helps to reduce the “cardboard cut-out” effect, which is often prevalent in 2D to stereoscopic 3D conversions.

The step-by-step process of 3D morphing is illustrated as200in FIG.2. The user accesses the web page or computer program for stereoscopic production of an image202. The single image to be processed is loaded204. The user selects apply the Depth Morphs from a file206. Preset Depth Maps for various picture types: portraits, etc. Depth Maps can be 256 color grayscale images. Selecting objects may also add depth from a scene and mapping them to a geometry object model. For example, the end user can use a marquee tool to select a standing person. That image data can then be mapped onto a cylinder or other similar geometric volume. The texture data would be interpolated to fix the selected volume. Selection of multiple such volumes will allow the end user to create multiple planes of depth. Auto-alignment will find a common point in each of the images and then align them as a stereoscopic image pair. This process may also be done with a single image create an illusion of depth.

The Select and apply Depth Morphs step206may comprise either Geometry Based Morph304or a Depth Map based Morph316or a combination of them as illustrated in FIG.3. The Geometry Based Morph path inputs the image Laod Geometry vased morph profiles section306and a Interactivel creat Geometry based morph profiles308. The outputs of these two elements are coupled to a step of Applying Geometry based profiles to the entire image or selected regions.

The Depth Map Based Morph path includes similar functions of Interactively Creat Depth Map based om morph profiles318and Interactively Create Depth Map based profiles318. these coupled to an Apply Depth Map based profiles to the entire image or selected regions322. The user may selct from one of the profiles312,322or from both.

The system displays the 2D to 3D conversion. The user may make manual adjustments similar to those in the two-image process described above.210. Manual alignment can be done using one or two images. If only one image is to be used, then the singular will be used as the source for both left and right perspectives. Using a single image can often produce positive parallax, but not negative parallax. When two separate images are used for manual alignment the end result may contain either or both positive and negative parallax.

A feedback loop212is available to process the result of changes through the system again. The cross talk reduction algorithms214as described above are again applied to the 3d image. The operator again chooses the color/contrast attributes needed for the type of display desired as discussed in the two image format. Finally the final stereo image created from the single image218.

The end user is able to take a 2D image and add multiple planes of depth. For example, with a picture of a face, the end user could select the nose, apply negative parallax (out of the screen), select the lips (set them at slightly negative parallax), select the eyes (apply positive parallax), select the ears (positive parallax), select the neck (positive parallax), etc. After making a selection the end user can control the depth map and vary the amount of positive or negative parallax in that selection.

FIGS. 3-9illustrate the step-by-step process by showing computer monitor displays of the process.FIG. 3illustrates the instruction of the selection of the images.FIG. 5illustrates the selection of the left image.FIG. 6illustrates the selection of the right image.FIG. 7provides the selection of auto alignment or manual alignment.FIG. 8illustrates the selection of the click points.FIG. 8illustrates the shutter glass display.FIG. 10illustrates the Grey Anaglyph display andFIG. 11illustrates the Color Anaglyph display.

The illustrative embodiments and modifications thereto described hereinabove are merely exemplary. It is understood that other modifications to the illustrative embodiments will readily occur to persons of ordinary skill in the art. All such modifications and variations are deemed to be within the scope and spirit of the present invention as will be defined by the accompany claims.