Patent ID: 7688346

Claim:
An interactive image capture and display system comprising: a) an image input means including an array of electronic image capture devices distributed in a horizontal plane such that their fields of view partially overlap and collectively cover a full 360 degrees; and b) an image storage and playback means compatible with existing television standards; c) a signal processing means including: 1) a means of producing graphical imagery depicting a panoramic image such that said panoramic image is composed of a plurality of smaller image sections; 2) a means for cropping, distorting and aligning individual images produced by the said image capture devices to produce an overall 360 degree panoramic image with negligible distortion and overlap between the individual image sections and wherein each pixel in the resulting 360 degree panoramic image has the same effective width, where each pixel subtends an equal horizontal angle to the center of said panoramic image; 3) a means for generating an image representing a subset of the said 360 degree panoramic image, whereby the azimuth and elevation of the center of said subset is adjustable by user control; 4) a means for selectively combining and geometrically altering real time imagery from said capture devices and prerecorded imagery to create a composite augmented reality experience; 5) a means for determining the correct location of said image sections within said 360 degree panoramic image utilizing additional information present in the source media; 6) a means for inserting tracking information to describe at least the current orientation of said array of electronic image capture devices into an outgoing video stream; 7) a means for encoding multi-track audio such that it maintains compatibility with standard video storage, playback and transmission systems; and 8) a means for producing orientation-sensitive audio in real-time, utilizing multi-track audio information and controlled by coordinates of a viewport within said panoramic image; d) an image output means capable of outputting an image in a format compatible with existing television standards; e) an audio output means capable of outputting at least 2 channels of audio; f) a display means including at least one display device; g) a user control means including an input device allowing the user to control said signal processing means; and h) A tracking means capable of measuring at least azimuth and elevation of said array of electronic image capture devices.