Abstract:
A method and device for producing and capturing three dimensional (“3D”) images by utilizing a matrix of reflex micro lens assemblies (“3DRML”) is provided. Each comprises a housing having a base structure, lateral walls surrounding the base structure, an open end defined by the walls, flex mirror assembly at the base structure and dual diode (or photodiodes (“PDs”) for capturing) projecting assembly. The projecting assembly has a parallax barrier extending from about the center of the mirror assembly and dividing it into two portions, and at least two light emitting diodes (“LEDs”) (or PD) affixed to the barrier away from the mirror assembly. LEDs project light to the mirror assembly (or PDs receive lights therefrom). Two lens assemblies at the open end correct and redirect the directions of light rays. PD (or LED), facing directly to the open end, may be added to capture (or produce) two dimensional images.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    N/A 
       STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT 
       [0002]    N/A 
       NAMES OF THE PARTIES TO A JOINT RESEARCH AGREEMENT 
       [0003]    N/A 
       REFERENCE TO A “SEQUENCE LISTING” 
       [0004]    N/A 
       BACKGROUND OF THE INVENTION 
       [0005]    1. Field of the Invention 
         [0006]    The present invention relates to a three dimensional (“3D”) imaging device and a method thereof either receptive or projective in nature without requirement for an adaptive eye ware. 
         [0007]    The present invention further relates to a method to create two independent light rays to be projected or recorded through the same lens assembly for capturing or generating 3D images. 
         [0008]    2. Description of Related Art 
         [0009]    Televisions have evolved using a series of refinements over the decades. However, throughout these advancements, the fundamental principals have remained mainly unaltered, from the very first black and white TV, where only information pertaining to luminosity was sent to a specific pixel, to color TV where the only difference made was the addition of a color sub carrier to the old technology. When TV&#39;s transition to HD technology the resolution increased but the technology behind the TV remained the same. 
         [0010]    The next evolution in the TV viewing experience, 3D images, brings a whole new methodology of viewing but is still based on the same TV technology as before. Many believe that the 3D TV today uses a completely new internal technology. In reality, it utilizes only a modification of the previous TV technologies. 
         [0011]    3D images are created by replicating how the human eyes see, allowing for our sense of depth and perception of space. To create a 3D image, it requires two cameras, they must record an image simultaneously from different angles, mimicking how the human eyes see. Both images are then projected by the same source in unison. However, this does not fully create a 3D image but only an image that will appear blurry to the viewer. The images then need to be filtered so that the image recorded by the right vantage point is only seen by the right eye and vice versa for the left. This can be done in a number of ways. Chromatic filtration was the first method and used red and cyan lenses in the glasses. This worked however resulted in an undesirable coloration in the resulting image. Newer technology has emerged using polarized light allowing for images to be viewed with unaltered and vibrant colors. 
         [0012]    There are, in general, three (3) types of 3D TV&#39;s in either commercial distribution or in a research stage. These utilize Active, Passive and/or Parallax technology. 
         [0013]    Active 3D technology uses Electronic Shutter Glasses to produce a 3D image. The TV will show 120 images per second, 60 images for the right eye and 60 for the left. The glasses synchronize with the TV by using an infrared or Bluetooth signals. The signal generated from the TV controls the activation of liquid crystal in the optics of the glasses. When an electrical current passes through the optics, the liquid crystal causes the optic to go opaque blocking out the image. The glasses alternate the optical element in sync with the TV. This allows only the image meant to be seen by a particular eye to be seen at any given time. As this happens faster than the human eye can detect, the illusion that there is a constant 3D image is created. 
         [0014]    Referring to  FIGS. 1 and 2 , passive 3D technology uses polarization of light. This is a much more sophisticated form of anaglyph technology, the method used for decades using multicolored glasses, typically a red-cyan combination. Passive 3D is what is used in the commercial movie theaters, primarily with the use of inexpensive eye glasses. Passive TV&#39;s work by having every other pixel polarized in the opposite direction. Image information meant for the left eye  21  is polarized in the opposite direction as the right  22 . The glasses  30  are then polarized to correspond with the polarization angles from the TV&#39;s, which are typically at 45 degrees for the left eye  31  and 135 degrees for the right eye  32 . As the lens optic on the glasses only allows for light with the same polarization angle to pass through the correct image is delivered to the corresponding eye. 
         [0015]    Another form of 3D displaying device utilizes Parallax Barriers  40  as shown in  FIG. 3 . Parallax Barriers  40  allow for 3D viewing without glasses by using a barrier film  60  matched to the pixel pitch of the screen  70 , providing the illusion of 3D. Every other pixel on the screen  70  will show an image for the corresponding eyes  50  and  55 . Parallax barriers  40  rely on restricting light to travel in one direction crossing through the barrier  60  and then to the human eyes  50  and  55 . However good this may sound the technology is limited to one, and only one viewing angle or position. Therefore, this is very restrictive for viewing. 
         [0016]    These three technologies all rely on reusing existing TV technology. 
         [0017]    For example, Canadian Patent Application No. 2,518,595 by Uwe et al., published on Apr. 21, 2004, teaches an apparatus and method for the conversion of a standard two dimensional screen into a 3D auto stereoscopic display. However, the application of the 3D optical assembly requires the disassembly of the front bezel and modification of the existing screen to install the 3D conversion assembly. Furthermore not all existing two dimensional screens are suitable for conversion. Precision alignment and signal processing are also required to provide a signal providing 3D imagery. 
         [0018]    PCT International Patent Application Publication No. WO2010122711 by Ogawa et al., published Mar. 15, 2010, teaches the play back of 3D images using 3D image playback apparatus. The apparatus consists of a signal transmitter and a receiver built in to the Active Shutter of the glasses to control the synchronization between the TV and the viewing apparatus. These proprietary glasses are referred to as Active Shutter Glasses or an Active 3D system. However, such specialized TVs require proprietary viewing glasses that are costly. 
         [0019]    PCT International Patent Application Publication No. WO 2010107247 by Seo et al., published Mar. 17, 2010, teaches a polarized filtration of a Liquid Crystal Display (LCD) using a passive 3D technology. This application of 3D imaging comprises of the application of the standard TV display panel with the addition of a polarized filter panel that is built into the screen, thus relying on polarized glasses for viewing. However, precision assembly of the screen is required for a high quality and consistent imagery between all screens assembled using this technology. Unlike active 3D technology, this allows for the use of inexpensive glasses to be used to create a stereoscopic image at all viewing angles; however the use of glasses restricts ease of use, comfort and convenience for multiple viewers. 
         [0020]    PCT International Patent Application Publication No. WO 2010/119592 by Tsuchida, published Oct. 21, 2010, teaches the creation of a 3D stereoscopic display requiring no adaptive technology to be able to view the stereoscopic 3D image by implementing a parallax barrier. While this device allows for stereoscopy to occur without specialized viewing equipment, it is limited to direct viewing from a single vantage point. Viewing at various angles other than the optimized viewing angle and distance from the screen will result in the loss of 3D viewing. 
         [0021]    PCT International Patent Application Publication No. WO 2010/122690 by Fukushima et al., published on Oct. 28, 2010, merely teaches enhanced brightness of a parallax barrier for both 2D and 3D displays. 
         [0022]    PCT International Patent Application Publication No. WO 2010/121945 by Akhriev et al., published on Oct. 28, 2010 discloses the use of face tracking to render a 3D image based on the subject&#39;s vantage point. While this would overcome the limitation of restricted viewing angles by tracking the subject&#39;s movement but does not address the issue of displaying 3D images to multiple viewers. 
         [0023]    PCT International Patent Application Publication No. WO 2010/116614 by Kimoto et al., published Oct. 14, 2010 discloses a device used in the generation of a 3D image. While it relates to the processing of an image, it does not disclose any device or method of creating 3D images that can be viewed on the disclosed device. 
         [0024]    The aforementioned existing technologies are limited in their applications. The adaptations of existing technologies, as listed above, would result in an impractical and non-viable product for both consumer and commercial markets. Therefore, there is a need to improve at least one of these issues listed above. 
       BRIEF SUMMARY OF THE INVENTION 
       [0025]    The present invention relates to a device for creating 3D images either receptive or projective in nature. 
         [0026]    The present invention would address one or more of the aforementioned shortcomings/issues of competing technologies, and resulting in a viewing experience that is easier and more enjoyable for users. It further provides a solution for creating 3D images that is simple and practical to use. 
         [0027]    The invention would further allow for multiple users to be able to view an image simultaneously from various angles in 3D without needing to use proprietary viewing apparatuses such as glasses to create the 3D effect. 
         [0028]    An object of the present invention is to provide methods and apparatus for producing and capturing three-dimensional images. 
         [0029]    Another object of the present invention is to provide an apparatus for capturing a three dimensional image. 
         [0030]    A yet other object of the present invention is to provide an apparatus for displaying a three dimensional image. 
         [0031]    A further object of the present invention is to provide an apparatus for capturing a three dimensional image while displaying a two dimensional image. 
         [0032]    A yet further object of the present invention is to provide an apparatus for capturing a three dimensional image while displaying a two dimensional image. 
     
    
     
       BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
         [0033]    The present invention is now described in more detail with reference to the accompanying drawings, in which: 
           [0034]      FIG. 1  illustrates a prior art anaglyph method for creating a three-dimensional image on a two-dimensional display; 
           [0035]      FIG. 2  illustrates a prior art eye glasses uses for viewing a three-dimensional image; 
           [0036]      FIG. 3  illustrates a prior art three-dimensional image display apparatus using a parallax barrier; 
           [0037]      FIG. 4  illustrates a screen comprising a matrix or array of projective, receptive or compound three-dimensional reflex micro lens assemblies of the present invention; 
           [0038]      FIGS. 5 and 6  illustrate a projective three-dimensional reflex micro lens assembly of the present invention; 
           [0039]      FIG. 7  illustrates a prior art CCD or CMOS based pixel for image sensing; 
           [0040]      FIGS. 8 and 9  illustrate a receptive three-dimensional reflex micro lens assembly of the present invention; 
           [0041]      FIG. 10  illustrates a compound three-dimensional reflex micro lens assembly of the present invention; 
           [0042]      FIG. 11  illustrates another compound three-dimensional reflex micro lens assembly of the present invention; and 
           [0043]      FIGS. 12 and 13  illustrate side section views of three-dimensional reflex micro lens assembly of the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0044]    The present invention relates to a three dimensional (“3D”) imaging device and method thereof either receptive or projective in nature without requirement for adaptive eye ware. The device and method are designed specifically for 3D imaging without adapting existing technology to achieve a 3D effect. With the redevelopment of how a 3D image is recorded, new streamlined and efficient ways of capturing 3D are proposed. By reverse engineering the process of capturing an image in 3D the projection of an image in 3D will be reproduced without adaptive eye ware. 
         [0045]    The present invention further relates to a device and method to create two independent light rays to be projected or recorded through the same lens assembly. 
         [0046]      FIG. 4  shows a screen  80 , comprising an array or matrix of 3D reflex micro lens (or “3D-RML”) assemblies either for projective (as for 3D display)  85 , for sensor  185  (as for 3D camera) or for both projective and sensor  285  or  385 . 
         [0047]    Referring to  FIGS. 5 and 6 , a projective 3D reflex micro lens assembly  85  comprises an optical or dual diode projection assembly  90  in a housing  86 . The housing  86  has a flex mirror assembly  93  as its base structure, with lateral walls  100  surrounding the flex mirror assembly, and an open end having one or more lenses, i.e.  94  and  95 . The flex mirror assembly  93  is generally concave in shape for reflecting light emitted from the dual diode projection assembly  90 . The dual diode projection assembly  90  comprises a parallax barrier  92 , one end of the parallax barrier  92  is affixed to and divides the reflex mirror assembly  93  into two portions. The parallax barrier  92  extends away from the reflex mirror assembly  93 , preferably from about the bottom of the concave or center of the concave surface. At least two diodes, a right eye diode  91   a  and left eye diode  91   b  are attached to the other end of the parallax barrier  92  with a sufficient distance from the reflex mirror assembly  93 . Each of these right  91   a  and left eye diode  91   b  projects an image onto the reflex mirror assembly  93 , and destined to a particular eye of a viewer(s) (not shown). For example, the right eye diode  91   a  projects images onto the reflex mirror assembly  93  for the right eye(s) of the viewer(s). Likewise, the left eye diode  91   b  projects images onto the reflex mirror assembly  93 , destined for the left eye(s) of the viewer(s). 
         [0048]    The parallax barrier  92  works as a block for preventing undesired light from proceeding at any angles. For example, the light that is emitted from the right eye diode  91   a  would not enter into the direction or angles that would overlap with the left eye diode  91   b  and vice versa. 
         [0049]    In the preferred embodiment of the present invention, the projective 3D reflex micro lens assembly  85  comprises two sets of lenses, including the first lens assembly  94  and secondary lens assembly  95 . The first lens assembly  94  may comprise of one or more lenses and would function as to correct the right light channels  96 , the images of which are emitted from the right eye diode  91   a  reflected on the reflex mirror assembly  93 , and the left light channels  97 , the images of which are emitted from the left eye diode  91   b  reflected on the reflex mirror assembly  93 , and allowing the right light channels  96  and left light channels  97  to proceed to the secondary lens assembly  95  as parallel sets of light channels. 
         [0050]    The secondary lens assembly  95  may comprise one or more lenses and would redirect each sets of right  96  and left light channels  97  to a different direction and creates a slight divergence in the parallel sets of light channels, such that, when the light reaches the viewer&#39;s eyes, the channels have separated sufficiently for the viewers to see the images as in three-dimensional images. In other words, light rays are projected at a slight angle of divergence so that each eye sees a slightly different projected image, and that these two tandem light rays are repeated at multiple angles such that multiple viewing positions are possible. 
         [0051]    Each projective 3D reflex micro lens assembly  85  represents a pixel in a 3D display, and is capable of projected at multiple angles since the reflex mirror assembly  93  is concaved/curved to provide a capability to reflect light in multiple directions. Light rays reflects at the entire radius of the curvature of the reflex mirror assembly  93 , and then out through the first and second lens assemblies  94  and  95  in multiple directions. This further allows for multiple viewing directions. In other words, each pixel or projective 3D reflex micro lens assembly  85  is capable of creating a 3D image without adaptive eye ware. In another preferred embodiment of the present invention, diffractive optics (not shown) may be used for this purpose in order to minimize the structural constraints or size. 
         [0052]    Each of the light rays (emitted from the right  91   a  and left eye diode  91   b ) are projected at a slight different angle of divergence so that each eye sees a slightly different projected image, and that these two tandem light rays are repeated at multiple angles such that multiple viewing positions are possible. 
         [0053]    Reference is made to  FIG. 7 , a conventional CCD or CMOS pixel  110  comprises CCD or CMOS (respectively) photodiode  118  with the width of the pixel  115 . A region  114  is light sensitive area and regions around it  113  are electric circuit, i.e. vertical register, etc. The pixel  110  comprises one or more micro-lenses  111   a  and  111   b  (typically upwardly convex lens(es)) for redirecting (or focusing) light rays  120  toward the photodiode  118 . However, such structure is not suited for capturing three-dimensional images. 
         [0054]      FIG. 8  shows another embodiment of the present invention for capturing three-dimensional images. A three-dimensional camera  170  comprises one or more lenses  170   a  to  170   n  for correcting directions of light rays coming into the camera  170 , and a matrix of receptive three-dimensional reflex mirror lens (3D-RML) assemblies  185  for sensing incoming direction corrected light rays for recording. Again, each receptive 3D-RML assembly  185  represents a pixel in a 3-D image. 
         [0055]    In the preferred embodiment of the present invention, each pixel or receptive 3D-RML assembly  185  consists of a housing  186  having a lateral wall  200  surrounding a reflex mirror assembly  193  as its base structure (of the housing  186 ) at the one end of the housing  186 , a dual photodiode reception assembly  190  being situated at the bottom or center of the reflex mirror assembly  193 , and at least two photodiodes, namely right eye photodiode  191   a  and left eye photodiode  191   b  in the dual photodiode reception assembly  190  with a sufficient distance from the reflex mirror assembly  193  as shown in  FIG. 9 . A parallax barrier  192 , which is a part of the dual photodiode reception assembly  190 , divides the reflex mirror assembly  193  into two portions and prevents incoming light rays from being detected incorrectly by the wrong photodiodes. Directions of incoming light rays are corrected by one or more lenses, i.e.  194  and  195 . In the preferred embodiment of the present invention, first  194  and secondary lens assembly  195  are used to redirect incoming light rays, and corrected light rays are reflected on the flex mirror assembly  193 , which in turn detected by the right  191   a  or left eye photodiode  191   b.  Each pixel or receptive 3D-RML assembly  185  provides a right  201   a  and left eye photodiode circuitry connection  201   b  and allows connections to a recording device (not shown) for the recording of 3D images. Multiple receptive 3D-RML assemblies may be arranged into a matrix of a predetermined size to produce a sensor of a preferred or given resolution. When the matrix is installed into a camera, each receptive 3D-RML assembly  185  may only use a single lens (instead of two as shown in  FIG. 9 ) or more than two lenses. In the case that the receptive 3D-RML assembly  185  uses a single lens, existing or already established lens structures for cameras may be used. 
         [0056]      FIG. 12  shows an array of receptive 3D-RML assemblies  185  for receiving incoming light rays,  197   a - 1 ,  197   b - 1 ,  197   a - 2 ,  197   b - 2 ,  197   a - 3 ,  197   b - 3 ,  197   a - 4 , and  197   b - 4 . However, depending on the resolution of the images required to capture or to enhance or improve quality of capturing three-dimensional images, a processing technique (optically, digitally or both optically and digitally) may be used.  FIG. 13  shows one of such techniques to create a larger degree of separation between left ( 197   a - 1 ,  197   a - 2 ,  197   a - 3 ) and right incoming rays ( 197   b - 1 ,  197   b - 2 ,  197   b - 3 ). In particular, incoming light rays, including left ( 197   a - 1 ,  197   a - 2 ,  197   a - 3 ) and right incoming rays ( 197   b - 1 ,  197   b - 2 ,  197   b - 3 ), are optically separated to create an improved three-dimensional visual effect. Slight loss of image resolution may be resulted in this particular example, such processing creates matched sets spanning across multiple receptive 3D-RML assemblies  185 . 
         [0057]    Yet other embodiment of the present invention, it provides a compound reflex mirror lens assembly  285  as shown in  FIG. 10 . The compound reflex mirror lens assembly  285  combines the projective 3D-RML assembly structure similar to the ones shown in  FIGS. 5 and 6  with a front facing photodiode  298  on a parallax assembly  290 . For example, the compound reflex lens assembly  285  comprises a housing  286  having lateral walls  300 , the optical projection and reception assembly  290 , include a parallax barrier  292  extends from the reflex mirror assembly  293 . A right  291   a  and left eye diode  291   b  are situated at the top of the parallax barrier  292 , and the front facing photodiode  298  is placed at the top thereof such that only the incoming light rays  296  is directed to the photodiode  298 , while the light rays emitted from the right  291   a  and left eye diode  291   b  are directed out to the corresponding viewer&#39;s eyes,  297   a  and  297   b.  In other words, the front facing photodiode  298  allows for incoming light to be recorded while light is emitted and projected out through the compound 3D-RML assembly  285 . This would allow for the recording of content in front of, for example, the screen while separate imagery is being projected. This may be suitable for computer users as the display screen works as a web camera or alike, allowing the viewer to look directly toward the image on the screen. Subject tracking may also be incorporated into the application such that commands based on the motions or/and gestures of the user may be used to control the device and its functionalities. 
         [0058]    Yet another embodiment of the present invention provides a 2D variant of the compound 3-D RML assembly  385  as shown in  FIG. 11 , which produces two-dimensional image while capturing three-dimensional images. This compound 3-D RML assembly  385  is based on the receptive 3-D RML assembly  185  as shown in  FIG. 9 . For example, the compound 3-D RML assembly  385  comprises the optical projection and reception assembly  390 . The optical projection and reception assembly comprises a right  391   a  and left eye photodiode  391   b  on the top portion of the parallax barrier  392  that extends from the flex mirror assembly  393 . A front facing diode  398  is situated on the top of the right  391   a  and left eye photodiode  391   b.  The front facing diode  398  emits and displays two-dimensional image  396  to the viewer&#39;s eyes while the right  391   a  and left eye photodiode  391   b  receive light rays  397   a  and  397   b,  respectively, for capturing three dimensional images. 
         [0059]    It is to be understood that the embodiments and variations shown and described herein are merely illustrations of the principles of this invention and that various modifications may be implemented by those skilled in the art without departing from the spirit and scope of the invention.