Method and system for communication between a wearable display device and a portable device

Techniques for reducing weight on wearable display devices are described. In one embodiment of the present invention, an active optical cable is used to transmit image data as well as control signals along with various instructions. The active optical cable is used between a wearable device and a control box (portable device) or extended all the way to a frame holding an integrated lens via a temple. An exemplary active optical cable includes one or more optical fibers for transporting control signals, image data and various instructions while a minimum number of wires are used (e.g., for power and ground).

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention generally relates to the area of display devices and more particularly relates to architecture and designs of display devices, where a display device is made in form of a pair of glasses, and may be used in various applications including virtual reality and augmented reality.

Description of the Related Art

Virtual Reality or VR is generally defined as a realistic and immersive simulation of a three-dimensional environment created using interactive software and hardware, and experienced or controlled by movement of the body. A person using virtual reality equipment is typically able to look around the artificially generated three-dimensional environment, moves around in it and interacts with features or items that are depicted on a screen or in goggles. Virtual realities artificially create sensory experiences, which can include sight, touch, hearing, and, less commonly, smell. Augmented reality (AR) is a technology that layers computer-generated enhancements atop an existing reality in order to make it more meaningful through the ability to interact with it. AR is developed into apps and used on mobile devices to blend digital components into the real world in such a way that they enhance one another, but can also be told apart easily. AR technology is quickly coming into the mainstream. It is used to display score overlays on telecasted sports games and pop out 3D emails, photos or text messages on mobile devices. Leaders of the tech industry are also using AR to do amazing and revolutionary things with holograms and motion activated commands.

The delivery methods of Virtual Reality and Augmented Reality are different when viewed separately. Most 2016-era virtual realities are displayed either on a computer monitor, a projector screen, or with a virtual reality headset (also called head-mounted display or HMD). HMDs typically take the form of head-mounted goggles with a screen in front of the eyes. Virtual Reality actually brings the user into the digital world by cutting off outside stimuli. In this way user is solely focusing on the digital content being displayed in the HMDs. Augmented reality is being used more and more in mobile devices such as laptops, smart phones, and tablets to change how the real world and digital images, graphics intersect and interact.

In reality, it is not always VR vs. AR as they do not always operate independently of one another, and in fact are often blended together to generate an even more immersing experience. For example, haptic feedback, which is the vibration and sensation added to interaction with graphics, is considered an augmentation. However, it is commonly used within a virtual reality setting in order to make the experience more lifelike though touch.

Virtual reality and augmented reality are great examples of experiences and interactions fueled by the desire to become immersed in a simulated land for entertainment and play, or to add a new dimension of interaction between digital devices and the real world. Alone or blended together, they are undoubtedly opening up worlds, both real and virtual alike.

FIG. 1Ashows an exemplary goggle now commonly seen in the market for the application of delivering or displaying VR or AR. No matter how a goggle is designed, it appears bulky and heavy, and causes inconvenience when worn on a user. Further most of the goggles cannot be seen through. In other words, when a user wears a goggle, he or she would not be able to see or do anything else. Thus, there is a need for an apparatus that can display the VR and AR but also allows a user to perform other tasks if needed.

Various wearable devices for VR/AR and holographic applications are being developed.FIG. 1Bshows a sketch of HoloLens from Microsoft. It weights 579 g (1.2 lbs). With the weight, a wearer won't feel comfortable when wearing it for a period. Indeed, what is available in the market is generally heavy and bulky in comparison to normal glasses. Thus there is still another need for a wearable AR/VR viewing or display device that looks similar to a pair of regular glasses but is also amenable to smaller footprint, enhanced impact performance, lower cost packaging, and easier manufacturing process.

Many glasses-like display devices employ a common design of positioning image forming components (such as LCOS) near the front or lens frames, hoping to reduce transmission loss of images and use less components. However, such a design often makes a glasses-like display device unbalanced, the front part is much heavier than the rear part of the glasses-like display device, adding some pressure on a nose. There is thus still another need to distribute the weight of such a display device when worn on a user.

Regardless how a wearable display device is designed, there are many components, wires and even batteries that must be used to make the display device function and operable. While there have been great efforts to move as many parts as possible to an attachable device or enclosure to drive the display device from a user's waist or pocket, the essential parts, such as copper wires, must be used to transmit various control signals and image data. The wires, often in form of a cable, do have a weight, which adds a pressure on a wearer when wearing such a display device. There is yet another need for a transmission medium that can be as light as possible without sacrificing the needed functions.

There are many other needs that are not to be listed individually but can be readily appreciated by those skilled in the art that these needs are clearly met by one or more embodiments of the present invention detailed herein.

SUMMARY OF THE INVENTION

This section is for the purpose of summarizing some aspects of the present invention and to briefly introduce some preferred embodiments. Simplifications or omissions in this section as well as in the abstract and the title may be made to avoid obscuring the purpose of this section, the abstract and the title. Such simplifications or omissions are not intended to limit the scope of the present invention.

The present invention is generally related to architecture and designs of wearable devices that may be for virtual reality and augmented reality applications. According to one aspect of the present invention, a display device is made in form of a pair of glasses and includes a minimum number of parts to reduce the complexity and weight thereof. A separate case or enclosure is provided as portable to be affixed or attached to a user (e.g., a pocket or waist belt). The enclosure includes all necessary parts and circuits to generate content for virtual reality and augmented reality applications, resulting in a minimum number of parts needed on the glasses, hence smaller footprint, enhanced impact performance, lower cost packaging, and easier manufacturing process of the glasses. The content is optically picked up by an optical cable and transported by optical fibers in the optical cable to the glasses, where the content is projected respectively to the lenses specially made for displaying the content before the eyes of the wearer.

According to another aspect of the present invention, the glasses (i.e., the lenses therein) and the enclosure are coupled by an optical cable including at least one optical fiber, where the fiber is responsible for transporting the content or an optical image from one end of the optical fiber to another end thereof by total internal reflections within the fiber. The optical image is picked up by a focal lens from a microdisplay in the enclosure.

According to still another aspect of the present invention, each of the lenses includes a prism in a form that propagates an optical image being projected onto one edge of the prism to an optical path that a user can see an image formed per the optical image. The prism is also integrated with or stacked on an optical correcting lens that is complementary or reciprocal to that of the prism to form an integrated lens for the glasses. The optical correcting lens is provided to correct an optical path from the prism to allow the user to see through the integrated lens without optical distortions.

According to still another aspect of the present invention, one exemplary the prism is a waveguide. each of the integrated lenses includes an optical waveguide that propagates an optical image being projected onto one end of the waveguide to another end with an optical path that a user can see an image formed per the optical image. The waveguide may also be integrated with or stacked on an optical correcting lens to form an integrated lens for the glasses.

According to still another aspect of the present invention, the integrated lens may be further coated with one for more films with optical characteristics that amplify the optical image before the eyes of the user.

According to still another aspect of the present invention, the glasses include a few electronic devices (e.g., sensor or microphone) to enable various interactions between the wearer and the displayed content. Signals captured by a device (e.g., a depth sensor) are transmitted to the enclosure via wireless means (e.g., RF or Bluetooth) to eliminate the wired connections between the glasses and the enclosure.

According to still another aspect of the present invention, instead of using two optical cables to transport the images from two microdisplays, a single optical cable is used to transport the images from one microdisplay. The optical cable may go through either one of the temples of the glasses. A splitting mechanism disposed near or right on the bridge of the glasses is used to split the images into two versions, one for the left lens and the other for the right lens. These two images are then respectively projected into the prisms or waveguides that may be used in the two lenses.

According to still another aspect of the present invention, the optical cable is enclosed within or attached to functional multi-layer structures which form a portion of an article of clothing. When a user wears a shirt made or designed in accordance with one of the embodiment, the cable itself has less weight while the user can have more activities.

According to still another aspect of the present invention, an optical conduit is used to transport an optical image received from an image source (e.g., a microdisplay). The optical conduit is encapsulated in or integrated with a temple of the display device. Depending on implementation, the optical conduit comprising a bundle or an array of optical fibers may be twisted, thinned or otherwise deformed to fit with a stylish design of the temple while transporting an optical image from one end to another end of the temple.

To further reduce the weight of the display device, according to still another aspect of the present invention, an active optical cable is used as a communication medium between the display device and a portable device, where the portable device is wearable by or attachable to a user. The active optical cable includes two ends and at least one optical fiber and two wires, where the two ends are coupled by the optical fiber and two wires. The two wires carry power and ground to energize the two ends and the operation of the display device while the at least optical fiber is used to carry all data, control and instruction signals.

According to still another aspect of the present invention, the portable device may be implemented as a standalone device or a docking unit to receive a smartphone. The portable device is primarily a control box that is connected to a network (e.g., the Internet) and generates control and instruction signals when controlled by a user. When a smartphone is received in the docking unit, many functions provided in the smartphone may be used, such as the network interface and touch screen to receive inputs from the user.

The present invention may be implemented as an apparatus, a method, a part of system. Different implementations may yield different benefits, objects and advantages. In one embodiment, the present invention is a pair of glasses comprising: at least a lens, a pair of temples, and a projection mechanism, disposed near an end of the temple, receiving an optical image from the temple and projecting the optical image into the lens. At least one temple includes an optical cable, wherein the optical cable is extended beyond the temple to receive the optical image optically picked up by a focal lens that projects the optical image onto one end of an optical cable. The optical cable includes at least one optical fiber to transport the optical image from one end of the optical cable to another end of the optical cable by total internal reflection in the optical fiber, and the optical image is projected onto the optical fiber by a focal lens from a displayed image on a microdisplay.

In another embodiment, the present invention is a display apparatus comprising: at least a lens, a pair of temples, at least one temple including an optical cable, wherein the optical cable is extended beyond the temple to receive an optical image, a projection mechanism, disposed near an end of the temple, receiving the optical image from the temple and projecting the optical image into the lens, and a sensor and an infrared lighting source disposed separately around the lens to image an eye looking at the optical image, wherein the eye being illuminated by the infrared lighting source. The projection mechanism includes a focal mechanism auto-focusing and projecting the optical image onto the first edge of the prism. The display apparatus further includes a wireless module provided to transmit wirelessly a sensing signal from the sensor to a case including a processor and circuitry to process the sensing signal and send a feedback signal to control the focal mechanism.

In still another embodiment, the present invention is a wearable display device, it comprises at least a lens, a temple, an optical block receiving an optical image from a microdisplay device, at least an optical conduit with a first end and a second end, and an integrated lens. The optical conduit is integrated within the temple. The first end coupled to the optical block and receiving the optical image therefrom. The optical image is transported to the second end by total internal reflections within the optical conduit. The integrated lens, coupled to the second end, receives the optical image from the optical conduit and presents the optical image for a user of the display device to view an image within the integrated lens.

In still another embodiment, the present invention is a method for transporting an optical image from a portable device to a wearable display device, the method comprises receiving the optical image from an optical cube, wherein the optical image is in a reversed aspect of ratio, the optical cube is attached with a microdisplay device and a light source, the optical image is formed by shining illumination (i.e., light intensities) from the light source onto the microdisplay device. The method further comprises projecting the optical image into an optical conduit including an array of optical fibers, and physically rotated by 90 degrees, rotating the optical image 90 degrees by transporting the optical image through the optical conduit by total internal reflections within the fibers, and receiving the optical image in a normalized aspect of ratio before projecting the optical image into an integrated lens for view therein by a viewer.

In still another embodiment, the present invention is a display apparatus comprising: at least one integrated lens; one active optical cable including two ends, at least one optical fiber and two wires, wherein the two ends are coupled by the at least one optical fiber and two wires. The display apparatus further comprises two temples, at least one of the temples enclosing the active optical cable; an image source integrated within a frame holding the at least one integrated lens, wherein the active optical cable, communicating with a portable device, receives image data from the active optical cable and generates an optical image per the image data, the optical image is projected into the integrated lens for view by a wearer.

In yet another embodiment, the present invention is a system comprising a pair of wearable display glasses including at least one integrated lens and one temple, the temple including an optical conduit transporting an optical image from one end of the temple to another end of the temple, wherein the optical image is projected into the integrated lens for a viewer to view an image formed from the optical image. The system further comprises a wearable docking unit including predefined circuitry to provide image data to generate the optical image; and an active optical cable including a first end, a second end, an array of optical fibers and at least two wires, the first and second ends being coupled by the optical fibers and wires.

There are many other objects, together with the foregoing attained in the exercise of the invention in the following description and resulting in the embodiment illustrated in the accompanying drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The detailed description of the invention is presented largely in terms of procedures, steps, logic blocks, processing, and other symbolic representations that directly or indirectly resemble the operations of data processing devices coupled to networks. These process descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art.

Referring now to the drawings, in which like numerals refer to like parts throughout the several views.FIG. 2Ashows a pair of exemplary glasses200that are used for applications of VR/AR according to one embodiment of the present invention. The glasses200appear no significant difference to a pair of normal glasses but include two flexible cables202and204that are respectively extended from the temples206and208. According to one embodiment, each pair of the two flexible cables202and the temples206and208are integrated or removably connected at one end thereof and include one or more optical fibers.

Both of flexible cables202are coupled at another end thereof to a portable computing device210, where the computing device210generates images based on a microdisplay that are captured by the cables202. The images are transported through the optical fibers in the flexible cables202by the total internal reflections therein all the way to another end of the optical fibers, where the images are projected onto the lenses in the glasses200.

According to one embodiment, each of the two flexible cables202includes one or more optical fibers. Optical fibers are used to transmit light from one place to the other along curved path in a more effective manner as shown inFIG. 2B. In one embodiment, the optical fibers are formed with thousands of strands of a very fine quality glass or quartz of refractive index about 1.7 or so. The thickness of a strand is tine. The strands are coated with a layer of some material of lower refractive index. The ends of the strands are polished and clamped firmly after aligning them carefully. When light is incident at a small angle at one end, it gets refracted into the strands (or fibers) and gets incident on the interface of the fibers and the coating. The angle of incidence being greater than the critical angle, the ray of light undergoes total internal reflections and essentially transports the light from one end to another end even if the fiber is bent. Depending on the implementation of the present invention, a single fiber or a plurality of fibers arranged in parallel may be used to transport an optical image projected onto one end of the fiber or fibers to another end thereof.

FIG. 2Cshows two exemplary ways to encapsulate a fiber or a plurality of fibers according to one embodiment of the present invention. The encapsulated fiber or fibers may be used as the cable202or204inFIG. 2Aand extended through each of the non-flexible temples206and208all the way to the end thereof. According to one embodiment, the temples206and208are made of a type of material (e.g., plastic or metal) commonly seen in a pair of regular glasses, a portion of the cable202or204is embedded or integrated in the temple206or208, resulting in a non-flexible part while. another portion of the cable202or204remains flexible. According to another embodiment, the non-flexible part and the flexible part of the cable202or204may be removably connected via a type of interface or connector.

Referring now toFIG. 2D, it shows how an image is being transported from a microdisplay240via a fiber cable242to an imaging medium244. As will be further described below, an imaging medium244may be a physical thing (e.g., films) or non-physical thing (e.g., the air). A microdisplay is a display that has a very small screen (e.g., less than an inch). This type of tiny electronic display system was introduced commercially in the late 1990s. The most common applications of microdisplays include rear-projection TVs and head-mounted displays. Microdisplays may be reflective or transmissive depending upon the way light is allowed to pass through the display unit. Through a lens246, an image (not shown) displayed on the microdisplay240is picked up by one end of the fiber cable242that transports the image to the other end of the fiber cable242. Another lens248is provided to collect the image from the fiber cable242and projects it to the imaging medium244. Depending on the implementation, there are different types of microdisplays and imaging mediums. Some of the embodiments of the microdisplays and imaging mediums will be described in detail below.

FIG. 2Eshows a set of exemplary variable focus elements (VFE)250to accommodate an adjustment of the projection of an image onto an optical object (e.g., an imaging medium or a prism). To facilitate the description of various embodiments of the present invention, it is assumed that there is an image medium. As illustrated inFIG. 2E, an image252transported by a fiber cable reaches the end surface254of the fiber cable. The image252is focused by a set of lens256, referred to herein as variable focus elements (VFE), onto an imaging medium258. The VFE256is provided to be adjusted to make sure that the image252is precisely focused onto the imaging medium258. Depending the implementation, the adjustment of the VFE256may be done manually or automatically in accordance with an input (e.g., a measurement obtained from a sensor). According to one embodiment, the adjustment of the VFE256is performed automatically in accordance with a feedback signal derived from a sensing signal from a sensor looking at an eye (pupil) of the wearer wearing the glasses200ofFIG. 2A.

Referring now toFIG. 2F, it shows an exemplary lens260that may be used in the glasses shown inFIG. 2A. The lens260includes two parts, a prism262and an optical correcting lens or corrector264. The prism262and the corrector264are stacked to form the lens260. As the name suggests, the optical corrector264is provided to correct the optical path from the prism262so that a light going through the prism262goes straight through the corrector264. In other words, the refracted light from the prism262is corrected or de-refracted by the corrector264. In optics, a prism is a transparent optical element with flat, polished surfaces that refract light. At least two of the flat surfaces must have an angle between them. The exact angles between the surfaces depend on the application. The traditional geometrical shape is that of a triangular prism with a triangular base and rectangular sides, and in colloquial use a prism usually refers to this type. Prisms can be made from any material that is transparent to the wavelengths for which they are designed. Typical materials include glass, plastic and fluorite. According to one embodiment, the type of the prism262is not in fact in the shape of geometric prisms, hence the prism262is referred herein as a freeform prism, which leads the corrector264to a form complementary, reciprocal or conjugate to that of the prism262to form the lens260.

On one edge of the lens260or the edge of the prism262, there are at least three items utilizing the prism262. Referenced by267is an imaging medium corresponding to the imaging medium244ofFIG. 2D or 258ofFIG. 2E. Depending on the implementation, the image transported by the optical fiber242ofFIG. 2Dmay be projected directly onto the edge of the prism262or formed on the imaging medium267before it is projected onto the edge of the prism262. In any case, the projected image is refracted in the prism262and subsequently seen by the eye265in accordance with the shapes of the prism262. In other words, a user wearing a pair of glasses employing the lens262can see the image being displayed through or in the prism262.

A sensor266is provided to image the position or movement of the pupil in the eye265. Again, based on the refractions provided by the prism262, the location of the pupil can be seen by the sensor266. In operation, an image of the eye265is captured. The image is analyzed to derive how the pupil is looking at the image being shown through or in the lens260. In the application of AR, the location of the pupil may be used to activate an action. Optionally, a light source268is provided to illuminate the eye265to facilitate the image capture by the sensor266. According to one embodiment, the light source268uses a near inferred source as such the user or his eye265would not be affected by the light source268when it is on.

FIG. 2Gshows the internal reflections from a plurality of sources (e.g., the sensor266, the imaging medium267and the light source268). As the prism is uniquely designed in particular shapes or to have particular edges, the rays from the sources are reflected several times within the prism268and subsequently impinge upon the eye265. For completeness,FIG. 2Hshows a comparison of such a lens to a coin and a ruler in sizes.

As described above, there are different types of microdisplays, hence different imaging mediums. The table below summarizes some of the microdisplays that may be used to facilitate the generation of an optical image that can be transported by one or more optical fibers one end to another end thereof by total internal reflection within the optical fiber(s).

In the first case shown above in the table, a full color image is actually displayed on a silicon. As shown inFIG. 2D, the full color image can be picked up by a focal lens or a set of lenses that project the full image right onto one end of the fiber. The image is transported within the fiber and picked up again by another focal lens at the other end of the fiber. As the transported image is visible and full color, the imaging medium244ofFIG. 2Dmay not be physically needed. The color image can be directly projected onto one edge of the prism262ofFIG. 2F.

In the second case shown above in the table, an LCoS is used with different light sources. In particular, there are at least three colored light sources (e.g., red, green and blue) used sequentially. In other words, a single color image is generated per one light source. The image picked up by the fiber is only a single color image. A full color image can be reproduced when all three different single color images are combined. The imaging medium244ofFIG. 2Dis provided to reproduce the full color image from the three different single color images transported respectively by the optical fiber.

FIG. 2Ishows a shirt270in which a cable272is enclosed within the shirt270or attached thereto. The shirt270is an example of fabric material or multi-layers. Such a relatively thin cable can be embedded into the multi-layers. When a user wears such a shirt made or designed in accordance with one of the embodiment, the cable itself has less weight while the user can have more freedom to move around.

FIG. 3Ashows how three single color images302are being combined visually and perceived as a full color image304by human vision. According to one embodiment, three colored light sources are used, for example, red, green and blue light sources that are turned sequentially. More specifically, when a red light source is turned on, only a red image is produced as a result (e.g., from a microdisplay). The red image is then picked up optically and transported by the fiber, and subsequently projected into the prism262ofFIG. 2F. As the green and blue lights are turned on afterwards and sequentially, the green and blue images are produced and transported respectively by the fiber, and subsequently projected into the prism262ofFIG. 2F. It is well known that human vision possesses the ability of combining the three single color images and perceives them as a full color image. With the three single color images projected sequentially into the prism, all perfectly registered, the eye sees a full color image.

Also in the second case shown above, the light sources can be nearly invisible. According to one embodiment, the three light sources produce lights near UV band. Under such lighting, three different color images can still be produced and transported but are not very visible. Before they can be presented to the eyes or projected into the prism, they shall be converted to three primary color images that can subsequently be perceived as a full color image. According to one embodiment, the imaging medium244ofFIG. 2Dis provided.FIG. 3Bshows that three different color images310are generated under three light sources respectively at wavelengths λ1, λ2, and λ3, the imaging medium312includes three films314, each coated with a type of phosphor, a substance that exhibits the phenomenon of luminescence. In one embodiment, three types of phosphor at wavelength 405 nm, 435 nm and 465 nm are used to convert the three different color images produced under the three light sources near UV band. In other words, when one such color image is projected onto a film coated with the phosphor at a wavelength 405 nm, the single color image is converted as a red image that is then focused and projected into the prism. The same process is true with other two single color images that go through a film coated with phosphor at wavelength 435 nm or 465 nm, resulting in green and blue images. When such red, green and blue images are projected sequentially into the prism, a human vision perceives them together as a full color image.

In the third or fourth case shown above in the table, instead of using a light either in the visible spectrum or near invisible to human eyes, the light source uses a laser source. There are also visible lasers and non-visible lasers. Operating not much differently from the first and second cases, the third or fourth case uses what is called spatial light modulation (SLM) to form a full color image. A spatial light modulator is a general term describing devices that are used to modulate amplitude, phase, or polarization of light waves in space and time. In other words, SLM+laser (RGB sequentially) can produce three separate color images. When they are combined with or without the imaging medium, a full color image can be reproduced. In the case of SLM+laser (non-visible), the imaging medium shall be presented to convert the non-visible images to a full color image, in which case, appropriate films may be used as shown inFIG. 3B.

Referring now toFIG. 4, it shows that an waveguide400is used to transport an optical image402from one end404of the waveguide400to another end406, wherein the waveguide400may be stacked with one or more pieces of glass or lenses (not shown) or coated with one or more films to from a suitable lens for a pair of glasses for the applications of displaying images from a computing device. It is known to those skilled in that art that an optical waveguide is a spatially inhomogeneous structure for guiding light, i.e. for restricting the spatial region in which light can propagate, where a waveguide contains a region of increased refractive index, compared with the surrounding medium (often called cladding).

The waveguide400is transparent and shaped appropriately at the end of404to allow the image402to be propagated along the waveguide400to the end406, where a user408can see through the waveguide400so as to see the propagated image410. According to one embodiment, one or more films are disposed upon the waveguide400to amplify the propagated image410so that the eye408can see a significantly amplified image412. One example of such films is what is called metalenses, essentially an array of thin titanium dioxide nanofins on a glass substrate.

Referring now toFIG. 5, it shows an exemplary functional block diagram500that may be used in a separate case or enclosure to produce content related to virtual reality and augmented reality for display on the exemplary glasses ofFIG. 2A. As shown inFIG. 5, there are two microdisplays502and504provided to supply content to both of lenses in the glasses ofFIG. 2A, essentially a left image goes to the left lens and a right image goes to the right lens. An example of the content is 2D or 3D images and video, or hologram. Each of the microdisplays502and504is driven by a corresponding driver506or508.

The entire circuit500is controlled and driven by a controller510that is programmed to generate the content. According to one embodiment, the circuit500is designed to communicate with the Internet (not shown), receive the content from other devices. In particular, the circuit500includes an interface to receive a sensing signal from a remote sensor (e.g., the sensor266ofFIG. 2F) via a wireless means (e.g., RF or Bluetooth). The controller510is programmed to analyze the sensing signal and provides a feedback signal to control certain operations of the glasses, such as a projection mechanism that includes a focal mechanism auto-focusing and projecting the optical image onto an edge of the prism262ofFIG. 2F. In addition, the audio is provided to synchronize with the content, and may be transmitted to earphones wirelessly.

FIG. 5shows an exemplary circuit500to produce the content for display in a pair of glasses contemplated in one embodiment of the present invention. The circuit500shows that there are two microdisplays502and504used to provide two respective images or video streams to the two lenses of the glasses inFIG. 2A. According to one embodiment, only one microdisplay may be used to drive the two lenses of the glasses inFIG. 2A. Such a circuit is not provided herein as those skilled in the art know how the circuit can be designed or how to modify the circuit500ofFIG. 5.

Given one video stream or one image, the advantage is that there is only one optical cable needed to transport the image.FIG. 6Ashows a modified version600ofFIG. 2Ato show that one cable602is used to couple the enclosure210to the glasses208. Instead of using two optical cables to transport the images from two microdisplays as shown inFIG. 2A, a single optical cable is used to transport the images from one microdisplay. The optical cable may go through either one of the temples of the glasses and perhaps further to part of one top frame. A splitting mechanism disposed near or right on the bridge of the glasses is used to split the images into two versions, one for the left lens and the other for the right lens. These two images are then respectively projected into the prisms or waveguides that may be used in the two lenses.

To split the image propagated or transported by the cable602, the glasses600are designed to include a splitting mechanism604that is preferably disposed near or at the bridge thereof.FIG. 6Bshows an exemplary splitting mechanism610according to one embodiment of the present invention. A cube612, also called X-cube beam splitter used to split incident light into two separate components, is provided to receive the image from a microdisplay via the cable602. In other words, the image is projected onto one side of the X-cube612. The X-cube612is internally coated with certain reflecting materials to split the incident image into two parts, one goes to the left and the other goes to the right as shown inFIG. 6B. A split image goes through a polarized plate614or616to hit a reflector618or620that reflects the image back to the polarized reflective mirror626or628. The two polarized plates614and616are polarized differently (e.g., in horizontally and vertically or circular left and right) corresponding to the images sequentially generated either for left eye or right eye. Coated with certain reflective material, the polarized reflective mirror626or628reflects the image to the corresponding eye. Depending on the implementation, the reflected image from the polarized reflective mirror626or628may be impinged upon one edge of the prism262ofFIG. 2For the waveguide400ofFIG. 4. Optionally, Two wave plates622and624are respectively disposed before the reflectors618and620.

FIG. 2BorFIG. 2Dshows an optical fiber cable220or242is used to transport an image from one end to another end. The use of the optical fibers, typically encapsulated in a flexible material such as plastic, can significantly reduce the weight of the glasses. According to one embodiment, a fiber cable is made with a plurality of optical fibers integrated in parallel to form an optical fiber conduit.FIG. 7Ashows an exemplary integration of an optical fiber conduit700. A plurality of individual fibers are integrated and shaped to form an optical fiber conduit700with a cross section thereof being a predefined shape (e.g., rectangular or square). When an optical image is projected onto one end of the conduit700, light beams of the image travel respectively in the fibers by total internal reflections in each of the fibers and reach another end of the conduit700.

Referring now toFIG. 7B, it shows a conduit710is shaped as a part of a temple of the glasses. In general, an image being projected onto one end of the conduit710has an aspect of ratio of 4:3 or 16:9. Regardless of an exact number of the ratio (an attribute describes the relationship between the width and height of an image), the horizontal dimension of the image is often longer than the vertical dimension. Preferably, the conduit710is in a shape having a ratio similar to that of the image, which would result in the temple appearing thick horizontally. According to one embodiment, the conduit710is twisted by 90 degrees in certain part. In other words, the conduit710starts with a ratio inversely similar to that of the image and then ends with a ratio similar to that of the image. For an image with a ratio of 16:9 (i.e., horizontal:vertical), a first part of the conduit200is made with a ratio of 9:16 and a second part of the conduit200is made with a ratio of 16:9. One of the important advantages, benefits and objectives of this implementation is to have the two temples of the glasses designed to look less bulky (i.e., sleek or stylish) even when they are used inherently or include a conduit to transport images or videos.

FIG. 7Bshows that the conduit710is twisted by 90 degrees near one end of the conduit710. An optical image is projected from an image source712onto a beginning part714of the conduit200, where the image source712may be readily rotated to accommodate the shape of the beginning interface714. It is assumed that an image from the image source has a ratio of 9:16. As a result, the first portion716of the conduit710can be made thinner horizontally than vertically. The conduit710is then rotated by 90 degrees in a second part718of the conduit710, the image is also rotated by 90 degrees. As a result, the image coming out of an ending part720of the conduit710has an aspect ratio of 16:9 and may be projected into an integrated lens (e.g.,260ofFIG. 2F) or a waveguide (e.g.,400ofFIG. 4) for normal viewing.

Depending on the implementation, the image source712may be simply a projection from the optical fiber cable220or242ofFIG. 2BorFIG. 2D, an optical image generated from a micro display device (microdisplay)222or an optical cube providing an optical image. According to one embodiment, the micro display device222(e.g., an LCOS) is provided to generate an optical image that is projected into the optical cube712. Two enlarged versions of the cube712are also shown inFIG. 7B. In one embodiment, the cube714includes two optical pieces or blocks717and718in triangular shape. A special optical material or film720is provided between the two blocks717and718. A light source722projects a light into the block717. The light is then turned to the microdisplay222by the film720to shine the microdisplay222. The microdisplay222generates the optical image with the light from the light source722. The image is then reflected into the block718and passes through the film720. The image is further projected onto the beginning part714of the conduit710for transmission within the conduit710to the second end720thereof. One of the important advantages, benefits and advantages in this implementation is the use of optical fibers to transmit an image from one end to another end without significantly increasing the metal weight that would be otherwise present when a cable with an array of wires is used. According to one embodiment, a waveguide726is provided to transport the projected optical image to a proper position and form an image based on the projected optical image.

According to one embodiment,FIG. 7Cshows an implementation of the light source730that may be used as the light source722ofFIG. 7B. The light source730includes a light guide732, a shade734and a number of lights736(two of which are shown). Illumination from the lights736is projected into the guide732. In one embodiment, the shade734is reflective on one side and opaque on the other side. Such a shade734is provided to reflect the illumination onto the block717, besides preventing any of the illumination from going out of the guide730. In other words, the shade734may be made with a film with one side being reflective and the other side being opaque.

The description ofFIG. 7Bis based on the assumption that the received optical image at the first end714of the conduit710is already rotated by 90 degrees. Therefore the conduit is made to rotate 90 degrees back to normalize the image orientation. Those skilled in the art may appreciate that the above description is equally applicable to a received image rotated by any degree, in which case the conduit710can be made to rotate back an equal amount to normalize the image orientation.FIG. 7Dshows one embodiment in which an optical conduit750is not rotated while receiving an optical image with the standard orientation (e.g., maintaining an aspect ratio of 16:9 or 4:3). An optical image from the image source752is made to pass through an optical lens754that may shrink the image vertically or horizontally or both accordingly. To facilitate the description of the present invention, it is assumed that the lens754only shrinks a received image horizontally by a predefined amount (e.g., 70%). As a result, the width or thickness of the conduit750can be made thinner. On the other end of the conduit750, there is a second lens756. Optically, the lens756does the opposite of what the lens754does, namely expanding the image horizontally by a predefined amount (e.g., 1/0.70), to recover the dimensions of the original image from the cube752.

In operation, an optical image with an aspect of ratio being X:Y (e.g., 16:9) from the image source752is projected through the (horizontally shrinking) lens754. The aspect of ratio is now Y:Y (e.g., 9:9). The optically distorted image is transported through the conduit750and then is projected through the lens756. As described above, the lens756expands a light beam horizontally, resulting in the recovery of the optically distorted image to a normal image with an aspect of ration being X:Y (16:9). One of the advantages, benefits and objectives of this embodiment is to have a temple designed normally or with style, even when it is used to transport optical images or videos therein. In other words, the conduit750may be designed in any sizes or shapes as long as the pair of the lenses754and756are conjugate, which means they operates optically just opposite.

FIG. 7Eshows an example of a temple760that may be used in the display glasses described in the present invention. Whatever the material the temple660may use, it encapsulates an optical conduit762(e.g., the conduit710or750) and an image source764. As the optical conduit762is made of an array of optical fibers, it may be structured per a predefined shape and even curved if needed. In a summary, the conduit762is made part of the temple760. The image source764is preferably positioned near one end of the end of the conduit762, and may also be enclosed in the temple760according to one embodiment.

Regardless of how the image source764is structured, there has to be at least some wires that are used to couple the image source764to a portable device to receive image data, various signals and instructions. According to one embodiment, a microdisplay in the image source712or752requires power to operate and receives electronic signals to generate images/videos as expected. When the microdisplay is moved in or near a temple, the power and signals must be brought to the microdisplay. Various copper wires would have to be used. In a prior art system, a cable including one or more conductors or wires is commonly used. However, the weight of the cable is significantly heavier than a fiber cable and could add certain pressure on the glasses when the two temples are connected or attached to such a cable. In general, the more wires in a cable, the heavier a temple could be.

According to one embodiment, most of these wires are replaced by fibers.FIG. 8Ashows what is called herein an active optical cable800that includes two ends802and804and at least one fiber806coupled between the two ends802and804. In addition, there are at least two wires (not visible) inFIG. 8Aembedded with the fiber806, one for power and the other for ground. These two wires are essentially to supply the power from one end to another end. Depending on how or how many signals need to go through the cable800, the number of the fibers803may vary or constant. The two ends802and804may be implemented as pluggable (e.g., USB-C type) depending on an actual need. Each of the two ends802and804includes a converter (e.g., a photodiode) to convert an electronic signal to a light or convert a light to an electronic signal. Each of the two ends802and804further includes necessary integrated circuits to perform encoding or decoding functions if needed, namely a data set or electronic signal when received is encoded and presented in a colored light or the colored light when received is decoded to recover the electronic signal. The details of the end802or804are not to be further provided herein to obscure other aspects of the present invention. It is assumed that the cable800is used to transport a set of signals from the end802to the end804. When the end802receives the signals, the converter in the end802converts the signals to a light beam including a set of optical signals, where each of the optical signal is encoded per one of the signals. Alternatively, a set of beams is produced by the converter, each beam corresponds to one of the signals. A light beam is then transported within a fiber from the first end802to the second end804. Once reaching the second end804, a converter in the second end804converts the light beam back into one or more electronic signals. It can be appreciated by those skilled in the art that the cable800is much lighter than an wire-based cable that would be otherwise used to carry these signals. It can also be readily understood that the active optical cable needs one or more optical fibers to transmit data, control signals or various instructions needed to present appropriate images/videos to a viewer.

FIG. 8Alists specifications such a cable808may be implemented based upon. The number of fibers may be individually specified depending on the implementation. In one example, image data in red, green and blue is respectively transported in three different fibers while the control signals are transported in one fiber, thus making a 4-channel fibers configuration for the active optical cable.FIG. 8Aalso shows the flexibility of such a fiber-based cable that may be folded or extended without loss of the signals.FIG. 8BandFIG. 8Ceach show an example of the cable800that includes 4 fibers for transporting image data and control signals and three wires for the power, ground and a I2C data bus, but with different interfaces (LVDS vs. DisplayPort). As the power consumption is small in this type of application, the wire for the power or the ground can be made very thin to reduce the weight of the cable800.

Referring now toFIG. 9A, it shows a skeleton of a pair of glasses900worn on a human being.FIG. 9Bshown an exploded view near the end of a temple of the glasses900. The temple includes an optical conduit902. One end of the conduit902is coupled to an optical image source904to receive an optical image therefrom. The source904includes a microdisplay906and an optical cube908. With an active optical cable910, the optical image source904receives control signals as well as image or video data to produce the optical images or videos. The optical signals are projected into and transported via the conduit902to another end thereof.

FIG. 9Cshows another embodiment in which the display glasses are implemented as a set of clipped-on glasses920on a regular glasses. Slightly different from the regular clipped-on sun glasses, the glasses920include at least one temple922, where the temple922encapsulates one optical conduit to transmit an optical image from one end to another. It should be noted that the temple922is truncated. It is not necessarily extended all the way to an ear of a human being or wearer. Depending on the implementation, the length of the truncated temple922may be around one inch or extended to the ear. One of the purposes to have such a truncated temple922is to distribute the weight of the clipped-on glasses920or pressure away from the nose largely responsible for holding the glasses924as well as the clipped-on glasses920. An active optical cable (not shown) is provided to couple the truncated temple922to a portable device (not shown).

As an option or comparison,FIG. 9Dshows an embodiment in which an optical conduit is not directly used in a temple. Instead, an image source930is provided near a piece of integrated lens (e.g.,260ofFIG. 2F). The image source930is implemented as a block or an optical block as it includes an optical cube. The block930is shown to be positioned near the display lens (e.g., the integrated lens260ofFIG. 2F).FIG. 9Eillustrates one embodiment in which the block930is integrated in a glasses frame or a lens frame932. Instead of using an optical conduit, an active optical cable934is used to deliver a data image all the way near the integrated lens (not shown), where the block930including a microdisplay device and a light source generates an optical image per the data image. The active optical cable934is embedded in or integrated with the temple936. The optical image is then projected into the integrated lens as shown inFIG. 2F. As an option,FIG. 9Fshows an embodiment in which a display device can be covered with a mask. In some applications (e.g., VR or viewing a length video), the see-through feature of the display glasses may impose some disruptions when the ambient light or movement are relatively strong. Thus a mask940is provided and may be mounted onto the display glasses942. In particular, the mask940is intended to disable the see-through feature of the display glasses942, so the viewer may concentrate the viewing of the video being displayed in the lenses944and946. According to one embodiment, the mask940is made opaque to block the lights (e.g., ambient lights) from the surrounding. For convenience, the mask940may be made in the form of sunglasses clip-on for easy on or off. In one embodiment, the mask940may also be made as a goggle to block nearly all of the ambient lighting from the surrounding.

Referring now toFIG. 10A, it shows a block diagram1000of using a pair of display glasses (i.e., display device)1002with a smartphone (e.g., iPhone), according to one embodiment of the present invention. The glasses200ofFIG. 2Aor the glasses900ofFIG. 9Amay be used as the display device1002. A cable1004(e.g., the active optical cable800ofFIG. 8A) is used to couple the glasses1002to a docking unit1006, the docking unit1006is provided to receive a smartphone. The docking unit1006allows a user (i.e., a wearer of the display device1002) to control the display device1002, for example, to select a media for display, to interact with a display, to activate or deactivate an application (e.g., email, browser and mobile payment).

According to one embodiment, the docking unit1006includes a set of batteries that may be charged via a power cord and used to charge the smartphone when there is a need. One of the advantages, benefits and objectives in the embodiment of providing a docking unit is to use many functions already in the smartphone. For example, there is no need to implement a network interface in the docking unit because the smartphone has the interface already. In operation, a user can control the smartphone to obtain what is intended for, the content of which can be readily displayed or reproduced on the display device via the cable1004coupling the docking unit1006to the display device1002.

As shown inFIG. 10A, the docking unit1006includes two parts, either one or both may be used in one implementation. The first part includes a receiving unit to receive a smartphone and may or may not have a battery pack that can be recharged and charge the smartphone when there is one and the smartphone is received. the second part includes various interfaces to communicate with the smartphone to receive data and instructions therefrom for the display device1002to display images/videos for the wearer to view. One of the important features, benefits and advantages in the present invention is the use of an active optical cable to couple the portable device to the display device1002. In general, the portable device is worn by the wearer (e.g., attached to a belt or pocket). In one embodiment, the clothing270ofFIG. 2Imay be used to conceal the cable and provide more freedom for the wearer to move around.

Referring now toFIG. 10B, it illustrates an internal functional block diagram1100of an exemplary docking unit that may be used inFIG. 10Aor as an independent portable device that may be operated by a wearer to control the display device1002. The device, as shown inFIG. 10B, includes a microprocessor or microcontroller1022, a memory space1024in which there is an application module1026, an input interface1028, an image buffer1030to drive a display device via a display interface1032and a network interface1034. The application module1026is a software version representing one embodiment of the present invention, and downloadable over a network from a library (e.g., Apple Store) or a designated server. One exemplary function provided by the application module1026is to allow a user (or a wearer of the display device) to enable certain interactions with a display by predefined movements of an eye being sensed by the sensor266ofFIG. 2F.

The input interface1028includes one or more input mechanisms. A user may use an input mechanism to interact with the display device by entering a command to the microcontroller1022. Examples of the input mechanisms include a microphone or mic to receive an audio command and a keyboard (e.g., a displayed soft keyboard) or a touch screen to receive a command. Another example of an input mechanism is a camera provided to capture a photo or video, where the data for the photo or video is stored in the device for immediate or subsequent use with the application module1026. The image buffer1030, coupled to the microcontroller1022, is provided to buffer image/video data used to generate the optical image/videos for display on the display device. The display interface1032is provided to drive the active optical cable and feeds the data from the image buffer1030thereto. In one embodiment, the display interface1032is caused to encode certain instructions received on the input interface1028and send them along the active optical cable. The network interface1034is provided to allow the device1100to communicate with other devices via a designated medium (e.g., a data network). It can be appreciated by those skilled in the art that certain functions or blocks shown inFIG. 10Bare readily provided in a smartphone and are not needed to be implemented when such a smartphone is used in a docking unit.

The present invention has been described in sufficient detail with a certain degree of particularity. It is understood to those skilled in the art that the present disclosure of embodiments has been made by way of examples only and that numerous changes in the arrangement and combination of parts may be resorted without departing from the spirit and scope of the invention as claimed. Accordingly, the scope of the present invention is defined by the appended claims rather than the forgoing description of embodiments.