A head-mounted device includes a plurality of front camera modules, a display device, an in-display camera module and an image-processing unit. The front camera modules include a first camera module and a second camera module that are respectively disposed at the left and right sides of the head-mounted device. The in-display camera module is disposed within the boundary of the display device. The image-processing unit is in communication connection with the front camera modules and the display device. The display device and the in-display camera module face a user side of the head-mounted device.

RELATED APPLICATIONS

This application claims priority to Taiwan Application 110107855, filed on Mar. 5, 2021, which is incorporated by reference herein in its entirety.

BACKGROUND

Technical Field

The present disclosure relates to a head-mounted device, more particularly to a head-mounted device including an in-display camera module.

Description of Related Art

With the advancement of semiconductor manufacturing technology, the performance of miniature electronic components has been improved, and image sensors for having more pixels has been scaled down. Therefore, featuring high image quality becomes one of the indispensable features of a miniature optical system nowadays. Furthermore, due to the popularization of high-performance microprocessors and microdisplays, the technology related to smart head-mounted devices rapidly develops in recent years. With the rise of artificial intelligence, electronic devices equipped with optical systems are trending towards multi-functionality for various applications, and the functional requirements for computer vision have been increasing.

The head-mounted devices have become smaller and more lightweight, and also have various intelligent applications such as virtual reality (VR), augmented reality (AR) and mixed reality (MR) in the rapidly developing technology landscape. Most smart head-mounted devices use conventional imaging camera modules for dynamic user tracking and positioning, and use eye tracking cameras for positioning of the eye gazing direction and thus reducing the burden of real-time image rendering, such that the head-mounted device can provide users with clear and low-latency images to achieve a highly immersive visual experience. However, most head-mounted devices are still too large and too heavy.

SUMMARY

According to one aspect of the present disclosure, a head-mounted device includes a plurality of front camera modules, a display device, an in-display camera module and an image-processing unit. The plurality of front camera modules include a first camera module and a second camera module that are respectively disposed at the left side and the right side of the head-mounted device. The in-display camera module is disposed within the boundary of the display device. The image-processing unit is in communication connection with the plurality of front camera modules and the display device. The first camera module and the second camera module face a front side of the head-mounted device. The display device and the in-display camera module face a user side of the head-mounted device. The front side of the head-mounted device is an opposite side of the user side of the head-mounted device.

According to another aspect of the present disclosure, a head-mounted device includes a plurality of front camera modules, a depth sensing module, a display device, an in-display camera module and an image-processing unit. The plurality of front camera modules include a first camera module and a second camera module that are respectively disposed at two ends of the head-mounted device. The depth sensing module includes an infrared camera module and an infrared illuminator. The in-display camera module is disposed within the boundary of the display device. The image-processing unit is in communication connection with the plurality of front camera modules, the depth sensing module and the display device. The first camera module and the second camera module face a front side of the head-mounted device. The display device and the in-display camera module face a user side of the head-mounted device. The front side of the head-mounted device is an opposite side of the user side of the head-mounted device.

According to another aspect of the present disclosure, a head-mounted device includes at least one front camera module, a display device, two viewing lens elements, an in-display camera module and an image-processing unit. The in-display camera module is disposed within the boundary of the display device. The image-processing unit is in communication connection with the front camera module and the display device. The front camera module faces a front side of the head-mounted device. The display device is configured to display images captured by the front camera module. The display device, the in-display camera module and the viewing lens elements face a user side of the head-mounted device. The front side of the head-mounted device is an opposite side of the user side of the head-mounted device.

DETAILED DESCRIPTION

Note that the drawings are only illustrative, and the head-mounted device in the drawings may not be in its actual scale.

The present disclosure provides a head-mounted device that includes at least one front camera module, a display device, an in-display camera module and an image-processing unit. Moreover, the head-mounted device can further include two viewing lens elements and a lens actuator.

The front camera module is configured to capture images and is in communication connection with the image-processing unit. Therefore, it is favorable for combining the images from the external real world with virtual images so as to produce augmented images for a user. Moreover, the number of the front camera module can be plural. The plurality of front camera modules include a first camera module and a second camera module that can be respectively disposed at the left side and the right side of the head-mounted device or two ends of the head-mounted device. Therefore, it is favorable for capturing images at different fields of view so as to provide a three-dimensional (3D) image.

The front camera modules can further include a third camera module disposed between the first camera module and the second camera module, and a maximum field of view of the third camera module is smaller than a maximum field of view of the first camera module and a maximum field of view of the second camera module. Therefore, it is favorable for providing the third camera module with a small field of view and a long focal length so as to have a telephoto function for an image zoom from afar.

At least one of the front camera modules can have a maximum field of view larger than 100 degrees. Moreover, the maximum field of view of the first camera module can be larger than 100 degrees. Therefore, it is favorable for having a wide field of view configuration so as to provide a large field of view with a relatively large range of image information during motion tracking and positioning. Moreover, the maximum field of view of the third camera module can be smaller than 50 degrees. Therefore, it is favorable for having a telephoto configuration so as to provide zoom for an image from afar. Moreover, the maximum field of view of the second camera module can range between the maximum field of view of the first camera module and the maximum field of view of the third camera module. Therefore, it is favorable for arranging three camera modules with different image magnifications.

The display device is in communication connection with the image-processing unit so as to display the image captured by the front camera modules. Therefore, it is favorable for having functionality of virtual reality and augmented reality in the head-mounted device. Moreover, the display device can include a curved screen. Therefore, it is favorable for providing a wider viewing angle. Moreover, the display device can include a light-passable display device. Therefore, it is favorable for having functionality of augmented reality in the head-mounted device so that the user can directly see the external real world.

The in-display camera module is disposed within the boundary of the display device, which is different from a conventional head-mounted device in which an eye tracking camera is usually disposed out of the display device. Therefore, it is favorable for reducing the overall size of the head-mounted device. The first camera module and the second camera module face a front side of the head-mounted device. The display device and the in-display camera module face a user side of the head-mounted device opposite to the front side of the head-mounted device, which is favorable for omitting an additional optical reflective element redirecting captured eyes images to an eye tracking camera and enhancing eye tracking.

The in-display camera module can include at least two inside cameras. Moreover, the in-display camera module can include a total of two inside cameras. Therefore, it is favorable for arranging the inside cameras as eye tracking camera modules to correspond to user's respective eyes. Moreover, the inside cameras can be respectively disposed at two ends of the display device. Moreover, the inside cameras can include two hole-punch camera modules. Therefore, it is favorable for reducing the overall size of the head-mounted device and increasing the production yield rate. Moreover, the hole-punch camera modules can be symmetrically disposed at the left side and the right side of the display device. Therefore, it is favorable for capturing images of user's respective eyes. Moreover, the inside cameras can include two under display camera modules. Therefore, it is favorable for hiding the under display camera modules under the display so as to provide a high screen-to-body ratio. Moreover, the under display camera modules can be respectively disposed near central areas of the viewing lens elements. Therefore, it is favorable for aligning the under display camera modules with the user's eyes so as to improve image quality of eye tracking and alternatively, to provide visual acuity test functionality. Moreover, the inside cameras can include two infrared camera (IR camera) modules, and the in-display camera module can further include at least one infrared illuminator (IR illuminator). Therefore, it is favorable for performing eye tracking by using non-visible light so as to prevent visual disruption in user's experience due to the non-visible light not being visible for naked eyes. Moreover, the number of the infrared illuminator can be two. Moreover, the in-display camera module can further include an eye tracking camera. Therefore, it is favorable for processing motion and gaze information of user's eyes. Moreover, the number of the eye tracking camera can be two. Moreover, the eye tracking cameras can include two under display camera modules. Moreover, the under display camera modules can be respectively disposed near central areas of the viewing lens elements. Moreover, the eye tracking cameras can include two infrared camera modules, and the in-display camera module can further include at least one infrared illuminator.

The viewing lens elements are configured corresponding to the user's eyes. Moreover, the viewing lens elements are disposed on a user side of the display device. Therefore, it is favorable for focusing an image from the display device so as to improve image quality in virtual reality of the head-mounted device. Moreover, the viewing lens elements can include two Fresnel lens elements respectively disposed on the left side and the right side of the head-mounted device. Therefore, it is favorable for reducing the size and the weight of the viewing lens elements so as to facilitate miniaturization and lightweight of the head-mounted device. Moreover, the viewing lens elements can include two metalens elements respectively disposed on the left side and the right side of the head-mounted device. Therefore, it is favorable for further reducing the size and the weight of the viewing lens elements.

The lens actuator is coupled to the viewing lens elements and is capable of moving all of the viewing lens elements simultaneously or each viewing lens element independently. Therefore, it is favorable for adjusting the respective positions of the viewing lens elements to the best focal distance from the user's eyes according to the visual acuity of the user. Specifically, when the in-display camera module performs a visual acuity test for the user's eyes, the image-processing unit will process the captured image of the user's eyes so as to provide the proper displacement values for each viewing lens element; alternatively, the lens actuator can move the viewing lens elements directly after obtaining an optimal focus by the in-display camera module; moreover, there can be an additional manual switch disposed on the lens actuator, such that the additional manual switch can be operated directly to adjust the respective positions of the viewing lens elements. However, the abovementioned movement of the viewing lens elements driven by the lens actuator are only exemplary, and the present disclosure is not limited thereto. Moreover, the lens actuator can be electrically, magnetically or physically coupled to the viewing lens elements so as to move the viewing lens elements via electricity, a magnetic force or a contact force. Moreover, the lens actuator can move the viewing lens elements along at least two axes. Therefore, it is favorable for adjusting the interpupillary distance (IPD) of the viewing lens elements.

According to the present disclosure, the head-mounted device can further include a depth sensing module. The depth sensing module can include an infrared camera module and an infrared illuminator. By arranging the depth sensing module, it is favorable for calculating the depth of a 3D image in a shorter time than using triangulation by two conventional cameras to perform 3D image depth calculation, thereby providing head tracking with low latency and lower power.

According to the present disclosure, the aforementioned features and conditions can be utilized in numerous combinations so as to achieve corresponding effects.

Please refer toFIG.1toFIG.4, whereFIG.1is a perspective view of a head-mounted device according to the 1st embodiment of the present disclosure,FIG.2is a top view of the head-mounted device inFIG.1for being coupled to user's eyes,FIG.3is a rear view of the head-mounted device inFIG.1, andFIG.4is a schematic view showing the usage scenario of the head-mounted device inFIG.1.

In this embodiment, the head-mounted device1is configured to be worn on a user's head. The head-mounted device1includes a frame101, a plurality of front camera modules102, a display device103, an in-display camera module104, an image-processing unit105, two viewing lens elements106and a lens actuator107. The frame101may have the appearance similar to a spectacle frame so as to be easily worn on the user's head, but the present disclosure is not limited thereto. The front camera modules102are disposed on the frame101, and the front camera modules102face outside to capture an image.

The front camera modules102include a first camera module102a, a second camera module102band a third camera module102c. The first camera module102aand the second camera module102bare respectively disposed at the left side and the right side of the frame101of the head-mounted device1; or it can be considered that the first camera module102aand the second camera module102bare respectively disposed at two ends of the frame101of the head-mounted device1. The third camera module102cis disposed between the first camera module102aand the second camera module102b.

The display device103is disposed on the frame101. The display device103displays the image captured by the front camera modules102. In specific, the front camera modules102and the display device103are in communication connection with the image-processing unit105, and the display device103can obtain the image captured by the front camera modules102via the image-processing unit105and can display the captured image. Moreover, the image-processing unit105is in communication connection with the front camera modules102and the display device103, and the arbitrarily arranged position of the image-processing unit105is not intended to restrict the present disclosure. In this embodiment, the image-processing unit105is exemplarily disposed on the frame101.

The in-display camera module104is disposed within the boundary of the display device103; or it can be considered that the in-display camera module104is disposed on or inside the displaying surface (not numbered) of the display device103. The first camera module102a, the second camera module102band the third camera module102cface a front side of the head-mounted device1. The display device103and the in-display camera module104face a user side of the head-mounted device1. The front side of the head-mounted device1is an opposite side of the user side of the head-mounted device1.

The viewing lens elements106are disposed corresponding to user's eyes EYE, and the viewing lens elements106are disposed on a user side of the display device103. The lens actuator107is coupled to the viewing lens elements106so as to manually move the viewing lens elements106, and the viewing lens elements106can be independently moved; alternatively, the in-display camera module104can track the positions of the user's eyes EYE, and the in-display camera module104can transmit the positions to the image-processing unit105via the communication connection therebetween. The lens actuator107is, for example, in communication connection with the image-processing unit105to independently move the viewing lens elements106by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes EYE obtained from the image-processing unit105.

Similar to wearing a pair of glasses, the head-mounted device1can be worn on the user's head in a manner of mounting the frame101on the user's head. When the head-mounted device1is worn at the suitable position, the display device103will be located within the sight of the user's eyes EYE, and the in-display camera module104will face the user's eyes EYE. Moreover, the lens actuator107can provide a manual focus adjustment manner to move the viewing lens elements106through a feedback of image clarity on the display device103; alternatively, the lens actuator107can move the viewing lens elements106to the front of the user's eyes EYE according to the positions of the user's eyes EYE tracked by the in-display camera module104. The first camera module102a, the second camera module102band the third camera module102ccapture an image of an object (not shown) in front of the user and then transmit the image to the display device103via the image-processing unit105. The display device103can display the image IMG thereon, and then the displayed image IMG can be transmitted and focused at the user's eyes EYE via the viewing lens elements106. The user can observe a virtual image VTI of the image IMG at a side of the viewing lens elements106that is opposite to the user's eyes EYE and has a focus F illustrated inFIG.4.

Please refer toFIG.5, which is a perspective view of a head-mounted device according to the 2nd embodiment of the present disclosure. Note that only the differences from the preceding embodiment are described hereinafter.

In this embodiment, the head-mounted device2is configured to be worn on a user's head. The head-mounted device2includes a frame201, a plurality of front camera modules202, a display device203and an image-processing unit205. The frame201may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules202are disposed on the frame201, and the front camera modules202face outside to capture an image.

The front camera modules202include a first camera module202a, a second camera module202band a third camera module202c. The first camera module202aand the second camera module202bare respectively disposed at the left side and the right side of the frame201of the head-mounted device2; or it can be considered that the first camera module202aand the second camera module202bare respectively disposed at two ends of the frame201of the head-mounted device2. The third camera module202cis disposed between the first camera module202aand the second camera module202b.

A maximum field of view of the third camera module202cis smaller than a maximum field of view of the first camera module202aand a maximum field of view of the second camera module202b. In specific, the first camera module202aand the second camera module202bare ultra-wide-angle camera modules, and the maximum field of view of the first camera module202aand the maximum field of view of the second camera module202bare 120 degrees. The third camera module202cis a telephoto camera module, and the maximum field of view of the third camera module202cis 45 degrees. The user can switch to the third camera module202cto enable a zoom function for capturing an image from afar.

The display device203is disposed on the frame201. The display device203is in communication connection with the image-processing unit205and in indirect communication connection with the front camera modules202via the image-processing unit205. The first camera module202a, the second camera module202band the third camera module202cface a front side of the head-mounted device2. The display device203faces a user side of the head-mounted device2which is opposite to the front side of the head-mounted device2so as to display the image captured by the front camera modules202to the user's eyes. Moreover, the image-processing unit205is exemplarily disposed on the frame201.

Similar to wearing a pair of glasses, the head-mounted device2can be worn on the user's head in a manner of mounting the frame201on the user's head. When the head-mounted device2is worn at the suitable position, the display device203will be located within the sight of the user's eyes. The first camera module202a, the second camera module202band the third camera module202ccapture an image of an object in front of the user and then transmit the image to the display device203via the image-processing unit205. The display device203can display the image thereon, and then the displayed image can be transmitted and focused at the user's eyes. The user can observe a virtual image of the image at a side of the display device203that is opposite to the user's eyes.

Please refer toFIG.6, which is a perspective view of a head-mounted device according to the 3rd embodiment of the present disclosure. Note that only the differences from the preceding embodiments are described hereinafter.

In this embodiment, the head-mounted device3is configured to be worn on a user's head. The head-mounted device3includes a frame301, a plurality of front camera modules302, a display device303and an image-processing unit305. The frame301may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules302are disposed on the frame301, and the front camera modules302face outside to capture an image.

The front camera modules302include a first camera module302a, a second camera module302band a third camera module302c. The first camera module302aand the second camera module302bare respectively disposed at the left side and the right side of the frame301of the head-mounted device3; or it can be considered that the first camera module302aand the second camera module302bare respectively disposed at two ends of the frame301of the head-mounted device3. The third camera module302cis disposed between the first camera module302aand the second camera module302b.

A maximum field of view of the third camera module302cis smaller than a maximum field of view of the first camera module302aand a maximum field of view of the second camera module302b, and the maximum field of view of the second camera module302branges between the maximum field of view of the first camera module302aand the maximum field of view of the third camera module302c. In specific, the first camera module302ais an ultra-wide-angle camera module, and the maximum field of view of the first camera module302ais 120 degrees. The second camera module302bis a wide-angle camera module, and the maximum field of view of the second camera module302bis 80 degrees. The third camera module302cis a telephoto camera module, and the maximum field of view of the third camera module302cis 30 degrees. The user can switch between the first camera module302a, the second camera module302band the third camera module302cto enable a two-stage zoom function for capturing an image from afar or from a large field of view.

The display device303is disposed on the frame301. The display device303is in communication connection with the image-processing unit305and in indirect communication connection with the front camera modules302via the image-processing unit305. The first camera module302a, the second camera module302band the third camera module302cface a front side of the head-mounted device3. The display device303faces a user side of the head-mounted device3which is opposite to the front side of the head-mounted device3so as to display the image captured by the front camera modules302to the user's eyes. Moreover, the image-processing unit305is exemplarily disposed on the frame301.

Similar to wearing a pair of glasses, the head-mounted device3can be worn on the user's head in a manner of mounting the frame301on the user's head. When the head-mounted device3is worn at the suitable position, the display device303will be located within the sight of the user's eyes. The first camera module302a, the second camera module302band the third camera module302ccapture an image of an object in front of the user and then transmit the image to the display device303via the image-processing unit305. The display device303can display the image thereon, and then the displayed image can be transmitted and focused at the user's eyes. The user can observe a virtual image of the image at a side of the display device303that is opposite to the user's eyes.

Please refer toFIG.7, which is a perspective view of a head-mounted device according to the 4th embodiment of the present disclosure. Note that only the differences from the preceding embodiments are described hereinafter.

In this embodiment, the head-mounted device4is configured to be worn on a user's head. The head-mounted device4includes a frame401, a plurality of front camera modules402, a display device403, an image-processing unit405and an infrared depth sensing module408. The frame401may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules402are disposed on the frame401. The front camera modules402face outside to capture an image, and the front camera modules402are in communication connection with the image-processing unit405so as to transmit the captured image to the image-processing unit405.

The front camera modules402include a first camera module402aand a second camera module402b. The first camera module402aand the second camera module402bare respectively disposed at the left side and the right side of the frame401of the head-mounted device4; or it can be considered that the first camera module402aand the second camera module402bare respectively disposed at two ends of the frame401of the head-mounted device4.

The display device403is disposed on the frame401. The display device403is in communication connection with the image-processing unit405. The first camera module402aand the second camera module402bface a front side of the head-mounted device4. The display device403faces a user side of the head-mounted device4which is opposite to the front side of the head-mounted device4so as to display the image processed by the image-processing unit405to the user's eyes. Moreover, the image-processing unit405is exemplarily disposed on the frame401.

The infrared depth sensing module408is disposed on the frame401and is located between the first camera module402aand the second camera module402b. The infrared depth sensing module408is a time-of-flight (ToF) module and includes an infrared camera module4081(receiver) and an infrared illuminator4082(emitter). The infrared illuminator4082of the ToF module can use a pulsed light module or a non-pulsed light module. The infrared depth sensing module408can also use a structured light module to provide a depth sensing function. The infrared depth sensing module408can be in communication connection with the image-processing unit405, and the image-processing unit405can combine the captured image data transmitted from the front camera modules402with the depth data transmitted from the infrared depth sensing module408to obtain a final image, and then the image-processing unit405can transmit the final image to the display device403.

Similar to wearing a pair of glasses, the head-mounted device4can be worn on the user's head in a manner of mounting the frame401on the user's head. When the head-mounted device4is worn at the suitable position, the display device403will be located within the sight of the user's eyes. The first camera module402aand the second camera module402bcapture an image of an object in front of the user and then transmit the image to the image-processing unit405. The infrared depth sensing module408detects and obtains a 3D image depth data of the object in front of the user through the infrared camera module4081and the infrared illuminator4082, and then the infrared depth sensing module408transmits the depth data to the image-processing unit405. The image-processing unit405combines the captured image with the depth data to obtain a final image, and the image-processing unit405transmits the final image to the display device403. The display device403can display the final image with the depth data thereon, which is then focused at the user's eyes. The user can observe a virtual image of the final image at a side of the display device403that is opposite to the user's eyes.

Please refer toFIG.8toFIG.10, whereFIG.8is a top view of a head-mounted device according to the 5th embodiment of the present disclosure for being coupled to user's eyes,FIG.9is a top view showing a manner of adjusting the position of viewing lens elements of the head-mounted device inFIG.8, andFIG.10is a top view showing another manner of adjusting the position of viewing lens elements of the head-mounted device inFIG.8. Note that only the differences from the preceding embodiments are described hereinafter.

In this embodiment, the head-mounted device5is configured to be worn on a user's head. The head-mounted device5includes a frame501, a plurality of front camera modules502, a display device503, an image-processing unit505, two viewing lens elements506and a lens actuator507. The frame501may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules502are disposed on the frame501, and the front camera modules502face outside to capture an image.

The display device503is disposed on the frame501. The display device503is in communication connection with the image-processing unit505and in indirect communication connection with the front camera modules502via the image-processing unit505. The front camera modules502face a front side of the head-mounted device5. The display device503faces a user side of the head-mounted device5which is opposite to the front side of the head-mounted device5so as to display the image captured by the front camera modules502to the user's eyes EYE. Moreover, the image-processing unit505is exemplarily disposed on the frame501.

The viewing lens elements506are disposed corresponding to the user's eyes EYE, and the viewing lens elements506are disposed on a user side of the display device503. The lens actuator507is coupled to the viewing lens elements506so as to manually move the viewing lens elements506through a knob or a dial (not shown), and the viewing lens elements506can be independently moved; alternatively, the lens actuator507can independently move the viewing lens elements506by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes EYE. The viewing lens elements506are movable by the lens actuator507along a first axis A1and a second axis A2. As shown inFIG.9, the viewing lens elements506are independently moved by the lens actuator507according to the different focal distances of the user's eyes EYE; one of the viewing lens elements506is moved close to the user's eyes EYE, and the other one is moved away from the user's eyes EYE, wherein D1denoted in FIG.9represents a difference between the viewing lens elements506along the first axis A1. As shown inFIG.10, the interpupillary distance of the viewing lens elements506is adjusted by the lens actuator507according to the distance between the user's eyes EYE, wherein D2denoted inFIG.10represents a difference between the viewing lens elements506along the second axis A2.

Similar to wearing a pair of glasses, the head-mounted device5can be worn on the user's head in a manner of mounting the frame501on the user's head. When the head-mounted device5is worn at the suitable position, the display device503will be located within the sight of the user's eyes EYE. Moreover, the lens actuator507can provide a manual focus adjustment manner to move the viewing lens elements506through a feedback of image clarity on the display device503; alternatively, the lens actuator507can move the viewing lens elements506to a suitable position for the user's eyes EYE according to the condition of the user's eyes EYE, and the focal distances and the interpupillary distance of the user's eyes EYE will be recorded in the lens actuator507so as to quickly adjust the positions of the viewing lens elements506in the next use. The front camera modules502capture an image of an object in front of the user and then transmit the image to the display device503via the image-processing unit505. The display device503can display the image thereon, and then the displayed image can be transmitted and focused at the user's eyes EYE via the viewing lens elements506. The user can observe a virtual image of the image at a side of the viewing lens elements506that is opposite to the user's eyes EYE.

Please refer toFIG.11, which is a top view of a head-mounted device according to the 6th embodiment of the present disclosure for being coupled to user's eyes. Note that only the differences from the preceding embodiments are described hereinafter.

In this embodiment, the head-mounted device6is configured to be worn on a user's head. The head-mounted device6includes a frame601, a plurality of front camera modules602, a display device603, an image-processing unit605, two viewing lens elements606and a lens actuator607. The frame601may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules602are disposed on the frame601, and the front camera modules602face outside to capture an image.

The display device603is disposed on the frame601. The display device603is in communication connection with the image-processing unit605and in indirect communication connection with the front camera modules602via the image-processing unit605. The front camera modules602face a front side of the head-mounted device6. The display device603faces a user side of the head-mounted device6which is opposite to the front side of the head-mounted device6so as to display the image captured by the front camera modules602to the user's eyes EYE. Moreover, the image-processing unit605is exemplarily disposed on the frame601.

The viewing lens elements606include two diffraction lens elements. In specific, the viewing lens elements606include two Fresnel lens elements respectively disposed on the left side and the right side of the head-mounted device6. The viewing lens elements606are disposed corresponding to the user's eyes EYE, and the viewing lens elements606are disposed on a user side of the display device603. The lens actuator607is coupled to the viewing lens elements606so as to manually move the viewing lens elements606, and the viewing lens elements606can be independently moved; alternatively, the lens actuator607can independently move the viewing lens elements606by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes EYE.

Similar to wearing a pair of glasses, the head-mounted device6can be worn on the user's head in a manner of mounting the frame601on the user's head. When the head-mounted device6is worn at the suitable position, the display device603will be located within the sight of the user's eyes EYE. Moreover, the lens actuator607can provide a manual focus adjustment manner to move the viewing lens elements606through a feedback of image clarity on the display device603; alternatively, the lens actuator607can move the viewing lens elements606to the front of the user's eyes EYE according to the positions of the user's eyes EYE. The front camera modules602capture an image of an object in front of the user and then transmit the image to the display device603via the image-processing unit605. The display device603can display the image thereon, and then the displayed image can be transmitted and focused at the user's eyes EYE via the viewing lens elements606. The user can observe a virtual image of the image at a side of the viewing lens elements606that is opposite to the user's eyes EYE.

Please refer toFIG.12, which is a top view of a head-mounted device according to the 7th embodiment of the present disclosure for being coupled to user's eyes. Note that only the differences from the preceding embodiments are described hereinafter.

In this embodiment, the head-mounted device7is configured to be worn on a user's head. The head-mounted device7includes a frame701, a plurality of front camera modules702, a display device703, an image-processing unit705, two viewing lens elements706and a lens actuator707. The frame701may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules702are disposed on the frame701, and the front camera modules702face outside to capture an image.

The display device703is disposed on the frame701. The display device703is in communication connection with the image-processing unit705and in indirect communication connection with the front camera modules702via the image-processing unit705. The front camera modules702face a front side of the head-mounted device7. The display device703faces a user side of the head-mounted device7which is opposite to the front side of the head-mounted device7so as to display the image captured by the front camera modules702to the user's eyes EYE. Moreover, the image-processing unit705is exemplarily disposed on the frame701.

The viewing lens elements706include two metalens elements that are respectively disposed on the left side and the right side of the head-mounted device7and have metasurfaces facing the display device703. The viewing lens elements706are disposed corresponding to the user's eyes EYE, and the viewing lens elements706are disposed on a user side of the display device703. The lens actuator707is coupled to the viewing lens elements706so as to manually move the viewing lens elements706, and the viewing lens elements706can be independently moved; alternatively, the lens actuator707can independently move the viewing lens elements706by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes EYE.

Similar to wearing a pair of glasses, the head-mounted device7can be worn on the user's head in a manner of mounting the frame701on the user's head. When the head-mounted device7is worn at the suitable position, the display device703will be located within the sight of the user's eyes EYE. Moreover, the lens actuator707can provide a manual focus adjustment manner to move the viewing lens elements706through a feedback of image clarity on the display device703; alternatively, the lens actuator707can move the viewing lens elements706to the front of the user's eyes EYE according to the positions of the user's eyes EYE. The front camera modules702capture an image of an object in front of the user and then transmit the image to the display device703via the image-processing unit705. The display device703can display the image thereon, and then the displayed image can be transmitted and focused at the user's eyes EYE via the viewing lens elements706. The user can observe a virtual image of the image at a side of the viewing lens elements706that is opposite to the user's eyes EYE.

Please refer toFIG.13, which is a top view of a head-mounted device according to the 8th embodiment of the present disclosure for being coupled to user's eyes. Note that only the differences from the preceding embodiments are described hereinafter.

In this embodiment, the head-mounted device8is configured to be worn on a user's head. The head-mounted device8includes a frame801, a plurality of front camera modules802, a display device803, two in-display camera modules804, an image-processing unit805, two viewing lens elements806and a lens actuator807. The frame801may have the appearance similar to a spectacle frame so as to be easily worn on the user's head. The front camera modules802are disposed on the frame801, and the front camera modules802face outside to capture an image.

The display device803is disposed on the frame801. The display device803is in communication connection with the image-processing unit805and in indirect communication connection with the front camera modules802via the image-processing unit805. The display device803includes a curved screen (not numbered) so as to display the image captured by the front camera modules802as providing an immersive experience. Moreover, the image-processing unit805is exemplarily disposed on the frame801.

The in-display camera modules804are respectively disposed at the left side and the right side within the boundary of the display device803; or it can be considered that the in-display camera modules804are respectively disposed at the left side and the right side on the displaying surface (not numbered) of the display device803. The front camera modules802face a front side of the head-mounted device8. The display device803and the in-display camera modules804face a user side of the head-mounted device8. The front side of the head-mounted device8is an opposite side of the user side of the head-mounted device8.

The in-display camera modules804include two inside cameras804a. The inside cameras804ainclude two eye tracking cameras respectively disposed at two ends of the display device803.

The viewing lens elements806are disposed corresponding to the user's eyes EYE, and the viewing lens elements806are disposed on a user side of the display device803. The lens actuator807is coupled to the viewing lens elements806so as to manually move the viewing lens elements806, and the viewing lens elements806can be independently moved; alternatively, the in-display camera modules804can track the positions of the user's eyes EYE, and the in-display camera modules804can transmit the positions to the image-processing unit805via the communication connection therebetween. The lens actuator807is, for example, in communication connection with the image-processing unit805to independently move the viewing lens elements806by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes EYE obtained from the image-processing unit805.

Similar to wearing a pair of glasses, the head-mounted device8can be worn on the user's head in a manner of mounting the frame801on the user's head. When the head-mounted device8is worn at the suitable position, the display device803will be located within the sight of the user's eyes EYE, and the in-display camera modules804will face the user's eyes EYE. Moreover, the lens actuator807can provide a manual focus adjustment manner to move the viewing lens elements806through a feedback of image clarity on the display device803; alternatively, the lens actuator807can move the viewing lens elements806to the front of the user's eyes EYE according to the positions of the user's eyes EYE tracked by the in-display camera modules804. The front camera modules802capture an image of an object in front of the user and then transmit the image to the display device803via the image-processing unit805. The display device803can display the image thereon as providing an immersive experience, and then the displayed image can be transmitted and focused at the user's eyes EYE via the viewing lens elements806. The user can observe a virtual image of the image at a side of the viewing lens elements806that is opposite to the user's eyes EYE.

Please refer toFIG.14, which is a rear view of a head-mounted device according to the 9th embodiment of the present disclosure. Note that only the differences from the preceding embodiment are described hereinafter.

In this embodiment, the head-mounted device9is configured to be worn on a user's head. The head-mounted device9includes a frame901, a display device903, two in-display camera modules904, an image-processing unit905, two viewing lens elements906and a lens actuator907. The frame901may have the appearance similar to a spectacle frame so as to be easily worn on the user's head.

The display device903is disposed on the frame901. The display device903is configured to display an image from outside, and the display device903is in communication connection with the image-processing unit905. Moreover, the image-processing unit905is exemplarily disposed on the frame901.

The in-display camera modules904are disposed within the boundary of the display device903; or it can be considered that the in-display camera modules904are disposed on the displaying surface (not numbered) of the display device903. The display device903and the in-display camera modules904face a user side of the head-mounted device9which is an opposite side of a front side of the head-mounted device9.

The in-display camera modules904include two inside cameras904a. The inside cameras904aare respectively disposed at two ends of the display device903. In specific, the inside cameras904ainclude two hole-punch camera modules symmetrically disposed at the left and right sides of the lower portion of the displaying surface of the display device903.

The viewing lens elements906are disposed corresponding to the user's eyes, and the viewing lens elements906are disposed on a user side of the display device903. The lens actuator907is coupled to the viewing lens elements906so as to manually move the viewing lens elements906, and the viewing lens elements906can be independently moved; alternatively, the in-display camera module904can track the positions of the user's eyes, and the in-display camera module904can transmit the positions to the image-processing unit905via the communication connection therebetween. The lens actuator907is, for example, in communication connection with the image-processing unit905to independently move the viewing lens elements906by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes obtained from the image-processing unit905.

Similar to wearing a pair of glasses, the head-mounted device9can be worn on the user's head in a manner of mounting the frame901on the user's head. When the head-mounted device9is worn at the suitable position, the display device903will be located within the sight of the user's eyes, and the in-display camera module904will face the user's eyes. Moreover, the lens actuator907can provide a manual focus adjustment manner to move the viewing lens elements906through a feedback of image clarity on the display device903; alternatively, the lens actuator907can move the viewing lens elements906to the front of the user's eyes according to the positions of the user's eyes tracked by the in-display camera module904. The display device903can display an image of an object in front of the user thereon, and then the displayed image can be transmitted and focused at the user's eyes via the viewing lens elements906. The user can observe a virtual image of the image at a side of the viewing lens elements906that is opposite to the user's eyes.

Please refer toFIG.15, which is a rear view of a head-mounted device according to the 10th embodiment of the present disclosure. Note that only the differences from the preceding embodiment are described hereinafter.

In this embodiment, the head-mounted device10is configured to be worn on a user's head. The head-mounted device10includes a frame1001, a display device1003, two in-display camera modules1004, an image-processing unit1005, two viewing lens elements1006and a lens actuator1007. The frame1001may have the appearance similar to a spectacle frame so as to be easily worn on the user's head.

The display device1003is disposed on the frame1001. The display device1003is configured to display an image from outside, and the display device1003is in communication connection with the image-processing unit1005. Moreover, the image-processing unit1005is exemplarily disposed on the frame1001.

The in-display camera modules1004are disposed within the boundary of the display device1003; or it can be considered that the in-display camera modules1004are disposed on the displaying surface (not numbered) of the display device1003. The display device1003and the in-display camera modules1004face a user side of the head-mounted device10which is an opposite side of a front side of the head-mounted device10.

The in-display camera modules1004include two inside cameras1004a. The inside cameras1004aare respectively disposed at two ends of the display device1003. In specific, the inside cameras1004ainclude two under display camera modules symmetrically disposed at the left and right sides of the lower portion of the displaying surface of the display device1003.

The viewing lens elements1006are disposed corresponding to the user's eyes, and the viewing lens elements1006are disposed on a user side of the display device1003. The lens actuator1007is coupled to the viewing lens elements1006so as to manually move the viewing lens elements1006, and the viewing lens elements1006can be independently moved; alternatively, the in-display camera module1004can track the positions of the user's eyes, and the in-display camera module1004can transmit the positions to the image-processing unit1005via the communication connection therebetween. The lens actuator1007is, for example, in communication connection with the image-processing unit1005to independently move the viewing lens elements1006by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes obtained from the image-processing unit1005.

Similar to wearing a pair of glasses, the head-mounted device10can be worn on the user's head in a manner of mounting the frame1001on the user's head. When the head-mounted device10is worn at the suitable position, the display device1003will be located within the sight of the user's eyes, and the in-display camera module1004will face the user's eyes. Moreover, the lens actuator1007can provide a manual focus adjustment manner to move the viewing lens elements1006through a feedback of image clarity on the display device1003; alternatively, the lens actuator1007can move the viewing lens elements1006to the front of the user's eyes according to the positions of the user's eyes tracked by the in-display camera module1004. The display device1003can display an image of an object in front of the user thereon, and then the displayed image can be transmitted and focused at the user's eyes via the viewing lens elements1006. The user can observe a virtual image of the image at a side of the viewing lens elements1006that is opposite to the user's eyes.

Please refer toFIG.16, which is a rear view of a head-mounted device according to the 11th embodiment of the present disclosure. Note that only the differences from the preceding embodiment are described hereinafter.

In this embodiment, the head-mounted device11is configured to be worn on a user's head. The head-mounted device11includes a frame1101, a display device1103, a plurality of in-display camera modules1104, an image-processing unit1105, two viewing lens elements1106and a lens actuator1107. The frame1101may have the appearance similar to a spectacle frame so as to be easily worn on the user's head.

The display device1103is disposed on the frame1101. The display device1103is configured to display an image from outside, and the display device1103is in communication connection with the image-processing unit1105. Moreover, the image-processing unit1105is exemplarily disposed on the frame1101.

The in-display camera modules1104are disposed within the boundary of the display device1103; or it can be considered that the in-display camera modules1104are disposed on the displaying surface (not numbered) of the display device1103. The display device1103and the in-display camera modules1104face a user side of the head-mounted device11which is an opposite side of a front side of the head-mounted device11.

The in-display camera modules1104include two inside cameras1104aand four infrared illuminators1104b. The inside cameras1104ainclude two eye tracking cameras respectively disposed near central areas of the viewing lens elements1106so as to be aligned with the user's eyes. The infrared illuminators1104bare disposed at four corners of the displaying surface of the display device1103. And, the inside cameras1104ainclude two infrared camera modules in combination with the infrared illuminators1104bto process user's eyes motion and gaze information. Moreover, the inside cameras1104ainclude two under display camera modules.

The viewing lens elements1106are disposed corresponding to the user's eyes, and the viewing lens elements1106are disposed on a user side of the display device1103. The lens actuator1107is coupled to the viewing lens elements1106so as to manually move the viewing lens elements1106, and the viewing lens elements1106can be independently moved; alternatively, the in-display camera module1104can track the positions of the user's eyes, and the in-display camera module1104can transmit the positions to the image-processing unit1105via the communication connection therebetween. The lens actuator1107is, for example, in communication connection with the image-processing unit1105to independently move the viewing lens elements1106by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes obtained from the image-processing unit1105.

Similar to wearing a pair of glasses, the head-mounted device11can be worn on the user's head in a manner of mounting the frame1101on the user's head. When the head-mounted device11is worn at the suitable position, the display device1103will be located within the sight of the user's eyes, and the in-display camera module1104will face the user's eyes. Moreover, the lens actuator1107can provide a manual focus adjustment manner to move the viewing lens elements1106through a feedback of image clarity on the display device1103; alternatively, the lens actuator1107can move the viewing lens elements1106to the front of the user's eyes according to the positions of the user's eyes tracked by the in-display camera module1104. The display device1103can display an image of an object in front of the user thereon, and then the displayed image can be transmitted and focused at the user's eyes via the viewing lens elements1106. The user can observe a virtual image of the image at a side of the viewing lens elements1106that is opposite to the user's eyes.

Please refer toFIG.17, which is a rear view of a head-mounted device according to the 12th embodiment of the present disclosure. Note that only the differences from the preceding embodiment are described hereinafter.

In this embodiment, the head-mounted device12is configured to be worn on a user's head. The head-mounted device12includes a frame1201, a display device1203, a plurality of in-display camera modules1204, an image-processing unit1205, two viewing lens elements1206and a lens actuator1207. The frame1201may have the appearance similar to a spectacle frame so as to be easily worn on the user's head.

The display device1203is disposed on the frame1201. The display device1203is configured to display an image from outside, and the display device1203is in communication connection with the image-processing unit1205. Moreover, the image-processing unit1205is exemplarily disposed on the frame1201.

The in-display camera modules1204are disposed within the boundary of the display device1203; or it can be considered that the in-display camera modules1204are disposed on the displaying surface (not numbered) of the display device1203. The display device1203and the in-display camera modules1204face a user side of the head-mounted device12which is an opposite side of a front side of the head-mounted device12.

The in-display camera modules1204include two inside cameras1204aand two infrared illuminators1204b. The inside cameras1204aare respectively disposed at two ends of the display device1203. In specific, the inside cameras1204aare symmetrically disposed at the left and right sides of the lower portion of the displaying surface of the display device1203. On the other hand, the infrared illuminators1204bare disposed at the left and right sides of the upper portion of the displaying surface of the display device1203. And, the inside cameras1204ainclude two infrared camera modules in combination with the infrared illuminators1204bto process user's eyes motion and gaze information. Moreover, the inside cameras1204ainclude two hole-punch camera modules.

The viewing lens elements1206are disposed corresponding to the user's eyes, and the viewing lens elements1206are disposed on a user side of the display device1203. The lens actuator1207is coupled to the viewing lens elements1206so as to manually move the viewing lens elements1206, and the viewing lens elements1206can be independently moved; alternatively, the in-display camera module1204can track the positions of the user's eyes, and the in-display camera module1204can transmit the positions to the image-processing unit1205via the communication connection therebetween. The lens actuator1207is, for example, in communication connection with the image-processing unit1205to independently move the viewing lens elements1206by a microelectromechanical or electromagnetic configuration according to the positions of the user's eyes obtained from the image-processing unit1205.

Similar to wearing a pair of glasses, the head-mounted device12can be worn on the user's head in a manner of mounting the frame1201on the user's head. When the head-mounted device12is worn at the suitable position, the display device1203will be located within the sight of the user's eyes, and the in-display camera module1204will face the user's eyes. Moreover, the lens actuator1207can provide a manual focus adjustment manner to move the viewing lens elements1206through a feedback of image clarity on the display device1203; alternatively, the lens actuator1207can move the viewing lens elements1206to the front of the user's eyes according to the positions of the user's eyes tracked by the in-display camera module1204. The display device1203can display an image of an object in front of the user thereon, and then the displayed image can be transmitted and focused at the user's eyes via the viewing lens elements1206. The user can observe a virtual image of the image at a side of the viewing lens elements1206that is opposite to the user's eyes.

Please refer toFIG.18, which is a rear view of a head-mounted device according to the 13th embodiment of the present disclosure. Note that only the differences from the preceding embodiment are described hereinafter.

In this embodiment, the head-mounted device13is configured to be worn on a user's head. The head-mounted device13includes a frame1301, a display device1303and two in-display camera modules1304. The frame1301may have the appearance similar to a spectacle frame so as to be easily worn on the user's head.

The display device1303is disposed on the frame1301. The display device1303includes an image projection module1303aand a light-passable display device1303b. The image projection module1303ais able to project an image on the light-passable display device1303b, and the light-passable display device1303bis semitransparent so as to display a combined image of an image projected by the image projection module1303aand an image from outside transmitted via the light-passable display device1303b.

The in-display camera modules1304are disposed within the boundary of the display device1303; or it can be considered that the in-display camera modules1304are disposed on the displaying surface (not numbered) of the display device1303. The display device1303and the in-display camera modules1304face a user side of the head-mounted device13which is an opposite side of a front side of the head-mounted device13.

The in-display camera modules1304include two inside cameras1304a. The inside cameras1304aare respectively disposed at two ends of the display device1303. In specific, the inside cameras1304ainclude two hole-punch camera modules symmetrically disposed at the left and right sides of the lower portion of the displaying surface of the display device1303.

Similar to wearing a pair of glasses, the head-mounted device13can be worn on the user's head in a manner of mounting the frame1301on the user's head. When the head-mounted device13is worn at the suitable position, the display device1303will be located within the sight of the user's eyes, and the in-display camera module1304will face the user's eyes. The image projection module1303aof the display device1303can project an image in front of the user's eyes according to the positions of the user's eyes tracked by the in-display camera module1304. The display device1303can display the projected image combined with an outside image and transmitted via the light-passable display device1303b, and then the displayed image can be focused at the user's eyes.

According to the head-mounted device discussed above, by arranging the in-display camera module within the boundary of the display device, the overall size of the head-mounted device disclosed in the abovementioned embodiments can thus be reduced, which is different from a conventional head-mounted device in which an inside camera is usually disposed out of the display device for facing user's eyes. Further, by arranging the display device and the in-display camera module to face the user's eyes, the eye tracking effect of the head-mounted device disclosed in the abovementioned embodiments can thus be enhanced, which is favorable for omitting an additional optical reflective element redirecting captured eyes images to the inside camera thereof.

Note that the communication connection described in the specification refers a connection manner for exchanging signals between two components via, for example, wired transmission or wireless transmission.