Patent Description:
The augmented reality (AR) display technology has been widely used in various fields. Examples are described in documents <CIT>, which describes a display control apparatus for controlling a virtual-image display unit and has an information acquisition unit comprising caution information containing relative position and relative direction with respect to vehicle of caution object, <CIT> and <CIT>. This technology can display images with the scenes in real environment. However, in current image display methods, the image and the scene of the real environment cannot be effectively superimposed when the user is viewing, resulting in blurred image or blurred scene of the real environment. Therefore, there is a need to provide an improved scheme for the display method of augmented reality.

This in mind, the present disclosure aims at providing a display method of an image that makes the positions of the vergence planes satisfy a relation, such that the user can clearly view the augmented reality image and the object in the environmental scene at the same time, or user's uncomfortable feeling can be effectively reduced.

This is achieved by a display method of an image according to the claims. The dependent claims pertain to corresponding further developments and improvements.

As will be seen more clearly from the detailed description following below, a display method of an image is provided by the present disclosure. The display method of an image includes the following steps. Providing a display, the display provides a first image, and the first image and an environmental scene are located within a field of view of a user. A first vergence plane of two eyes of the user is located at a first position when the user views the first image, and a second vergence plane of the two eyes is located at a second position when the user views an object in the environmental scene. A first distance exists between the first position of the first vergence plane and the user, a second distance exists between the second position of the second vergence plane and the user, and the first distance and the second distance satisfy a first relation: Dn < D1 < Df, wherein D1 represents the first distance, Dn = D2 + Δn, and Df = D2 + Δf, wherein D2 represents the second distance, Δn =(De / <NUM>)* {tan[tan-<NUM>(<NUM>*D2 / De) - δ]} - D2, and Δf = (De / <NUM>)*{tan[tan-<NUM>(<NUM>*D2 / De) +δ]} - D2, and wherein De represents a distance between the two eyes, δ represents an eye angular resolution of the two eyes, and δ = <NUM> degrees.

In the following, the disclosure is further illustrated by way of example, taking reference to the accompanying drawings.

The present disclosure may be understood by reference to the following detailed description, taken in conjunction with the drawings as described below. It is noted that, for purposes of illustrative clarity and being easily understood by the readers, various drawings of this disclosure show a portion of the electronic device, and certain components in various drawings may not be drawn to scale. In addition, the number and dimension of each element shown in drawings are only illustrative and are not intended to limit the scope of the present disclosure.

Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will understand, electronic equipment manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to.

In addition, when an element is referred to as being "directly on", "directly disposed on", "directly connected to", or "directly coupled to" another element or layer, there are no intervening elements or layers presented.

The electrical connection may be direct connection or indirect connection. When two elements are electrically connected, the electrical signals may be transmitted by direct contact, and there are no other elements presented between the two elements. When two elements are electrically connected, the electrical signals may be transmitted through the intermediate element bridging the two elements. The term "electrically connecting" may also be referred to as "coupling".

Although terms such as first, second, third, etc., may be used to describe diverse constituent elements, such constituent elements are not limited by the terms. The terms are used only to discriminate a constituent element from other constituent elements in the specification. The claims may not use the same terms, but instead may use the terms first, second, third, etc. with respect to the order in which an element is claimed. Accordingly, in the following description, a first constituent element may be a second constituent element in a claim.

The electronic device of the present disclosure may include a display device, but not limited herein. The display device may include a touch display, a curved display or a free shape display, but not limited herein. The display device may be a bendable or flexible display device. The display device may include light-emitting diodes, liquid crystal, fluorescence, phosphors, other suitable display media or combinations of the above, but not limited herein. The light-emitting diodes may, for example, include organic light-emitting diodes (OLEDs), inorganic light-emitting diodes (LEDs), mini-light-emitting diodes (mini LEDs, millimeter sized LEDs), micro-light-emitting diodes (micro-LEDs, micrometer sized LEDs), quantum dots (QDs) light-emitting diodes (e.g. QLEDs or QDLEDs), other suitable light-emitting diodes or any combination of the above, but not limited herein. The concept or principle of the present disclosure may also be applied to non-self-emissive liquid crystal display (LCD), but not limited herein.

The display device may be any combination of the devices describe above, but not limited herein. In addition, the appearance of the display device may be rectangular, circular, polygonal, a shape with curved edges or other suitable shapes. The electronic device may have external systems such as a driving system, a control system, a light source system, a shelf system, etc. to support a display device.

Please refer to <FIG> is a schematic diagram of an electronic device according to a first embodiment of the present disclosure. The electronic device <NUM> may be, for example, an augmented reality (AR) system or other types of three-dimensional image display systems, but not limited herein. For example, the electronic device <NUM> of this embodiment is applied to a vehicle as an example, but the application of the electronic device <NUM> of the present disclosure is not limited herein. In other embodiments, the augmented reality system may also be applied to glasses, but not limited herein.

As shown in <FIG>, the electronic device <NUM> may include a display <NUM>, an optical element <NUM> and a controller <NUM>, but not limited herein. The electronic device <NUM> may also selectively include a sensing element <NUM> and a sensing element <NUM>, but not limited herein. The controller <NUM> may be coupled to the display <NUM>, the optical element <NUM>, the sensing element <NUM> and the sensing element <NUM>.

The display <NUM> may provide an image. The image may be projected onto a glass <NUM> (such as a windshield) through the optical element <NUM>, the image may form an image V1 (also referred to as a first image) on a virtual image plane Pi outside the glass <NUM>, and two eyes of a user (such as an eye <NUM> and an eye <NUM>) may view the image V1 through the glass <NUM>. Therefore, the image V1 outside the glass <NUM> and an environmental scene may be located within a field of view (FOV) of the user. In addition, the display <NUM> may provide a left-eye image for the eye <NUM> and a right-eye image for the eye <NUM>, and an offset exists between the left-eye image and the right-eye image, so that the image V1 finally viewed by the user is a three-dimensional image, but not limited herein. In addition, the electronic device <NUM> of this embodiment may project single image V1 onto one virtual image plane Pi, but not limited herein.

Please refer to <FIG> is a schematic diagram of the comparison of different user viewing states. An example (i) is a state that the user viewing one or more objects in the environmental scene, an example (ii) is a user viewing state of the conventional augmented reality system, and an example (iii) is a user viewing state using the display method of image of this embodiment. In <FIG>, a first object (such as roads, pedestrians, etc.) in the environmental scene may be located on an image plane Pr, and the image generated by the augmented reality system may be located on a virtual image plane Pi. In the example (i), the sight lines of the two eyes (such as the eye <NUM> and the eye <NUM>) converge on the image plane Pr, and one eye (such as the eye <NUM> or the eye <NUM>) also focuses on the image plane Pr when the user views the first object in the environmental scene. In other words, in the example (i), the positions of the vergence plane Pvr of the two eyes, the accommodation plane Par of the single eye and the image plane Pr of the first object in the environmental scene are the same. However, in the example (i), as shown by a dashed frame X, the image of the display viewed by the user is blurred while the user is viewing the first object in the environmental scene.

In the example (ii), an image Vx provided by the conventional augmented reality system may be located on the virtual image plane Pi. The sight lines of the two eyes converge on the virtual image plane Pi, and the single eye also focuses on the virtual image plane Pi when the user views the image Vx. In other words, in the example (ii), the positions of the vergence plane Pvx of the two eyes, the accommodation plane Pax of the single eye and the virtual image plane Pi of the image Vx are the same. However, in the example (ii), as shown by a dashed frame Y, the first object in the environmental scene within the dashed frame Y viewed by the user is blurred while the user is viewing the image Vx.

However, when the image Vx provided by the augmented reality system is used to mark the first object in the environmental scene, due to the difference in the positions of the vergence planes of the two eyes, the user may not clearly view the image Vx of the augmented reality system and the first object in the environmental scene at the same time, or the user may feel uncomfortable. Therefore, in the display method of the image of the present disclosure, the drawbacks exist in the conventional augmented reality system may be lessened by adjusting the position of the vergence plane of the two eyes when the user views the augmented reality image V1.

According to the invention as shown in (iii) of <FIG>, in the display method of the image of this embodiment, a vergence plane Pv1 (also referred to as a first vergence plane) where the sight lines of the two eyes of the user converge may be located at a first position when the two eyes of the user views the image V1, and a distance D1 (also referred to as a first distance) exists between the first position of the vergence plane Pv1 and the user. Furthermore, a vergence plane Pv2 (also referred to as a second vergence plane) where the sight lines of the two eyes of the user converge may be located at a second position when the user views the first object in the environmental scene, and a distance D2 (also referred to as a second distance) exists between the second position of the vergence plane Pv2 and the user.

In addition, please refer to <FIG> is a schematic diagram of a relationship of positions of vergence planes of two eyes of a user viewing an image and an environmental scene. The distance Di in <FIG> may be the distance D1 between the vergence plane Pv1 of the two eyes and the user when the user views the image V1, and the distance Dr in <FIG> may be the distance D2 between the vergence plane Pv2 of the two eyes and the user when the user views the first object in the environmental scene. As shown in <FIG>, the distance Di and the distance Dr may have a range R1, and the distance D1 and the distance D2 may fall within the range R1. The user may clearly view the image V1 and the first object in the environmental scene at the same time, or may effectively reduce user's uncomfortable feeling when the distance D1 and the distance D2 fall within the range R1.

The distance D1 and the distance D2 may satisfy a first relation: Dn < D1 < Df when the distance D1 and the distance D2 fall within the range R1. The lower limit distance Dn = D2 + Δn, and the lower limit distance Dn (as shown in <FIG>) may be the shortest distance Di that the user can clearly view the image V1 and the first object in the environmental scene at the same time. The upper limit distance Df = D2 + Δf, and the upper limit distance Df (as shown in <FIG>) may be the farthest distance Di that the user can clearly view the image V1 and the first object in the environmental scene at the same time. In addition, Δn = (De / <NUM>)* {tan[tan-<NUM>(<NUM>*D2 / De) - δ]} - D2, and Δf = (De / <NUM>)*{tan[tan-<NUM>(<NUM>*D2 / De) +δ]} - D2. Furthermore, De represents a distance between the two eyes (such as a distance De between the eye <NUM> and the eye <NUM> in <FIG>), δ represents an eye angular resolution of the two eyes, and δ = <NUM> degrees.

The method of adjusting the position of the vergence plane Pv1 of the two eyes when the user is viewing the augmented reality image V1 according to the invention will be described in the following. Please refer to <FIG> is a schematic diagram of adjusting a position of a vergence plane of two eyes according to the present disclosure. In addition, in order to simplify the drawing, the optical element <NUM> and the glass <NUM> in <FIG> are omitted in <FIG>.

According to the invention in <FIG>, a sub-pixel Pxa of the display <NUM> may emit a light beam La1 to the eye <NUM>, a sub-pixel Pxb of the display <NUM> may emit a light beam La2 to the eye <NUM>, and the light beam La1 and the light beam La2 may intersect at a vergence point Vt1. Based on the above principle, each picture may be displayed by one or a plurality of corresponding sub-pixels, and different pictures may be displayed by different sub-pixels. The eye <NUM> may view the picture represented by the light beam La1, and the eye <NUM> may view the picture represented by the light beam La2. An offset may be included between the pictures represented by the light beam La1 and the light beam La2 through displaying the pictures represented by the light beam La1 and the light beam La2 by different sub-pixels, thereby converging the two eyes at the vergence point Vt1.

In another example of <FIG>, a sub-pixel Pxc of the display <NUM> may emit a light beam La3 to the eye <NUM>, a sub-pixel Pxd of the display <NUM> may emit a light beam La4 to the eye <NUM>, and the light beam La3 and the light beam La4 may intersect at a vergence point Vt2. The eye <NUM> may view the picture represented by the light beam La3, and the eye <NUM> may view the picture represented by the light beam La4. An offset may be included between the pictures represented by the light beam La3 and the light beam La4 through displaying the pictures represented by the light beam La3 and the light beam La4 by different sub-pixels, thereby converging the two eyes at the vergence point Vt2, and the position of the vergence point Vt2 may be different from the position of the vergence point Vt1. Therefore, the position of the vergence plane of the two eyes may be adjusted through providing pictures to the eye <NUM> and the eye <NUM> by different sub-pixels.

Please refer to <FIG>. In the conventional augmented reality system of the example (ii), the position of the vergence plane Pvx of the two eyes and the position of the image Vx are the same when the user views the image Vx. However, as shown in the example (iii) in <FIG>, compared with the conventional augmented reality system, the first position of the vergence plane Pv1 may be different from a third position of the image V1 since the first position of the vergence plane Pv1 may be adjusted in the display method of the image of this embodiment.

On the other hand, as shown in the example (iii) in <FIG>, in the display method of the image of this embodiment, one eye (such as the eye <NUM> or the eye <NUM>) of the user may focus on an accommodation plane Pa1 (also referred to as a first accommodation plane) when the one eye of the user views the image V1, and a fourth position of the accommodation plane Pa1 is the same as the third position of the image V1, but not limited herein. In addition, a distance D3 (also referred to as a third distance) exists between the fourth position of the accommodation plane Pa1 and the user.

Please refer to <FIG> is a schematic diagram of a relationship of positions of a vergence plane of two eyes and an accommodation plane of one eye when a user views the image V1. The distance Di in <FIG> may be the distance D1 between the vergence plane Pv1 of the two eyes and the user when the user views the image V1, and the distance Da in <FIG> may be the distance D3 between the accommodation plane Pa1 of the one eye and the user when the user views the image V1. As shown in <FIG>, the distance Di and the distance Da may have a range R2, and the distance D1 and the distance D3 may fall within the range R2. The distance difference between the position of the accommodation plane Pa1 and the position of the vergence plane Pv1 may be reduced when the distance D1 and the distance D3 fall within the range R2, thereby reducing the discomfort of the user caused by the vergence-accommodation conflict.

When the distance D1 and the distance D3 fall within the range R2, the distance D1 and the distance D3 may satisfy a second relation as below: <MAT>.

A distance difference Δd1 exists between the distance D1 and the distance D3. The uncomfortable feeling of the user caused by the vergence-accommodation conflict may be mitigated when the distance difference Δd1 satisfies the second relation. In addition, in some embodiments, the second relation may be: <NUM> ≤ Δd1 < D3 - (D1/<NUM>+ <NUM> * D1).

The display <NUM> may include light emitting diodes, liquid crystal, fluorescence, phosphors, other suitable display media or combinations of the above, but not limited herein. The light emitting diodes may include, for example, organic light-emitting diodes (OLEDs), inorganic light-emitting diodes (LEDs), mini-light-emitting diodes (Mini LEDs), micro-light-emitting diodes (micro-LEDs), quantum dots (QDs) light-emitting diodes (such as QLEDs or QDLEDs), other suitable materials or any combinations of the above, but not limited herein. The display <NUM> may also be a bendable or flexible electronic device. In addition, as shown in <FIG>, the surface of the display <NUM> may include a plurality of lenses <NUM>, and the lenses <NUM> may have different shapes according to different optical requirements, but not limited herein.

The optical element <NUM> may include a mirror, a lens or combinations of the above, but not limited herein. The optical element <NUM> may include an image surface shift system, but not limited herein. The image surface shift system may include a projector system, a light filed technology element, a folding light path element, or combinations of the above, but note limited herein. The projection system may include a lens projector, a mirror or combinations of the above, but not limited herein. The light filed technology element may include a holographic optical element (HOE), an integral image element or combinations of the above, but not limited herein. The folding light path element may include a multi-mirror and space element, but not limited herein.

The glass <NUM> may include a windshield, but not limited herein. The glass <NUM> may be wedge type, flat type, curve type or combinations of the above, but not limited herein. A thin film may also be disposed on the glass <NUM>, but not limited herein.

The sensing element <NUM> may include an eye tracking sensor, a head tracking sensor, a feature tracking sensor or combinations of the above, but not limited herein.

The sensing element <NUM> may include an environment sensor, but not limited herein. The sensing element <NUM> may include a camera, a light field camera, a structure light camera, a feature detector, a lidar, a radar or combinations of the above, but not limited herein.

The controller <NUM> may include programmable programming to execute algorithm processing, which may include, for example, a central processing unit (CPU), a system on chip (SoC), an application specific integrated circuit (ASIC), etc., but not limited herein. For example, the controller <NUM> may receive the information obtained by the sensing element <NUM> and the sensing element <NUM>, such as the street views, pedestrians, the eye information of the user, etc. Based on this information, the controller <NUM> may obtain the image information for the display <NUM> through the algorithm calculation. The controller <NUM> may transmit the display data including the image information to the display <NUM>, and the display <NUM> may provide the image V1 according to the display data, thereby realizing the display method of the image of the present disclosure.

Other embodiments of the present disclosure will be disclosed in the following. In order to simplify the illustration, the same elements in the following would be labeled with the same symbol. For clearly showing the differences between various embodiments, the differences between different embodiments are described in detail below, and repeated features will not be described redundantly. In addition, theses repeated features may be applied in various embodiments in the following.

Please refer to <FIG> and <FIG>. <FIG> is a schematic diagram of a user viewing an image according to a second embodiment of the present disclosure. <FIG> is a schematic diagram of a user viewing state according to the second embodiment of the present disclosure. In some embodiments, the display <NUM> of the electronic device <NUM> may provide a plurality of images. As shown in <FIG>, the display <NUM> may also provide an image V2 (also referred to as a second image) in addition to the image V1, and the image V2 may be located on a virtual image plane Pj. The position of the virtual image plane Pj may be different from the position of the virtual image plane Pi, so the position of the image V2 may be different from the position of the image V1. The two eyes of the user may view the image V2 through the glass <NUM>, and the image V2 and the environmental scene may exist within the field of view of the user.

As shown in <FIG>, a vergence plane Pv3 (also referred to as a third vergence plane) of the two eyes of the user is located at a fifth position when the user views the image V2, and the fifth position of the vergence plane Pv3 is different from the first position of the vergence plane Pv1 (as shown in <FIG>). A vergence plane Pv4 (also referred to as a fourth vergence plane) of the two eyes is located at a sixth position when the user views a second object in the environmental scene. The positions of the first object and the second object in the environmental scene may be different, and the sixth position of the vergence plane Pv4 in <FIG> is different from the second position of the vergence plane Pv2 in <FIG>. In addition, a distance D4 (also referred to as a fourth distance) exists between the fifth position of the vergence plane Pv3 and the user, and a distance D5 (also referred to as a fifth distance) exists between the sixth position of the vergence plane Pv4 and the user.

For making the user clearly view the image V2 and the second object in the environmental scene at the same time, or for effectively reducing user's uncomfortable feeling, the distance D4 and the distance D5 may also fall within the range R1 in <FIG>. In this condition, the distance Di in <FIG> may be the distance D4 between the vergence plane Pv3 of the two eyes and the user when the user views the image V2, and the distance Dr in <FIG> may be the distance D5 between the vergence plane Pv4 of the two eyes and the user when the user views the second object in the environmental scene. The distance D4 and the distance D5 may satisfy a third relation: Ds < D4 < Dt when the distance D4 and the distance D5 fall within the range R1 of <FIG>.

In the third relation, The lower limit distance Ds = D5 + Δs, and the lower limit distance Ds (as shown in <FIG>) may be the shortest distance Di that the user can clearly view the image V2 and the second object in the environmental scene at the same time. The upper limit distance Dt = D5 + Δt, and the upper limit distance Dt (as shown in <FIG>) may be the farthest distance Di that the user can clearly view the image V2 and the second object in the environmental scene at the same time. In addition, Δs =(De / <NUM>)*{tan[tan-<NUM>(<NUM>*D5 / De) - δ]} - D5, and Δt = (De / <NUM>)*{tan[tan-<NUM>(<NUM>*D5 / De) +δ]} - D5. Furthermore, De represents a distance between the two eyes (such as a distance De between the eye <NUM> and the eye <NUM> in <FIG>), δ represents an eye angular resolution of the two eyes, and δ = <NUM> degrees.

Therefore, when the environmental scene includes the first object and the second object, and the distance between the first object and the user is different from the distance between the second object and the user, the electronic device <NUM> may provide the image V1 corresponding to the first object and the image V2 corresponding to the second object. In addition, the user may clearly view the image V1 and the first object in the environmental scene at the same time, or clearly view the image V2 and the second object in the environmental scene at the same time by adjusting the positions of the vergence planes of the two eyes when the user is viewing the augmented reality image V1 and the augmented reality image V2 through the display method of the image of this embodiment.

On the other hand, one eye (such as the eye <NUM> or the eye <NUM>) of the user focuses on an accommodation plane Pa2 (also referred to as a second accommodation plane) when the one eye of the user views the image V2, and a seventh position of the accommodation plane Pa2 is the same as the position of the image V2. Since the position of the image V2 is different from the position of the image V1 (as shown in <FIG>), the seventh position of the accommodation plane Pa2 (as shown in <FIG>) is also different from the fourth position of the accommodation plane Pa1 (as shown in <FIG>). In addition, a distance D6 (also referred to as a sixth distance) exists between the seventh position of the accommodation plane Pa2 and the user.

For mitigating the discomfort of the user caused by the vergence-accommodation conflict, the distance D4 and the distance D6 may also fall within the range R2 in <FIG>. In this condition, the distance Di in <FIG> may be the distance D4 between the vergence plane Pv3 of the two eyes and the user when the user views the image V2, and the distance Da in <FIG> may be the distance D6 between the accommodation plane Pa2 of the one eye and the user when the user views the image V2. When the distance D4 and the distance D6 fall within the range R2 of <FIG>, the distance D4 and the distance D6 may satisfy a fourth relation as below:<MAT>.

A distance difference Δd2 exists between the distance D4 and the distance D6. In addition, in some embodiments, the fourth relation may be: <NUM> ≤ Δd2 < D6 - (D4/<NUM> + <NUM> * D4).

In some embodiments, the image V1 and the image V2 may be displayed by different regions of the display <NUM>. As shown in <FIG>, the image V1 and the image V2 may be displayed by sub-pixels in different regions of the display <NUM>, so that the user may have different vergence planes (such as the vergence point Vt1 and the vergence point Vt2) when the user views the image V1 and the image V2, but limited herein. In some embodiments, the display <NUM> may provide the image V1 at a first time point and the image V2 at a second time point, and the first time point is different from the second time point, but not limited herein. The method described above may make the positions of the vergence planes of the two eyes the user different when the user views the image V1 and the image V2, or make the positions of the accommodation planes of the one eye of the user different when the user views the image V1 and the V2, and the method of adjusting the positions of the accommodation planes may be referred to the subsequent <FIG>.

Please refer to <FIG> is a schematic diagram of a user viewing an image according to a third embodiment of the present disclosure. In some embodiments (as shown in <FIG>), the display <NUM> of the electronic device <NUM> may provide an image V3, the image V3 may be located on a virtual image plane Pk, and the distances between the user and different portions of the image V3 or different portions of the virtual image plane Pk may be different. For example, the image V3 may include different image contents displayed by different regions (or sub-pixels) of the display <NUM>, and the user may have vergence planes of the two eyes or the accommodation planes of the one eye at different distances when the user views these different image contents, but not limited herein. In addition, the vergence planes of the two eyes and different objects in the environmental scene may satisfy the range R1 in <FIG>, or the vergence planes of the two eyes and the accommodation planes of the one eye may satisfy the range R2 in <FIG>. Therefore, the user may clearly view different image contents and different objects in the environmental scene at the same time, or the discomfort of the user caused by the vergence-accommodation conflict may be mitigated.

Please refer to <FIG> is a schematic diagram of a user viewing state according to a fourth embodiment of the present disclosure. In some embodiments, the position of the accommodation plane Pa1 may be further adjusted in the display method of the image when the distance D1 between the vergence plane Pv1 of the two eyes and the user and the distance D3 between the accommodation plane Pa1 of the one eye and the user fall outside the range R2 in <FIG>, or when the distance difference between the position of the accommodation plane Pa1 and the position of the vergence plane Pv1 needs to be reduced to further mitigate the discomfort of the user caused by the visual vergence-accommodation conflict.

Different from the first embodiment (as shown in the example (iii) of <FIG>), in this embodiment (as shown in <FIG>), one eye (such as the eye <NUM> or the eye <NUM>) of the user focuses on the accommodation plane Pa1 when the one eye of the user views the image V1, the fourth position of the accommodation plane Pa1 may be different from the third position of the image V1, and the fourth position of the accommodation plane Pa1 may also be different from the first position of the vergence plane Pv1. Therefore, the fourth position of the accommodation plane Pa1 may be closer to the first position of the vergence plane Pv1, and the distance difference Δd1 between the distance D1 and the distance D3 may be further reduced.

The method of adjusting the accommodation position of one eye in this embodiment will be described in the following. Please refer to <FIG> is a schematic diagram of adjusting a position of an accommodation plane of one eye according to the present disclosure. The eye <NUM> is used as an example in <FIG>, but this method may also be applied to the eye <NUM>. In addition, in order to simplify the drawing, the optical element <NUM> and the glass <NUM> in <FIG> are omitted in <FIG>.

In the example (i) of <FIG>, a sub-pixel Px1, a sub-pixel Px2, a sub-pixel Px3, a sub-pixel Px4, a sub-pixel Px5, a sub-pixel Px6 and a sub-pixel Px7 of the display <NUM> may respectively emit a light beam Lb1, a light beam Lb2, a light beam Lb3, a light beam Lb4, a light beam Lb5, a light beam Lb6 and a light beam Lb7 to a view point VP1, a view point Vp2, a view point Vp3, a view point Vp4, a view point Vp5, a view point Vp6 and a view point Vp7 on a plane Pe where the eye <NUM> is located. The light beam Lb1, the light beam Lb2, the light beam Lb3, the light beam Lb4, the light beam Lb5, the light beam Lb6 and the light beam Lb7 may focus on an accommodation point Ap1.

Furthermore, the light beam Lb3, the light beam Lb4 and the light beam Lb5 emitted by the sub-pixel Px3, the sub-pixel Px4 and the sub-pixel Px5 may enter a pupil <NUM> of the eye <NUM> in different view directions. In other words, the eye <NUM> may view the light beam Lb3, the light beam Lb4 and the light beam Lb5 emitted by different sub-pixels at the same time. Based on the above principle, each light beam may respectively represent a picture, each picture may be displayed by one or a plurality of corresponding sub-pixels, and different pictures may be displayed by different sub-pixels. For example, an image provided by the display <NUM> may include the pictures represented by the light beam Lb1 to the light beam Lb7 at the same time, and the eye <NUM> may view the pictures represented by the light beam Lb3, the light beam Lb4 and the light beam Lb5 at the same time. Offsets included between the pictures represented by the light beam Lb3, the light beam Lb4 and the light beam Lb5 in the same image may be generated by displaying the pictures represented by the light beam Lb3, the light beam Lb4 and the light beam Lb5 by different sub-pixels, thereby making the eye <NUM> focus on the accommodation point Ap1.

In the example (ii) of <FIG>, a sub-pixel Px8, a sub-pixel Px9, a sub-pixel Px10, a sub-pixel Px11, a sub-pixel Px12, a sub-pixel Px13 and a sub-pixel Px14 of the display <NUM> may respectively emit a light beam Lb8, a light beam Lb9, a light beam Lb10, a light beam Lb11, a light beam Lb12, a light beam Lb13 and a light beam Lb14 to a view point VP8, a view point Vp9, a view point Vp10, a view point Vp11, a view point Vp12, a view point Vp13 and a view point Vp14 on a plane Pe where the eye <NUM> is located. The light beam Lb8, the light beam Lb9, the light beam Lb10, the light beam Lb11, the light beam Lb12, the light beam Lb13 and the light beam Lb14 may focus on another accommodation point Ap2, and the position of the accommodation point Ap2 is different from the position of the accommodation point Ap1.

Furthermore, the light beam Lb8, the light beam Lb9 and the light beam Lb10 emitted by the sub-pixel Px8, the sub-pixel Px9 and the sub-pixel Px10 may enter the pupil <NUM> of the eye <NUM> in different view directions. In other words, the eye <NUM> may view the light beam Lb8, the light beam Lb9 and the light beam Lb10 emitted by different sub-pixels at the same time. For example, an image provided by the display <NUM> may include the pictures represented by the light beam Lb8 to the light beam Lb14 at the same time, and the eye <NUM> may view the pictures represented by the light beam Lb8, the light beam Lb9 and the light beam Lb10 at the same time. Offsets included between the pictures represented by the light beam Lb8, the light beam Lb9 and the light beam Lb10 in the same image may be generated by displaying the pictures represented by the light beam Lb8, the light beam Lb9 and the light beam Lb10 by different sub-pixels, thereby making the eye <NUM> focus on the accommodation point Ap2.

As shown in <FIG>, the images provided by the display <NUM> may have different offsets through displaying different images (such as the images including the light beams Lb1-Lb7 and the images including the light beams Lb8-Lb14) by different sub-pixels (such as the sub-pixels Px1-Px7 and the sub-pixels Px8-Px14), such that the fourth position of the accommodation plane Pa1 of the one eye in <FIG> may be adjusted. For example, the controller <NUM> may obtain the image information (such as the information regarding offsets) for the display <NUM> through the algorithm calculation. The controller <NUM> may transmit the display data including the image information to the display <NUM>, and the display <NUM> may provide the image V1 according to the display data, thereby realizing the display method of adjusting the accommodation plane of the one eye.

In addition, taking <FIG> as an example, the view point Vp1, the view point Vp2, the view point Vp6 and the view point Vp7 (or the view point Vp11, the view point Vp12, the view point Vp13 and the view point Vp14) are located outside the pupil <NUM>, and these view points (or the pictures corresponding to these view points) make the eye <NUM> able to view the image while moving, that is to say, these view points increase the dimension of the moving range of the eyes.

Claim 1:
A display method of an image, comprising:
providing a display (<NUM>), wherein the display provides a first image (V1), and the first image (V1) and an environmental scene are located within a field of view of a user, a first vergence plane (Pv1) where a plurality of sight lines of two eyes (<NUM>, <NUM>) of the user converge is located at a first position when the user views the first image (V1), and a second vergence plane (Pv2) where the plurality of sight lines of the two eyes (<NUM>, <NUM>) converge is located at a second position when the user views an object in the environmental scene,
wherein a first distance (D1) exists between the first position of the first vergence plane (Pv1) and the user, a second distance (D2) exists between the second position of the second vergence plane (Pv2) and the user,
wherein the display (<NUM>) comprises a first set of sub-pixels (Pxa, Pxb) and a second set of sub-pixels (Pxc, Pxd), and the first set of sub-pixels (Pxa, Pxb) are different from the second set of sub-pixels (Pxc, Pxd),
wherein the first set of sub-pixels (Pxa, Pxb) provide a first set of light beams (La1, La2) to the two eyes (<NUM>, <NUM>) and converge the two eyes (<NUM>, <NUM>) at the first position located at a first vergence point (Vt1), the second set of sub-pixels (Pxc, Pxd) provide a second set of light beams (La3, La4) to the two eyes (<NUM>, <NUM>) and converge the two eyes (<NUM>, <NUM>) at the first position located at a second vergence point (Vt2), and the first vergence point (Vt1) is different from the second vergence point (Vt2),
wherein the first distance (D1) is adjusted when the first position of the first vergence plane (Pv1) is adjusted from the first vergence point (Vt1) to the second vergence point (Vt2), and the first distance (D1) and the second distance (D2) satisfy a first relation: <MAT>
wherein D1 represents the first distance (D1), Dn = D2 + Δn, and Df = D2 + Δf,
wherein D2 represents the second distance (D2), Δn =(De / <NUM>)* {tan[tan-<NUM>(<NUM>*D2 / De) - δ]} - D2, and Δf = (De / <NUM>)* {tan[tan-<NUM>(<NUM>*D2 / De) +δ]} - D2, and
wherein De represents a distance (De) between the two eyes (<NUM>, <NUM>), δ represents an eye angular resolution of the two eyes (<NUM>, <NUM>), and δ = <NUM> degrees.