Office Action 1: Non-Final Rejection (2024-04-25)
Rejection types: 103 - Obviousness

CLAIMS:
IN THE CLAIMS:

This listing of claims will replace all prior versions, and listings, of claims in the application:

1\. (Original) A display device, comprising:
a display panel, comprising a display region, a first region disposed outside the display region and extending along a first direction, and a second region disposed outside the display region and extending along a second direction, wherein the first direction is intersected with the second direction; and
a plurality of photoelectric sensor assemblies, each of the photoelectric sensor assemblies being provided with a strip-shaped photosensitive region; wherein one portion of the plurality of photoelectric sensor assemblies are disposed in the first region, extension directions of the photosensitive regions of the portion of the photoelectric sensor assemblies being parallel to the second direction; the other portion of the photoelectric sensor assemblies are disposed in the second region, extension directions of the photosensitive regions of the other portion of the photoelectric sensor assemblies being parallel to the first direction; and each of the photoelectric sensor assemblies is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal.

2\. (Original) The display device according to claim 1, wherein the photoelectric sensor assemblies within the first region and the second region are arranged in rows.

3\. (Original) The display device according to claim 1, wherein the photoelectric sensor assemblies are arranged in two rows in each of the first region and the second region along a direction away from the display region, and the two rows of photoelectric sensor assemblies are staggered.
4\. (Original) The display device according to claim 3, wherein in the two rows of photoelectric sensor assemblies, a length of a photosensitive region of a first photoelectric sensor assembly is greater than a length of a photosensitive region of a second photoelectric sensor assembly, wherein the first photoelectric sensor assembly is any one of a row, distal from the display region, of photoelectric sensor assemblies, and the second photoelectric sensor assembly is any one of a row, proximal to the display region, of photoelectric sensor assemblies.

5\. (Original) The display device according to claim 4, wherein a ratio of the length of the photosensitive region of the first photoelectric sensor assembly to the length of the photosensitive region of the second photoelectric sensor assembly ranges from 1.1 to 2.

6\. (Currently amended) The display device according to claim 3, wherein the photosensitive region of each of the photoelectric sensor assemblies is trapezoidal;
wherein in the two rows of photoelectric sensor assemblies, an upper base of a photosensitive region of any one of the row, distal from the display region, of photoelectric sensor assemblies is collinear with an upper base of a photosensitive region of any one of the row, proximal to the display region, of photoelectric sensor assemblies.

7\. (Currently amended) The display device according to claim 2, wherein the photosensitive region of each of the photoelectric sensor assemblies is rectangular.

8\. (Currently amended) The display device according to claim 2, wherein in a same row of the photoelectric sensor assemblies, areas of the photosensitive regions of the plurality of photoelectric sensor assemblies progressively decrease in a direction from both ends to a center.

9\. (Currently amended) The display device according to claim 2, wherein in a same row of the photoelectric sensor assemblies, areas of the photosensitive regions of the photoelectric sensor assemblies are equal.

10\. (Currently amended) The display device according to claim 2, wherein in a same row of the photoelectric sensor assemblies, distances between any two adjacent photoelectric sensor assemblies are equal.

11\. (Currently amended) The display device according to claim 1, further comprising: an optical structure disposed on a side, distal from the display panel, of the photoelectric sensor assembly, wherein the optical structure comprises a light shielding region, and a plurality of light transmitting regions corresponding to the first region and the second region, an orthographic projection of each of the light transmitting regions on the display panel being within a corresponding first region or a corresponding second region;
wherein each of the photoelectric sensor assemblies is configured to receive the optical signal reflected via the eyes of the user and transmitted through the light transmitting region in the optical structure, and convert the optical signal into the electric signal.

12\. (Currently amended) The display device according to claim 1, further comprising: a processing circuit connected to each of the photoelectric sensor assemblies, wherein the processing circuit is configured to determine gaze positions of the eyes of the user on the display panel based on a signal value of the electric signal transmitted by each of the photoelectric sensor assemblies, a position of the photoelectric sensor assembly within the first region, and a position of the photoelectric sensor assembly within the second region.

13\. (Original) The display device according to claim 12, further comprising: a control circuit;
wherein each of the photoelectric sensor assemblies comprises: a switch transistor and a photodiode;
wherein the photodiode comprises: a substrate, and a pixel electrode, a P-type material layer, a photosensitive material layer, an N-type material layer, and a common electrode that are disposed on a side of the substrate, and are successively stacked along a direction away from the substrate;
wherein a first electrode of the switch transistor is electrically connected to the pixel electrode, a second electrode of the switch transistor is electrically connected to the processing circuit, a control electrode of the switch transistor is electrically connected to the control circuit, and the control circuit is configured to control on and off of the switch transistor.

14\. (Currently amended) A wearable display device, comprising: a display device , a lens disposed on a display side of the display device, and
a plurality of light-emitting elements disposed on an edge of the lens; wherein the display device comprises:
a display panel, comprising a display region, a first region disposed outside the display region and extending along a first direction, and a second region disposed outside the display region and extending along a second direction, wherein the first direction is intersected with the second direction; and
a plurality of photoelectric sensor assemblies, each of the photoelectric sensor assemblies being provided with a strip-shaped photosensitive region; wherein one portion of the plurality of photoelectric sensor assemblies are disposed in the first region, extension directions of the photosensitive regions of the portion of the photoelectric sensor assemblies being parallel to the second direction; the other portion of the photoelectric sensor assemblies are disposed in the second region, extension directions of the photosensitive regions of the other portion of the photoelectric sensor assemblies being parallel to the first direction; and each of the photoelectric sensor assemblies is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal; and
 emitting directions of the plurality of light-emitting elements face away from the display device.

15\. (Currently amended) A method for determining gaze positions, applicable to a display device , wherein the display device comprises:
a display panel, comprising a display region, a first region disposed outside the display region and extending along a first direction, and a second region disposed outside the display region and extending along a second direction, wherein the first direction is intersected with the second direction; and
a plurality of photoelectric sensor assemblies, each of the photoelectric sensor assemblies being provided with a strip-shaped photosensitive region; wherein one portion of the plurality of photoelectric sensor assemblies are disposed in the first region, extension directions of the photosensitive regions of the portion of the photoelectric sensor assemblies being parallel to the second direction; the other portion of the photoelectric sensor assemblies are disposed in the second region, extension directions of the photosensitive regions of the other portion of the photoelectric sensor assemblies being parallel to the first direction; and each of the photoelectric sensor assemblies is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal; and
the method comprises:
receiving a first electric signal transmitted by a-the photoelectric sensor assembly within a-the first region, wherein the first electric signal is converted, by the photoelectric sensor assembly within the first region, from a first optical signal reflected via eyes of a user;
receiving a second electric signal transmitted by a-the photoelectric sensor assembly within a-the second region, wherein the second electric signal is converted, by the photoelectric sensor assembly within the second region, from a second optical signal reflected via the eyes of the user; and
determining a gaze position of the eyes of the user on a display panel based on the first electric signal and the second electric signal.

16\. (New) The wearable display device according to claim 14, wherein the photoelectric sensor assemblies within the first region and the second region are arranged in rows.

17\. (New) The wearable display device according to claim 14, wherein the photoelectric sensor assemblies are arranged in two rows in each of the first region and the second region along a direction away from the display region, and the two rows of photoelectric sensor assemblies are staggered.

18\. (New) The wearable display device according to claim 17, wherein in the two rows of photoelectric sensor assemblies, a length of a photosensitive region of a first photoelectric sensor assembly is greater than a length of a photosensitive region of a second photoelectric sensor assembly, wherein the first photoelectric sensor assembly is any one of a row, distal from the display region, of photoelectric sensor assemblies, and the second photoelectric sensor assembly is any one of a row, proximal to the display region, of photoelectric sensor assemblies.

19\. (New) The wearable display device according to claim 18, wherein a ratio of the length of the photosensitive region of the first photoelectric sensor assembly to the length of the photosensitive region of the second photoelectric sensor assembly ranges from 1.1 to 2.

20\. (New) The wearable display device according to claim 17, wherein the photosensitive region of each of the photoelectric sensor assemblies is trapezoidal;
wherein in the two rows of photoelectric sensor assemblies, an upper base of a photosensitive region of any one of the row, distal from the display region, of photoelectric sensor assemblies is collinear with an upper base of a photosensitive region of any one of the row, proximal to the display region, of photoelectric sensor assemblies.
3 4 5 6 7 8

OFFICE ACTION:
DETAILED ACTION
Notice of Pre-AIA  or AIA  Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Information Disclosure Statement
The information disclosure statement (IDS) submitted on 01/13/2023 is being considered by the examiner.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA  35 U.S.C. 102 and 103 (or as subject to pre-AIA  35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA  to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
This application currently names joint inventors. In considering patentability of the claims the examiner presumes that the subject matter of the various claims was commonly owned as of the effective filing date of the claimed invention(s) absent any evidence to the contrary.  Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and effective filing dates of each claim that was not commonly owned as of the effective filing date of the later invention in order for the examiner to consider the applicability of 35 U.S.C. 102(b)(2)(C) for any potential 35 U.S.C. 102(a)(2) prior art against the later invention.
Claim(s) 1-4, 7, 9-10, 12 and 14-17 is/are rejected under 35 U.S.C. 103 as being unpatentable over Gustafsson et al. (US. Pub. No. 2017/0091549, hereinafter “Gustafsson”) in view of Hsu et al. (US. Pub. No. 2007/0273778, hereinafter “Hsu”), further in view of Lewis et al. (US. Pub. No. 2013/0050642, hereinafter “Lewis”).
As to claims 14 and 1, (Currently amended) Gustafsson discloses a wearable display device [figure 4, a wearable display device], associated with its display device, comprising: a wherein
the display device comprises:
a display panel [display panel of 110], comprising a display region [figure 4, display region of 110 where viewer 440 is viewing],
Gustafsson does not disclose a first region disposed outside the display region and extending along a first direction, and a second region disposed outside the display region and extending along a second direction, wherein the first direction is intersected with the second direction; and
a plurality of photoelectric sensor assemblies, each of the photoelectric sensor assemblies being provided with a strip-shaped photosensitive region; wherein one portion of the plurality of photoelectric sensor assemblies are disposed in the first region, extension directions of the photosensitive regions of the portion of the photoelectric sensor assemblies being parallel to the second direction; the other portion of the photoelectric sensor assemblies are disposed in the second region, extension directions of the photosensitive regions of the other portion of the photoelectric sensor assemblies being parallel to the first direction; and each of the photoelectric sensor assemblies is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal.
Hsu teaches a display [figure 2A, display 300] comprising a display region [figure 2A, display region AA], a first region [figure 2A, first region of VA outside AA extending along a first direction (horizontal)] disposed outside the display region and extending along a first direction, and a second region [figure 2A, second region of VA outside AA extending along a second direction (vertical)] disposed outside the display region and extending along a second direction, wherein the first direction is intersected with the second direction [figure 2A, first direction is intersected with second direction]; and
a plurality of photoelectric sensor assemblies [figure 2A, a plurality of photoelectric sensor 500], each of the photoelectric sensor assemblies being provided with a strip-shaped photosensitive region [figure 2A, strip-shaped photosensitive region]; wherein one portion of the plurality of photoelectric sensor assemblies are disposed in the first region, extension directions of the photosensitive regions of the portion of the photoelectric sensor assemblies being parallel to the second direction [figure 2A, 500 on the left/right edge in the first region, extension directions being parallel to second direction]; the other portion of the photoelectric sensor assemblies are disposed in the second region, extension directions of the photosensitive regions of the other portion of the photoelectric sensor assemblies being parallel to the first direction [figure 2A, 500 on the top/bottom edge in the second region, extension directions being parallel to first direction].
Therefore, it would have been obvious to one having ordinary skill in the art before the effective filing date of the invention to have modified the wearable display device of Gustafsson to a first region disposed outside the display region and extending along a first direction, and a second region disposed outside the display region and extending along a second direction, wherein the first direction is intersected with the second direction; and a plurality of photoelectric sensor assemblies, each of the photoelectric sensor assemblies being provided with a strip-shaped photosensitive region; wherein one portion of the plurality of photoelectric sensor assemblies are disposed in the first region, extension directions of the photosensitive regions of the portion of the photoelectric sensor assemblies being parallel to the second direction; the other portion of the photoelectric sensor assemblies are disposed in the second region, extension directions of the photosensitive regions of the other portion of the photoelectric sensor assemblies being parallel to the first direction; and each of the photoelectric sensor assemblies is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal, as taught by Hsu, in order to precent reduction of artistic appearance of the display panel (Hsu, paragraph 10).
Gustafsson, as modified by Hsu, does not each of the photoelectric sensor assemblies is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal.
Lewis teaches wearable display device wherein each of photoelectric sensor assemblies [figures 4A-C, 152, 134] is configured to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal [paragraph 99, When light within the wavelength range or about the predetermined wavelength of the position sensitive device is detected on the sensor or light sensitive portion of the device, an electrical signal is generated which identifies the location on the surface of the detector].
Therefore, it would have been obvious to one having ordinary skill in the art before the effective filing date of the invention to have modified the wearable display device of Gustafsson to receive an optical signal reflected via eyes of a user and convert the optical signal into an electric signal, as taught by Lewis, in order to automatically align a see-through, near-eye, mixed reality display with an IPD (Lewis, paragraph 4).
As to claim 15, (Currently amended) see the above discussion of claim 14, except for determining a gaze position of the eyes of the user on a display panel based on the first electric signal and the second electric signal [Lewis, abstract, The pupil alignment may be determined based on an arrangement of gaze detection elements for each display optical system including at least one sensor for capturing data of the respective eye and the captured data].
As to claims 16 and 2, (New) Gustafsson, as modified by Hsu and Lewis, discloses the wearable display device according to claim 14, associated with its display device, wherein the photoelectric sensor assemblies within the first region and the second region are arranged in rows [Hsu, figure 2A, 500 are arranged in rows]. In addition, the same rationale is used as in rejections for claims 14 and 1.
As to claims 17 and 3, (New) Gustafsson, as modified by Hsu and Lewis, discloses the wearable display device according to claim 14, associated with its display device, wherein the photoelectric sensor assemblies are arranged in two rows in each of the first region and the second region along a direction away from the display region, and the two rows of photoelectric sensor assemblies are staggered [Hsu, figure 2A, 500 are arranged in two rows in first region and second region along a direction away from display region and are staggered]. In addition, the same rationale is used as in rejections for claims 14 and 1.
As to claim 7, (Currently amended) Gustafsson, as modified by Hsu and Lewis, discloses the display device according to claim 2, wherein the photosensitive region of each of the photoelectric sensor assemblies is rectangular [Lewis, figure 4C, 134 is rectangular]. In addition, the same rationale is used as in rejections for claims 14 and 1.
As to claim 9, (Currently amended) Gustafsson, as modified by Hsu and Lewis, discloses the display device according to claim 2, wherein in a same row of the photoelectric sensor assemblies, areas of the photosensitive regions of the photoelectric sensor assemblies are equal [Hsu, figure 2A, areas of 500 are equal]. In addition, the same rationale is used as in rejections for claims 14 and 1.
As to claim 10, (Currently amended) Gustafsson, as modified by Hsu and Lewis, discloses the display device according to claim 2, wherein in a same row of the photoelectric sensor assemblies, distances between any two adjacent photoelectric sensor assemblies are equal [Hsu, figure 2A, distances between two adjacent 500 are equal]. In addition, the same rationale is used as in rejections for claims 14 and 1.
As to claim 12, (Currently amended) Gustafsson, as modified by Hsu and Lewis, discloses the display device according to claim 1, further comprising: a processing circuit [Lewis, figure 7A, processing circuit 200 connected to photodetectors 152] connected to each of the photoelectric sensor assemblies, wherein the processing circuit is configured to determine gaze positions of the eyes of the user on the display panel based on a signal value of the electric signal transmitted by each of the photoelectric sensor assemblies, a position of the photoelectric sensor assembly within the first region, and a position of the photoelectric sensor assembly within the second region [Lewis, paragraph 99, When light within the wavelength range or about the predetermined wavelength of the position sensitive device is detected on the sensor or light sensitive portion of the device, an electrical signal is generated which identifies the location on the surface of the detector, abstract, The pupil alignment may be determined based on an arrangement of gaze detection elements for each display optical system including at least one sensor for capturing data of the respective eye and the captured data]. In addition, the same rationale is used as in rejections for claims 14 and 1.
Allowable Subject Matter
Claims 4-6, 8, 11, 13 and 18-20 are objected to as being dependent upon a rejected base claim, but would be allowable if rewritten in independent form including all of the limitations of the base claim and any intervening claims.
The following is a statement of reasons for the indication of allowable subject matter: None of the prior art, made of record, singularly or in combination, teaches or fairly suggests the features presented in the combination limitations of dependent claims 4, 6, 8, 11, 13, 18 and 20, such as “wherein in the two rows of photoelectric sensor assemblies, a length of a photosensitive region of a first photoelectric sensor assembly is greater than a length of a photosensitive region of a second photoelectric sensor assembly, wherein the first photoelectric sensor assembly is any one of a row, distal from the display region, of photoelectric sensor assemblies, and the second photoelectric sensor assembly is any one of a raw, proximal to the display region, of photoelectric sensor assemblies”, recited by claims 4 and 18, respectively; “wherein the photosensitive region of each of the photoelectric sensor assemblies is trapezoidal; wherein in the two rows of photoelectric sensor assemblies, an upper base of a photosensitive region of any one of the row, distal from the display region, of photoelectric sensor assemblies is collinear with an upper base of a photosensitive region of any one of the row, proximal to the display region, of photoelectric sensor assemblies”, recited by claims 6 and 20, respectively; “wherein in a same row of the photoelectric sensor assemblies, areas of the photosensitive regions of the plurality of photoelectric sensor assemblies progressively decrease in a direction from both ends to a center”, recited by claim 8; “an optical structure disposed on a side, distal from the display panel, of the photoelectric sensor assembly, wherein the optical structure comprises a light shielding region, and a plurality of light transmitting regions corresponding to the first region and the second region, an orthographic projection of each of the light transmitting regions on the display panel being within a corresponding first region or a corresponding second region; wherein each of the photoelectric sensor assemblies is configured to receive the optical signal reflected via the eyes of the user and transmitted through the light transmitting region in the optical structure, and convert the optical signal into the electric signal”, recited by claim 11; and “a control circuit; wherein each of the photoelectric sensor assemblies comprises: a switch transistor and a photodiode; wherein the photodiode comprises: a substrate, and a pixel electrode, a P-type material layer, a photosensitive material layer, an N-type material layer, and a common electrode that are disposed on a side of the substrate, and are successively stacked along a direction away from the substrate; wherein a first electrode of the switch transistor is electrically connected to the pixel electrode, a second electrode of the switch transistor is electrically connected to the processing circuit, a control electrode of the switch transistor is electrically connected to the control circuit, and the control circuit is configured to control on and off of the switch transistor”, recited by claim 13.
Conclusion


NEXT OFFICE ACTION: DETAILED ACTION
Notice of Pre-AIA  or AIA  Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant’s argument, filed on 07/22/2024, with respect to the amended claim limitations of claims 1, 14 and 15 have been fully considered and are persuasive. The rejections of claims 1, 14 and 15 have been withdrawn in view of Applicant’s amendments.
Allowable Subject Matter
Claims 1-2, 4-16 and 18-20 are allowed.
The following is an examiner’s statement of reasons for allowance:
None of the prior art, made of record, singularly or in combination, teaches or fairly suggests the features presented in the combined limitations of independent claims 1, 14 and 15, based on Applicant’s persuasive arguments, filed on 07/22/2024. The dependent claims 2, 4-13, 16 and 18-20 are allowed for at least the same reason indicated above.
Any comments considered necessary by applicant must be submitted no later than the payment of the issue fee and, to avoid processing delays, should preferably accompany the issue fee.  Such submissions should be clearly labeled “Comments on Statement of Reasons for Allowance.”
Conclusion

CITED REFERENCE SUMMARIES: Ref US20070273778A1: Claims:
A photo sensing display apparatus, comprising: a display panel, comprising: an active area; an inactive area, disposed around the active area; a plurality of sub-pixels, disposed in the active area for displaying a frame; and at least a dummy sub-pixel, disposed in the active area, the dummy sub-pixel having a photo sensing device; and a photo sensing controller, coupled to the photo sensing device.
a display panel, comprising: an active area; an inactive area, disposed around the active area; a plurality of sub-pixels, disposed in the active area for displaying a frame; and at least a dummy sub-pixel, disposed in the active area, the dummy sub-pixel having a photo sensing device; and
an inactive area, disposed around the active area;
a plurality of sub-pixels, disposed in the active area for displaying a frame; and
at least a dummy sub-pixel, disposed in the active area, the dummy sub-pixel having a photo sensing device; and
a photo sensing controller, coupled to the photo sensing device.
The apparatus according to claim 1 , wherein the display panel comprises a plurality of dummy sub-pixels, the photo sensing devices of the dummy sub-pixels are coupled to each other in series and electrically coupled to the photo sensing controller via at least two control lines.
The apparatus according to claim 2 , wherein the photo sensing devices are thin film transistors (TFTs), which are coupled to each other in series with the gates as well as drains of the TFTs coupled to one of the control lines and the sources of the TFTs coupled to the other control line.
The apparatus according to claim 2 , wherein the photo sensing devices are thin film transistors (TFTs), which are coupled to each other in series with the gates of the TFTs coupled to a first control line, the drains of the TFTs coupled to a second control line, the sources of the TFTs coupled to a third control line, and the three control lines electrically connecting the photo sensing controller and the TFTs.
The apparatus according to claim 4 , wherein the first control line is coupled to the second control line.
The apparatus according to claim 1 , wherein the display panel comprises a plurality of dummy sub-pixels and the photo sensing devices of the dummy sub-pixels are electrically coupled to the photo sensing controller respectively.
The apparatus according to claim 1 , wherein the display panel comprises a plurality of dummy sub-pixels and the photo sensing devices of the dummy sub-pixels are electrically coupled to the photo sensing controller in group.
The apparatus according to claim 1 , wherein the display panel comprises a plurality of dummy sub-pixels and the dummy sub-pixels are continuously or discontinuously disposed at four sides of the active area.
The apparatus according to claim 1 , wherein the display panel comprises a plurality of dummy sub-pixels and the dummy sub-pixels are continuously or discontinuously disposed at three sides of the active area.
The apparatus according to claim 1 , wherein the active area comprises a plurality of dummy sub-pixels and the dummy sub-pixels are continuously or discontinuously disposed at two sides of the active area.
The apparatus according to claim 1 , wherein the display panel comprises a plurality of dummy sub-pixels and the dummy sub-pixels are continuously or discontinuously disposed at one side of the active area.
The apparatus according to claim 1 , wherein the photo sensing device is a thin film transistor (TFT) and a channel layer of the TFT is composed of mono-crystalline silicone.
The apparatus according to claim 1 , wherein the photo sensing device is a thin film transistor and a channel layer of the thin film transistor is composed of polycrystalline silicone (poly-Si).
The apparatus according to claim 1 , wherein the photo sensing device is a TFT and a channel layer of the TFT is composed of amorphous silicone (a-Si).
The apparatus according to 1 , wherein the display panel further comprises a TFT substrate, a color filter substrate and a liquid crystal layer, the liquid crystal layer is disposed between the TFT substrate and the color filter substrate and the sub-pixels and the dummy sub-pixel are disposed on the TFT substrate.
A display panel, capable of sensing environmental luminance and electrically coupled to a photo sensing controller, the display panel comprising: an active area; an inactive area, disposed around the active area; a plurality of sub-pixels, disposed in the active area for displaying a frame; and at least a dummy sub-pixel, disposed in the active area, the dummy sub-pixel having a photo sensing device for sensing the environmental luminance and outputting a photo sensing signal to the photo sensing controller.
at least a dummy sub-pixel, disposed in the active area, the dummy sub-pixel having a photo sensing device for sensing the environmental luminance and outputting a photo sensing signal to the photo sensing controller.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the photo sensing devices of the dummy sub-pixels are coupled to each other in series and electrically coupled to the photo sensing controller.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the photo sensing devices of the dummy sub-pixels are electrically coupled to the photo sensing controller respectively.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the photo sensing devices of the dummy sub-pixels are electrically coupled to the photo sensing controller in group.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the dummy sub-pixels are continuously or discontinuously disposed at four sides of the active area.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the dummy sub-pixels are continuously or discontinuously disposed at three sides of the active area.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the dummy sub-pixels are continuously or discontinuously disposed at two sides of the active area.
The display panel according to claim 16 , comprising a plurality of dummy sub-pixels, wherein the dummy sub-pixels are continuously or discontinuously disposed at one side of the active area.
The display panel according to claim 16 , further comprising a TFT substrate, a color filter substrate and a liquid crystal layer, wherein the liquid crystal layer is disposed between the TFT substrate and the color filter substrate and the sub-pixels and the dummy sub-pixel are disposed on the TFT substrate.
Ref US20130050642A1: Claims:
A method for automatically aligning a see-through, near-eye, mixed reality display with an inter-pupillary distance (IPD) for a user comprising: automatically determining whether the see-through, near-eye, mixed reality display is aligned with a user IPD in accordance with an alignment critiera; and responsive to the display device not being aligned with the user IPD in accordance with the alignment criteria, automatically adjusting the display device for bringing the device into alignment with the user IPD.
automatically determining whether the see-through, near-eye, mixed reality display is aligned with a user IPD in accordance with an alignment critiera; and
responsive to the display device not being aligned with the user IPD in accordance with the alignment criteria, automatically adjusting the display device for bringing the device into alignment with the user IPD.
The method of claim 1 further comprising: responsive to the display device being aligned with the user IPD in accordance with the alignment criteria, storing an IPD data set for the user comprising a position of each optical axis of a respective display optical system of the display device, each display optical system being positioned to be seen through by a respective eye.
responsive to the display device being aligned with the user IPD in accordance with the alignment criteria, storing an IPD data set for the user comprising a position of each optical axis of a respective display optical system of the display device, each display optical system being positioned to be seen through by a respective eye.
The method of claim 1 wherein automatically determining whether the see-through, near-eye, mixed reality display is aligned with a user IPD in accordance with an alignment criteria further comprises: identifying an object in the user field of view at a distance and a direction for determining an IPD; performing processing for drawing the user's focus to the object; capturing data of each eye during an observation period for the object by at least one sensor in an arrangement of gaze detection elements for the respective display optical system; and determining whether each pupil is aligned with its respective optical axis in accordance with alignment criteria based on the captured data and the arrangement of gaze detection elements.
identifying an object in the user field of view at a distance and a direction for determining an IPD;
performing processing for drawing the user's focus to the object;
capturing data of each eye during an observation period for the object by at least one sensor in an arrangement of gaze detection elements for the respective display optical system; and
determining whether each pupil is aligned with its respective optical axis in accordance with alignment criteria based on the captured data and the arrangement of gaze detection elements.
The method of claim 1 wherein automatically determining whether the see-through, near-eye, mixed reality display is aligned with a user IPD in accordance with an alignment criteria further comprises: identifying an object in the user field of view at a distance and a direction for determining an IPD; performing processing for drawing the user's focus to the object; determining a reference gaze vector for each eye to the real object which passes through an optical axis of a respective display optical system for each eye based on an arrangement of gaze detection elements for the display optical system; capturing data of each eye by at least one sensor of the arrangement during an observation period for the real object; determining a current gaze vector for each eye based on the captured data and the arrangement; and determining whether each pupil is aligned with its respective optical axis in accordance with an alignment criteria be determining whether the current gaze vector for each eye matches the reference gaze vector for each eye.
determining a reference gaze vector for each eye to the real object which passes through an optical axis of a respective display optical system for each eye based on an arrangement of gaze detection elements for the display optical system;
capturing data of each eye by at least one sensor of the arrangement during an observation period for the real object;
determining a current gaze vector for each eye based on the captured data and the arrangement; and
determining whether each pupil is aligned with its respective optical axis in accordance with an alignment criteria be determining whether the current gaze vector for each eye matches the reference gaze vector for each eye.
The method of claim 1 wherein automatically determining whether the see-through, near-eye, mixed reality display is aligned with a user IPD in accordance with an alignment criteria further comprises: identifying a real object in the user field of view at a distance and a direction for determining an IPD; performing processing for drawing the user's focus to the real object; capturing image data of each eye in an image format during an observation period for the real object by at least one sensor aligned with an optical axis of a respective display optical system of the display device, each display optical system being positioned to be seen through by a respective eye; determining a respective pupil position from the optical axis from the image data; and determining whether each pupil aligned is aligned with its respective optical axis based on the pupil position in the image format in accordance with alignment criteria.
identifying a real object in the user field of view at a distance and a direction for determining an IPD;
performing processing for drawing the user's focus to the real object;
capturing image data of each eye in an image format during an observation period for the real object by at least one sensor aligned with an optical axis of a respective display optical system of the display device, each display optical system being positioned to be seen through by a respective eye;
determining a respective pupil position from the optical axis from the image data; and
determining whether each pupil aligned is aligned with its respective optical axis based on the pupil position in the image format in accordance with alignment criteria.
The method of claim 5 wherein automatically adjusting the display device for bringing the device into alignment with the user IPD further comprises: determining at least one adjustment value for a respective display adjustment mechanism based on a mapping criteria of the at least one sensor for each display optical system not satisfying the alignment criteria; and moving the respective display optical system based on the at least one adjustment value.
determining at least one adjustment value for a respective display adjustment mechanism based on a mapping criteria of the at least one sensor for each display optical system not satisfying the alignment criteria; and
moving the respective display optical system based on the at least one adjustment value.
The method of claim 6 wherein determining at least one adjustment value for a respective display adjustment mechanism based on a mapping criteria of the at least one sensor for each display optical system not satisfying the alignment criteria further comprises: based on the mapping criteria for the at least one sensor, determining a horizontal pupil position difference vector; based on the mapping criteria for the at least one sensor, determining a vertical pupil position difference vector; correlating the horizontal pupil position difference vector to a horizontal adjustment value; and correlating the vertical pupil position difference vector to a vertical adjustment value.
based on the mapping criteria for the at least one sensor, determining a horizontal pupil position difference vector;
based on the mapping criteria for the at least one sensor, determining a vertical pupil position difference vector;
correlating the horizontal pupil position difference vector to a horizontal adjustment value; and
correlating the vertical pupil position difference vector to a vertical adjustment value.
The method of claim 7 further comprising: determining whether any of the horizontal or vertical adjustment values are out of range; and responsive to any horizontal or vertical adjustment value being out of range, determining a depth adjustment value for bringing any out of range adjustment value closer to being within range.
determining whether any of the horizontal or vertical adjustment values are out of range; and
responsive to any horizontal or vertical adjustment value being out of range, determining a depth adjustment value for bringing any out of range adjustment value closer to being within range.
A system for automatically aligning a see-through, near-eye, mixed reality display with an inter-pupillary distance (IPD) of a user comprising: a see-through, near-eye, mixed reality display device having a support structure including movable support structures, and having attached to a respective movable support structure a respective display optical system for each eye positioned to be seen through by the respective eye, each display optical system having an optical axis; a display adjustment mechanism attached to at least one movable support structure for adjusting a position of the respective display optical system; a respective arrangement of gaze detection elements positioned with respect to each display optical system on the respective movable support structure for forming a spatial relationship between the gaze detection elements and the respective eye; each respective arrangement including at least one respective sensor having a detection area for capturing data of the respective eye of the respective display optical system; a memory for storing software and data including the captured data of each eye; and one or more processors having access to the memory and being communicatively coupled to the display adjustment mechanism for automatically controlling adjustment of each display optical system for alignment with the inter-pupillary distance based on the captured data and the arrangement of gaze detection elements.
a see-through, near-eye, mixed reality display device having a support structure including movable support structures, and having attached to a respective movable support structure a respective display optical system for each eye positioned to be seen through by the respective eye, each display optical system having an optical axis;
a display adjustment mechanism attached to at least one movable support structure for adjusting a position of the respective display optical system;
a respective arrangement of gaze detection elements positioned with respect to each display optical system on the respective movable support structure for forming a spatial relationship between the gaze detection elements and the respective eye;
each respective arrangement including at least one respective sensor having a detection area for capturing data of the respective eye of the respective display optical system;
a memory for storing software and data including the captured data of each eye; and
one or more processors having access to the memory and being communicatively coupled to the display adjustment mechanism for automatically controlling adjustment of each display optical system for alignment with the inter-pupillary distance based on the captured data and the arrangement of gaze detection elements.
The system of claim 9 further comprising an environment facing camera positioned on the display device to have a front facing field of view and being communicatively coupled to the one or more processors for providing image data from which the one or more processors determine a user field of view including at least a real object.
The system of claim 9 wherein the at least one respective sensor is an infra-red (IR) sensor; and the arrangement of gaze detection elements includes IR illuminators for generating glints, the IR illuminators being at fixed positions on the respective movable support structure with respect to a detection area of the IR sensor; the IR sensor capturing data of glints on the eye associated with the respective display optical system; and the processor determining a gaze vector for the eye based on the data of glints and determining whether a pupil is aligned with the optical axis of the respective display optical system based on the gaze vector.
the IR sensor capturing data of glints on the eye associated with the respective display optical system; and
the processor determining a gaze vector for the eye based on the data of glints and determining whether a pupil is aligned with the optical axis of the respective display optical system based on the gaze vector.
The system of claim 9 wherein the at least one respective sensor is an infra-red (IR) camera; and the arrangement of gaze detection elements includes IR illuminators for generating glints, the IR illuminators being at fixed positions on the respective movable support structure with respect to a detection area of the IR camera; the IR camera capturing image data of the respective eye of the respective display o
[Truncated to input limit]