Office Action 2: Final Rejection (2024-10-23)
Rejection types: 103 - Obviousness

CLAIMS:
AMENDMENTS TO THE CLAIMS

1-20. (Cancelled)219

21\. (Currently amended) A therapeutic training device comprising;a head mounted display comprising:
 an outward facing video display comprising a transparency that is variable; and
 a light having an adjustable brightness to illuminate eyes of a wearer,
wherein adjusting at least one of the transparency and the brightness allows an observer to see the eyes of the wearer through the outward facing video display.

22\. (Previously presented) The therapeutic training device of claim 21, comprising a controller configured to inversely adjust the transparency of the outward facing video display and the brightness of the light.

23\. (Currently amended) The therapeutic training device of claim 21, wherein the outward facing video display comprises a display selected from the group consisting of a video projector, a LCD display, a LED display, and a quantum dot display.

24\. (Previously presented) The therapeutic training device of claim 21, wherein the outward facing video display comprises a plurality of outward facing video displays.

25\. (Currently amended) The therapeutic training device of claim 21, further comprising eye tracking components and software.

26\. (Currently amended) The therapeutic training device of claim 21, further comprising a controller configured to adjust a-the transparency of the outward facing video display, and to adjust the brightness of the light.

27\. (Previously presented) A therapeutic training device, comprising:
eyeglass frames;
an outward facing video display positioned within the eyeglass frames; and
a controller coupled to the outward facing video display to control a display of media content on the video display, such that the display of media content is viewable by a patient when the therapeutic training device is worn by a user,
wherein the outward facing video display is see-through from the side of the user.

28\. (Previously presented) The device of claim 27, wherein the outward facing video display comprises a display selected from the group consisting of a video projector, a LCD display, a LED display, or a quantum dot display.

29\. (Previously presented) The device of claim 27, wherein the outward facing video display comprises a plurality of outward facing video displays.

30\. (Previously presented) The device of claim 27, comprising a light having an adjustable brightness to illuminate the eyes of the user.

31\. (Previously presented) The device of claim 27, wherein a transparency of the media content displayed on the outward facing video display is adjustable.

32\. (Previously presented) The device of claim 31, wherein the transparency of the media content displayed on the outward facing video display is adjusted manually by the user.

33\. (Previously presented) The device of claim 31, wherein the transparency of the media content displayed on the outward facing video display is adjusted by software.

34\. (Previously presented) The device of claim 27, comprising eye tracking components and software.

35\. (Previously presented) The device of claim 27, wherein a transparency of the media content displayed on the outward facing video display is variable, and wherein the device further comprises
a light having an adjustable brightness and configured to illuminate eyes of the user.

36\. (Previously presented) The device of claim 35, comprising a controller configured to inversely adjust a transparency of the outward facing video display and the brightness of the light.

OFFICE ACTION:
DETAILED ACTION
Notice of Pre-AIA  or AIA  Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Status of Claims
This office action is in response to arguments and amendments entered on July 12, 2024 for the patent application 17/181,544 originally filed on February 22, 2021. Claims 21, 23, 25-28, and 35 are amended. Claims 1-20 are canceled. Claims 21-36 remain pending. The first office action of January 26, 2024 is fully incorporated by reference into this office action.
Response to Amendment
Applicant’s amendments to the claims have been noted by the Examiner.
The Applicant’s amendments are sufficient to overcome the outstanding rejections under 35 USC 102 and 35 USC 103. However, new rejections under 35 USC 103 apply to claims 27-36, as set forth below.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 27-29 and 31-34 are rejected under 35 U.S.C. 103 as being unpatentable over Ive et al. (hereinafter “Ive,” US 2024/0012601) in view of Saur et al. (hereinafter “Saur,” US 2018/0308451).
Regarding claim 27, Ive discloses a therapeutic training device, comprising:
eyeglass frames (Ive [0003], “HMDs take various forms, including goggles, helmets, masks, visors, glasses…”);
an outward facing video display positioned within the eyeglass frames (Ive [0044], “The embodiments herein are generally directed to head-mounted displays (HMDs), and more particularly, to HMDs that have an outward-facing output system (including display(s), a speaker(s), or the like)”; also Ive [0146], “these concepts apply equally or by analogy to head mounted displays or wearable electronic devices or systems of other configurations as well, including without limitation visors, glasses…”); and
a controller coupled to the outward facing video display to control a display of media content on the video display, such that the display of media content is viewable by a patient when the therapeutic training device is worn by a user (Ive [0055], “The HMD 102 also includes an external or outward-facing display 106. The outward-facing display 106 may define a display surface that faces away from the wearer, and may be configured to display visual output (e.g., still images, video images) to persons other than the wearer 100. As noted above and described herein, such visual output may include real-time or pre-captured video or still images of at least a part of the wearer's 100 face (e.g., the wearer's eyes and eyebrows).”).
Ive does not teach wherein the outward facing video display is see-through from the side of the user.
However, Saur discloses wherein the video display is see-through from the side of the user (Saur [0047], “LCD displays with LCD shutter technology are used as displays 5A, 5B in the present exemplary embodiment. The LCD shutter technology renders it possible to set the degree of transparency of the LCD displays as desired between 0% (opaque) and 100% (transparent) by applying a control voltage.”; also Saur [0054], “control of the head-mounted display 1 is facilitated for the situation-dependent switch-over between various modes such as clear view, AR and/or VR,” transparency of the video display may be between opaque and fully transparent. Saur discloses modifying transparency of an inward-facing video. In full VR mode, the display is opaque and transparency is set to 0%. In clear view mode, the display is fully transparent and set to 100% transparency. In AR mode, the view is partially transparent. When the display has transparency, the wearer can see through the video display).
Saur is analogous to Ive, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive, to include wherein the video display is see-through from the side of the user, as taught by Saur, because it combines prior art elements according to known methods to yield predictable results. Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Regarding claim 28, Ive in view of Saur discloses that the outward facing video display comprises a display selected from the group consisting of a video projector, a LCD display, a LED display, or a quantum dot display (Ive [0127], “The outward-facing display 106 may be any suitable type of display, including a liquid-crystal display (LCD), organic light emitting diode (OLED) display, LED display, or the like.”).
Regarding claim 29, Ive in view of Saur discloses that the outward facing video display comprises a plurality of outward facing video displays (Ive [0129], “while the outward-facing display 106 is often shown and described herein as a single display component, it may include multiple different displays, such as two or more displays in a side-by-side arrangement, or two or more displays in an over-under arrangement.”).
Regarding claim 31, Ive does not explicitly teach that a transparency of the media content displayed on the outward facing video display is adjustable.
However, Saur discloses a transparency of the media content displayed on the outward facing video display is adjustable (Saur [0016], “modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus”; also Saur [0017], “a head-mounted display (also referred to as HMD) is understood to be a visual output appliance that is worn on the head. It presents images on a display of the playback arrangement. By way of example, the display can be a display arranged in front of the eyes, the degree of transparency of which for optical signals can be modified by applying a voltage… The degree of transparency of the display, of the reflection area or of the device for reducing ambient light that is incident on the beam splitter can be set, in particular, in a range from 0% (opaque) to 100% (transparent) as desired.”).
Saur is analogous to Ive, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive, to include a transparency of the media content displayed on the outward facing video display is adjustable, as taught by Saur, because it combines prior art elements according to known methods to yield predictable results. Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Regarding claim 32, Ive does not teach that the transparency of the media content displayed on the outward facing video display is adjusted manually by the user.
However, Saur discloses the transparency of the media content displayed on the outward facing video display is adjusted manually by the user (Saur [0031], “an actuation unit for modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus”; also Saur [0034], “The evaluation unit and/or the actuation unit can be integrated into the head-wearable presentation apparatus or realized as software on a computer.”).
Saur is analogous to Ive, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive, to include the transparency of the media content displayed on the outward facing video display is adjusted manually by the user, as taught by Saur, because it combines prior art elements according to known methods to yield predictable results. Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Regarding claim 33, Ive does not teach that the transparency of the media content displayed on the outward facing video display is adjusted by software.
However, Saur discloses the transparency of the media content displayed on the outward facing video display is adjusted by software (Saur [0031], “an actuation unit for modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus”; also Saur [0034], “The evaluation unit and/or the actuation unit can be integrated into the head-wearable presentation apparatus or realized as software on a computer.”).
Saur is analogous to Ive, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive, to include the transparency of the media content displayed on the outward facing video display is adjusted by software, as taught by Saur, because it combines prior art elements according to known methods to yield predictable results. Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Regarding claim 34, Ive in view of Saur discloses eye tracking components and software (Ive [0142], “The HMD 2000 may also include wearer-facing sensors 2024 that may be used to sense, capture, and/or detect information about a wearer of the head-mounted display (including video and/or still images). Example wearer-facing sensors 2024 include, without limitation, cameras, eye-tracking sensors”).
Claims 30, 35, and 36 are rejected under 35 U.S.C. 103 as being unpatentable over Ive in view of Saur, and in further view of Samec et al. (hereinafter “Samec,” US 2016/0270656).
Regarding claim 30, Ive in view of Saur does not explicitly teach a light having an adjustable brightness to illuminate the eyes of the user.
However, Samec discloses a light having an adjustable brightness to illuminate the eyes of the user (Samec [1858], “The augmented reality/virtual reality device can comprise a head mounted display… The generated thin illuminating beam can be conditioned by one or more lenses and filters and directed into the eye of a user… the angle of incidence and/or the brightness of the thin illuminating beam on the eye can also be adjusted…”).
Samec is analogous to Ive in view of Saur, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive in view of Saur, to include a light having an adjustable brightness to illuminate the eyes of the user, as taught by Samec, in order to provide imaging output of various portions of the wearer’s eyes for ophthalmic use cases (Samec [1858]). Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Regarding claim 35, Ive discloses a therapeutic training device comprising a head mounted display having an outward facing video display (Ive [0044], “The embodiments herein are generally directed to head-mounted displays (HMDs), and more particularly, to HMDs that have an outward-facing output system (including display(s), a speaker(s), or the like)”).
Ive does not explicitly teach a video display comprising a transparency that is variable.
However, Saur discloses a video display comprising a transparency that is variable (Saur [0016], “modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus”; also Saur [0017], “a head-mounted display (also referred to as HMD) is understood to be a visual output appliance that is worn on the head. It presents images on a display of the playback arrangement. By way of example, the display can be a display arranged in front of the eyes, the degree of transparency of which for optical signals can be modified by applying a voltage… The degree of transparency of the display, of the reflection area or of the device for reducing ambient light that is incident on the beam splitter can be set, in particular, in a range from 0% (opaque) to 100% (transparent) as desired.”).
Saur is analogous to Ive, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive, to include a video display comprising a transparency that is variable, as taught by Saur, because it combines prior art elements according to known methods to yield predictable results. Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Ive in view of Saur does not explicitly teach a head mounted display comprising a light having an adjustable brightness to illuminate the eyes of the user.
However, Samec discloses a head mounted display comprising a light having an adjustable brightness to illuminate the eyes of the user (Samec [1858], “The augmented reality/virtual reality device can comprise a head mounted display… The generated thin illuminating beam can be conditioned by one or more lenses and filters and directed into the eye of a user… the angle of incidence and/or the brightness of the thin illuminating beam on the eye can also be adjusted…”).
Samec is analogous to Ive in view of Saur, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive in view of Saur, to include a head mounted display comprising a light having an adjustable brightness to illuminate the eyes of the user, as taught by Samec, in order to provide imaging output of various portions of the wearer’s eyes for ophthalmic use cases (Samec [1858]). Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Regarding claim 36, Ive does not explicitly teach a controller configured to inversely adjust the transparency of the outward facing video display and the brightness of the light.
However, Saur discloses a controller configured to inversely adjust the transparency of the outward facing video display (Saur [0016], “modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus”; also Saur [0017], “a head-mounted display (also referred to as HMD) is understood to be a visual output appliance that is worn on the head. It presents images on a display of the playback arrangement. By way of example, the display can be a display arranged in front of the eyes, the degree of transparency of which for optical signals can be modified by applying a voltage… The degree of transparency of the display, of the reflection area or of the device for reducing ambient light that is incident on the beam splitter can be set, in particular, in a range from 0% (opaque) to 100% (transparent) as desired,” the transparency of the display can be adjusted to be more opaque or more transparent).
Saur is analogous to Ive, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive, to include a controller configured to inversely adjust the transparency of the outward facing video display, as taught by Saur, because it combines prior art elements according to known methods to yield predictable results. Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Samec discloses a controller configured to inversely adjust the brightness of the light (Samec [1858], “The augmented reality/virtual reality device can comprise a head mounted display… The generated thin illuminating beam can be conditioned by one or more lenses and filters and directed into the eye of a user… the angle of incidence and/or the brightness of the thin illuminating beam on the eye can also be adjusted,” the brightness of the light can be adjusted to both brighter and dimmer).
Samec is analogous to Ive in view of Saur, as both are drawn to the art of head mounted displays. It would be obvious to try by one of ordinary skill in the art at the time of filing to have modified the method as taught by Ive in view of Saur, to include a controller configured to inversely adjust the brightness of the light, as taught by Samec, in order to provide imaging output of various portions of the wearer’s eyes for ophthalmic use cases (Samec [1858]). Doing so is a predictable solution that one of ordinary skill in the art could have pursued with a reasonable expectation of success.
Allowable Subject Matter
Claims 21-26 are allowed.
The following is a statement of reasons for the indication of allowable subject matter:
Claims 21-26, as amended, are allowable because they are directed to at least a video display having a variable transparency, having an adjustable brightness to illuminate the eyes of a wearer, and adjusting the transparency or brightness so that an observer can see the eyes of the wearer through the video display. These features are not disclosed by the primary reference Ive.
Response to Arguments
The Applicant’s arguments filed on July 12, 2024 have been fully considered by the Examiner.
The Applicant respectfully argues that for both independent claims 21 and 27, “the video display is see-through (e.g., so that an observer can directly see the user's eyes, or so that the user can see the surrounding world past the display). This differs substantially from Ive, in which the user can see only an inward-facing screen (which can display the user's surroundings, but which is not see-through to allow the user to see their surroundings directly). Similarly, although an observer of the Ive device can, in some cases, see a representation of the user's eyes on an outward facing screen, the observer cannot see the user's actual eyes, because the display is not transparent. Indeed, if the Ive device were to lose power or malfunction, the wearer would need to remove the device in order to see their surroundings or to allow observers to see their eyes.”
While this appears to be true for independent claim 21, the Examiner respectfully disagrees that claim 27 is limited by these features. Independent claim 27 does not recite a video display having a variable transparency, having an adjustable brightness to illuminate the eyes of a wearer, and adjusting the transparency or brightness so that an observer can see the eyes of the wearer through the video display, as claim 21 does. Notably, claim 27 instead recites that the outward facing video display “is see-through from the side of the user.” This implies that the display is not necessarily see-through from the side of the viewer. Claim 27 has no mention of transparency, illumination, or seeing the eyes of the wearer, and therefore remains rejected under 35 USC 103 in view of Ive and Saur supra.
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action.  Accordingly, THIS ACTION IS MADE FINAL.  See MPEP § 706.07(a).  Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action.  In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action.  In no event, however, will the statutory period for reply expire later than SIX MONTHS from the date of this final action.

APPLICANT REBUTTAL: REMARKS/ARGUMENTS
This paper is submitted as a response to the Advisory Action mailed January 31, 2025 and the final Office Action mailed October 23, 2024. At the time of receiving the Office Action and the Advisory Action, claims 21-36 were pending, and claims 1-20 were cancelled. In the Office Action, claims 21-26 are allowed. Claims 27-36, however, were rejected under 35 U.S.C. § 103 as unpatentable over Ive et al. (US 2024/0012604; hereinafter, "Ive") in view of Saur et al. (US 2018/0308451; hereinafter "Saur"), and in the cases of claims 30, 35, and 36, further in view of Samec et al. (US 2016/0270656; hereinafter "Samec"). In the Advisory Action, the claims were rejected because they failed to comply with 37 CFR 1.121.
By this paper, Applicant resubmits amendments to claims 27 and 30-36, which now comply with 37 CFR 1.121. The substance of the present claims is identical to the claims previously filed in the After Final on January 22, 2025. No claims are presently cancelled or added, and no new matter is added.
Rejections under 35 U.S.C.
§
Although claims 21-26 are allowed, the Office rejects claims 27-36 as unpatentable over Ive in view of Saur (and in some cases, in further view of Samec). Applicant respectfully traverses these rejections.
Notably, the Office states that Applicant's arguments were successful regarding independent claim 21, but that independent claim 27 does not contain the limitations based on which claim 21 is deemed patentable. In particular, the Office states:
claim 27 instead recites that the outward facing video display 'is see- through from the side of the user.' This implies that the display is not necessarily
see-through from the side of the viewer. Claim 27 has no mention of transparency, illumination, or seeing the eyes of the wearer, and therefore remains rejected under
35 USC 103 in view of Ice and Saur supra.
In light of the Office's comments, claim 27 is herein amended to recite a therapeutic training device, comprising: eyeglass frames; an outward facing video display positioned within the eyeglass frames; and a controller coupled to the outward facing video display to control a display of media content on the video display, wherein a level of the media content is selectively adjustable such that the display of media content and eyes of a user are each selectively viewable by a patient when the therapeutic training device is worn by the user, wherein the outward facing video display is see-through from the side of the user.
This clarification shows that the device, as set forth in claim 27, differs substantially from Ive, in which the user can see only an inward-facing screen (which can display the user's surroundings, but which is not see-through to allow the user to see their surroundings directly). Similarly, although an observer of the Ive device can, in some cases, see a representation of the user's eyes on an outward facing screen, the observer cannot see the user's actual eyes, because the display is not transparent. Indeed, if the Ive device were to lose power or malfunction, the wearer would need to remove the device in order to see their surroundings or to allow observers to see their eyes.
The amendments also introduce patentable features of claim 21 (albeit, in different wording) into claim 27.
In light of the foregoing, it is Applicant's belief that the claim set as provided herein overcomes all rejections made by the Office in the Action. Thus, Applicant respectfully submits
that for at least the reasons provided herein, the claim set as provided herein overcomes all rejections made by the Office in the Action.
Applicant also submits that the amendments to the claims are supported by the original disclosure as filed, as evidenced by at least paragraphs [0001] and [0010] of the specification.
CONCLUSION

NEXT OFFICE ACTION: Reasons for Allowance
Claims 21-36 are allowed.
The following is an examiner’s statement of reasons for allowance:
The closest cited prior art reference of record to the instant invention is Ive (US 2024/0012601). Ive discloses a wearable head-mounted display for facilitating enhanced interaction where the wearer’s eyes is displayed on an outward-facing display. However, the head-mounted display of Ive does not disclose at least a video display having a variable transparency, an adjustable brightness to illuminate the eyes of the wearer, and adjusting the transparency or brightness so that an observer can see the eyes of the wearer through the display.
Saur (US 2018/0308451) describes a wearable LCD display with “LCD shutter technology” that can change the opacity of the LCD display. However, Saur the LCD display of Saur is inward-facing and Saur does not contemplate an outward-facing LCD display allowing an outside observer to see the wearer’s eyes.
Samec (US 2016/0270656) was relied upon for its disclosure of illuminating the eyes of the user. However, Samec illuminates the eyes of the user by directing a beam into the eye of the user. Samec does not contemplate illuminating the eyes of the user so that an outside observer can see the wearer’s eyes.
None of the cited prior art references of record, alone or in combination, anticipate or render obvious at least the limitations of “an outward facing video display comprising a transparency that is variable; and a light having an adjustable brightness to illuminate eyes of a wearer, wherein adjusting at least one of the transparency and the brightness allows an observer to see the eyes of the wearer through the outward facing video display” of independent claim 21, or the limitations of “an outward facing video display positioned within the eyeglass frames; and a controller coupled to the outward facing video display to control a display of media content on the video display, wherein a level of the media content is selectively adjustable such that the display of media content and eyes of a user are each selectively viewable by a patient when the therapeutic training device is worn by the user, wherein the outward facing video display is see-through from the side of the user.” of independent claim 27.
The Examiner notes that the term “level of media content” is explicitly defined by the instant specification publication paragraph [0041] as follows: “As used herein, the term “level of media content” is understood to describe a physical characteristic of media content which may be adjusted to increase or decrease a perceivable amount of the displayed media content on a therapeutic training device disclosed herein, including but not limited to an opacity, a brightness, or a transparency of the displayed media content.”
Therefore, no statutory rejections regarding subject-matter eligibility or prior art exist, and claims 21-36 are allowable.
Any comments considered necessary by applicant must be submitted no later than the payment of the issue fee and, to avoid processing delays, should preferably accompany the issue fee.  Such submissions should be clearly labeled “Comments on Statement of Reasons for Allowance.”

CITED REFERENCE SUMMARIES: Ref US20240012601A1: Claims:
A wearable electronic device, comprising: a housing; a wearer-facing camera positioned in the housing and configured to capture first images of a wearer; and an outward-facing display positioned in the housing and configured to display second images based on the captured images.
a wearer-facing camera positioned in the housing and configured to capture first images of a wearer; and
an outward-facing display positioned in the housing and configured to display second images based on the captured images.
The wearable electronic device of claim 1 , further comprising a processor operatively coupled to the wearer-facing camera and the outward-facing display and configured to modify the captured first images to produce the second images.
The wearable electronic device of claim 1 , wherein the second images have the same content as the captured first images.
The wearable electronic device of claim 1 , wherein: the captured first images include video images of the wearer's eyes; and the second images include video images of different eyes that are coordinated with the video images of the wearer's eyes.
the captured first images include video images of the wearer's eyes; and
the second images include video images of different eyes that are coordinated with the video images of the wearer's eyes.
The wearable electronic device of claim 2 , wherein: the wearable electronic device further comprises an outward-facing sensor configured to detect an environmental condition of an environment surrounding the wearable electronic device; and the processor is further configured to modify the captured first images based on the environmental condition.
the wearable electronic device further comprises an outward-facing sensor configured to detect an environmental condition of an environment surrounding the wearable electronic device; and
the processor is further configured to modify the captured first images based on the environmental condition.
The wearable electronic device of claim 5 , wherein: the environmental condition is a lighting condition; and the processor is further configured to modify the captured first images to substantially match the lighting condition.
the environmental condition is a lighting condition; and
the processor is further configured to modify the captured first images to substantially match the lighting condition.
The wearable electronic device 5 , wherein: the environmental condition is a presence of an observer; and the processor is further configured to: determine whether the observer matches a known contact of the wearer; and in response to determining that the observer matches a known contact of the wearer, modifying the captured first images by obscuring identifiable physical features of the wearer.
the environmental condition is a presence of an observer; and
the processor is further configured to: determine whether the observer matches a known contact of the wearer; and in response to determining that the observer matches a known contact of the wearer, modifying the captured first images by obscuring identifiable physical features of the wearer.
determine whether the observer matches a known contact of the wearer; and
in response to determining that the observer matches a known contact of the wearer, modifying the captured first images by obscuring identifiable physical features of the wearer.
A wearable electronic device, comprising: a housing; a first camera positioned in the housing and configured to capture images of a wearer; a second camera positioned in the housing and configured to capture images of an observer; a wearer-facing display positioned in the housing and configured to display first visual output based on the images of the observer; an outward-facing display positioned in the housing and configured to display second visual output based on the images of the wearer; and a processor operatively coupled to the first camera, the second camera, the wearer-facing display, and the outward-facing display.
a first camera positioned in the housing and configured to capture images of a wearer;
a second camera positioned in the housing and configured to capture images of an observer;
a wearer-facing display positioned in the housing and configured to display first visual output based on the images of the observer;
an outward-facing display positioned in the housing and configured to display second visual output based on the images of the wearer; and
a processor operatively coupled to the first camera, the second camera, the wearer-facing display, and the outward-facing display.
The wearable electronic device of claim 8 , wherein the processor is configured to: generate an at least partially virtual scene for display on the wearer-facing display; and integrate the images of the observer into the at least partially virtual scene.
generate an at least partially virtual scene for display on the wearer-facing display; and
integrate the images of the observer into the at least partially virtual scene.
The wearable electronic device of claim 8 , wherein the processor is configured to: generate an at least partially virtual scene for display on the wearer-facing display; and cause the images of the observer to be displayed in a discrete window that overlays the at least partially virtual scene.
cause the images of the observer to be displayed in a discrete window that overlays the at least partially virtual scene.
The wearable electronic device of claim 8 , wherein: the processor is configured to colorize the images of the wearer, thereby producing colorized images of the wearer; and the first visual output comprises the colorized images of the wearer.
the processor is configured to colorize the images of the wearer, thereby producing colorized images of the wearer; and
the first visual output comprises the colorized images of the wearer.
The wearable electronic device of claim 8 , wherein the processor is configured to cause the first visual output and the second visual output to be displayed at substantially the same time.
The wearable electronic device of claim 8 , wherein the processor is configured to: analyze the captured images to detect a first physical characteristic of the wearer; determine whether the first physical characteristic is indicative of a particular expression; and in accordance with a determination that the first physical characteristic is indicative of the particular expression, produce the second visual output by modifying the captured images to exaggerate a second physical characteristic of the wearer.
analyze the captured images to detect a first physical characteristic of the wearer;
determine whether the first physical characteristic is indicative of a particular expression; and
in accordance with a determination that the first physical characteristic is indicative of the particular expression, produce the second visual output by modifying the captured images to exaggerate a second physical characteristic of the wearer.
The wearable electronic device of claim 13 , wherein the processor is further configured to, in accordance with a determination that the first physical characteristic is not indicative of the particular expression, produce the second visual output without exaggerating the second physical characteristic of the wearer.
The wearable electronic device of claim 13 , wherein the first physical characteristic and the second physical characteristic are the same physical characteristic.
The wearable electronic device of claim 15 , wherein the first physical characteristic and the second physical characteristic comprise a size of an eye.
A wearable electronic device, comprising: a housing; a camera positioned in the housing and configured to capture images of a wearer; a sensor configured to detect an environmental condition of an environment surrounding the wearable electronic device; and an outward-facing display positioned in the housing and configured to display visual output based on the captured images.
a camera positioned in the housing and configured to capture images of a wearer;
a sensor configured to detect an environmental condition of an environment surrounding the wearable electronic device; and
an outward-facing display positioned in the housing and configured to display visual output based on the captured images.
The wearable electronic device of claim 17 , wherein: detecting the environmental condition comprises detecting a position of an observer relative to the outward-facing display; and the wearable electronic device is configured to produce the visual output by skewing and/or stretching the captured images in accordance with the detected position.
detecting the environmental condition comprises detecting a position of an observer relative to the outward-facing display; and
the wearable electronic device is configured to produce the visual output by skewing and/or stretching the captured images in accordance with the detected position.
The wearable electronic device of claim 18 , wherein the wearable electronic device is configured to: periodically update the detected position of the observer relative to the outward-facing display; and periodically update the visual output by skewing and/or stretching the captured images in accordance with the updated detected position.
periodically update the detected position of the observer relative to the outward-facing display; and
periodically update the visual output by skewing and/or stretching the captured images in accordance with the updated detected position.
The wearable electronic device of claim 17 , wherein the sensor is selected from the group consisting of: a light detection and ranging sensor; a radio detection and ranging sensor; an optical object detection sensor; and an acoustic object detection sensor.
Ref US20180308451A1: [content unavailable]
Ref US20160270656A1: [content unavailable]
Ref US20240012601: Claims:
1. A wearable electronic device, comprising:
a housing; a wearer-facing camera positioned in the housing and configured to capture first images of a wearer; and an outward-facing display positioned in the housing and configured to display second images based on the captured images.
2. The wearable electronic device of claim 1, further comprising a processor operatively coupled to the wearer-facing camera and the outward-facing display and configured to modify the captured first images to produce the second images.
3. The wearable electronic device of claim 1, wherein the second images have the same content as the captured first images.
4. The wearable electronic device of claim 1, wherein:
the captured first images include video images of the wearer's eyes; and the second images include video images of different eyes that are coordinated with the video images of the wearer's eyes.
5. The wearable electronic device of claim 2, wherein:
the wearable electronic device further comprises an outward-facing sensor configured to detect an environmental condition of an environment surrounding the wearable electronic device; and the processor is further configured to modify the captured first images based on the environmental condition.
6. The wearable electronic device of claim 5, wherein:
the environmental condition is a lighting condition; and the processor is further configured to modify the captured first images to substantially match the lighting condition.
7. The wearable electronic device 5, wherein:
the environmental condition is a presence of an observer; and the processor is further configured to:
determine whether the observer matches a known contact of the wearer; and
in response to determining that the observer matches a known contact of the wearer, modifying the captured first images by obscuring identifiable physical features of the wearer.
8. A wearable electronic device, comprising:
a housing; a first camera positioned in the housing and configured to capture images of a wearer; a second camera positioned in the housing and configured to capture images of an observer; a wearer-facing display positioned in the housing and configured to display first visual output based on the images of the observer; an outward-facing display positioned in the housing and configured to display second visual output based on the images of the wearer; and a processor operatively coupled to the first camera, the second camera, the wearer-facing display, and the outward-facing display.
9. The wearable electronic device of claim 8, wherein the processor is configured to:
generate an at least partially virtual scene for display on the wearer-facing display; and integrate the images of the observer into the at least partially virtual scene.
10. The wearable electronic device of claim 8, wherein the processor is configured to:
generate an at least partially virtual scene for display on the wearer-facing display; and cause the images of the observer to be displayed in a discrete window that overlays the at least partially virtual scene.
11. The wearable electronic device of claim 8, wherein:
the processor is configured to colorize the images of the wearer, thereby producing colorized images of the wearer; and the first visual output comprises the colorized images of the wearer.
12. The wearable electronic device of claim 8, wherein the processor is configured to cause the first visual output and the second visual output to be displayed at substantially the same time.
13. The wearable electronic device of claim 8, wherein the processor is configured to:
analyze the captured images to detect a first physical characteristic of the wearer; determine whether the first physical characteristic is indicative of a particular expression; and in accordance with a determination that the first physical characteristic is indicative of the particular expression, produce the second visual output by modifying the captured images to exaggerate a second physical characteristic of the wearer.
14. The wearable electronic device of claim 13, wherein the processor is further configured to, in accordance with a determination that the first physical characteristic is not indicative of the particular expression, produce the second visual output without exaggerating the second physical characteristic of the wearer.
15. The wearable electronic device of claim 13, wherein the first physical characteristic and the second physical characteristic are the same physical characteristic.
16. The wearable electronic device of claim 15, wherein the first physical characteristic and the second physical characteristic comprise a size of an eye.
17. A wearable electronic device, comprising:
a housing; a camera positioned in the housing and configured to capture images of a wearer; a sensor configured to detect an environmental condition of an environment surrounding the wearable electronic device; and an outward-facing display positioned in the housing and configured to display visual output based on the captured images.
18. The wearable electronic device of claim 17, wherein:
detecting the environmental condition comprises detecting a position of an observer relative to the outward-facing display; and the wearable electronic device is configured to produce the visual output by skewing and/or stretching the captured images in accordance with the detected position.
19. The wearable electronic device of claim 18, wherein the wearable electronic device is configured to:
periodically update the detected position of the observer relative to the outward-facing display; and periodically update the visual output by skewing and/or stretching the captured images in accordance with the updated detected position.
20. The wearable electronic device of claim 17, wherein the sensor is selected from the group consisting of: a light detection and ranging sensor; a radio detection and ranging sensor; an optical object detection sensor; and an acoustic object detection sensor.
Ref US20180308451: Claims:
1. A method for operating a head-wearable presentation apparatus, including the steps of:
capturing data that are representative of at least one state variable of the head of a person wearing the head-wearable presentation apparatus, evaluating the captured data in order to determine the at least one state variable of the head, and modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus if the at least one state variable of the head corresponds to a predetermined state variable.
2. The method as claimed in claim 1, wherein the data that are representative of at least one state variable of the head represent orientation data and the at least one state variable of the head contains the viewing direction of the person wearing the head-wearable presentation apparatus.
3. The method as claimed in claim 2, wherein the data that are representative of at least one state variable of the head also represent position data of the head-wearable presentation apparatus in addition to the orientation data and the at least one state variable of the head also contains the position of the person wearing the head-wearable presentation apparatus in addition to the viewing direction.
4. The method as claimed in claim 2, wherein reference data for the data representing the at least one state variable of the head are captured by targeting a reference point.
5. The method as claimed in claim 1, wherein the data that are representative of at least one state variable of the head contain movement data and/or acceleration data of the head-wearable presentation apparatus and the at least one state variable of the head contains a head movement of the person wearing the head-wearable presentation apparatus.
6. The method as claimed in claim 1, wherein image data are captured, by means of at least one camera that is assigned to the head-wearable presentation apparatus, as data that are representative of the at least one state variable of the head, the at least one state variable of the head contains the viewing direction of the person wearing the head-wearable presentation apparatus and the image data are evaluated for the purposes of determining the viewing direction in order to determine the image content, with a predetermined viewing direction being deduced if a predetermined image content is present, or for the purposes of creating a map of the surroundings in which the orientation and the position of the head of the person wearing the head-wearable presentation apparatus are known.
7. A computer program product with program code for carrying out the method as claimed in claim 1 when the program code is loaded onto a computer and/or executed on a computer.
8. A head-wearable presentation apparatus having a capturing unit with means for capturing data that are representative of at least one state variable of the head of a person wearing the head-wearable presentation apparatus, having an evaluation unit for evaluating the captured data in order to determine the at least one state variable of the head therefrom, and having an actuation unit for modifying a degree of transparency of at least one playback arrangement of the head-wearable presentation apparatus if the at least one state variable of the head corresponds to a predetermined state variable.
9. The head-wearable presentation apparatus as claimed in claim 8, wherein the data represent orientation data and the at least one state variable of the head contains the viewing direction of the person wearing the head-wearable presentation apparatus.
10. The head-wearable presentation apparatus as claimed in claim 9, wherein the data also represent position data of the head-wearable presentation apparatus in addition to the orientation data and the at least one state variable of the head also contains the position of the person wearing the head-wearable presentation apparatus in addition to the viewing direction.
11. The head-wearable presentation apparatus 
[Truncated to input limit]