Patent ID: 12210221

DETAILED DESCRIPTION

An electronic eyewear device with a SMA actuator to apply torque to the eyewear temples. The torque presses the eyewear temples against the side of a user's head for a snug and comfortable fit. The SMA actuator allows one size of eyewear frames to fit a larger range of users, thereby reducing the number of sizes required to be manufactured for the electronic eyewear device.

Additional objects, advantages and novel features of the examples will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The objects and advantages of the present subject matter may be realized and attained by means of the methodologies, instrumentalities and combinations particularly pointed out in the appended claims.

In the following detailed description, numerous specific details are set forth by way of examples to provide a thorough understanding of the relevant teachings. However, it should be apparent to those skilled in the art that the present teachings may be practiced without such details. In other instances, well known methods, procedures, components, and circuitry have been described at a relatively high-level, without detail, to avoid unnecessarily obscuring aspects of the present teachings.

The term “coupled” as used herein refers to any logical, optical, physical or electrical connection, link or the like by which signals or light produced or supplied by one system element are imparted to another coupled element. Unless described otherwise, coupled elements or devices are not necessarily directly connected to one another and may be separated by intermediate components, elements or communication media that may modify, manipulate, or carry the light or signals.

The orientations of the electronic eyewear device, associated components and any complete devices incorporating an eye scanner and camera such as shown in any of the drawings, are given by way of example only, for illustration and discussion purposes. In operation for a particular variable optical processing application, the electronic eyewear device may be oriented in any other direction suitable to the particular application of the electronic eyewear device, for example up, down, sideways, or any other orientation. Also, to the extent used herein, any directional term, such as front, rear, inwards, outwards, towards, left, right, lateral, longitudinal, up, down, upper, lower, top, bottom and side, are used by way of example only, and are not limiting as to direction or orientation of any optic or component of an optic constructed as otherwise described herein.

Reference now is made in detail to the examples illustrated in the accompanying drawings and discussed below.

FIG.1Ais an illustration depicting a side view of an example hardware configuration of an electronic eyewear device100including an optical assembly180A with an image display180C (FIG.2A). Electronic eyewear device100includes multiple visible light cameras114A and114B (FIG.3) that form a stereo camera, of which the first visible light camera114A is located on a right temple110A and the second visible light camera114B is located on a left temple110B (FIG.2A). In the illustrated example, the optical assembly180A is located on the right side of the electronic eyewear device100. The optical assembly180A can be located on the left side or other locations of the electronic eyewear devices100.

The visible light cameras114A and114B may include an image sensor that is sensitive to the visible light range wavelength. Each of the visible light cameras114A and114B has a different frontward facing angle of coverage, for example, visible light camera114A has the depicted angle of coverage111A (FIG.3). The angle of coverage is an angle range in which the respective image sensor of the visible light cameras114A and114B detects incoming light and generates image data. Examples of such visible lights cameras114A and114B include a high-resolution complementary metal-oxide-semiconductor (CMOS) image sensor and a video graphic array (VGA) camera, such as 640p (e.g., 640×480 pixels for a total of 0.3 megapixels), 720p, 1080p, 4K, or 8K. Image sensor data from the visible light cameras114A and114B may be captured along with geolocation data, digitized by an image processor, and stored in a memory.

To provide stereoscopic vision, visible light cameras114A and114B may be coupled to an image processor (element912ofFIG.9) for digital processing and adding a timestamp corresponding to the scene in which the image is captured. Image processor912may include circuitry to receive signals from the visible light cameras114A and114B and to process those signals from the visible light cameras114A and114B into a format suitable for storage in the memory (element934ofFIG.9). The timestamp may be added by the image processor912or other processor that controls operation of the visible light cameras114A and114B. Visible light cameras114A and114B allow the stereo camera to simulate human binocular vision. Stereo cameras also provide the ability to reproduce three-dimensional images of a three-dimensional scene (scene715ofFIG.7) based on two captured images (image pairs758A and758B ofFIG.7) from the visible light cameras114A and114B, respectively, having the same timestamp. Such three-dimensional images allow for an immersive virtual experience that feels realistic, e.g., for virtual reality or video gaming. For stereoscopic vision, the pair of images758A and758B may be generated at a given moment in time—one image for each of the visible light cameras114A and114B. When the pair of generated images758A and758B from the frontward facing field of view (FOV)111A and111B of the visible light cameras114A and114B are stitched together (e.g., by the image processor912), depth perception is provided by the optical assemblies180A and180B.

In an example, the electronic eyewear device100includes a frame105, a right rim107A, a right temple110A extending from a right lateral side170A of the frame105, and a see-through image display180C (FIGS.2A-B) comprising optical assembly180A to present a GUI or other image to a user. The electronic eyewear device100includes the first visible light camera114A connected to the frame105or the right temple110A to capture a first image of the scene. Electronic eyewear device100further includes the second visible light camera114B connected to the frame105or the left temple110B to capture (e.g., simultaneously with the first visible light camera114A) a second image of the scene which at least partially overlaps the first image. Although not shown inFIGS.1A and1B, a high speed (HS) processor932(FIG.9) is coupled to the electronic eyewear device100and is connected to the visible light cameras114A and114B and memory934(FIG.9) accessible to the processor932, and programming in the memory934may be provided in the electronic eyewear device100itself.

Although not shown inFIG.1A, the electronic eyewear device100also may include a head movement tracker (element109ofFIG.1B) or an eye movement tracker (element113ofFIG.2Aor element213ofFIGS.2B and2C). Electronic eyewear device100may further include the see-through image displays180C and D of optical assemblies180A and180B, respectively, for presenting a sequence of displayed images. The electronic eyewear devices100may further include an image display driver (element942ofFIG.9) coupled to the see-through image displays180C and180D to drive the image displays180C and180D. The see-through image displays180C and180D and the image display driver are described in further detail below. Electronic eyewear device100may further include the memory934and the processor932(FIG.9) having access to the image display driver942and the memory934, as well as programming in the memory934. Execution of the programming by the processor932configures the electronic eyewear device100to perform functions, including functions to present, via the see-through image displays180C and180D, an initial displayed image of the sequence of displayed images, the initial displayed image having an initial field of view corresponding to an initial head direction or an initial eye gaze direction as determined by the eye movement tracker113or213.

Execution of the programming by the processor932may further configure the electronic eyewear device100to detect movement of a user of the electronic eyewear device100by: (i) tracking, via the head movement tracker (element109ofFIG.1B), a head movement of a head of the user, or (ii) tracking, via an eye movement tracker (element113ofFIG.2Aor element213ofFIGS.2B and2C), an eye movement of an eye of the user of the electronic eyewear device100. Execution of the programming by the processor932may further configure the electronic eyewear device100to determine a field of view adjustment to the initial field of view of the initial displayed image based on the detected movement of the user. The field of view adjustment may include a successive field of view corresponding to a successive head direction or a successive eye direction. Execution of the programming by the processor932may further configure the electronic eyewear device100to generate successive displayed images of the sequence of displayed images based on the field of view adjustment. Execution of the programming by the processor932may further configure the electronic eyewear device100to present, via the see-through image displays180C and180D of the optical assemblies180A and180B, the successive displayed images.

FIG.1Bis an illustration depicting a top cross-sectional view of optical components and electronics in a portion of the electronic eyewear device100illustrated inFIG.1Adepicting the first visible light camera114A, a head movement tracker109, and a printed circuit board (PCB)140. Construction and placement of the second visible light camera114B is substantially similar to the first visible light camera114A, except the connections and coupling are on the other lateral side170B (FIG.2A). As shown, the electronic eyewear device100includes the first visible light camera114A and a circuit board, which may be a flexible printed circuit board (PCB)140. A first hinge126A connects the right temple110A to a hinged arm125A of the electronic eyewear device100. In some examples, components of the first visible light camera114A, the flexible PCB140, or other electrical connectors or contacts may be located on the right temple110A or the first hinge126A.

Also shown inFIG.1Bis an electrically conductive shield can142coupled to, and disposed between, a RF ground plate144and the PCB140. The shield can142encompasses RF electronic components, such as low-power wireless circuitry924and high-speed wireless circuitry936(FIG.9), and it provides an RF ground to the RF electrical components. The shield can142provides an RF shield to prevent spurious RF signals from emitting outside of the shield can. The shield can142also provides a ground for safety and electro-static discharge protection and can form as part of an antenna design.

As shown, electronic eyewear device100may include a head movement tracker109, which includes, for example, an inertial measurement unit (IMU). An inertial measurement unit is an electronic device that measures and reports a body's specific force, angular rate, and sometimes the magnetic field surrounding the body, using a combination of accelerometers and gyroscopes, sometimes also magnetometers. The inertial measurement unit works by detecting linear acceleration using one or more accelerometers and rotational rate using one or more gyroscopes. Typical configurations of inertial measurement units contain one accelerometer, gyroscope, and magnetometer per axis for each of the three axes: horizontal axis for left-right movement (X), vertical axis (Y) for top-bottom movement, and depth or distance axis for up-down movement (Z). The accelerometer detects the gravity vector. The magnetometer defines the rotation in the magnetic field (e.g., facing south, north, etc.) like a compass that generates a heading reference. The three accelerometers detect acceleration along the horizontal, vertical, and depth axis defined above, which can be defined relative to the ground, the electronic eyewear device100, or the user wearing the electronic eyewear device100.

Electronic eyewear device100may detect movement of the user of the electronic eyewear device100by tracking, via the head movement tracker109, the head movement of the user's head. The head movement includes a variation of head direction on a horizontal axis, a vertical axis, or a combination thereof from the initial head direction during presentation of the initial displayed image on the image display. In one example, tracking, via the head movement tracker109, the head movement of the user's head includes measuring, via the inertial measurement unit, the initial head direction on the horizontal axis (e.g., X axis), the vertical axis (e.g., Y axis), or the combination thereof (e.g., transverse or diagonal movement). Tracking, via the head movement tracker109, the head movement of the user's head further includes measuring, via the inertial measurement unit, a successive head direction on the horizontal axis, the vertical axis, or the combination thereof during presentation of the initial displayed image.

Tracking, via the head movement tracker109, the head movement of the user's head may include determining the variation of head direction based on both the initial head direction and the successive head direction. Detecting movement of the user of the electronic eyewear device100may further include in response to tracking, via the head movement tracker109, the head movement of the user's head, determining that the variation of head direction exceeds a deviation angle threshold on the horizontal axis, the vertical axis, or the combination thereof. In sample configurations, the deviation angle threshold is between about 3° to 10°. As used herein, the term “about” when referring to an angle means±10% from the stated amount.

Variation along the horizontal axis slides three-dimensional objects, such as characters, Bitmojis, application icons, etc. in and out of the field of view by, for example, hiding, unhiding, or otherwise adjusting visibility of the three-dimensional object. Variation along the vertical axis, for example, when the user looks upwards, in one example, displays weather information, time of day, date, calendar appointments, etc. In another example, when the user looks downwards on the vertical axis, the electronic eyewear device100may power down.

As shown inFIG.1B, the right temple110A includes temple body211that is configured to receive a temple cap, with the temple cap omitted in the cross-section ofFIG.1B. Disposed inside the right temple110A are various interconnected circuit boards, such as PCBs or flexible PCBs140, that include controller circuits for first visible light camera114A, microphone(s)130, speaker(s)132, low-power wireless circuitry (e.g., for wireless short-range network communication via BLUETOOTH®), and high-speed wireless circuitry (e.g., for wireless local area network communication via WI-FI® and positioning via GPS).

The first visible light camera114A is coupled to or disposed on the flexible PCB140and covered by a visible light camera cover lens, which is aimed through opening(s) formed in the right temple110A. In some examples, the frame105connected to the right temple110A includes the opening(s) for the visible light camera cover lens. The frame105may include a front-facing side configured to face outwards away from the eye of the user. The opening for the visible light camera cover lens may be formed on and through the front-facing side. In the example, the first visible light camera114A has an outward facing angle of coverage111A with a line of sight or perspective of the right eye of the user of the electronic eyewear device100. The visible light camera cover lens also can be adhered to an outward facing surface of the right temple110A in which an opening is formed with an outward facing angle of coverage, but in a different outwards direction. The coupling can also be indirect via intervening components.

The first visible light camera114A may be connected to the first see-through image display180C of the first optical assembly180A to generate a first background scene of a first successive displayed image. The second visible light camera114B may be connected to the second see-through image display180D of the second optical assembly180B to generate a second background scene of a second successive displayed image. The first background scene and the second background scene may partially overlap to present a three-dimensional observable area of the successive displayed image.

Flexible PCB140may be disposed inside the right temple110A and coupled to one or more other components housed in the right temple110A. Although shown as being formed on the circuit boards140of the right temple110A, the first visible light camera114A can be formed on another circuit board (not shown) in one of the left temple110B, the hinged arm125A, the hinged arm125B, or the frame105.

FIG.2Ais an illustration depicting a rear view of an example hardware configuration of an electronic eyewear device100. As shown inFIG.2A, the electronic eyewear device100is in a form configured for wearing by a user, which are eyeglasses in the example ofFIG.2A. The electronic eyewear device100can take other forms and may incorporate other types of frameworks, for example, a headgear, a headset, or a helmet.

In the eyeglasses example, electronic eyewear device100includes the frame105which includes the right rim107A connected to the left rim107B via the bridge106, which is configured to receive a nose of the user. The right and left rims107A and107B include respective apertures175A and175B, which hold the respective optical elements180A and180B, such as a lens and the see-through displays180C and180D. As used herein, the term lens is meant to cover transparent or translucent pieces of glass or plastic having curved and flat surfaces that cause light to converge/diverge or that cause little or no convergence/divergence.

Although shown as having two optical elements180A and180B, the electronic eyewear device100can include other arrangements, such as a single optical element depending on the application or intended user of the electronic eyewear device100. As further shown, electronic eyewear device100includes the right temple110A adjacent the right lateral side170A of the frame105and the left temple110B adjacent the left lateral side170B of the frame105. The temples110A and110B may be integrated into the frame105on the respective sides170A and170B (as illustrated) or implemented as separate components attached to the frame105on the respective sides170A and170B. Alternatively, the temples110A and110B may be integrated into hinged arms125A and125B attached to the frame105.

In the example ofFIG.2A, an eye scanner113is provided that includes an infrared emitter115and an infrared camera120. Visible light cameras typically include a blue light filter to block infrared light detection. In an example, the infrared camera120is a visible light camera, such as a low-resolution video graphic array (VGA) camera (e.g., 640×480 pixels for a total of 0.3 megapixels), with the blue filter removed. The infrared emitter115and the infrared camera120may be co-located on the frame105. For example, both are shown as connected to the upper portion of the left rim107B. The frame105or one or more of the temples110A and110B may include a circuit board (not shown) that includes the infrared emitter115and the infrared camera120. The infrared emitter115and the infrared camera120can be connected to the circuit board by soldering, for example.

Other arrangements of the infrared emitter115and infrared camera120may be implemented, including arrangements in which the infrared emitter115and infrared camera120are both on the right rim107A, or in different locations on the frame105. For example, the infrared emitter115may be on the left rim107B and the infrared camera120may be on the right rim107A. In another example, the infrared emitter115may be on the frame105and the infrared camera120may be on one of the temples110A or110B, or vice versa. The infrared emitter115can be connected essentially anywhere on the frame105, right temple110A, or left temple110B to emit a pattern of infrared light. Similarly, the infrared camera120can be connected essentially anywhere on the frame105, right temple110A, or left temple110B to capture at least one reflection variation in the emitted pattern of infrared light.

The infrared emitter115and infrared camera120may be arranged to face inwards towards an eye of the user with a partial or full field of view of the eye to identify the respective eye position and gaze direction. For example, the infrared emitter115and infrared camera120may be positioned directly in front of the eye, in the upper part of the frame105or in the temples110A or110B at either ends of the frame105.

FIG.2Bis an illustration depicting a rear view of an example hardware configuration of another electronic eyewear device200. In this example configuration, the electronic eyewear device200is depicted as including an eye scanner213on a right temple210A. As shown, an infrared emitter215and an infrared camera220are co-located on the right temple210A. The eye scanner213or one or more components of the eye scanner213can be located on the left temple210B and other locations of the electronic eyewear device200, for example, the frame105. The infrared emitter215and infrared camera220are like that ofFIG.2A, but the eye scanner213can be varied to be sensitive to different light wavelengths as described previously inFIG.2A. Similar toFIG.2A, the electronic eyewear device200includes a frame105which includes a right rim107A which is connected to a left rim107B via a bridge106. The rims107A-B may include respective apertures which hold the respective optical elements180A and180B comprising the see-through displays180C and180D.

FIG.2CandFIG.2Dare illustrations depicting rear views of example hardware configurations of the electronic eyewear device100, including two different types of see-through image displays180C and180D. In one example, these see-through image displays180C and180D of optical assemblies180A and180B include an integrated image display. As shown inFIG.2C, the optical assemblies180A and180B include a display matrix180C and180D of any suitable type, such as a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, a waveguide display, or any other such display.

The optical assemblies180A and180B also includes an optical layer or layers176A-N, which can include lenses, optical coatings, prisms, mirrors, waveguides, optical strips, and other optical components in any combination. The optical layers176can include a prism having a suitable size and configuration and including a first surface for receiving light from display matrix and a second surface for emitting light to the eye of the user. The prism of the optical layers176may extend over all or at least a portion of the respective apertures175A and175B formed in the rims107A and107B to permit the user to see the second surface of the prism when the eye of the user is viewing through the corresponding rims107A and107B. The first surface of the prism of the optical layers176faces upwardly from the frame105and the display matrix overlies the prism so that photons and light emitted by the display matrix impinge the first surface. The prism may be sized and shaped so that the light is refracted within the prism and is directed towards the eye of the user by the second surface of the prism of the optical layers176. In this regard, the second surface of the prism of the optical layers176can be convex to direct the light towards the center of the eye. The prism can be sized and shaped to magnify the image projected by the see-through image displays180C and180D, and the light travels through the prism so that the image viewed from the second surface is larger in one or more dimensions than the image emitted from the see-through image displays180C and180D.

In another example, the see-through image displays180C and180D of optical assemblies180A and180B may include a projection image display as shown inFIG.2D. The optical assemblies180A and180B include a projector150, which may be a three-color projector using a scanning mirror, a galvanometer, a laser projector, or other types of projectors. During operation, an optical source such as a projector150is disposed in or on one of the temples110A or110B of the electronic eyewear device100. Optical assemblies180A and180B may include one or more optical strips155A-N spaced apart across the width of the lens of the optical assemblies180A and180B or across a depth of the lens between the front surface and the rear surface of the lens.

As the photons projected by the projector150travel across the lens of the optical assemblies180A and180B, the photons encounter the optical strips155. When a particular photon encounters a particular optical strip, the photon is either redirected towards the user's eye, or it passes to the next optical strip. A combination of modulation of projector150, and modulation of optical strips, may control specific photons or beams of light. In an example, a processor controls the optical strips155by initiating mechanical, acoustic, or electromagnetic signals. Although shown as having two optical assemblies180A and180B, the electronic eyewear device100can include other arrangements, such as a single or three optical assemblies, or the optical assemblies180A and180B may have different arrangements depending on the application or intended user of the electronic eyewear device100.

As further shown inFIG.2CandFIG.2D, electronic eyewear device100includes a right temple110A adjacent the right lateral side170A of the frame105and a left temple110B adjacent the left lateral side170B of the frame105. The temples110A and110B may be integrated into the frame105on the respective lateral sides170A and170B (as illustrated) or implemented as separate components attached to the frame105on the respective sides170A and170B. Alternatively, the temples110A and110B may be integrated into the hinged arms125A and125B attached to the frame105.

In one example, the see-through image displays include the first see-through image display180C and the second see-through image display180D. Electronic eyewear device100may include first and second apertures175A and175B that hold the respective first and second optical assemblies180A and180B. The first optical assembly180A may include the first see-through image display180C (e.g., a display matrix, or optical strips and a projector in the right temple110A). The second optical assembly180B may include the second see-through image display180D (e.g., a display matrix, or optical strips and a projector (shown as projector150) in right temple110A). The successive field of view of the successive displayed image may include an angle of view between about 15° to 30°, and more specifically 24°, measured horizontally, vertically, or diagonally. The successive displayed image having the successive field of view represents a combined three-dimensional observable area visible through stitching together of two displayed images presented on the first and second image displays.

As used herein, “an angle of view” describes the angular extent of the field of view associated with the displayed images presented on each of the image displays180C and180D of optical assemblies180A and180B. The “angle of coverage” describes the angle range that a lens of visible light cameras114A or114B or infrared camera220can image. Typically, the image circle produced by a lens is large enough to cover the film or sensor completely, possibly including some vignetting (i.e., a reduction of an image's brightness or saturation toward the periphery compared to the image center). If the angle of coverage of the lens does not fill the sensor, the image circle will be visible, typically with strong vignetting toward the edge, and the effective angle of view will be limited to the angle of coverage. The “field of view” is intended to describe the field of observable area which the user of the electronic eyewear device100can see through his or her eyes via the displayed images presented on the image displays180C and180D of the optical assemblies180A and180B. Image display180C of optical assemblies180A and180B can have a field of view with an angle of coverage between 15° to 30°, for example 24°, and have a resolution of 480×480 pixels (or greater, e.g., 720p, 1080p, 4K, or 8K).

FIG.3shows a cross-sectional rear perspective view of the electronic eyewear device ofFIG.2A. The electronic eyewear device100includes the infrared emitter115, infrared camera120, a frame front330, a frame back335, and a circuit board340. It can be seen inFIG.3that the upper portion of the left rim of the frame of the electronic eyewear device100includes the frame front330and the frame back335. An opening for the infrared emitter115is formed on the frame back335.

As shown in the encircled cross-section4in the upper middle portion of the left rim of the frame, a circuit board, which is a flexible PCB340, is sandwiched between the frame front330and the frame back335. Also shown in further detail is the attachment of the left temple110B to the left temple125B via the left hinge126B. In some examples, components of the eye movement tracker113, including the infrared emitter115, the flexible PCB340, or other electrical connectors or contacts may be located on the left temple125B or the left hinge126B.

FIG.4is a cross-sectional view through the infrared emitter115and the frame corresponding to the encircled cross-section4of the electronic eyewear device ofFIG.3. Multiple layers of the electronic eyewear device100are illustrated in the cross-section ofFIG.4, as shown the frame includes the frame front330and the frame back335. The flexible PCB340is disposed on the frame front330and connected to the frame back335. The infrared emitter115is disposed on the flexible PCB340and covered by an infrared emitter cover lens445. For example, the infrared emitter115is reflowed to the back of the flexible PCB340. Reflowing attaches the infrared emitter115to contact pad(s) formed on the back of the flexible PCB340by subjecting the flexible PCB340to controlled heat which melts a solder paste to connect the two components. In one example, reflowing is used to surface mount the infrared emitter115on the flexible PCB340and electrically connect the two components. However, it should be understood that through-holes can be used to connect leads from the infrared emitter115to the flexible PCB340via interconnects, for example.

The frame back335includes an infrared emitter opening450for the infrared emitter cover lens445. The infrared emitter opening450is formed on a rear-facing side of the frame back335that is configured to face inwards towards the eye of the user. In the example, the flexible PCB340can be connected to the frame front330via the flexible PCB adhesive460. The infrared emitter cover lens445can be connected to the frame back335via infrared emitter cover lens adhesive455. The coupling can also be indirect via intervening components.

In an example, the processor932utilizes eye tracker113to determine an eye gaze direction230of a wearer's eye234as shown inFIG.5, and an eye position236of the wearer's eye234within an eyebox as shown inFIG.6. The eye tracker113is a scanner which uses infrared light illumination (e.g., near-infrared, short-wavelength infrared, mid-wavelength infrared, long-wavelength infrared, or far infrared) to captured image of reflection variations of infrared light from the eye234to determine the gaze direction230of a pupil232of the eye234, and also the eye position236with respect to a see-through display180.

The block diagram inFIG.7illustrates an example of capturing visible light with cameras114A and114B. Visible light is captured by the first visible light camera114A with a round field of view (FOV)111A. A chosen rectangular first raw image758A is used for image processing by image processor912(FIG.9). Visible light is also captured by the second visible light camera114B with a round FOV111B. A rectangular second raw image758B chosen by the image processor912is used for image processing by processor912. The raw images758A and758B have an overlapping field of view713. The processor912processes the raw images758A and758B and generates a three-dimensional image715for display by the displays180.

FIG.8AandFIG.8Billustrate a top cross-sectional view of the hinge126A of the electronic eyewear device100with a SMA actuator800A, where the hinge126A is in a bent position (FIG.8A) and in an open straight position (FIG.8B), respectively. The hinge126A couples the frame105to the temple125A. The SMA actuator800A includes a SMA wire802, a frame SMA mount804, and a temple SMA mount806coupling the frame105to the temple125A. The SMA actuator800A is configured to rotate the hinge126A from the open straight position (FIG.8B) to the bent position (FIG.8A). The hinge126A has a mechanical stop808that contacts a frame surface810when the hinge126A has reached the open position (FIG.8B). The mechanical stop808prevents the hyperextension of the hinge126A and prevents damage to the SMA wire802and SMA mounts804and806. Hyperextension of the hinge occurs when the angle between the inner side of the temple and the frame exceeds 90 degrees.

The frame SMA mount804and the temple SMA mount806provide a mechanical connection of the SMA wire802to the frame105and to the temple125A, respectively. The frame SMA mount804and temple SMA mount806additionally provide an electrical connection of the SMA wire802to frame electronics820and to temple electronics822. The frame electronics820are electrically coupled to the frame SMA mount804by a connector814, and the temple electronics822are electrically coupled to the temple SMA mount806by a connector816. The connectors814and816are configured to transmit electrical current to and from the SMA wire actuator800A. In an example, the frame electronics820controllably provide the current to control a length of the SMA wire802. The connectors814and816include one or more electrical conductors. One or more conductors824is configured to carry power and data signals between the frame electronics820and the temple electronics824.

The hinge126A is free to rotate about a vertical axis in response to externally applied forces, such as a user folding and unfolding the temple125A from the frame105. When an electrical current is transmitted from the frame electronics820and through the SMA wire802, the SMA wire802may heat to a temperature above the SMA wire's802state-transition temperature. If the SMA wire802exceeds this state-transition temperature, the length of the SMA wire802reduces and responsively applies a bias force including torque about the vertical axis of the hinge126A, resulting in the temple125A folding inward towards the frame105. When a user is wearing the eyewear100, the applied current to the SMA wire802causes the temple125A to apply a force to the user's head due to the SMA wire802exceeding the state-transition temperature. This force results in a comfortable and snug fit of the electronic eyewear device100on the user's head and described below with reference toFIG.9andFIG.10. If an electrical current is no longer supplied to the SMA wire802, the SMA wire802maintains its position until a sufficient external force is applied to overcome the tension of the SMA wire802to adjust the hinge126A towards a open or bent position. The torque generated by the SMA actuator800A can be increased by increasing the number of SMA wires802within the actuator800A. In one example, five separate SMA wires802are used to couple the frame105to the temple125A.

The hinge126B and temple125B has the same functionality and construction as the hinge126A and temple125A.

FIG.8CandFIG.8Dillustrate a top cross-sectional view of another example of the hinge126A of the electronic eyewear device100with a rotary SMA actuator800B. The temple125A is shown in a bent position inFIG.8Cand an open straight position inFIG.8D. The rotary SMA actuator800B is disposed within the hinge126A and is electrically coupled to the temple electronics822via a connector818. The connector818is configured to supply an electrical current from the temple electronics822to the rotary SMA actuator800B, such as the electrical current provided by the frame electronics820to the temple electronics822via conductors824. In another example, the rotary SMA actuator800B receives the electrical current directly from the frame electronics820. The rotary SMA actuator800B directly applies a torque to the hinge126A in response to the electrical current. A rotor of the rotary SMA actuator800B is connected to the hinge126A to directly apply torque about the vertical axis of the hinge126A and move the temple125A inward and toward a folded position.

The electrical current is transmitted through a SMA wire (not shown) in the rotary SMA actuator800B, causing the SMA wire to heat to a temperature above the wire's state-transition temperature, similar to the wire802described with respect toFIG.8AandFIG.8B. As the SMA wire exceeds this state-transition temperature, the length of the SMA wire reduces and applies a torque about the vertical axis of the hinge126A, resulting in the temple125A moving inward towards the frame105. When a user is wearing the eyewear100, the current applied to the rotary SMA actuator800B causes the temple125A to apply a force to the user's head due to the SMA wire exceeding the state-transition temperature. This force results in a comfortable and snug fit of the electronic eyewear device100on the user's head. If an electrical current is no longer supplied to the rotary SMA actuator800B, the rotary SMA actuator800B maintains its position until a sufficient external force is applied to overcome the tension of the SMA rotary actuator800B and adjusts the hinge126A towards an open or bent position. The mechanical stop808protects the hinge126B and rotary SMA actuator800B from hyperextension of the hinge126A. The hinge126A is free to rotate about the vertical axis in response to externally applied forces, such as a user folding and unfolding the temple125A from the frame105.

The hinge126B and temple125B has the same functionality and construction as the hinge126A and temple125A.

As illustrated inFIG.9, the processor932is configured to control the SMA actuators800A-B. In one example, the processor932is located in the frame electronics820. In another example, the processor932is located in the temple electronics822. The processor932controls the current to the SMA actuators800A-B to heat the SMA wires above the state-transition temperature to create torque about the hinge126A-B. A SMA wire control program946stored in the memory934is executed by the processor932to control the magnitude of force generated by the SMA actuators800A-B on the temples125A-B, such that the temple force applied to the side of the user's head provides a comfortable and snug fit. In one example, the processor932controls a power supply located in the frame electronics820configured to supply a predetermined current to the SMA actuators800A-B, for example, 1 milliamp, to generate a predetermined movement of the SMA actuators800A-B that result in the temples125A-B moving towards the frame105. The movement of the SMA actuators800A-B causes the respective temple125A-B to bend inwardly and secure the eyewear100against a head of the user. The temple bend is sufficient to secure the eyewear100to different user head sizes.

In another example, the processor932is additionally configured to determine an electrical resistance of the SMA wire802in the actuators800A-B by measuring the voltage and current supplied to the actuators800A-B. Applying current to heat the SMA wire802causes the wire length to decrease and the cross-sectional area of the SMA wire802to increase. This causes the resistance of the SMA wire802to increase. A one-time calibration is done to measure a relationship between the hinge126A-B angular position and the resistance of the SMA wire802. The results are stored in a lookup table of the memory934. The processor932estimates that temples125A-B of the electronic eyewear device100have achieved a snug fit by measuring the SMA wire802resistance, which corresponds to the hinge angular position. The angle at which a snug fit is achieved may vary from user to user. In one example, a snug fit is achieved when the angle between the frame105and the temple125A-B is 88 degrees. In another example, a sensor may be utilized by the processor932, such as an angle sensor coupled to the respective hinge126A-B, to physically determine the hinge126A-B angular position. The sensor measures the angular position of the hinge126A-B and sends a respective signal to the processor932. When the processor932determines that the actuator800A-B has reached a position that remains constant even with increased applied current, the processor932ceases current flow to the actuator800A-B.

The SMA actuators800A-B allow for the electronic eyewear device100to fit a larger range of user's head sizes. The torque applied by the SMA actuator800A-B to the hinge126A-B provides a snug fit for a larger range of users than a standard eyewear hinge system. This allows one size of frames and temples to fit a larger range of users, which in turn reduces the number of sizes needed to be produced, thereby simplifying design, manufacturing, supply chain, and retail operations.

FIG.9depicts additional electronic components disposed in the electronic eyewear device100/200. The illustrated electronic components include the processor932, the memory934, and the see-through image display180C and180D including embedded antennas.

Memory934includes instructions for execution by processor932to implement functionality of eyewear100/200, including instructions for processor932to control in the image715. Processor932receives power from battery (not shown) and executes the instructions stored in memory934, or integrated with the processor932on-chip, to perform functionality of eyewear100/200, and communicating with external devices via wireless connections.

A user interface adjustment system900includes a wearable device, which is the electronic eyewear device100with an eye movement tracker213(e.g., shown as infrared emitter215and infrared camera220inFIG.2B). User interface adjustment system900also includes a mobile device990and a server system998connected via various networks. Mobile device990may be a smartphone, tablet, laptop computer, access point, or any other such device capable of connecting with electronic eyewear device100using both a low-power wireless connection925and a high-speed wireless connection937. Mobile device990is connected to server system998and network995. The network995may include any combination of wired and wireless connections.

Electronic eyewear device100includes at least two visible light cameras114(one associated with one side (e.g., the right lateral side170A) and one associated with the other side (e.g., left lateral side170B). Electronic eyewear device100further includes two see-through image displays180C-D of the optical assembly180A-B (one associated with each side). Electronic eyewear device100also includes image display driver942, image processor912, low-power circuitry920, and high-speed circuitry930. The components shown inFIG.9for the electronic eyewear device100/200are located on one or more circuit boards, for example a PCB or flexible PCB, in the temples110A-B as previously described. Alternatively, or additionally, the depicted components can be located in the temples, frames, hinges, or bridge of the electronic eyewear device100. The visible light cameras114A-B can include digital camera elements such as a complementary metal-oxide-semiconductor (CMOS) image sensor, charge coupled device, a lens, or any other respective visible or light capturing elements that may be used to capture data, including images of scenes with unknown objects.

Eye movement tracking programming945implements the user interface field of view adjustment instructions, including, to cause the electronic eyewear device100to track, via the eye movement tracker213, the eye movement of the eye of the user of the electronic eyewear device100. Other implemented instructions (functions) cause the electronic eyewear device100to determine, a field of view adjustment to the initial field of view of an initial displayed image based on the detected eye movement of the user corresponding to a successive eye direction. Further implemented instructions generate a successive displayed image of the sequence of displayed images based on the field of view adjustment. The successive displayed image is produced as visible output to the user via the user interface. This visible output appears on the see-through image displays180C-D of optical assembly180A-B, which is driven by image display driver942to present the sequence of displayed images, including the initial displayed image with the initial field of view and the successive displayed image with the successive field of view.

As shown inFIG.9, high-speed circuitry930includes high-speed processor932, memory934, and high-speed wireless circuitry936. In the example, the image display driver942is coupled to the high-speed circuitry930and operated by the high-speed processor932to drive the image displays180C-D of the optical assembly180A-B to create the virtual image. High-speed processor932may be any processor capable of managing high-speed communications and operation of any general computing system needed for electronic eyewear device100. High-speed processor932includes processing resources needed for managing high-speed data transfers on high-speed wireless connection937to a wireless local area network (WLAN) using high-speed wireless circuitry936. In certain examples, the high-speed processor932executes an operating system such as a LINUX operating system or other such operating system of the electronic eyewear device100and the operating system is stored in memory934for execution. In addition to any other responsibilities, the high-speed processor932executing a software architecture for the electronic eyewear device100is used to manage data transfers with high-speed wireless circuitry936. In certain examples, high-speed wireless circuitry936is configured to implement Institute of Electrical and Electronic Engineers (IEEE) 802.11 communication standards, also referred to herein as Wi-Fi. In other examples, other high-speed communications standards may be implemented by high-speed wireless circuitry936.

Low-power wireless circuitry924and the high-speed wireless circuitry936of the electronic eyewear device100can include short range transceivers (e.g., UWB or Bluetooth™) and wireless wide, local, or wide area network transceivers (e.g., cellular or WiFi) including antennas. Mobile device990, including the transceivers communicating via the low-power wireless connection925and high-speed wireless connection937, may be implemented using details of the architecture of the electronic eyewear device100, as can other elements of network995.

Memory934includes any storage device capable of storing various data and applications, including, among other things, color maps, camera data generated by the visible light cameras114A-B and the image processor912, as well as images generated for display by the image display driver942on the see-through image displays180C-D of the optical assembly180A-B. While memory934is shown as integrated with high-speed circuitry930, in other examples, memory934may be an independent standalone element of the electronic eyewear device100. In certain such examples, electrical routing lines may provide a connection through a chip that includes the high-speed processor932from the image processor912or low-power processor922to the memory934. In other examples, the high-speed processor932may manage addressing of memory934such that the low-power processor922will boot the high-speed processor932any time that a read or write operation involving memory934is needed.

Server system998may be one or more computing devices as part of a service or network computing system, for example, that include a processor, a memory, and network communication interface to communicate over the network995with the mobile device990and electronic eyewear device100. Electronic eyewear device100is connected with a host computer. For example, the electronic eyewear device100is paired with the mobile device990via the high-speed wireless connection937or connected to the server system998via the network995.

Output components of the electronic eyewear device100include visual components, such as the image displays180C-D of optical assembly180A-B as described inFIGS.2C-D(e.g., a display such as a liquid crystal display (LCD), a plasma display panel (PDP), a light emitting diode (LED) display, a projector, or a waveguide). The image displays180C-D of the optical assembly180A-B are driven by the image display driver942. The output components of the electronic eyewear device100further include acoustic components (e.g., speakers), haptic components (e.g., a vibratory motor), other signal generators, and so forth. The input components of the electronic eyewear device100, the mobile device990, and server system998, may include alphanumeric input components (e.g., a keyboard, a touch screen configured to receive alphanumeric input, a photo-optical keyboard, or other alphanumeric input components), point-based input components (e.g., a mouse, a touchpad, a trackball, a joystick, a motion sensor, or other pointing instruments), tactile input components (e.g., a physical button, a touch screen that provides location and force of touches or touch gestures, or other tactile input components), audio input components (e.g., a microphone), and the like.

Electronic eyewear device100may optionally include additional peripheral device elements919. Such peripheral device elements may include biometric sensors, additional sensors, or display elements integrated with electronic eyewear device100. For example, peripheral device elements919may include any I/O components including output components, motion components, position components, or any other such elements described herein. The electronic eyewear device100can take other forms and may incorporate other types of frameworks, for example, a headgear, a headset, or a helmet.

For example, the biometric components of the user interface field of view adjustment may include components to detect expressions (e.g., hand expressions, facial expressions, vocal expressions, body gestures, or eye tracking), measure biosignals (e.g., blood pressure, heart rate, body temperature, perspiration, or brain waves), identify a person (e.g., voice identification, retinal identification, facial identification, fingerprint identification, or electroencephalogram based identification), and the like. The motion components include acceleration sensor components (e.g., accelerometer), gravitation sensor components, rotation sensor components (e.g., gyroscope), and so forth. The position components include location sensor components to generate location coordinates (e.g., a Global Positioning System (GPS) receiver component), WiFi or Bluetooth™ transceivers to generate positioning system coordinates, altitude sensor components (e.g., altimeters or barometers that detect air pressure from which altitude may be derived), orientation sensor components (e.g., magnetometers), and the like. Such positioning system coordinates can also be received over wireless connections925and937from the mobile device990via the low-power wireless circuitry924or high-speed wireless circuitry936.

According to some examples, an “application” or “applications” are program(s) that execute functions defined in the programs. Various programming languages can be employed to create one or more of the applications, structured in a variety of manners, such as object-oriented programming languages (e.g., Objective-C, Java, or C++) or procedural programming languages (e.g., C or assembly language). In a specific example, a third-party application (e.g., an application developed using the ANDROID™ or IOS™ software development kit (SDK) by an entity other than the vendor of the particular platform) may be mobile software running on a mobile operating system such as IOS™, ANDROID™, WINDOWS® Phone, or other mobile operating systems. In this example, the third-party application can invoke API calls provided by the operating system to facilitate functionality described herein.

FIG.10is a flowchart1000illustrating use of the SMA actuator800A-B to adjust the fit of an electronic eyewear device100to a user. This example process provides for a secure and comfortable fit of the electronic eyewear device100on a user.

At block1002, a user places the electronic eyewear device100on their head with the hinges126A-B in the open position as shown inFIG.8AandFIG.8C.

At block1004, the processor932sends control signals to the frame electronics820, such as the power supply, to send current to the SMA actuator800A-B. In one example, current is conducted through the SMA wire802of the actuator800A from the frame electronics820, such as via connector814and SMA mount804as shown inFIG.8A. In another example, current is supplied by the temple electronics822via connector816and SMA mount806to the SMA wire in the rotary SMA actuator800B shown inFIG.8C. The current may be first supplied from the frame electronics820to the temple electronics822, and then to the rotary SMA actuator800B.

At block1006, the actuator800A-B applies torque about the vertical axis of the hinge126A-B when the SMA wire of the actuator800A-B surpasses the state-transition temperature threshold. The current flowing through the SMA wire increases the temperature of the SMA wire above the state-transition temperature in a few seconds. As the SMA wire exceeds the state-transition temperature, the SMA wire length reduces and applies the torque to the hinge126A-B, resulting in the temples125A-B being urged inward toward the frame to press against the side of the user's head.

At block1008, the actuator800A-B holds its position until sufficient external force is supplied to overcome the tension of the SMA wire and move the hinge126A-B in either direction.

It will be understood that the terms and expressions used herein have the ordinary meaning as is accorded to such terms and expressions with respect to their corresponding respective areas of inquiry and study except where specific meanings have otherwise been set forth herein. Relational terms such as first and second and the like may be used solely to distinguish one entity or action from another without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” “comprising,” “includes,” “including,” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises or includes a list of elements or steps does not include only those elements or steps but may include other elements or steps not expressly listed or inherent to such process, method, article, or apparatus. An element preceded by “a” or “an” does not, without further constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

Unless otherwise stated, all measurements, values, ratings, positions, magnitudes, sizes, and other specifications that are set forth in this specification, including in the claims that follow, are approximate, not exact. Such amounts are intended to have a reasonable range that is consistent with the functions to which they relate and with what is customary in the art to which they pertain. For example, unless expressly stated otherwise, a parameter value or the like may vary by as much as ±10% from the stated amount.

In addition, in the foregoing Detailed Description, various features are grouped together in various examples for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed examples require more features than are expressly recited in each claim. Rather, as the following claims reflect, the subject matter to be protected lies in less than all features of any single disclosed example. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.

While the foregoing has described what are considered to be the best mode and other examples, it is understood that various modifications may be made therein and that the subject matter disclosed herein may be implemented in various forms and examples, and that they may be applied in numerous applications, only some of which have been described herein. It is intended by the following claims to claim any and all modifications and variations that fall within the true scope of the present concepts.