Patent ID: 12210220

DETAILED DESCRIPTION

In the following detailed description of embodiments of the invention, reference is made to the accompanying drawings, in which like references indicate similar elements, and in which is shown by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those of skill in the art to practice the invention. In other instances, well-known circuits, structures, and techniques have not been shown in detail in order not to obscure the understanding of this description. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the invention is defined only by the appended claims.

In one or more embodiments, methods, apparatuses, and systems are described, that provide modularization of an eyewear system for a user. As described in the description of embodiments below, various combinations and configurations of electronics are taught for incorporation into eyewear devices. Some electronics configurations are removably couplable to an eyewear device. In some embodiments, an electronics configuration is built-into an eyewear device. In yet other embodiments, a behind the neck module assembly is releasably couplable with an eyewear device. In various embodiments, the modularized reconfigurable eyewear devices provide information to a user through the eyewear device. As used in this description of embodiments, information includes streaming audio in the form of music, information also includes parameters of a user's biology (e.g., biometrics of physiology, biomechanics, etc.) such as, but not limited to; heart rate, breathing rate, posture, steps, cadence, etc. Information also includes information of interest to a user such as, but not limited to; information on a vehicle that a user is using such as; revolutions per minute (RPM) of a bicycle, engine parameters such as RPM, oil pressure, cooling water temperature, wind speed, depth of water, air speed, etc. In various embodiments, information is presented to a user through an eyewear device by, for example, an audio broadcast that a user hears and a video broadcast to a display that the user sees in the eyewear device, or sees as an image as projected onto a pupil of the user's eye. Thus, information is to be given an expansive meaning within the scope of embodiments taught herein.

FIG.1illustrates a modular reconfigurable eyewear system, according to embodiments of the invention. With reference toFIG.1, a modularized eyewear device is shown in perspective view at100. The modularized eyewear device100has a frame chassis102. In various embodiments, the frame chassis102is ophthalmically constructed to provide frame rim portions that hold lens120and lens122. The lens120and122can provide any of the functions that eyewear devices provide, such as but not limited to, a safety glass lens, a prescriptive lens, a sunglass lens, a welding glass lens, etc. An eyewear device can also contain a single lens instead of the dual lens illustrated. In some embodiments, a nose pad is provided, thereby providing a cushion for the contact zone with a user's nose. In some embodiments, the nose pad is made from a compliant material such as silicon rubber.

A temple104(left temple) and a temple114(right temple) are coupled to the frame chassis102. The temples104and114can be flexibly coupled to the frame chassis102, with hinges as shown in the figure or the temples104and114can be provided with a fixed orientation relative to the frame chassis102.

In various embodiments, one or more temples (104and114) and the chassis frame102can be fitted with electronics as described below. Within the view of100, a left temple insert module (TIM)106is configured with the left temple104and a right temple insert module (TIM)116is configured with the right temple114. Temple insert modules (TIMs) are described more fully in conjunction with the figures below.

With continued reference toFIG.1, a modularized eyewear device is shown in exploded view at130. A frame chassis132is ophthalmically constructed to encircle a lens140and a lens142with a frame rim thereby securing the lens140and the lens142thereto. A brow bar146is fastened to the frame chassis132in various ways, via assembly fasteners, adhesive, etc. A left temple144includes a left temple connector152which is rotatably coupleable with a left chassis connector150. Together, the left chassis connector150and the left temple connector152form a rotatable mechanical and electrical connection between the chassis132and the left temple144, thereby providing one or more electrical pathways to connect the frame chassis132to the left temple144. Similarly, a right temple134is rotatably coupleable to the frame chassis132through a right hinge assembly148.

Note that in some embodiments, a modularized eyewear device is configured such that each temple can be removed from its hinge via an electrical/mechanical connector having one or more electrical contacts, not shown for clarity in the illustration. These electrical contact points can be made using, for example, pins, points, pads, slots, contact devices, etc. For example, the line indicated at154demarcates the mating of the right temple connector with the right temple134. Similarly, the line indicated at156demarcates the mating of the left temple connector152with the left temple144.

Through the provision of electrical/mechanical connectors between each temple, e.g.,134,144and the frame chassis132the temples are interchangeable with the eyewear device. This functionality permits a user to interchange one temple with another. Different temples can be configured with different electronics to provide different functionality as described herein. Either temple can be configured to accommodate various electronics configurations. For example, in one or more embodiments, the right interchangeable temple accommodates an electronics package that can include one or more of; a biometric sensor, a biomechanical sensor, a vehicle sensor, an environmental sensor, a temperature sensor, an acoustic sensor, a motion sensor, a light sensor, a touch sensor, a proximity sensor, a velocity sensor, an acceleration sensor, a rotation sensor, a magnetic field sensor, a global position system (GPS) receiver, cables, microphones, a micro speaker, a source of electrical power (battery), a camera, a micro display, a heads-up display (HUD) module, a multiaxis inertial measurement unit, a wireless communications system. Note that a TIM can also contain the electronics package and sensor(s) described above. In various embodiments, one or more wireless communication system are provided that utilize for example; near-field communications (NFC) using the industrial-scientific-medical (ISM) frequency of 13.56 MHz, the Adaptive Network Topology (ANT) ANT+wireless standard, wireless communications using a Bluetooth standard, a Bluetooth low energy standard (BLE), wireless communication using a Wi-Fi standard, and wireless communication using mobile telephone standards such as for example the 3G, 4G, Long Term Evolution (LTE), 5G, etc. standard or other wireless standards. In some embodiments, electrical pathways from the electronics exit a temple via a sheath cavity and travel into a temple sheath and continue into a brow bar sheath cavity. The right interchangeable temple contains a hinge-connector148that fastens to the brow bar146and chassis frame132.

In one or more embodiments, the right interchangeable temple attaches to the front of the frame chassis via a hinge-connector that allows for power and data transferred to the left interchangeable temple through the modular brow bar. The hinge-connector mechanically interlocks with the frame chassis and allows for power/data connectivity with electrical pin conductors. In one or more embodiments, when positioned in the open direction of wearing, the hinge-connectors sense the open state of the device allowing for power or data transfer. When in the closed position (temples folded inward), the hinge-connector in conjunction with signals received from one or more of proximity sensors and motion sensors will allow the system to sense the user-device interaction state and will deactivate the power or data transfer. This function leads to reduced power consumption when folded and stowed and can lead to automatic power up while a user wears the device on his or her head. In addition to switchable data or power transfer from the hinge-connector, the hinge-connector can provide flexible circuits and wired micro-connectors that provide steady uninterrupted power and or data transfer.

In some embodiments, it is convenient to route electrical pathways within a volume of the brow bar146. In some embodiments, the brow bar146is constructed to provide a channel along its length, within which the electrical pathways are routed. Thus, the brow bar146provides one or more sheaths, channels, etc. along its length within which electrical pathways and sensors can be contained. Examples of electrical pathways are, but are not limited to; wires, printed circuit board, flexible printed circuit board, etc. In various embodiments, it is advantageous to mount one or more sensors to the brow bar146, thereby making an electrical sub-assembly for the frame chassis132. In some embodiments, additional electrical pathways from the frame chassis132are joined with the electrical pathway contained in the brow bar146. In some embodiments, a flexible electronic circuit is adhered to the underside top face of the brow bar and exits the brow bar via the left and right sheath cavities. Alternatively, or in combination, fully embedded flexible electronics may be cast into the brow bar with integrated contact points exiting the brow bar near each hinge. These integrated contact points on both sides of the brow bar allow transmission of data or power when in contact with the integrated contact points of the right and left temple. In addition to facilitating connection to electronics, the brow bar can conceal an optional pupil module by a securing flange and allows the user to view a microdisplay via the brow bar pupil aperture.

In similar fashion the left temple is configured as a left interchangeable temple connected to the front frame of the eyewear with a left hinge-connector. In various embodiments, the left interchangeable temple can contain the same electronics configuration/functionality as the right interchangeable temple or interchangeable temples can contain different electronics configurations and different functionality.

With continued reference toFIG.1, a left temple164and right temple174are configured as shown at160. Each of the temples164and174contain electronics which are configured to provide information and functionality to a user of the eyewear system. As shown at160, the left temple164has a temple door (not shown) removed thereby exposing an electronics package indicated at186. The temple door secures and protects electronics from environmental exposure and hazard. The temple door is secured to the temple assembly with suitable mechanical fasteners for a given application. In some embodiments, the temple door provides a rating with respect to water intrusion via an IP Code from International Protection Marking IEC standard 60529. A source of electrical power (battery) is illustrated at184and an audio speaker and port is illustrated at182. The audio speaker and port182is generally located on a posterior end of a temple and in some embodiments is an integrated directional projection speaker that privately directs sound to a user's ear. Projection stereo speakers can communicate various audio signals to the user, such as but not limited to, voice prompts, streaming music, smart audio assistance, data, etc. Notably, the projection speaker design does not occlude the user's ear. Thus, the user can hear far field sounds and the far field sounds are not degraded as they are with currently available earbud style headphones that occlude a user's ear.

The right temple174is also provided with an electronics package (not shown in the view) contained within the right temple174. The right temple is provided with an audio speaker with audio speaker port184, which can be an integrated directional projection speaker. In one or more embodiments, the right temple174is configured to accommodate an external assembly190that contains a micro display assembly192. Similarly, the left temple could be configured for the external assembly190and the micro display assembly192.

In various embodiments, a micro display assembly, such as192, is a head up display (HUD) Pupil™ Optics Module that houses the optics, electronics, and micro display that form the optical system. The pupil mechanism also may house cables, flexible circuit boards, or wires which exit from a housing into an electronics contact pathway. In one or more embodiments, these electrical pathways are connected to a side of the left temple174to enable the user with a see-through head up display external accessory to enhance a visual component of a mobile reality experience.

In one or more embodiments, wiring which exits the brow bar is concealed in the right and left sheaths of the temples and enters into the right and left temples via the sheath cavities, thereby protecting the wiring from environmental hazards. The area near the contact pathway may also accommodate motion mechanisms for customizing the interpupillary distance of the head-up micro display module.

In different embodiments, the front frame portion, such as102or132(FIG.1) or any similar structure in the figures below, and the right and left temple portions, such as104,114,134,144,164,174(FIG.1) or any similar structures in the figures below, can be part of a set of interchangeable front frame portions and temple portions each having the same or different combinations of devices, accessories, capabilities and/or functions. At least one of an electronics board, microphones, speakers, battery, camera, heads-up display module, wireless Wi-Fi radio, GPS chipset, LTE cellular radio, multiaxis inertial measurement unit, motion sensor, touch sensor, light and proximity sensors, etc. can be included in desired combinations. Electronics can be further included that permit a user to perform at least one of; wirelessly connecting to a cellular service, a smart phone, a smart watch, a smart bracelet, a mobile computer, and a sensor peripheral. The electronics can further include the ability to; view see-through augmented reality images via a modular head up display (HUD), provide stereo audio content, provide voice and audio notification including music through one or more integrated projection micro-speakers. The front frame electrical contact devices and the temple electrical contact devices can include electrical contact points in or near respective hinge connectors for removable electrical contact with each other for electrically transmitting at least one of; power, electrical signals and data between the temple portions and the front frame portion when the contact points are in an electrically closed position. In some embodiments when assembled together, the front frame hinge connectors, the front frame electrical contact devices, the temple hinge connectors and the temple electrical contact devices can form electromechanical hinges, hinge connectors, assemblies or devices. In some embodiments, system electrical power can be turned off by folding the temple portions into a storage position thereby disconnecting the contact points.

In some embodiments, at least one of the front frame electronics and the temple electronics can include at least one of a battery, camera, heads-up display module, controller, digital storage electronics. CPU, projection micro-speaker, microphone, wireless Wi-Fi radio, GPS chipset, LTE cellular radio, multiaxis inertial measurement system or unit, and sensory, motion, touch, light, proximity, temperature and pressure sensors, etc.

In some embodiments, at least one temple can include a temple module insert (TIM) containing selected temple electronics, mounted thereto. In other embodiments, a neck smart cord is electrically connected to a behind the neck electronics module. The neck smart cord has right and left connectors or connector ends for mechanically and or electrically interconnecting the behind the neck electronics module with the right and left temples of an eyewear device.

FIG.2illustrates a reconfigurable component for an eyewear device, according to embodiments of the invention. With reference toFIG.2at200, a temple202is provided with an engagement portion204. A temple insert module, referred to in this description of embodiments as a “TIM” at210is configured to be releasably coupleable with the engagement portion204of the temple202. The TIM210is installed into the temple202as indicated by arrows212aand212b. In various embodiments, the engagement portion204is accomplished by a mechanical connection, such as but not limited to; press fit, clip, mechanical interlock, hook and loop, magnetic surface, external clamp to temple, flange and mechanical coupling to temple, etc. In yet other embodiments the engagement portion204and the TIM210utilize magnetic surfaces, thereby holding the TIM210secure by magnetic attraction. The form of the engagement portion shown at204, as well as the form of any engagement portion illustrated elsewhere in the figures presented herein, is given merely for illustration and does not limit embodiments of the invention. In the view illustrated at200, the TIM210only makes a mechanical connection with the temple202no electrical connection is provided between the TIM210and the temple202.

In some embodiments, the TIM210is provided with a speaker and speaker port214, which can be a micro projection speaker. The speaker provides information to a user through an audio broadcast. Note that the speakers provided herein are speakers that are located externally from a user's ear and are therefore not inserted into the user's ear like an earbud is inserted. The TIM210is configured with an electronics package that contains a processor, memory, electrical power, and one or more wireless communication protocols that enable the TIM210to communicate wirelessly222with one or more devices220. The device220can be an external sensor such as, but not limited to: a biometric sensor or a vehicle sensor, a local user device, a network node, such as a wireless router, a remote network, or a remote user device such as a mobile phone accessed through a network. Different sensors, networks, and remote devices are described more fully in conjunction with the figures below.

Following the architecture ofFIG.2at200, in some embodiments, a second temple and a second TIM are provided. The two TIMs in such a system can engage in wireless communication between the device220and between themselves as needed to provide a level of design functionality to a user. For example, in one embodiment, a left TIM includes wireless network capability sufficient to communicate with the remote device220, utilizing a first network protocol. In addition, the left TIM and the right TIM are provided with wireless network capability that supports communication utilizing a second network protocol. In order to conserve electrical power, the first network protocol has a greater range than the second network protocol because a distance between the left TIM and the remote device is greater than a separation distance between the left TIM and the right TIM (nominally a width of user's head). The architecture illustrated at200is referred to as true wireless because there is no wired connection between the left TIM and the right TIM. In one or more embodiments, an audio stream is provided from a user device to a first TIM utilizing a first wireless network. Then a second wireless audio stream is provided from one TIM to the other TIM utilizing a second wireless network in order to provide the audio stream to each of a left and a right projection speakers of the eyewear device.

The temples and TIMs described at200provide reconfigurable components for eyewear devices as described in conjunction with the figures herein. A forward end206of the temple202is engageable with a frame chassis of an eyewear device as described above with or without a connector between a temple and a frame. Thus, the temple202can attain a fixed position relative to a frame chassis or the temple can be rotatably coupled to the frame chassis depending on a give design of the eyewear.

With reference toFIG.2at250, a temple252is provided with an engagement portion254. A temple insert module, TIM at260, is configured to be releasably coupleable with the engagement portion254of the temple252. The TIM260is installed into the temple252as indicated by arrows262aand262b. In various embodiments, the engagement portion204is accomplished by a combined electrical and mechanical connection. The mechanical connection can be as described in conjunction with2104204such as, but not limited to; press fit, clip, mechanical interlock, hook and loop, etc. In yet other embodiments the engagement portion254and the TIM260utilize magnetic surfaces, thereby holding the TIM260secure by magnetic attraction. A number of electrical contacts280are provided for illustration with no limitation implied thereby. The electrical contacts280mate with corresponding electrical contacts in the temple252thereby providing electrical connection to one or more electrical pathways (not shown) in the temple252. The electrical pathways within the temple252facilitate electrical connection between the TIM260and one or more sensors272and274, which can also represent a source of signals provided to a display(s). The sensors272and274can be acoustic sensors such as microphones or any of the sensors described herein for use in conjunction with electronics packages configured with eyewear devices. In one or more embodiments, one or more of272and274provide signals to a display such as a HUD.

In some embodiments, the TIM260is provided with a speaker and speaker port264, which can be a micro projection speaker. The speaker provides information to a user through an open-ear audio broadcast.

Following the architecture ofFIG.2at250, in some embodiments, a second temple and a second TIM are provided, as shown below inFIG.3. The two TIMs in such a system engage in wireless communication between the device220and between themselves as needed to provide a level of design functionality to a user. The temples and TIMs described at250provide reconfigurable components for eyewear devices as described in conjunction with the figures herein. For example, a forward end256of the temple252is engageable with a frame chassis of an eyewear device as described above with or without a connector between a temple and a frame. Thus, the temple252can attain a fixed position relative to a frame chassis or the temple can be rotatably coupled to the frame chassis depending on a given design of the eyewear.

FIG.3illustrates, at300, multiple reconfigurable components for an eyewear device, according to embodiments of the invention. With reference toFIG.3at300, the left reconfigurable component250fromFIG.2is illustrated with a companion right reconfigurable component for an eyewear device. A right temple352has an engagement portion that is not shown inFIG.3but is similar to the engagement portion254of the left temple252. A temple insert module, TIM at360is configured to be releasably coupleable with the engagement portion of the temple352. The TIM360is couple with the temple352as indicated by arrows362aand362b. In various embodiments, the engagement portion of the temple352is accomplished by a combined electrical and mechanical connection. The mechanical connection can be provided as described above in conjunction with210/204such as, but not limited to; press fit, clip, mechanical interlock, hook and loop, etc. In yet other embodiments the engagement portion of the temple352and the TIM360utilize magnetic surfaces, thereby holding the TIM360secure by magnetic attraction. Several electrical contacts380are provided for illustration with no limitation implied thereby. The electrical contacts380mate with corresponding electrical contacts in the temple352thereby providing electrical connection to one or more electrical pathways (not shown) in the temple352. The electrical pathways within the temple352facilitate electrical connection between the TIM360and one or more sensors372and374. The sensors372and374can be acoustic sensors such as microphones or any of the sensors or displays described herein for use in conjunction with electronics packages configured with eyewear devices. In various embodiments, the TIM360is configured with an electronics package that contains a processor, memory, electrical power, and one or more wireless communication systems using protocols that enable the TIM360to communicate wirelessly as indicated by a wireless transmission at222with one or more devices220. In addition, the TIM360and the TIM260can be configured with wireless communication capability that permits wireless communication between the TIMs as indicated by a wireless transmission at382. In some embodiments, the TIM360is provided with a speaker and a speaker port indicated at364, which can be a micro projection speaker. The speaker provides information to a user through an audio broadcast.

With reference to view390ofFIG.3, electrical connectivity schematics are illustrated for each of TIM260and TIM360. The TIM260is electrically coupled to the sensor272with an electrical pathway394. Similarly, the TIM260is electrically coupled to the sensor274by an electrical pathway392. The connectivity illustrated between the TIM260and the respective sensors constitutes a left temple electrical schematic384. Note that the left temple electrical schematic384can be more complex or less complex that the illustration. Thus, the left temple electrical schematic is provided merely for illustration with no limitation implied thereby.

Similarly, the TIM360is electrically coupled to the sensor372with an electrical pathway398. The TIM260is electrically coupled to the sensor374by an electrical pathway396. The connectivity illustrated between the TIM360and the respective sensors constitutes a right temple electrical schematic386. Note that the right temple electrical schematic386can be more complex or less complex that the illustration. Thus, the right electrical schematic is provided merely for illustration with no limitation implied thereby.

The two TIMs in such a system engage in wireless communication between the device220and between themselves as needed to provide a level of design functionality to a user. For example, in one embodiment, a left TIM includes wireless network capability sufficient to communicate with the remote device220, utilizing a first network protocol. In addition, the left TIM and the right TIM are provided with wireless network capability that supports wireless communication as indicated at382. The wireless communication382can be performed with a second network protocol, which is different from that used at222. In order to conserve electrical power, the first network protocol (222) has a greater range than the second network protocol (382) because a separation distance between the left TIM260and the remote device220is greater than a separation distance between the left TIM260and the right TIM360, the latter is nominally a width of user's head and the former can be as much as a distance to a mobile telephone cellular tower.

FIG.4illustrates another reconfigurable modularized eyewear system, according to embodiments of the invention. With reference toFIG.4, one or more of sensors, power components, and computational units are distributed throughout an eyewear device, including distributed throughout a frame chassis such as402. A frame chassis402is ophthalmically constructed to encircle lens440with frame rims thereby securing the lens440thereto. A left temple404are a right temple414are coupled to the frame chassis402, thereby forming an eyewear device. The left temple404is configured with an engagement portion indicated at408. A left temple insert module (TIM)406is configured as described above to engage with the engagement portion408, thereby providing both mechanical and electrical connection between the TIM406and the temple404. Similarly, a right temple426is illustrated as engaged with the engagement portion of the right temple414. The TIM406contains an audio speaker and audio port indicated at410and the TIM426contains an audio speaker and audio port indicated at430. In various embodiments, the audio speakers of410and430are projection speakers. The eyewear device includes several sensors or display(s),462,464,466,468, and470that are integrated into an electrical pathway that extends from the left temple404through the frame chassis402to the right temple414. In various embodiments there can be more sensors or less sensors that those shown inFIG.4. The sensors and the locations of the sensors shown inFIG.4are provided merely as an illustration and do not limit embodiments of the invention. As described above in conjunction with the previous figures, at least one of the temple insert modules.406and or426, are provided with a suite of electronics necessary to provide wirelessly connectivity222to a device220.

In the eyewear device of400, a high-level view of an electrical pathway schematic is shown at480. With reference to480, the left TIM406and the right TIM426are electrically coupled with sensors462,464,466,468, and470by electrical pathway elements482,484,486,488,490, and492. An electrical pathway element, such as484, electrically connects the sensor464. Together, the components shown in480provide a modularized reconfigurable set of components for an eyewear device. In one or more embodiments, one or more acoustic sensors are located in at least one of, the frame chassis402, the left temple404, and the right temple414. Thus, acoustic sensors can be located anywhere on a temple (left or right) or a frame chassis of the eyewear device.

FIG.5illustrates, generally at500, a perceptive view and a top view of the modularized eyewear system fromFIG.4, according to embodiments of the invention. With reference toFIG.5, a modularized eyewear device is illustrated in perspective view at502. A modularized nose pad504is releasably couplable as indicated at506with the modularized eyewear device502. Modularization of nose pads permits a user to swap nose pads in order to improve the fit between the eyewear and the user's nose and facial structure. A greater level of comfort can be achieved through modularization of the nose pad of the eyewear device. In addition, other sensors such as a biometric sensor can be provided in the nose pad.

FIG.6Aillustrates, generally at600, a system architecture for a modularized eyewear device, according to embodiments of the invention. With reference toFIG.6A, in various embodiments, a modularized reconfigurable eyewear device can contain more than one wireless communication system. In various embodiments, an eyewear device602has a high-level block diagram architecture as shown at604. In various embodiments, the eyewear device602is configured to communicate with a wireless sensor640and a mobile device670. The wireless sensor640can contain a single sensor or a plurality of sensors. The wireless sensor640can contain any one or more of the sensors listed herein without limitation. For example, the wireless sensor640can include a biometric sensor or biomechanical sensor configured for use with a user or a sensor configured for use with a vehicle or building. Some examples of biometric sensors are, but are not limited to; a heart rate monitor, a perspiration sensor, a temperature sensor, etc. Some examples, of vehicle sensors are, but are not limited to; a velocity sensor, an acceleration sensor, a global position system signal, a vehicle engine parameter, a wind speed indicator, etc. Some examples of sensors for use with a building are, but are not limited to; a temperature reading from a thermostat, a water pressure value, etc. Some non-limiting examples of vehicles are, but are not limited to; a scooter, bicycle, an automobile, a boat, a yacht, a watercraft, an airplane, a military vehicle, a wing suit, etc. In some embodiments, data is received at640and or616from a special use network. An example, of a special use network, given for illustration with no imitation implied thereby, is a National Marine Electronics Association (NMEA) NMEA 2000 network designed for watercraft such as yachts (power or sail). NMEA 2000, also referred to in the art as “NMEA2k” or “N2K” is standardized as International Electrotechnical Commission (IEC) 61162-1. NMEA 200 is a plug-and-play communications standard used for connecting marine sensors and display units within ships, boats, yachts, etc. The mobile device670can be any one or more of the mobile devices listed herein without limitation. For example, the mobile device can be a mobile phone, a watch, a wrist band, a bracelet, a tablet computer, a laptop computer, a desktop computer, a vehicle computer, etc.

The eyewear device602has a high-level architecture, represented at604, that contains a speaker606, a central processing unit608, a source of electrical power610, an acoustic sensor608, a storage device614, and a wireless communication system616. Wireless communication system616can contain one or more of the following wireless communication systems, e.g., a near-field communication system618, a wireless communication system utilizing the Bluetooth communication protocol620, a wireless communication system utilizing the Wi-Fi communication protocol at624, a mobile telephone communications protocol622. The wireless communication protocol designated by LTE at622is given merely as an example for wireless devices and does not limit embodiments of the invention. Those of skill in the art will recognize that one or more antennas are included, but not shown for clarity, in the wireless communication system block616.

The wireless sensor640has a high-level architecture, represented at642, that includes one or more sensors644and a wireless communication system646. The wireless communications system646can be a low data rate communications system such as a near-field communications system, BLE, ANT+, or the like. Or the wireless communication system646can be provided as a higher data rate system as required by the sensor(s)644.

The mobile device670has a high-level architecture, represented at672, that includes, a central processing unit674, a source of electrical power676, storage678, and one or more wireless communication systems indicated at the block680. The mobile device670can be optionally configured to reach remote networks as indicated by cloud689. The wireless communication block680can include one or more of the following wireless communication systems, e.g., a near-field communication system682, a wireless communication system utilizing the Bluetooth communication protocol684, a wireless communication system utilizing the Wi-Fi communication protocol at686, and a mobile telephone communications protocol at688. The wireless communication protocol designated by LTE at688is given merely as an example of a communication system for mobile devices and does not limit embodiments of the invention. Those of skill in the art will recognize that one or more antennas are included, but not shown for clarity, in the wireless communication system block680and642.

In some embodiments, the wireless sensor system642and the eyewear device602are configured initially by a user of the mobile device670and the mobile device user interface as indicated by pathways652aand652b. In operation, the eyewear device602receives data wirelessly as indicated at650from a suitable wireless communication system, such as for example a near-field communications system618. Wireless data obtained from the wireless sensor system642can be transmitted to the user device670/672by another wireless communication system such as indicated at654. The wireless communication indicated at654can be accomplished with a higher data rate channel using for example Bluetooth protocol at620/684, or Wi-Fi protocols at624/686, or mobile phone communications protocol indicated at622/688. Data transferred from the eyewear device602can be stored and analyzed on the user device670in various embodiments and with different application programs.

FIG.6Billustrates, generally at690, wireless networks corresponding to the system architecture for the modularized eyewear device ofFIG.6A, according to embodiments of the invention. With reference toFIG.6B, the wireless communication block616can connect to a plurality of devices as shown in the figure. For example, one or more wireless sensors640can connect to the wireless communication block616utilizing low data rate near-field communication networks as indicated at618. One or more user devices670can communicate wirelessly with the wireless communication block using Bluetooth communication protocols as indicated at620. One or more wireless nodes, such as Wi-Fi nodes indicated at692can communicate wirelessly with the wireless communication block616as indicated at624. One or more remote networks694can communicate wirelessly with the wireless communication block616using cellular communication protocols as indicated at622. Thus, a reconfigurable eyewear device can contain one or more of the wireless communication systems shown in the illustration at690. An eyewear device can be reconfigured for different wireless communication by swapping for example one TIM module for another. Alternatively, one or more temples can be swapped with a frame chassis as described above to provide customized functionality to an eyewear device.

FIG.7illustrates, generally at700, another system architecture for the modularized eyewear device ofFIG.4, according to embodiments of the invention. With reference toFIG.7, the wireless communication block616of the eyewear device602can be configured for cellular communications via mobile telephone networks directly without needing a user device to function as an intermediary. For example, in700, the eyewear device602is configured for communication with a remote device702, which can be a mobile telephone, by a wireless communication system622thereby connecting with the remote device702directly through the external networks indicated by cloud704. No intermediary user mobile device is needed to support this line of communication. Such a configuration of an eyewear device allows a user of the eyewear device to make telephone calls from the eyewear device with the assistance of an interface, such as a voice interface, one or more tactile interface like buttons, etc. The voice interface provides command and control of the telephone call by converting the user's voice signals to commands that the device uses to facilitate the operation of the wireless network for the telephone call. Examples of such commands are, but are not limited to; select caller, place call, volume up, volume down, end call, etc.

FIG.8illustrates, generally at800, a block diagram of a temple insert module (TIM), according to embodiments of the invention. With reference toFIG.8, as used in this description of embodiments, a TIM can be based on a device such as a computer, in which embodiments of the invention may be used. The block diagram is a high-level conceptual representation and may be implemented in a variety of ways and by various architectures. Bus system802interconnects a Central Processing Unit (CPU)804(alternatively referred to herein as a processor), Read Only Memory (ROM)806, Random Access Memory (RAM)808, storage810, audio822, user interface824, and communications830. RAM808can also represent dynamic random-access memory (DRAM) or other forms of memory. The user interface824can be in various embodiments a voice interface, a touch interface, a physical button, or combinations thereof. It is understood that memory (not shown) can be included with the CPU block804. The bus system802may be for example, one or more of such buses as a system bus, Peripheral Component Interconnect (PCI), Advanced Graphics Port (AGP), Small Computer System Interface (SCSI), Institute of Electrical and Electronics Engineers (IEEE) standard number 994 (FireWire), Universal Serial Bus (USB), universal asynchronous receiver-transmitter (UART), serial peripheral interface (SPI), inter-integrated circuit (I2C), etc. The CPU804may be a single, multiple, or even a distributed computing resource. Storage810may be flash memory, etc. Note that depending upon the actual implementation of a TIM, the TIM may include some, all, more, or a rearrangement of components in the block diagram. Thus, many variations on the system ofFIG.8are possible.

Connection with one or more wireless networks832is obtained via communication (COMM)830, which enables the TIM800to communicate wirelessly with local sensors, local devices, as well as with remote devices on remote networks. In some embodiments,832/830provide access to remote voice-to-text conversion systems which can be in remote locations for example cloud based.832and830flexibly represent wireless communication systems in various implementations, and can represent various forms of telemetry, general packet radio service (GPRS), Ethernet, Wide Area Network (WAN), Local Area Network (LAN). Internet connection, Wi-Fi, WiMAX, ZigBee, Infrared, Bluetooth, near-field communications, mobile telephone communications systems, such as 3G, 4G, LTE, 5G, etc. and combinations thereof. In various embodiments, a touch interface is optionally provided at824. Signals from one or more sensors are input to the system via829and828. Global position system (GPS) information is received and is input to the system at826. Audio can represent a speaker such as a projection speaker or projection micro-speaker described herein.

In various embodiments, depending on the hardware configuration different wireless protocols are used in the networks to provide the systems described in the figures above. One non-limiting embodiment of a technology used for wireless signal transmission is the Bluetooth wireless technology standard which is also commonly known as IEEE 802.15.1 standard. In other embodiments, the wireless signal transmission protocol known as Wi-Fi is used which uses the IEEE 802.11 standard. In other embodiments, the ZigBee communication protocol is used which is based on the IEEE 802.15.4 standard. These examples are given merely for illustration and do not limit different embodiments. Transmission Control Protocol (TCP) and Internet Protocol (IP) are also used with different embodiments. Embodiments are not limited by the data communication protocols listed herein and are readily used with other data communication protocols not specifically listed herein.

In various embodiments, the components of systems as well as the systems described in the previous figures (such as a temple insert module (TIM)) are implemented in an integrated circuit device, which may include an integrated circuit package containing the integrated circuit. In some embodiments, the components of systems as well as the systems are implemented in a single integrated circuit die. In other embodiments, the components of systems as well as the systems are implemented in more than one integrated circuit die of an integrated circuit device which may include a multi-chip package containing the integrated circuit

FIG.9illustrates a modularized eyewear device fitted with a behind the neck module assembly, according to embodiments of the invention. With reference toFIG.9, at900, a behind the neck module assembly is fitted to a passive set of eyewear. Passive eyewear indicates that there are no electronics located in the eyewear. Alternatively, the eyewear can be active or powered eyewear, as described herein, configured with electronics packaged into one or more temples or temple insert modules (TIMs). The eyewear has a frame chassis902that contains lens906. Coupled to the frame chassis902is a left temple904and a right temple914. The behind the neck module assembly includes a behind the neck electronics pod (ePOD)924, a left temple interlock920a right temple interlock922, a left smart cord926and a right smart cord928. The left smart cord926couples electrically and mechanically the ePOD924to the left temple interlock920and the right smart cord couples electrically and mechanically the ePOD924to the right temple interlock922.

The left temple interlock920contains an acoustic cavity, an audio speaker, and an acoustic port. The acoustic port for the left audio speaker is indicated at930. The left smart cord926contains electrical conductors that provide an audio signal for the audio speaker contained within the left temple interlock920. In one or more embodiments, the audio speaker contained in the left temple interlock is a micro-projection speaker. Similarly, the acoustic port for the right audio speaker is indicated at932. The right smart cord928contains electrical conductors that provide an audio signal for the audio speaker contained within the right temple interlock922. In one or more embodiments, the audio speaker contained in the right temple interlock is a micro-projection speaker

In various embodiments, the ePOD924contains an electronics unit. The electronics unit contains the electronic components and functionality described herein for a temple insert module (TIM). In other words, the electronics unit is a TIM mechanically and electrically packaged for use in a behind the neck module assembly.

Electronics units having different electronic configuration and functionality can be swapped in and out of the ePOD in similar fashion to the way different TIMs are swapped into and out of a temple of an eyewear device.

At950a length adjustment is provided to shorten or lengthen the right smart cord and the left smart cord. A behind the neck electronics pod (ePOD)954is configured with a left smart cord956and a right smart cord958exiting the same end of the ePOD954. Such a configuration of the smart cords956and958permit a slider960to move either away from the ePOD or toward the ePOD. Moving the slider960away from the ePOD954shortens the available free length of the smart cords965/958. Moving the slider960towards the ePOD954increases the available free length of smart cords956/958.

In one or more embodiments, in operation when in an “on” state, audio data is streamed to the electronics unit in the ePOD924and is directed to the left and right speakers for broadcast to a user when the behind the neck module assembly is installed on an eyewear device and the user wears the eyewear device.

FIG.10illustrates, generally at1000, a behind the neck module assembly in perspective view configured with a wearable device, according to embodiments of the invention. With reference toFIG.10, a first sensor1050is illustrated on the ePOD924. A second sensor1052is illustrated incorporated into the right temple interlock922. A third sensor1054is illustrated incorporated into the left temple interlock920. The sensors1050,1052, and1054can be any of the sensors described herein previously described for use in a TIM or directly in electronics built into a temple.

In the embodiment shown inFIG.10, each temple interlock module, i.e.,920and922contains a through hole into which a temple of the eyewear is inserted. In this embodiment, the temple interlock modules920and922are made from a compliant material such as an elastomer or rubber that permits elongation sufficient for a temple to be inserted therethrough. For example, the left temple interlock920contains a through hole1040into which the left temple904is inserted. The right temple interlock922contains a through hole1042into which the right temple914is inserted. Each of the temple interlocks920and922are positioned on a pair of compatible eyewear such that each of the speaker ports930and932are positioned in front of and near to a user's ear. Compatible eyewear is eyewear that is compatible with the mechanical attachment provided by the temple interlocks.

FIG.11illustrates, generally at1100and1150, coupling a temple interlock to a temple according to embodiments of the invention. With reference toFIG.11, at1100a magnetic temple interlock is illustrated. The magnetic temple interlock includes a magnetic region1108on a temple1102of an eyewear device. A temple interlock1104has a corresponding magnetic region1106. In operation, the magnetic regions1106and1108are brought together, thereby causing the magnetic regions1106and1108to attract each other which provides a clamping force between the temple interlock1104and the temple1102. A port of an acoustic cavity that contains a speaker is illustrated at1110.

Another method of clamping is illustrated at1150. A temple interlock1152contains a slot1158between a first side1156aand a second side1156bof compliant material. The geometry of1158,1156a, and1156bforms a U shape into which a temple of an eyewear device can be inserted. The elasticity of the material1152provides a releasable coupling between the temple interlock1152and the temple of the eyewear (not shown). An acoustic port of an acoustic cavity that houses a speaker is indicated at1154.

FIG.12illustrates, generally at1200, coupling a behind the neck module to electronics contained within a temple, according to embodiments of the invention. With reference toFIG.12, a behind the neck module assembly is coupled to electronics contained within a temple. A portion of a behind the neck module assembly is illustrated with a behind the neck electronics pod (ePOD)1220, a left smart cord1222, and a left temple interlock1210. Any of the electronics contained with a temple, as previously described, can be contained directly within a temple without a temple insert module (TIM). Or alternatively, the electronics contained with the temple can be electronics that are part of a TIM, as indicated optionally at1204. In either situation, a temple1202is provided with a number of electrical contacts indicated at1206. A corresponding number of electrical contacts1208are provided in the left temple interlock1210. A mechanical interlock between the temple1202and the left temple interlock1210is provided to make the connection between1210and1202releasably couplable. In one or more embodiments a magnetic coupling is provided near or at the location of1206/1208to provide a releasable coupling thereto.

FIG.13illustrates, generally at1300, a schematic for combining a behind the neck module assembly with temple electronics, according to embodiments of the invention. With reference toFIG.13, an outline of an eyewear device is indicated at1302. The eyewear device1302contains electronics and or electronic pathways in a left temple, a right temple, and a frame chassis. The outline1302encompasses the frame chassis, left temple, and right temple. In the system depicted in the figure, an electronics path1308extends between the left temple and the right temple of the eyewear device1302.

The eyewear device contains a left temple insert module (TIM)1304located in a left temple and a right TIM1306located in a right temple. A behind the neck module assembly with electronics unit (ePOD) is indicated at1310. A left smart cord1312provides an electrical pathway between the ePOD1310and the left TIM1304. A right smart cord1314provides an electrical pathway between the ePOD1310and the right TIM1306. In various embodiments both the left TIM1304and the right TIM1306are configured with one or more wireless communication network systems that permit wireless communication between the left TIM1304and the right TIM1306as indicated at1316. A remote device1320is representative of one or more wireless sensors or wireless user devices as described above in conjunction with the preceding figures. Wireless communication1322is accomplished between the remote device1320and at least one of the left TIM1304, the right TIM1306, and the ePOD1310. All of the electronic system functionality described above with respect to a TIM is applicable to an ePOD such as ePOD1310.

In some embodiments, a left temple is not electrically connected to a right temple, in such as case the electrical path1308is removed from the electrical schematic shown in1300.

FIG.14illustrates, generally at1400, a user interface on a behind the neck module assembly, according to embodiments of the invention. With reference toFIG.14, a behind the neck electronics pod (ePOD) is illustrated at1402. The ePOD1402has a display interface1404. The display interface1404can be implemented in various ways in different embodiments. In some embodiments the user interface is a tactile surface button. In some embodiments, the user interface is implemented with a touch screen, such as a capacitive touch screen presenting one or more controls to a user. In some embodiments, the user interface communicates information to a user. In yet other embodiments, the user interface communicates information to a person who views the user interface1404from behind the user who is wearing the ePOD1402. An example of such information is, but is not limited to, an emoji, mood status, icon, etc. as indicated at1406.

FIG.15illustrates, generally at1500, a block diagram for a behind the neck electronics unit, according to embodiments of the invention. With reference toFIG.15, as used in this description of embodiments, a behind the neck electronics unit can be based on a device such as a computer, in which embodiments of the invention may be used. The block diagram is a high-level conceptual representation and may be implemented in a variety of ways and by various architectures. Bus system1502interconnects a Central Processing Unit (CPU)1504(alternatively referred to herein as a processor), Read Only Memory (ROM)1506, Random Access Memory (RAM)1508, storage1510, audio1522, user interface1524, and communications1530. RAM1508can also represent dynamic random-access memory (DRAM) or other forms of memory. The user interface1524can be in various embodiments a voice interface, a touch interface, a physical button, or combinations thereof. It is understood that memory (not shown) can be included with the CPU block1504. The bus system1502may be for example, one or more of such buses as a system bus, Peripheral Component Interconnect (PCI), Advanced Graphics Port (AGP), Small Computer System Interface (SCSI), Institute of Electrical and Electronics Engineers (iEEE) standard number 994 (FireWire), Universal Serial Bus (USB), universal asynchronous receiver-transmitter (UART), serial peripheral interface (SPI), inter-integrated circuit (I2C), etc. The CPU1504may be a single, multiple, or even a distributed computing resource. Storage1510may be flash memory, etc. Note that depending upon the actual implementation of a TIM, the TIM may include some, all, more, or a rearrangement of components in the block diagram. Thus, many variations on the system ofFIG.15are possible.

Connection with one or more wireless networks1532is obtained via communication (COMM)1530, which enables the TIM1500to communicate wirelessly with local sensors, local devices, as well as with remote devices on remote networks. In some embodiments,1532/1530provide access to remote voice-to-text conversion systems which can be in remote locations for example cloud based.1532and1530flexibly represent wireless communication systems in various implementations, and can represent various forms of telemetry, general packet radio service (GPRS), Ethernet, Wide Area Network (WAN), Local Area Network (LAN), Internet connection, Wi-Fi, WiMAX, ZigBee, Infrared, Bluetooth, near-field communications, mobile telephone communications systems, such as 3G, 4G, LTE, 5G, etc. and combinations thereof. In various embodiments, a touch interface is optionally provided at1524. An optional display is provided at1520. Signals from one or more sensors are input to the system via1529and1528. Global position system (GPS) information is received and is input to the system at1526. Audio can represent a speaker such as a projection speaker or projection micro-speaker described herein.

In various embodiments, depending on the hardware configuration different wireless protocols are used in the networks to provide the systems described in the figures above. One non-limiting embodiment of a technology used for wireless signal transmission is the Bluetooth wireless technology standard which is also commonly known as IEEE 802.15.1 standard. In other embodiments, the wireless signal transmission protocol known as Wi-Fi is used which uses the IEEE 802.11 standard. In other embodiments, the ZigBee communication protocol is used which is based on the IEEE 802.15.4 standard. These examples are given merely for illustration and do not limit different embodiments. Transmission Control Protocol (TCP) and Internet Protocol (IP) are also used with different embodiments. Embodiments are not limited by the data communication protocols listed herein and are readily used with other data communication protocols not specifically listed herein.

In various embodiments, the components of systems as well as the systems described in the previous figures (such as a behind the neck electronics unit) are implemented in an integrated circuit device, which may include an integrated circuit package containing the integrated circuit. In some embodiments, the components of systems as well as the systems are implemented in a single integrated circuit die. In other embodiments, the components of systems as well as the systems are implemented in more than one integrated circuit die of an integrated circuit device which may include a multi-chip package containing the integrated circuit

In various embodiments, the descriptions of embodiments provided herein provide reconfigurable components for head wearable devices. Reconfigurable components for head wearable devices include, but are not limited to, removable temples, removable temple insert modules (TIMs), a behind the neck module assembly, an electronics pod ePOD for a behind the neck module assembly and removable electronics units for ePODs.

FIG.16illustrates, generally at1600, a schematic block diagram of system architecture, according to embodiments of the invention. With reference toFIG.16, embodiments of the invention are used in a system architecture that is customized for head wearable devices, such as, but not limited to, smart glasses or other eye-wear devices or head wearable devices. The system architecture described in conjunction with figures below is used in conjunction with the reconfigurable components for head wearable devices described above that include, but are not limited to; removable temples, removable temple insert modules (TIMs), a behind the neck module assembly, an electronics pod ePOD for a behind the neck module assembly, and removable electronics units for ePODs, etc.

With reference toFIG.16, a mobile communications unit (MCU), an MCU with a digital signal processor (DSP) are illustrated in various embodiments inFIG.16at1602. The system1600, in various embodiments, includes one or more of the following sub-blocks:Central Processing Unit (CPU)+DSP chip1634.Voice wake-up chip1608.Universal Serial Bus (USB) type A magnetic pogo pin connector1610for battery charging and signal paths to a computer or a mobile device.A multi-functional button1614.A bi-color light source, such as a light emitting diode (LED) (For example RED and BLUE color)1620.Stereo power amplifier1630to drive 2 speakers1628.Two microphones1604/1606.Sensors:Touch sensor1616.Proximity sensor1618.6-axis sensor (3 axis accelerometer+3 axis gyroscope)1622.3-axis magnetometer1620.

In some embodiments, the core of the hardware architecture is a single chip with CPU, digital signal processor, and Bluetooth RF modules inside the device. CPU and DSP (1634) can be a separate chip or can be integrated into a single chip. In some embodiments, an integration of the DSP into the CPU is adopted to reduce cost. Note that the list of sub-blocks above is given merely for illustration and that embodiments of the invention may contains more sub-blocks or fewer sub-blocks than those listed above. The interfaces shown herein, such as, general purpose input-output (GPIO), I-squared-c (I2C), Universal Asynchronous Receiver/Transmitter (UART), etc. are shown by way of example and do not limit embodiments of the invention. Embodiments of the invention are readily implemented with different interface and bus standards.

Tasks for the CPU include task scheduling, GPIO control, sensor control data capture and manipulation, Bluetooth Radio Frequency (RF) management and power management. IN various embodiments, the DSP handles signal processing tasks such as noise cancellation, acoustic echo cancellation, cross-talk correction, and all time consuming signal processing algorithms. Bluetooth (BT) RF module1632handles BT wireless communication protocols. In some embodiments, in addition to the Bluetooth module1632, a cellular communications module is added to provide direct cellular telephone communications from the system1600embedded into a head wearable device. In other embodiments, the Bluetooth module1632is replaced by a cellular communications module. Thus, many different configurations of wireless communications are possible with the system1600. The system1600can be configured with various sensors, such as those listed below. Those of ordinary skill in the art will recognize that a system1600can be configured with additional sensors or fewer sensors than those shown in the list below:LED1620—via GPIO output pin.Button1614—via GPIO input pin.Touch sensor166—via GPIOs input and output pins.Voice wake-up chip1608—via GPIO and UART.Proximity sensor1618—via I2C bus.Microphone1604/1606& speaker1628—via analog-digital-converter (ADC)1640and digital-to-analog-converter (DAC)1636.6+3 axis sensors—via I2C bus.

FIG.17illustrates a schematic block diagram for wakeup control, according to embodiments of the invention. Referring toFIG.17, the system1702will enter sleep mode1704in order to save battery power. A voice wake-up chip, such as for example1608, is used to detect a wake-up word1710(for example “SOLOS” spoken by a user and received on a microphone such as1604). If the wake-up word1710is detected at1608, the CPU/System is powered up and moves to a “RUN” state as indicated at1706.

The systems1700,1702or1600illustrated in conjunction withFIG.16andFIG.17, utilize an embedded speech recognition system1608. Examples, of embedded speech recognition systems for use in embodiments of the invention are, but are not limited to, the embedded speech recognition systems from NUANCE such as the VoCon Hybrid, etc. or embedded speech recognition systems from other manufacturers. The data sheet for the NUANCE VoCon Hybrid is included herein as APPENDIX 1.

Referring toFIG.16andFIG.17, in operation, when idle, the System1702is in “SLEEP” mode whereas the DSP VoCon1608is always “ON” so that it can detect the wake-up word1710via an input from the connected microphone1604. When the DSP VoCon system1608detects the wake-up word1710, a wakeup control signal1714is sent to move the System1702from “SLEEP” mode1704to “RUN” mode1706.

The embedded speech recognition system1608is used to process wake-up word(s)1710and it is also used for command and control of the head wearable device from commands extracted from a user's speech.

In various embodiments, the components of system shown inFIG.16and/orFIG.17are implemented in an integrated circuit device, which may include an integrated circuit package containing the integrated circuit. In some embodiments, the components of the system(s) are implemented in a single integrated circuit die. In other embodiments, the components of the system(s) are implemented in more than one integrated circuit die of an integrated circuit device which may include a multi-chip package containing the integrated circuit.

In various embodiments, six (6) axis sensors, illustrated at1624, and three (3) axis sensors, illustrated at1622, are used to perform heading, tracking, and e-compass functions. In one embodiment, provided merely tor illustration and with no limitation implied thereby, the sensors capture the following nine (9) axis data (at rate of 10 samples/second) which can be used by a mobile communications unit (MCU)1602to calculate movement of a user's head. The nine (9) axes of data are, but are not limited to: acceleration data measured from accelerometers along X, Y, and Z axes; gyroscope data from X, Y, and Z axes; and magnetometer data from X, Y, and Z axes. It is understood by those of ordinary skill in the art that X. Y, and Z axes imply an orthogonal coordinate system. In some embodiments, these sensor data are used to track the trajectory of user's movement while wearing a head wearable device.

FIG.18illustrates, generally at1800, a state diagram for button operation, according to embodiments of the invention. A button, such as1614inFIG.16, is designed to support multiple purpose functionality. In one or more embodiments, the descriptions of the functions supported by a single button, a touch slider, and a proximity sensor are illustrated by way of example. Other functionality can be provided by the button, touch sensor, and proximity sensor. Different numbers of buttons, sliders, and sensors can also be provided in various embodiments in order to provide the needed functionality for a given head wearable device. The functionality and state diagrams presented herein are provided merely by way of example and do not limit embodiments of the invention. Power ON/OFF Function1802/1804is illustrated as follows:a) A power “ON” state at1802is entered with a short press of the “Power Button” for a predetermined time (in one or more embodiment the predetermined time is two (2) seconds) until an “ON” indication light is activated. In one or more embodiments, the “ON” indication light is a blue colored light, in the “ON” state1802a user can, through voice command ask the system what the battery power level is at. For example, a system can be configured to return battery power level quantized to different granularity. One example is a quantization to three (3) battery power levels, i.e, low, medium, high. Other quantizations are possible, and this example using three battery power levels is given merely for illustration with no limitation implied thereby. Alternatively, the system can be configured to notify the user of the current battery power level via machine generated audible voice message.b) A power “OFF” state at1804is entered with a long press of the “Power Button” for a predetermined time (in one or more embodiment the predetermined time is three (3) seconds) until a an “OFF” indication light is activated. In one or more embodiments, the “OFF” indication light is a red colored light. The system can be configured to notify the user that the system is powering down to the “OFF” state via machine generated audible voice message.The pairing/unpaired functions1806/1807with a device, such as a mobile phone, are illustrated as follows:i. A press of the “Power Button” for a time longer than is required to move to the OFF state, results in “PAIRING” the system to a mobile device. For the purpose of the example given herein, 5 seconds is a suitable time to configure the system for “PAIRING,” noting that 5 seconds is longer than the time (2 seconds) required to move the system to the OFF sate. Thus, in operation, a user depresses the “Power Button” until a blue colored light and a red colored light blink alternatively which will pair the system with a mobile device, indicated at1806. After pairing, the system will play a machine generated voice prompt telling the user that pairing was successful. The system can be moved to the “UNPAIR” state at1807by depressing the power for a time longer than is required for pairing. Thus eight (8) seconds would accomplish moving the system to the “UNPAIR” state at1807. Different times can be chosen and those predetermined times given herein are given merely for an example and do not limit embodiments of the invention.ii. After pairing successfully, a user can play music at1808and make a phone call at1810utilizing a wireless connection between the head wearable device and a mobile phone or an MCU (generically referred to as a device). Head wearable devices, such as Smart Glasses will be turned off automatically after a preset time if the connection fails. In one embodiment, provided merely for example the preset time is three (3) minutes.iii. When music is playing through the smart glasses at1808, a short press of the button will advance to the next song at1812. In one embodiment, provided merely for illustration, and with no limitation implied thereby, a short press of the button necessary to advance to the next song is less than two (2) seconds.iv. When there is an incoming call during music playback or when in the idle state, a short press the button for less than a predetermined time will answer the call at1814. For the purpose of illustration, and with no limitation implied thereby, a predetermined time for a short press of the button is less than 2 seconds. In case a user presses the button longer than the predetermined time, then the call is rejected at1816.

FIG.19illustrates, generally at1900, a state diagram for touch sensor operation, according to embodiments of the invention. In one or more embodiments, a touch sensor is configured with concurrent “slider” functionality and “tap” functionality. An example of a touch sensor is1616inFIG.16.

In one or more embodiments, provided merely for example, and with no limitation implied thereby, a touch sensor supports two functions: touch slider, single tap and double tap operations. In other embodiments, a touch sensor can be configured to support more or less functionality than that of the sensor described herein. With reference toFIG.19, a state diagram corresponding to touch sensor operations is illustrated. Volume control by slider1930is configured on an eyewear device1940. The slider1930is configured to accept a “sliding” input registered by a user sliding a finger along the sensor region. In this example, the volume control has 8 levels (level 1 . . . level 8). A “quick slide” imparted to the touch slider results in an increase or a decrease in the volume by 1 level depending on a direction of the “quick slide.” For example, if a current volume is at level 3, a quick slide forward1952/1954increases the volume1904changing the volume from level 3 to level 4, where 1 represents minimum volume and 8 represents maximum volume. Similarly, a quick slide backward from level 3 results in a decrease in volume1906changing the volume thereby from level 3 to level 2.

“Slow slide” applied by a user to the touch slider means increase or decrease the volume continuously. For example, if the current volume is at level 3, a slow slide forward to the end of the touch sensor region increases volume1904, changing it from level 1 to level 8. A slow slide forward to a middle of the touch sensor region, increases volume1904, changing the volume from a level 1 to a level 4.

When the volume is at level 4, slow slide backward1962/1964to the end of the sensor region, decreases volume1906, changing the volume from a level 4 to a level 1.

From an incoming phone call state1920, sliding forward1952/1954results in answering an incoming call at1924. From the incoming phone call state1920, sliding backward1962/1964results in rejection of an incoming call at1922.

A double tap executed by a user on the touch slider region1930of the smart glasses1940is used to activate or deactivate the wake-up chip. In one or more embodiments, if voice wake-up is in an “OFF” state then a double tap applied to the touch slider region changes the voice wake-up to an “ON” state1910. Similarly, if voice wake-up is in an “ON” state1910, then a double tap applied to the touch slider region changes the voice wake-up to the “OFF” state1902.

In various embodiments, a single tap is used to play music by moving the system to a music “PLAY” state1902or to enter a music “PAUSE” state1908, where music play is paused pending further input from the user. When in the “PAUSE” state, a subsequent single tap from the user moves control back to the “PLAY” state and music play resumes at1902. Additional state changes are accomplished by subsequent single taps to move between PLAY” to PAUSE” and vice versa as desired.

FIG.20illustrates a state diagram, generally at2000, for proximity sensor operation, according to embodiments of the invention. In various embodiments, a proximity sensor (such as1618inFIG.16) is used to detect whether a user is wearing the head wearable device or has taken the head wearable device (eyewear) off. In one example, given merely for illustration, and with no limitation implied thereby, the logic for the sensor operation proceeds as follows. If the output of the proximity sensor is a “1” that means that the user is wearing the eyewear2002. If the output of the proximity sensor is a “0” that means that the user has removed the eyewear2004.

Logic is configured to turn “OFF” music play when the user removes the eyewear from the user's head. For example, if user has put on the eyewear2002, then music will “PLAY” at2006controlled by either of the sensors described above that control the music play functionality. If the user removes the eyewear2004, the proximity sensor will output “0,” when the “0” output has lasted for more than a predetermined time, the music will “STOP” and the system will enter a “PAUSE” state2008for music play. In one or more embodiments, the predetermined time required for the music to stop playing is five (5) seconds. The music will resume “PLAY” state2006if the user puts the eyewear back on, in which case the proximity sensor output changes to “1.”

If the eyewear should remain off of the user's head for more than a predetermined time, then the system is powered down into an “OFF” state at2010. In one or more embodiments, the predetermined time required to power the system down while the user is not wearing the eyewear is ten (10) seconds or more. Those of ordinary skill in the art will recognize that the predetermined times given above are examples and that different predetermined times can be used in various embodiments. No limitation is implied by the times selected for the examples given herein.

FIG.21AthroughFIG.21Dillustrate locations for the touch sensor and the multi-function button. With reference toFIG.21A, an eyewear device is illustrated at2102in perspective view with rear orientation. A multifunction button2106is shown located on an underside of a right temple2108. A touch sensor area2104is shown located on an outer surface of the right temple2108. Both the multifunction button2106and the touch sensor area2104provide functionality as described in conjunction with the figures above.

With reference toFIG.21B, an eyewear device2252is illustrated in a forward oriented perspective view at2200and in side view at2275. A multifunction button2276is shown located on an underside of a right temple2278of the eyewear device2252. A touch sensor area2254is shown located on an outer surface of the right temple2278. Both the multifunction button2276and the touch sensor area2254provide functionality as described in conjunction with the figures above.

With reference toFIG.21C, an eyewear device is illustrated in side view at2300. A touch sensor area2304is illustrated as a rectangular area on an outer side of the right temple2378. Note that the touch sensor area2304can be provided in shapes other than rectangular. A rectangular shape for2304is provided merely for illustration with no limitation implied thereby. A user utilizes a finger2306to slide forward or backward to control volume as described above in conjunction with the preceding figures and to initiate taps as described above.

With reference toFIG.21D, an eyewear device2402is illustrated in a side view at2400. A multifunction button2404is illustrated on an under side of a right temple2478. A user utilizes a finger2406to depress the button2404as described above in conjunction with the preceding figures in order to control functions of the eyewear system in2402.

Note that the multi-function button and or the touch sensor area can be located in other positions on the head wearable device, such as, for example, on an outer surface of a temple, on a top surface of a temple, or on a left temple.

For example, in one or more embodiments, a multifunction button is located on a top surface of a right temple. In use, a user grasps the right temple with two fingers, one finger placed on a bottom surface of the temple and the other finger placed against a top surface of the temple. For example, in one scenario, the user places a right thumb against the underside of the right temple, a right middle finger is placed on a top surface of the right temple thereby grasping the right temple. With the right index finger the user can operate the multifunction button. Arranged in this fashion the multifunction button is set back from a plane of the front frame such that the button is aligned with and operable by the user's index finger when the temple as grasped as described above.

In various embodiments, such an arrangement of the multifunction button is more easily operated when the user is undergoing an activity such as bicycle riding and the user is operating the multifunction button.

In some embodiments, a bump, depression, or other shape of alignment mark is fashioned into the temple to serve as an alignment location for a user's finger or fingers relative to a location of the multifunction button. Placing a multifunction button a specified distance from an alignment location permits a user to quickly find the multifunction button when the eyewear is on the user's head. In some embodiments, the alignment is provided when a user grasps a temple with thumb and middle finger at the junction of the temple and the front frame.

While the multifunction button is shown on the right temple, the multifunction button can also be located on a left temple of the eyewear device. A left-handed user might prefer to have the multifunction button as well as the touch sensor located on a left temple, while a right-handed user might prefer to have the multifunction button and the touch sensor located on a right temple. Thus, embodiments of the invention are configured in either button/temple configuration.

Gesture Detection

In various embodiments, the hardware architecture includes a touch sensor and a multi-axis motion sensor as described above. In some embodiments, a nine (9) axis motion sensor is used. The sensor data is used to detect various head gestures. Once a head gesture is detected, a corresponding action will be taken by the system. In one example, when a phone call comes in, a user can nod his or her head in one direction, such as up and down to answer the call. Similarly, a head shake left-to-right or right-to-left is interpreted by the system to reject the call. For example, a phone call comes in, a user can put his or her finger on the touch sensor and then nod his or her head down to pick up the phone call. Or with a finger on the touch sensor, the user shakes his or her head to reject the call.

In some embodiments, the multi-axis sensor is used for posture detection of the user. In various embodiments, the sensors collect accelerometer data, gyroscope data, and magnetometer data and then pass the data to the system for processing using a software algorithm running on a central processing unit (CPU), DSP, etc. as described in conjunction with the figures above In some embodiments, sensors are configured using three orthogonal axes. These data are processed using one or more of; a software algorithm, a CPU, and a DSP to detect the posture of the user's head. In various embodiments, when the user's head is not in a proper position for a long time, a voice message is generated and broadcast via the speaker to the user. Such communications to the user permit the user to take corrective action and improve posture for example.

Audio Content

As described above, in various embodiments, a head wearable device is used in conjunction with a mobile device to facilitate phone calls with the system that is configured into the head wearable device (eyewear device). Content, such as music can be streamed via a mobile device to a head wearable device. The content stream can also originate in the “cloud,” i.e., the Internet, or local network and be streamed to the head wearable device. In addition, local storage configured either with the system (FIG.16) or configured on the head wearable device for use by the system (FIG.16) can be used to provide a source of content that is played for the user through the speaker(s) incorporated with the head wearable device. Thus, in various embodiments, content is played for a user through the head wearable device either in conjunction with a mobile device or in a standalone configuration without the mobile device.

Answering a Phone Call

Phone calls can be answered in various ways in various embodiments. A phone call can be answered and or terminated with the voice interface utilizing the local speech recognition system using control words such as “ANSWER” to receive a call and “GOODBYE,” for example, to end a call. Alternatively, a phone call can be answered with one or more of the physical sensors such as the “touch sensor” and or the “button.” Alternatively, a phone call can be answered through analysis of a head gesture utilizing data output from the accelerometers, gyroscope, etc. Note that a combination of one or more of the above (i.e., speech recognition, sensor output, and gesture identification) can be combined to answer a phone call. Similarly, one or more of the above can be combined to provide for selection and or playing of audio content for the user through the system incorporated into the head wearable device.

Command and Control

System control—utilizing a wake-up word to power the system up from a sleep state using a wake-up word, such as for example, “SOLOS”. Content control—“play running music,” “skip song,” “volume up,” “volume down,” etc. Telephone control—such as for example: “make a phone call to ‘name’” (phone number corresponding to ‘name’ e.g., can be selected from contacts), “volume up,” “volume down.” Information control—such as for example: “internet browsing,” checking for “temperature,” check “weather,” “navigation,” etc. These examples have been provided merely for illustration and do not limit embodiments of the invention.

Magnetometer

In various embodiments, a magnetometer is incorporated into a head wearable device. In some embodiments, the magnetometer is a three-axis magnetometer. The magnetometer in the head wearable device is used for navigation to ascertain an orientation of the user to the earth's magnetic field. A magnetometer mounted in a head wearable device, when on a user, has a fixed pointing direction that is aligned with the movement of the user. Thus, a magnetometer's output from a head wearable device will provide a more useful signal then a magnetometer that might be incorporated into a user's mobile phone because the mobile phone is not necessarily aligned with the direction that the user is pointing in.

In various embodiments, a magnetometer's output is used within an application program utilizing a map to display a user's direction and to rotate the digital map as the user's orientation to north changes, for example.

Accelerometer

In various embodiments, one or more accelerometers are provided in the head wearable device. In some embodiments, a three-axis accelerometer is provided.

Gyroscope

In various embodiments, one or more gyroscopes are provided in the head wearable device. In some embodiments, a three-axis gyroscope is provided.

Battery Housed in One or More Temples

In various embodiments, one or more batteries are provided to power the system and the one or more batteries are stored within a volume of a temple or temples. Batteries are constructed with chemistries such as Lithium Ion or other battery chemistries to support long life and to permit many recharge cycles over the life of the battery. Depending on the expected power needs for a head wearable device, several different sized temples can be provided for different applications. For example, some sports events might require six or more hours of “ON” time for a system. In such a situation, a large temple houses a long-life battery. A smaller volume temple will house a smaller battery having a shorter useful time between recharge cycles. Head wearable devices are configured for various uses such as sporting activities, business uses, home, and commercial uses. Some non-limiting examples of sporting activities are, but are not limited to, bicycling, running, skiing, boating, hiking, etc.

System Distribution Across the Head Wearable Device

In one or more embodiments, the electronics system of a head wearable device is distributed across a left temple, a front frame, and a right temple. In one or more embodiments, a left temple houses a battery, one or more microphones, and at least one speaker. A right temple houses a battery, system electronics, one or microphones, and at least one speaker. In some embodiments, electrical connections between components of the system (temples and front frame) are provided in the form of removable connectors. In some embodiments, these connectors can be hinged.

For purposes of discussing and understanding the different embodiments, it is to be understood that various terms are used by those knowledgeable in the art to describe techniques and approaches. Furthermore, in the description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of an embodiment. It will be evident, however, to one of ordinary skill in the art that an embodiment may be practiced without these specific details. In some instances, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring various embodiments. These embodiments are described in sufficient detail to enable those of ordinary skill in the art to practice the invention, and it is to be understood that other embodiments may be utilized and that logical, mechanical, electrical, and other changes may be made without departing from the scope of the present invention.

Some portions of the description may be presented in terms of algorithms and symbolic representations of operations on, for example, data bits within a computer memory. These algorithmic descriptions and representations are the means used by those of ordinary skill in the data processing arts to most effectively convey the substance of their work to others of ordinary skill in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of acts leading to a desired result. The acts are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the discussion, it is appreciated that throughout the description, discussions utilizing terms such as “processing” or “computing” or “calculating” or “determining” or “displaying” or the like, can refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission, or display devices.

An apparatus for performing the operations herein can implement the present invention. This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer, selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but not limited to, any type of disk including floppy disks, hard disks, optical disks, compact disk-read only memories (CD-ROMs), and magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), dynamic random access memories (DRAM), electrically programmable read-only memories (EPROM)s, electrically erasable programmable read-only memories (EEPROMs), FLASH memories, magnetic or optical cards, RAID, etc., or any type of media suitable for storing electronic instructions either local to the computer or remote to the computer.

The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the required method. For example, any of the methods according to the embodiments can be implemented in hard-wired circuitry, by programming a general-purpose processor, or by any combination of hardware and software. One of ordinary skill in the art will immediately appreciate that the embodiments can be practiced with computer system configurations other than those described, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, digital signal processing (DSP) devices, set top boxes, network PCs, minicomputers, mainframe computers, and the like. The embodiments can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.

The methods herein may be implemented using computer software. If written in a programming language conforming to a recognized standard, sequences of instructions designed to implement the methods can be compiled for execution on a variety of hardware platforms and for interface to a variety of operating systems. In addition, the embodiments are not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the embodiments as described herein. Furthermore, it is common in the art to speak of software, in one form or another (e.g., program, procedure, application, driver, . . . ), as taking an action or causing a result. Such expressions are merely a shorthand way of saying that execution of the software by a computer causes the processor of the computer to perform an action or produce a result.

It is to be understood that various terms and techniques are used by those knowledgeable in the art to describe communications, protocols, applications, implementations, mechanisms, etc. One such technique is the description of an implementation of a technique in terms of an algorithm or mathematical expression. That is, while the technique may be, for example, implemented as executing code on a computer, the expression of that technique may be more aptly and succinctly conveyed and communicated as a formula, algorithm, or mathematical expression. Thus, one of ordinary skill in the art would recognize a block denoting A+B=C as an additive function whose implementation in hardware and/or software would take two inputs (A and B) and produce a summation output (C). Thus, the use of formula, algorithm, or mathematical expression as descriptions is to be understood as having a physical representation in at least hardware and/or software (such as a computer system in which the techniques of the present invention may be practiced as well as implemented as an embodiment).

Non-transitory machine-readable media is understood to include any mechanism for storing information (such as program code, etc.) in a term readable by a machine (e.g., a computer). For example, a machine-readable medium, synonymously referred to as a computer-readable medium, includes read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; except electrical, optical, acoustical or other forms of transmitting information via propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.); etc.

As used in this description, “one embodiment” or “an embodiment” or similar phrases means that the feature(s) being described are included in at least one embodiment of the invention. References to “one embodiment” in this description do not necessarily refer to the same embodiment; however, neither are such embodiments mutually exclusive. Nor does “one embodiment” imply that there is but a single embodiment of the invention. For example, a feature, structure, act, etc. described in “one embodiment” may also be included in other embodiments. Thus, the invention may include a variety of combinations and/or integrations of the embodiments described herein.

While the invention has been described in terms of several embodiments, those of skill in the art will recognize that the invention is not limited to the embodiments described, but can be practiced with modification and alteration within the spirit and scope of the appended claims. The description is thus to be regarded as illustrative instead of limiting.