Crown input and feedback for head-mountable devices

A head-mountable device can include a crown module that receives input from a user and provides localized haptic feedback to the user. A magnetic element coupled to a crown can be moved by inducing magnetic fields, and the position and/or movement of the magnetic element can be detected to provide closed-loop control of the induced magnetic fields. The haptic feedback can be effectively perceived by the user at the crown without causing the entire head-mountable device to vibrate against the head and/or face of the user.

TECHNICAL FIELD

The present description relates generally to head-mountable devices, and, more particularly, to crown modules for head-mountable devices.

BACKGROUND

A head-mountable device can be worn by a user to display visual information within the field of view of the user. The head-mountable device can be used as a virtual reality (VR) system, an augmented reality (AR) system, and/or a mixed reality (MR) system. A user may observe outputs provided by the head-mountable device, such as visual information provided on a display. The display can optionally allow a user to observe an environment outside of the head-mountable device. Other outputs provided by the head-mountable device can include speaker output and/or haptic feedback. A user may further interact with the head-mountable device by providing inputs for processing by one or more components of the head-mountable device. For example, the user can provide tactile inputs, voice commands, and other inputs while the device is mounted to the user's head.

DETAILED DESCRIPTION

Head-mountable devices, such as head-mountable displays, headsets, visors, smartglasses, head-up display, etc., can perform a range of functions that are managed by the components (e.g., sensors, circuitry, and other hardware) included with the wearable device. The head-mountable device can provide a user experience that is immersive or otherwise natural so the user can easily focus on enjoying the experience without being distracted by the mechanisms of the head-mountable device.

It can be desirable to provide a mechanism for a user to provide inputs to a head-mountable device to facilitate user interaction with the head-mountable device. It can be further desirable to provide a mechanism for providing feedback to the user. Such feedback can be provided in the form of haptic feedback delivered to the user. However, haptic feedback can feel unpleasant when applied across an entire device that is mounted on a head of the user. Where the user is providing tactile inputs by contacting an input member with another portion of the body, such as a finger or hand, the haptic feedback can be locally applied to that portion of the user's body, so that the haptic feedback is delivered in a way that is effective and pleasant to the user.

Systems of the present disclosure can provide a head-mountable device with a crown module with an input system that allows a user to provide inputs by rotating a crown of the crown module. The head-mountable device can interpret the rotation and/or torque as a user input. The crown module can further include a feedback system that provides localized haptic feedback at the crown. A magnetic element coupled to the crown can be moved by inducing magnetic fields, and the position and/or movement of the magnetic element can be detected to provide closed-loop control of the induced magnetic fields. The haptic feedback can be effectively perceived by the user at the crown without causing the entire head-mountable device to vibrate against the head and/or face of the user.

According to some embodiments, for example as shown inFIG.1, a head-mountable device100includes a frame110that is worn on a head of a user. The frame110can be positioned in front of the eyes of a user to provide information within a field of view of the user. The frame110can provide nose pads or another feature to rest on a user's nose. The frame110can be supported on a user's head with the securement element120. The securement element120can wrap or extend along opposing sides of a user's head. The securement element120can include earpieces for wrapping around or otherwise engaging or resting on a user's ears. It will be appreciated that other configurations can be applied for securing the head-mountable device100to a user's head. For example, one or more bands, straps, belts, caps, hats, or other components can be used in addition to or in place of the illustrated components of the head-mountable device100. By further example, the securement element120can include multiple components to engage a user's head.

The frame110can provide structure around a peripheral region thereof to support any internal components of the frame110in their assembled position. For example, the frame110can enclose and support various internal components (including for example integrated circuit chips, processors, memory devices and other circuitry) to provide computing and functional operations for the head-mountable device100, as discussed further herein. Any number of components can be included within and/or on the frame110and/or the securement element120.

The frame110can include and/or support one or more cameras130. The cameras130can be positioned on or near an outer side112of the frame110to capture images of views external to the head-mountable device100. As used herein, an outer side112of a portion of a head-mountable device is a side that faces away from the user and/or towards an external environment. The captured images can be used for display to the user or stored for any other purpose.

The head-mountable device can be provided with one or more display elements140that provide visual output for viewing by a user wearing the head-mountable device. As shown inFIG.1, one or more optical modules containing display elements140can be positioned on an inner side114of the frame110. As used herein, an inner side of a portion of a head-mountable device is a side that faces toward the user and/or away from the external environment. For example, a pair of optical modules can be provided, where each optical module is movably positioned to be within the field of view of each of a user's two eyes. Each optical module can be adjusted to align with a corresponding eye of the user. Movement of each of the optical modules can match movement of a corresponding camera130. Accordingly, the optical module is able to accurately reproduce, simulate, or augment a view based on a view captured by the camera130with an alignment that corresponds to the view that the user would have naturally without the head-mountable device100.

A display element140can transmit light from a physical environment (e.g., as captured by a camera) for viewing by the user. Such a display element can include optical properties, such as lenses for vision correction based on incoming light from the physical environment. Additionally or alternatively, a display element140can provide information as a display within a field of view of the user. Such information can be provided to the exclusion of a view of a physical environment or in addition to (e.g., overlaid with) a physical environment.

Examples of CGR include virtual reality and mixed reality.

As further shown inFIG.1, the head-mountable device100can include a crown module200that received input from a user and provides feedback to the user. The crown module200can be provided on exterior surface of the head-mountable device100, such as on the frame110. As shown inFIG.1, the crown module200can be provided on a lateral side116that is defined by and outwardly facing surface between the outer side112and the inner side114of the frame110. It will be understood that the crown module200can be provided at any portion of the head-mountable device100, including any portion of the frame110(e.g., outer side112or inner side114) and/or on the securement element120. It will be further understood that multiple crown modules200can be provided by the head-mountable device100. For example, separate crown modules200can be provided on a same side or opposing sides of the head-mountable device100.

Referring now toFIG.2, the crown module200can be provided as a self-contained component that is connected both to other portions of the head-mountable device100. For example, the frame110or another portion of the head-mountable device100can provide a recess118into which the crown module200can be inserted. By providing the crown module200as a self-contained component, the crown module200can be sealed so that its internal components are protected from an external environment.

The crown module200can include one or more attachment elements configured to facilitate mechanical coupling or connection of the crown module200and the frame110by engaging complementary attachment elements of the frame110(e.g., within the recess118). The attachment elements can include protrusions, grooves, locks, latches, snaps, screws, clasps, threads, magnets, and/or pins can be included on the crown module200and/or the frame110for securely attaching the crown module200to the frame110.

The crown module200and the frame110can each include one or more communication interfaces that facilitate a communication link between the crown module200and the frame110(e.g., a controller within the frame110). The communication interfaces can include one or more of a variety of features, such as electrical connectors, pogo pins, conductive surfaces, wireless receivers/transmitters, and/or inductive coupling features (e.g., coils) for communicably coupling the components of the frame110and the crown module200.

Referring now toFIG.3, the crown module200can provide an input system that facilitates receiving input by a user and a haptic feedback system that provides feedback to the user. For the purposes of the following description, the described crown module200is one example of that shown and discussed above with respect toFIGS.1and2. However, certain features of the crown module200, including the external surface geometry, may be simplified or vary with respect to aspects of the crown module200discussed above.

As shown inFIG.3, the crown module200can include a housing210that defines at least a portion of an outer periphery of the crown module200and contains internal components thereof. A crown222can be provided at an exterior portion of the housing210. For example, the crown222can protrude from a surface of the housing210to be accessible by user. The crown222can be connected to a shaft220that extends within the housing210. The crown222and/or the shaft220can be supported relative to the housing210by one or more bearings236that facilitates rotation and/or translation of the crown222and/or the shaft220relative to the housing210.

The housing210can define a first chamber232that is sealed from an external environment. Components of the input system can be positioned within the first chamber232. As such, the components of the input system can be protected from ingress of fluids and/or particles that would interfere with operation of the input system. The first chamber232can be defined at least in part by one or more seal members (e.g., O-rings) that move with the shaft220within the first chamber232of the housing210.

In some embodiments, the crown222may be used to accept rotary input from the user, which may be used to control aspects of the head-mountable device. The crown222may be knurled or otherwise textured to improve grip with the user's finger and/or thumb. In some embodiments, a crown222may be turned by the user to scroll a display or select from a range of values. In other embodiments, the crown222may be rotated to move a cursor or other type of selection mechanism from a first displayed location to a second displayed location in order to select an icon or move the selection mechanism between various icons that are output on the display. The crown may also be used to control the volume of a speaker, the brightness of the display element, visual output of the head-mountable device, or control other hardware settings.

In some embodiments, an optical encoder274may be used to detect the rotational motion of the crown about an axis. More specifically, the example provided below with respect toFIG.3may use an optical encoder274to detect rotational movement, rotational direction and/or rotational speed of a component of the electronic device. Once the rotational movement, rotational direction and/or rotational speed have been determined, this information may be used to output or change information and images that are presented on a display or user interface of the head-mountable device.

As shown in the example embodiment ofFIG.3, the optical encoder274of the present disclosure includes a light source270, an optical sensor272(e.g., photodiode and/or photodiode array), and a shaft220. In some embodiments, the optical encoder274of the present disclosure can utilize an encoding pattern262disposed directly on the shaft220. For example, the encoding pattern262can include a number of light and dark markings or stripes that are axially disposed along the shaft220. Each stripe or combination of stripes on the shaft220may be used to identify a position of the shaft220. For example, as light is emitted from the light source270and reflected off of the shaft220into the optical sensor272, a position, rotation, rotation direction and rotation speed of the shaft220may be determined. Once the rotation direction and speed are determined, this information may be used to output or change information or images that are presented on the display or user interface of the head-mountable device.

In other embodiments, the shape or form of the shaft220of the encoder274may be used to determine a position, rotation, rotation direction and rotation speed of the shaft220. For example, the shaft220may be fluted or have a number of channels that cause the light to be reflected in a number of different directions. Accordingly, a diffractive pattern may be used to determine the rotation, rotation direction and rotation speed of the shaft220.

As shown inFIG.3, a crown assembly may be provided partially within the housing210of the crown module200and may be formed from a crown222disposed at the end of a shaft220. As discussed above, the crown module200includes the optical encoder274that includes a shaft220, a light source270, and an optical sensor272. Although an optical sensor is specifically mentioned, embodiments disclosed herein may use various types of sensors that are arranged in various configurations for detecting the movement described herein. For example, the movement of the shaft220may be detected by an image sensor, a light sensor such as a CMOS light sensor or imager, a photovoltaic cell or system, photo resistive component, a laser scanner and the like.

The optical encoder274may produce an encoder output that is used to determine positional data of the crown222. In particular, the optical encoder274may produce an output that is used to detect that movement of the crown222including the direction of the movement, speed of the movement and so on. The movement may be rotational movement (e.g., about the axis290), translational movement (e.g., along or parallel to the axis290), angular movement (e.g., tilt relative to the axis290), and so on. The optical encoder274may also be used to detect the degree of the change of rotation of the crown222and/or the angle of rotation of the crown222as well as the speed and the direction of the rotation of the crown222. The optical encoder274can be operably connected to a controller250for receiving signals based on the detections performed by the optical encoder274.

The crown222can be coupled to and/or monolithically formed with the shaft220. In some cases, the shaft220and crown222may be formed as a single piece. As the shaft220is coupled to, or is otherwise a part of the crown222, as the crown222rotates or moves in a particular direction and at a particular speed, the shaft220also rotates or moves in the same direction and with the same speed.

The crown module200can include a switch230for accepting translational input from the user and applied to the crown222. As shown inFIG.3, the switch230can act as a force sensor when the shaft220is moved with movement of the crown222, for example, along or parallel to the axis290. The switch230can include a dome switch that is configured to provide a tactile feedback when actuated. The actuation of a dome switch can be perceived by the user as a click or release as the switch230is actuated. Once the force has been removed from the crown222, the dome switch can resiliently return to its original position, providing a biasing force to return the crown222to its original position. Additionally or alternatively, the switch230may include a separate biasing element, such as a spring, that exerts a force (either directly or indirectly) against the crown222and/or the shaft220. The crown222and/or the shaft220can be translatable relative to the housing210along or parallel to the axis290, providing an ability for the user to translate the crown222and apply a translating force to the switch230. Actuation of the switch230can provide a binary output (actuated/not actuated) and/or a non-binary output that corresponds to the amount of translation along the axis of motion. It will be understood that the switch can be or include other types of input and/or force measuring devices, such as capacitive sensors, resistive sensors, strain gauges, and the like. The switch230can be operably connected to a controller250for receiving signals based on the inputs received at the switch.

As further shown inFIG.3, a haptic feedback system can include mechanisms that facilitate haptic feedback. A haptic feedback system can be implemented as any suitable device configured to provide force feedback, vibratory feedback, tactile sensations, and the like. For example, in one embodiment, the haptic feedback system may be implemented as a linear actuator configured to provide a punctuated haptic feedback, such as a tap or a knock.

According to some embodiments, the haptic feedback system can include a magnetic element252. The magnetic element252can be positioned within a second chamber224defined by the shaft220. The magnetic element252can be coupled to the shaft220at one or more locations. For example, as shown inFIG.3, the magnetic element252can be coupled to the shaft220by one or more spring elements264. The spring elements264can bias the magnetic element252to a particular location relative to the shaft220. The biasing forces can be along the axis290and/or another axis.

The magnetic element252can include a temporary magnet of a soft magnetic material or a permanent magnet of a hard magnetic material. As used herein, “magnet” can include a magnet of a hard magnetic material and/or a magnet of a soft magnetic material. Hard magnetic materials include materials that retain their magnetism even after the removal of an applied magnetic field. Magnets that include hard magnetic material can form permanent magnets. Hard magnetic materials include neodymium (NdFeB), iron-neodymium, iron-boron, cobalt-samarium, iron-chromium-cobalt, and combinations or alloys thereof. Soft magnetic materials include materials that are responsive to magnetic fields, but do not retain their magnetism after removal of an applied magnetic field. Magnets that include soft magnetic material can form temporary magnets. Soft magnetic materials include iron, iron-cobalt, iron-silicon, steel, stainless steel, iron-aluminum-silicon, nickel-iron, ferrites, and combinations or alloys thereof. It will be recognized that “hard magnetic” and “soft magnetic” does not necessarily relate to the rigidity of the materials.

It will be recognized that various arrangements and alterations to the above description can be implemented to provide haptic feedback. For example, the magnetic element252can have a variety of shapes and sizes. Multiple magnetic elements can be provided. These and other designs can be implemented to facilitate an induced magnetic field and magnetic forces between the magnetic elements.

The haptic feedback system can further include a magnetic field generator to induce a magnetic field in the magnetic element252. For example, one or more coils244can be positioned on one or more sides of the magnetic element252. The coils244can include one or more helical windings in one or more layers. It will be recognized that any number of windings and arrangements of the coil can be provided to induce a magnetic field.

As shown inFIG.3, the coils244are operated to induce a magnetic field near the magnetic element252. When the coils244are activated with an electric current, the causes the magnetic element252to move under the influence of a magnetic force. For example, where the magnetic element252is a temporary magnet of a soft magnetic material, the magnetic field can cause the magnetic domains of the magnetic element252to align with the magnetic field. The magnetic element252will then be attracted toward a direction based on the activated coils244. Additionally or alternatively, the magnetic element252can be a permanent magnet of a hard magnetic material. Based on the alignment (i.e., polarity) of such a permanent magnet, the magnetic field causes the magnetic element252to attract toward or repel away from one or more coils244when activated.

The magnetic element252can move within the second chamber224, for example, along and/or parallel to the axis290. As such, the magnetic element252can move relative to the shaft220. Such movement can include deflection from a nominal position, for example a position to which the spring elements264bias the magnetic element252. As the magnetic element252moves (e.g., along the axis290), the shaft220can receive forces, for example through the spring elements264. As described above, the magnetic element252is connected to the shaft220via the spring elements264, and the coils244are connected to the housing210to move with the housing210. As such, magnetic forces between the magnetic element252and the coils244are transmitted to the shaft220to cause movement of the shaft220and/or the crown222relative to the housing210.

The haptic feedback can include movement of the shaft220and/or the crown222relative to the housing210and along the axis290of the crown module200. For example, the magnetic element252can be aligned along the axis290of the crown module200. Movement from haptic feedback can be along the same axis290about which the crown222and the shaft220rotate. Additionally or alternatively, movement from haptic feedback can be along another axis or in multiple axes and directions.

The position and/or movement of the magnetic element252can be detected and/or tracked by one or more magnetic field sensors246. The magnetic field sensors246can be positioned to detect magnetic fields induced by the presence and/or movement of the magnetic element252. For example, based on a known magnetic field output of the magnetic element252, a magnitude of a magnetic field detected by the magnetic field sensors246can be used to calculate a distance between the magnetic element252and any given one of the magnetic field sensors246. Multiple magnetic field sensors246can be provided for more precise detections of the magnetic element252. Examples of magnetic field sensors246can include Hall Effect sensors, magnetometers, compasses, and the like. Other sources of magnetic fields, such as from the coils244, can be considered based on known operation of the coils244and their respective positions relative to each of the magnetic field sensors246. As such, the contribution of the magnetic element252to the detected magnetic field can be isolated for calculations and corresponding actions.

Output provided by the magnetic field sensors246can be used to provide closed-loop control for operating the coils244. For example, it can be desirable to position and/or move the magnetic element252in a particular way to produce a desired type of haptic feedback. Without closed-loop controls, and attempt to drive the magnetic element252with the coils244may not produce the desired haptic feedback. When the magnetic element252is not in a known position, the operation of the coils244may have unexpected effects on the magnetic element252. However, by detecting the position and/or movement of the magnetic element252, the coils244can be operated to target the magnetic element252based on both its current position and/or movement and its desired position and/or movement. As such, the closed-loop control of the coils can be based, at least in part, on the output of the magnetic field sensors246. Such output can be provided continuously, periodically, and/or on demand to inform how the coils244should be operated.

In use, the coils244can be operated to provide haptic feedback while the user is operating (e.g., contacting and/or rotating) the crown222. The haptic feedback can be provided based on a variety of conditions and parameters. For example, the haptic feedback can be controlled by providing an electric current to the coils244. The induced and corresponding magnetic force between the magnetic element252and the coils244is based on the current in the coils244. As such, the current can have a duration, amplitude, frequency, waveform, duty cycle, or other parameters as desired for a desired and corresponding haptic feedback.

For example, the magnetic element252can be made to vibrate by applying a control signal to the coils244. The control signal may be a wave having a predetermined amplitude and/or frequency. When the control signal is applied, the induced magnetic field causes the magnetic element252to vibrate at the frequency of the control signal. The frequency can be in a range between 10 Hz and 5,000 Hz, 50 Hz and 1,000 Hz, or 100 Hz and 500 Hz. The frequency of the control signal may be adjusted to alter the rate of movement of the magnetic element252if a certain vibration is desired. The amplitude of the control signal may be correlated to the magnitude of movement of the magnetic element252, and may be adjusted to alter the intensity of the vibration.

The haptic feedback system can provide haptic feedback to a user by moving the magnetic element252within the shaft220and thereby moving the shaft220and/or the crown222of the crown module200relative to the housing210. In contrast to haptic feedback applied directly to the housing210and/or other portions of the head-mountable device, haptic feedback provided at the shaft220more directly provides sensations relating to the shaft220. For example, haptic feedback can be provided while the user is operating (e.g., contacting and/or rotating) the crown222. As the shaft220and the crown222are moved (e.g., vibrated) relative to the housing210, the rest of the head-mountable device can remain stationary, so that the haptic feedback is not felt by the user at other locations of contact. By further example, while the user is wearing the head-mountable device, the haptic feedback can nonetheless be localized to the crown222so that the user feels the haptic feedback only at that location.

The haptic feedback system can provide haptic feedback based on operation of the crown module200. For example, haptic feedback can be provided while the crown222and/or the shaft220are rotated by the user. Incremental and/or periodic haptic feedback can be provided based on the rotation performed by the user. By further example, the haptic feedback can be provided at a speed that corresponds to the speed of rotation performed by the user. As such, the haptic feedback can provide confirmation to the user relating to the input that is received by the user.

The haptic feedback system can provide haptic feedback based on activities performed by the head-mountable device. For example, the haptic feedback can correspond to visual information that is output to the user by the head-mountable device. By further example, visual information can be modified by use or operation of the crown, and haptic feedback can be provided to indicate how the user can interact with the visual information. For example, the user can rotate the crown in one or both of two directions to cause the head-mountable device to perform certain actions. Such rotation be performed to control the volume of a speaker, the brightness of the display element, visual output of the head-mountable device, optical settings of an optical subassembly, or control other hardware settings. Rotation can be performed to scroll through a list or other set of items visually displayed by the head-mountable device.

While a first type of haptic feedback can be provided as the user rotates the crown, a second type of haptic feedback can be provided to indicate how the user can interact with the head-mountable device and/or limitations regarding the user input. For example, as the user scrolls through a list displayed by the head-mountable device, a first type of haptic feedback can be provided based on the user input (e.g., speed of rotation, etc.). By further example, as the user reaches the end of a list, a second type of haptic feedback can be provided to indicate that the user has reached the end of the list. Additionally or alternatively, different types of feedback can be provided in this way for other actions, such as zooming in on or out from an image, changing volume settings, changing display brightness, and the like.

The haptic feedback system can provide haptic feedback for one or more other purposes. According to some embodiments, the haptic feedback can notify the user based on a message, alert, or alarm. Such notifications can be accompanied by other feedback, including tactile, auditory, and/or visual feedback on the crown module200and/or the external device. According to some embodiments, the haptic feedback can provide confirmation that a user selection (e.g., made with the crown module200) has been received by the head-mountable device and/or an external device. According to some embodiments, the haptic feedback can inform the user regarding status or operation of the head-mountable device and/or an external device.

In some embodiments, a magnetic element can be freely moveable within a shaft for providing haptic feedback to a crown of a crown module. For example, as shown inFIG.4, the magnetic element252can be positioned within a second chamber224defined by the shaft220. Rather than being coupled to the shaft220, the magnetic element252can be free to move within the second chamber224. The magnetic element252can transfer forces to the shaft220and/or the crown222when it contacts ends of the second chamber224.

Additionally or alternatively, the second chamber224can contain a fluid (e.g., gas or liquid) therein that surrounds at least part of the magnetic element252. As such, the magnetic element252can be suspended within the fluid. The magnetic element252can move within the second chamber224by compressing and/or displacing the fluid. As the magnetic element252moves in response to operation of the coils244, its motions can be dampened by compression and/or displacement of the fluid, with forces being transferred to the shaft220and/or the crown222.

Additionally or alternatively, rather than a single solid mass, the magnetic element252can include a magnetically response fluid or component within a fluid. For example, the magnetic element252can be a ferrofluid within the second chamber224. The ferrofluid can be moved in response to operation of the coils244, and forces can be transferred to the shaft220and/or the crown222.

In some embodiments, a magnetic element can be fixed to the shaft for direct transfer of forces thereto. For example, as shown inFIG.5, the magnetic element252can be securely positioned relative to the shaft220. Rather than being moveable within the shaft220, the magnetic element252can have a fixed position and/or orientation relative to the shaft220, such that forces applied to the magnetic element252by operation of the coils244can be directly transferred to the shaft220and/or the crown222.

Referring now toFIG.6, components of the head-mountable device can be operably connected to provide the performance described herein.FIG.6shows a simplified block diagram of an illustrative head-mountable device100in accordance with one embodiment of the invention. It will be appreciated that components described herein can be provided on one, some, or all of a housing, a securement element, and/or a crown module. It will be understood that additional components, different components, or fewer components than those illustrated may be utilized within the scope of the subject disclosure.

As shown inFIG.6, the head-mountable device100can include a controller250(e.g., control circuitry) with one or more processing units that include or are configured to access a memory182having instructions stored thereon. The instructions or computer programs may be configured to perform one or more of the operations or functions described with respect to the head-mountable device100. The controller250can be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions. For example, the controller250may include one or more of: a processor, a microprocessor, a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), or combinations of such devices. As described herein, the term “processor” is meant to encompass a single processor or processing unit, multiple processors, multiple processing units, or other suitably configured computing element or elements.

The memory182can store electronic data that can be used by the head-mountable device100. For example, the memory182can store electrical data or content such as, for example, audio and video files, documents and applications, device settings and user preferences, timing and control signals or data for the various modules, data structures or databases, and so on. The memory182can be configured as any type of memory. By way of example only, the memory182can be implemented as random access memory, read-only memory, Flash memory, removable memory, or other types of storage elements, or combinations of such devices.

The head-mountable device100can further include a display element140for displaying visual information for a user. The display element140can provide visual (e.g., image or video) output. The display element140can be or include an opaque, transparent, and/or translucent display. The display element140may have a transparent or translucent medium through which light representative of images is directed to a user's eyes. The display element140may utilize digital light projection, OLEDs, LEDs, uLEDs, liquid crystal on silicon, laser scanning light source, or any combination of these technologies. The medium may be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to become opaque selectively. Projection-based systems may employ retinal projection technology that projects graphical images onto a person's retina. Projection systems also may be configured to project virtual objects into the physical environment, for example, as a hologram or on a physical surface. The head-mountable device100can include an optical subassembly configured to help optically adjust and correctly project the image-based content being displayed by the display element140for close up viewing. The optical subassembly can include one or more lenses, mirrors, or other optical devices.

The head-mountable device100can include one or more sensors170, as described herein. The head-mountable device100can include one or more other sensors. Such sensors can be configured to sense substantially any type of characteristic such as, but not limited to, images, pressure, light, touch, force, temperature, position, motion, and so on. For example, the sensor can be a photodetector, a temperature sensor, a light or optical sensor, an atmospheric pressure sensor, a humidity sensor, a magnet, a gyroscope, an accelerometer, a chemical sensor, an ozone sensor, a particulate count sensor, and so on. By further example, the sensor can be a bio-sensor for tracking biometric characteristics, such as health and activity metrics. Other user sensors can perform facial feature detection, facial movement detection, facial recognition, eye tracking, user mood detection, user emotion detection, voice detection, etc. Sensors can include a camera which can capture image based content of the outside world. By further example, an eye sensor can optically capture a view of an eye (e.g., pupil) and determine a direction of a gaze of the user.

The head-mountable device100can include an input/output component186, which can include any suitable component for connecting head-mountable device100to other devices. Suitable components can include, for example, audio/video jacks, data connectors, or any additional or alternative input/output components. The input/output component186can include buttons, keys, or another feature that can act as a keyboard for operation by the user.

The head-mountable device100can include the microphone188as described herein. The microphone188can be operably connected to the controller250for detection of sound levels and communication of detections for further processing, as described further herein.

The head-mountable device100can include the speakers194as described herein. The speakers194can be operably connected to the controller250for control of speaker output, including sound levels, as described further herein.

The head-mountable device100can include communications circuitry192for communicating with one or more servers or other devices using any suitable communications protocol. For example, communications circuitry192can support Wi-Fi (e.g., a 802.11 protocol), Ethernet, Bluetooth, high frequency systems (e.g., 1400 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, TCP/IP (e.g., any of the protocols used in each of the TCP/IP layers), HTTP, BitTorrent, FTP, RTP, RTSP, SSH, any other communications protocol, or any combination thereof. Communications circuitry192can also include an antenna for transmitting and receiving electromagnetic signals.

The head-mountable device100can include a battery160, which can charge and/or power components of the head-mountable device100. The battery160can also charge and/or power components connected to the head-mountable device100.

The head-mountable device100can include components of the crown module, such as the encoder274, the switch230, the coils244, and/or the magnetic field sensors246. Such components can be provided in operable connection to each other and/or the controller250. For example, the operation of the coils244can be based, at least in part, on detections of the magnetic field sensors246, as described herein. By further example, the user inputs detected by the encoder274and/or the switch230can produce output signals that affect operation of other components of the head-mountable device100, as described herein.

While some embodiments of touch-based input devices disclosed herein relate to head-mountable devices, it will be appreciated that the subject technology can encompass and be applied to other devices. For example, an input device (e.g., crown module) in accordance with embodiments disclosed herein can include a phone, a tablet computing device, a mobile computing device, a watch, a laptop computing device, a mouse, a game controller, a remote control, a digital media player, a stylus, and/or any other electronic device. Further, the external device can be any device that interacts with a touch-based input device. For example, an external device in accordance with embodiments disclosed herein can include a tablet, a phone, a laptop computing device, a desktop computing device, a wearable device, a mobile computing device, a tablet computing device, a display, a television, a phone, a digital media player, and/or any other electronic device.

Accordingly, embodiments of the present disclosure provide a head-mountable device with a crown module with an input system that allows a user to provide inputs by rotating a crown of the crown module. The head-mountable device can interpret the rotation and/or torque as a user input. The crown module can further include a feedback system that provides localized haptic feedback at the crown. A magnetic element coupled to the crown can be moved by inducing magnetic fields, and the position and/or movement of the magnetic element can be detected to provide closed-loop control of the induced magnetic fields. The haptic feedback can be effectively perceived by the user at the crown without causing the entire head-mountable device to vibrate against the head and/or face of the user.

Various examples of aspects of the disclosure are described below as clauses for convenience. These are provided as examples, and do not limit the subject technology.

Clause A: a head-mountable device comprising: a housing; a crown positioned at least partially outside the housing; a shaft positioned within the housing and connected to the crown such that the shaft rotates with the crown and about an axis; a sensor for detecting rotation of the shaft; a switch at an end of the shaft that is opposite the crown, the switch being operable by movement of the shaft along the axis; a magnetic element within the shaft; and a coil coupled to the housing and configured to induce a magnetic field in the magnetic element, such that, when the coil is activated, the magnetic element provides haptic feedback by moving the shaft and the crown relative to the housing.

Clause B: a head-mountable device comprising: a housing; a crown positioned at least partially outside the housing; a magnetic element within the housing and coupled to the crown; and a coil coupled to the housing and configured to induce a first magnetic field in the magnetic element, such that, when the coil is activated, the magnetic element provides haptic feedback by moving the crown relative to the housing; and a magnetic field sensor configured to detect a second magnetic field produced by the magnetic element; and a controller configured to operate the coil is based on a detection of the second magnetic field.

Clause C: a head-mountable device comprising: a housing; a crown positioned at least partially outside the housing; a shaft positioned within the housing and connected to the crown; a magnetic element within a chamber of the shaft and being moveable relative to the shaft; and a coil coupled to the housing and configured to induce a magnetic field in the magnetic element, such that, when the coil is activated, the magnetic element provides haptic feedback by moving within the shaft.

One or more of the above clauses can include one or more of the features described below. It is noted that any of the following clauses may be combined in any combination with each other, and placed into a respective independent clause, e.g., clause A, B, or C.

Clause 1: a frame; a display on an inner side of the frame; a camera on an outer side of the frame; a speaker; and a microphone.

Clause 2: the magnetic element is moveable within a chamber of the shaft and relative to the shaft.

Clause 3: the magnetic element is fixed with respect to the shaft.

Clause 4: the magnetic element is coupled to the shaft by a spring element.

Clause 5: the shaft is positioned within a sealed chamber of the housing that contains the sensor.

Clause 6: a pair of seal members each sealingly engaging an inner surface of the housing and an outer surface of the shaft, wherein the sensor is positioned axially between the pair of seal members.

Clause 7: the sensor is an optical sensor and the shaft comprises a visual feature for detection by the optical sensor.

Clause 8: the coil is a first coil on a first axial side of the magnetic element; and the head-mountable device comprises a second coil on a second axial side of the magnetic element.

Clause 9: the controller is configured to alter an activity of the coil when the magnetic field sensor detects that the second magnetic field has exceeded a threshold corresponding to a position or velocity of the magnetic element.

Clause 10: the magnetic field sensor comprises a Hall Effect sensor coupled to the housing.

Clause 11: a shaft positioned within the housing and connected to the crown such that the shaft rotates with the crown and about an axis; and a sensor for detecting rotation of the shaft.

Clause 12: a switch at an end of the shaft that is opposite the crown, the switch being operable by movement of the shaft along an axis of the shaft.

Clause 13: a liquid within the chamber, the magnetic element being suspended in the liquid.

Clause 14: the magnetic element comprises a ferrofluid.

Clause 15: the shaft is rotatable with the crown and about an axis; and the head-mountable device further comprising a sensor for detecting rotation of the shaft.

The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.

The claims are not intended to be limited to the aspects described herein, but are to be accorded the full scope consistent with the language of the claims and to encompass all legal equivalents. Notwithstanding, none of the claims are intended to embrace subject matter that fails to satisfy the requirements of the applicable patent law, nor should they be interpreted in such a way.