Systems and methods for controlling electronic devices

An audio system including a wearable audio device having a sensor to determine a first motion of the first wearable device from a first orientation to a second orientation, a first peripheral device, a first input arranged on, in, or in communication with the wearable audio device or the first peripheral device, and circuitry connected to the wearable audio device or the first peripheral device. The circuitry is arranged to: receive the first input while the first wearable audio device is in the first orientation; receive the first input while the first wearable audio device is moved via the first motion to the second orientation; determine that the first input has been released during or after the first motion; and, adjust a setting of the wearable audio device or the first peripheral device based at least in part on the first motion from the first orientation to the second orientation.

BACKGROUND

Aspects and implementations of the present disclosure are generally directed to systems and methods for control of electronic devices, for example, wearable audio devices.

SUMMARY OF THE DISCLOSURE

The present disclosure relates to devices and systems capable of controlling or adjusting a device or program setting based at least in part on sensor data obtained via a sensor arranged on, in, or in communication with a wearable audio device.

In one aspect, a wearable audio device is provided, the wearable audio device including a first input arranged on, in, or in communication with the first wearable audio device, a sensor arranged to determine a first motion of the first wearable audio device from a first orientation to a second orientation, and circuitry arranged to: receive the first input while the first wearable audio device is in the first orientation; receive the first input while the first wearable audio device is moved via the first motion to the second orientation; determine that the first input has been released during or after the first motion; and, adjust a setting of the wearable audio device based at least in part on the first motion from the first orientation to the second orientation.

In an aspect, the first input is a touch capacitive sensor.

In an aspect, the first input is a first gesture of a user.

In an aspect, the first gesture is selected from: a facial expression of a user; an eye movement of the user, or a motion of the user's jaw or teeth.

In an aspect, the first input is a voice input received at a first microphone connected to the wearable audio device.

In an aspect, the wearable audio device comprises a first speaker arranged to produce a first audio signal at a first volume.

In an aspect, the first motion comprises a rotation of the wearable audio device about an imaginary axis through the wearable device.

In an aspect, the adjusting of the setting of the wearable audio device comprises: increasing or decreasing the first volume of the audio signal proportionately to a degree of the rotation of the wearable audio device about the imaginary axis.

In an aspect, the adjusting of the setting of the wearable audio device comprises: selecting a level of Active Noise Reduction (ANR).

In an aspect, the adjusting of the setting can be a selection of a preset user routine from plurality of preset user routines.

In an aspect, an audio system is provided, the audio system including a wearable audio device having a sensor arranged to determine a first motion of the first wearable device from a first orientation to a second orientation, a first peripheral device, a first input arranged on, in, or in communication with the wearable audio device or the first peripheral device, and circuitry connected to the wearable audio device or the first peripheral device. The circuitry is arranged to: receive the first input while the first wearable audio device is in the first orientation; receive the first input while the first wearable audio device is moved via the first motion to the second orientation; determine that the first input has been released during or after the first motion; and, adjust a setting of the wearable audio device or the first peripheral device based at least in part on the first motion from the first orientation to the second orientation.

In an aspect, the first input is a touch capacitive sensor.

In an aspect, the first input is a first gesture of a user.

In an aspect, the first gesture is selected from: a facial expression of a user; an eye movement of the user, or a motion of the user's jaw or teeth.

In an aspect, the first input is a voice input received at a first microphone connected to the wearable audio device.

In an aspect, the wearable audio device comprises a first speaker arranged to produce a first audio signal at a first volume.

In an aspect, the first motion comprises a rotation of the wearable audio device about an imaginary axis through the wearable device.

In an aspect, the adjusting of the setting of the wearable audio device comprises: increasing or decreasing the first volume of the audio signal proportionately to a degree of the rotation of the wearable audio device about the imaginary axis.

In an aspect, the adjusting of the setting of the wearable audio device comprises: selecting a level of Active Noise Reduction (ANR).

In an aspect, the adjusting of the setting can be a selection of a preset user routine from plurality of preset user routines.

These and other aspects of the various embodiments will be apparent from and elucidated with reference to the embodiment(s) described hereinafter.

DETAILED DESCRIPTION OF EMBODIMENTS

The present disclosure relates to devices and systems capable of controlling or adjusting a device or program setting based at least in part on sensor data obtained via a sensor arranged on, in, or in communication with a wearable audio device.

The term “wearable audio device”, as used in this application, is intended to mean a device that fits around, on, in, or near an ear (including open-ear audio devices worn on the head or shoulders of a user) and that radiates acoustic energy into or towards the ear. Wearable audio devices are sometimes referred to as headphones, earphones, earpieces, headsets, earbuds or sport headphones, and can be wired or wireless. A wearable audio device includes an acoustic driver to transduce audio signals to acoustic energy. The acoustic driver may be housed in an earcup. While some of the figures and descriptions following may show a single wearable audio device, having a pair of earcups (each including an acoustic driver) it should be appreciated that a wearable audio device may be a single stand-alone unit having only one earcup. Each earcup of the wearable audio device may be connected mechanically to another earcup or headphone, for example by a headband and/or by leads that conduct audio signals to an acoustic driver in the ear cup or headphone. A wearable audio device may include components for wirelessly receiving audio signals. A wearable audio device may include components of an active noise reduction (ANR) system. Wearable audio devices may also include other functionality such as a microphone so that they can function as a headset. WhileFIG. 1shows an example of an audio eyeglasses form factor, in other examples the headset may be an in-ear, on-ear, around-ear, or near-ear headset. In some examples, a wearable audio device may be an open-ear device that includes an acoustic driver to radiate acoustic energy towards the ear while leaving the ear open to its environment and surroundings.

The following description should be read in view ofFIGS. 1-6B.FIG. 1is a schematic view of audio system100according to the present disclosure. Audio system100includes wearable audio device102and first peripheral device104. It should be appreciated that, although illustrated inFIGS. 1-3 and 6A-6Bas a pair of smart eyeglass frames, wearable audio device can be any device capable of establishing a wired or wireless connection with first peripheral device104, e.g., wireless headphones. Additionally, although illustrated inFIGS. 1 and 4as a smart phone, it should be appreciated that first peripheral device104can be any device capable of establishing a wired or wireless connection with wearable audio device102, e.g., wireless speakers, a smart television, a personal computer, tablet, smart watch, etc.

In one example, as illustrated inFIG. 2, wearable audio device102is a pair of smart eyeglasses having rims106, lenses108, end pieces110, hinges112, a first temple114A and a second temple114B. Rims106can be selected from any style rims known in the art, e.g., round, oval, square, rectangular, or any other conceivable rim shape. Lenses108can be prescription lenses, non-prescription lenses or tinted lenses (sunglasses). It should be appreciated that whatever lenses are chosen can be formed or cut to fit within rims106. At opposing ends of rims106, wearable audio device102includes end pieces110which are bent at an angle with respect to rims106. Each end piece110is connected to a temple114via a hinge, e.g., first temple114A and second temple114B. Each temple is arranged to span from rims106to and rest on the top of a user's ear while in use.

As illustrated inFIG. 3, first wearable audio device102also includes first circuitry116. First circuitry116includes speaker118and first communication module120(shown inFIG. 5A). First speaker118is arranged to produce a first audio signal at a first volume, i.e., first audio signal122(shown inFIG. 5A) at first volume V1(not shown) proximate at least one ear of a user in response to audio data sent and/or received from first communication module120. As illustrated inFIG. 3, first speaker118can be integrated within first temple114A and/or second temple114B and proximate to where a user's ear is positioned during use of wearable audio device102. First communication module120(shown inFIG. 5A) is arranged to send and/or receive data from an antenna, e.g., first antenna124as shown inFIG. 5A. The data received can be, e.g., audio data or communication data sent and/or received from a plurality of external devices, e.g., first peripheral device104. It should be appreciated, that first communication module120can be operatively connected to a first processor126(shown inFIG. 5A) and first memory128(shown inFIG. 5A) operatively arranged to execute and store a first set of non-transitory computer-readable instructions130(shown inFIG. 5A), as well as a battery or other power source (not shown). Furthermore, wearable audio device102may further include a first microphone132(not shown), or an array of microphones, arranged on, in, or in communication with wearable audio device102and arranged to obtain voice data from a user.

Furthermore, first wearable audio device102includes a first sensor134(shown inFIG. 5A) arranged on or in first wearable audio device102. First sensor134can be selected from: a gyroscope, an accelerometer, a magnetometer, or any other sensor capable of determining the position, angular velocity, orientation, acceleration, or direction with respect to a magnetic force of first wearable audio device102. First sensor134is arranged to obtain sensor data136(schematically shown inFIG. 5A) and relay sensor data136to first communication module120. As will be described below, first wearable audio device102and/or first peripheral device104can utilize sensor data136to obtain an orientation and a motion of first wearable audio device102while in use, e.g., first orientation164, second orientation176, and first motion174(all discussed below).

As shown inFIG. 2, first wearable audio device102further includes a first user interface138having at least one user input, e.g., first user input140. While first user interface138is illustrated inFIG. 2as being on end pieces110, first user interface138could be located at any suitable location on first wearable audio device102, e.g., rims106, lenses108, hinges112, first temple114A, second temple114B, etc. First user input140can be selected from: a touch capacitive sensor, a mechanical button, a slideable switch, or any other conceivable input which can be obtained from an action of a user. Additionally, although not discussed in detail, first user input140can be a signal generated by first sensor134such that a motion or a gesture, i.e., first gesture141, made by the user can serve as an input to first wearable audio device102. First input140can also be a signal generated by a second sensor135(shown inFIG. 3) such as a pressure or deformation sensor, an Electrooculography (EOG) sensor, an Electromyography (EMG) sensor, an Electrocardiogram (EKG/ECG) sensor, a piezoelectric sensor, an electrically active film, or any other sensor that can translate and transmit physiological events that take place on or in a user's body to wearable audio device102. A non-limiting list of gestures that may be detected by second sensor135includes: a smile; a frown; a wink or blink; eye movement (e.g., movement of eyes back and forth or up and down); an eyebrow raise; a clenching of a user's jaw; movement of a user's jaw forward, backward, or to one side; raising of a user's ears; an opening of a user's mouth; flaring of a user's nostrils; movement of a user's cheeks; etc. In one example, first gesture141can be selected from a movement of a user's eye or the muscles on a user's face, e.g., a blink of the user's eye, such that the act of blinking can be used as first input140and can operate to switch wearable audio device102from default control state160(discussed below) to active control state162(discussed below) and vice versa.

Furthermore, it should be appreciated that the voice data obtained from first microphone132(not shown) can also serve as an input for first wearable audio device102. In one example, as shown inFIG. 2, first user input140is a mechanical button arranged on the end piece110of first temple114A of wearable audio device102.FIGS. 2-3illustrate a right-side perspective view and a left-side perspective view, respectively, of first wearable audio device102having user first interface138and first user input140. It should be appreciated that first interface138and first user input140can be arranged anywhere on, in, or in communication with wearable audio device102including: first temple114A, second temple114B, rims106, or either hinge110, in any conceivable arrangement.

FIG. 4illustrates a front schematic view of first peripheral device104according to the present disclosure. First peripheral device104includes second circuitry142which can include second communication module144(shown inFIG. 5B) arranged to send and/or received data, e.g., audio data or communication data via a second antenna146(shown inFIG. 5B). First peripheral device104further includes second user interface148having at least one second input150, and second processor152(shown inFIG. 5B) and second memory154(shown inFIG. 5B) arranged to execute and store a second set of non-transitory computer-readable instructions156(shown inFIG. 5B). Second memory154and/or first memory128of wearable audio device102can include a plurality of settings168and/or a plurality of user routines172, which will be discussed below in detail. Furthermore, although not discussed in detail, second user input150can be a signal generated by inertial sensors located on or within first peripheral device104, e.g., an accelerometer, a gyroscope, and/or a magnetometer, such that a motion or a gesture, e.g., first gesture141discussed above, made by the user can serve as an input for first peripheral device104. Furthermore, first peripheral device may also include a microphone, i.e., second microphone158(shown inFIG. 4), or an array of microphones, arranged to receive voice data from a user.

During operation of audio system100, first wearable audio device102or first peripheral device104are arranged to establish a first wired or wireless connection. For example, first antenna124of first communication module120may initiate/request a wired or wireless connection with first peripheral device104where the request is received and accepted via second antenna146of second communication module144. Conversely, second antenna146of second communication module144may initiate/request the wired or wireless connection with first wearable audio device102where the request is received an accepted via first antenna124of first communication module120. In one example, the connection is a wireless connection established between first communication module120and second communication module144using a wireless protocol selected from: a Bluetooth protocol, a Bluetooth Low-Energy (BLE) protocol, a ZigBee protocol, Near-Field Magnetic Induction (NFMI), Near-Field Electromagnetic Induction (NFEMI), a Wi-Fi (IEEE 802.11) protocol, or any other protocol for establishing a wireless connection between first wearable device102and first peripheral device104. It should further be appreciated that the connection may be a physical connection made between first wearable audio device102and first peripheral device104, e.g., via a cable or cord arranged to send and/or receive audio data and communication data between first wearable audio device102and first peripheral device104.

Once the connection between wearable audio device102and first peripheral device104is established, first wearable audio device102is in a default control state, i.e., default control state160. In default control state160, sensor data136obtained from first sensor134can be sent from first wearable audio device102and received by first peripheral device104such that second circuitry142can utilized sensor data136with, e.g., a third-party application stored and executed on second memory154and second processor152, respectively.

While in default control state160, a user may, for example, engage first user input140located on end piece110of first temple114A of wearable audio device102. Upon engaging first user input140, wearable audio device102switches from the default control state160to active control state162, and, using sensor data136obtained from first sensor134, determines and obtains an orientation of wearable audio device102, i.e., first orientation164(shown inFIG. 6A). First orientation164can be stored in first memory128of wearable audio device102, second memory154of first peripheral device104, or the memory of another external device, or a memory accessible via a network connection (e.g., cloud-based connection). While wearable audio device102remains in active control state162, i.e., as long as first user input140remains engaged, sensor data136obtained from first sensor134is utilized to modify or adjust a setting166of plurality of settings168and/or switch between routines170of a plurality of user routines172. Setting166of plurality of settings168can be selected from: increasing or decreasing first volume V1of audio signal122; activating or deactivating or otherwise selecting a level of Active Noise Reduction (ANR); switching between routines170of plurality of user routines172; start or play the first audio signal122; stop first audio signal122; pause first audio signal122; resume first audio signal122; switch or cycle between tracks or audio files; answer a phone call; decline a phone call; accept a notification; dismiss a notification; access a Virtual Personal Assistant (VPA) program (e.g., Amazon Alexa, Google Assistant, Apple Siri); or any other setting related to programs or applications that utilize audio data. Each routine170of plurality of user routines172are intended to be various combinations of preset user settings or default settings which may be cycled through during use of the device. For example, a user may have a preconfigured or predefined routine170of plurality of routines172which establishes a certain volume and/or level of active noise reduction, e.g., during exercise. In this example, the user may want a predefined volume and predefined level of active noise reduction (as well as other relevant settings) which maximizes the audibility of the user's music, while also allowing some external noise to alert the user to oncoming danger. It should be appreciated that the user may establish a plurality of routines172which are situationally specific for various situations a user may encounter. In one example, while the wearable audio device102remains in the active control state162, i.e., while the user remains engaged with first user input140, the user may generate a first motion174, e.g., a rotation horizontally about a first imaginary vertical axis A1(illustrated inFIGS. 1, and 6A-6B), a rotation vertically about a second imaginary vertical axis A2(illustrated inFIG. 1), a revolution, a roll, a twist, or any conceivable combination thereof. Upon the user disengaging with first user input140, wearable audio device102switches from active control state162to default control state160, and, using sensor data136obtained from first sensor134, determines and obtains an orientation of wearable audio device102, i.e., second orientation176(shown inFIG. 6B). Second orientation176can be stored in first memory128, second memory154, the memory of another external device, or a memory accessible via a network connection (e.g., cloud-based connection). It should be appreciated that first motion174between first orientation164and second orientation176is utilized to modify or adjust setting166or cycle between routines170of plurality of user routines172. It should also be appreciated that the magnitude of modification or adjustment of, e.g., setting166, may be proportional to a degree of motion or degree of rotation178, discussed below, of wearable audio device102during first motion174between first orientation164and second orientation176.

In one example, first user input140is a mechanical button located on end piece110of first temple114A of wearable audio device102. During use of wearable audio device102, wearable audio device102, via audio data obtained by the wired or wireless connection between first wearable audio device102and first peripheral device104, is arranged to produce or generate first audio signal122through first speaker118at first volume V1. Initially, wearable audio device102is in default control state160where sensor data136obtained by first sensor134may be utilized by a third-party program, e.g., an augmented reality program. While wearable audio device102is in the default control setting state160, the user may engage or depress first user input140. Upon engaging or depressing first user input140, wearable audio device102switches from default control state160to active control state162and determines and obtains, using sensor data136obtained from first sensor134, first orientation164of first wearable audio device102. In this example, first orientation164corresponds with the user's head being in a neutral position, i.e., look horizontally forward parallel with the ground upon which the user would be standing or sitting while using wearable audio device102(illustrated inFIG. 6A). While in the active control state162, i.e., while the user is maintaining engagement with first user input140, a motion of the user's head along with motion of wearable audio device102, i.e., first motion174, is utilized to modify or adjust setting166. When the user releases or disengages with first user input140, wearable audio device102switches from active control state162to default control state160and determines and obtains, from sensor data136obtained via first sensor134, an orientation of wearable audio device102, i.e., second orientation176. In this example, setting166is a volume setting associated with first audio signal122, second orientation176is a non-neutral position, e.g., a position of a user's head looking to the right with respect to the neutral position about imaginary vertical axis A1(shown inFIG. 6B), and first motion174(not shown) is a horizontal rotation about imaginary vertical axis A1from first orientation164to second orientation176. As wearable audio device102is moved via first motion174the first volume, i.e., first volume V1can be modified or adjusted proportionately to a degree of rotation178of wearable audio device102about imaginary vertical axis A1. In this example, a user may have a comfortable range of neck rotation of approximately 150 degrees, i.e., 75 degrees of rotation to the left with respect to imaginary vertical axis A1and 75 degrees of rotation to the right with respect to imaginary vertical axis A1. Sensor134may be arranged to obtain changes in sensor data136corresponding to changes of approximately 10 degrees of rotational motion to the left or to the right of first orientation164. In this example, first volume V1may be increased or decreased proportionately to the degree of rotation178of wearable audio device102, e.g., first volume V1can be increased incrementally for each 10 degree rotation to the right with respect to first orientation164. Conversely, first volume V1can be decreased incrementally for each 10 degree rotation to the left with respect to first orientation164. It should be appreciated that the foregoing description could be utilized to adjust any setting that is incremented and/or decremented, e.g., adjusting a level of active noise reduction from a maximum level to a minimum level, and to various points in between.

In one example, wearable audio device102is arranged to cycle through predefined or predetermined routines170of a plurality of user routines172. Similarly, here first orientation164corresponds with a neutral head position of the user i.e., looking horizontally forward parallel with the ground upon which the user would be standing or sitting while using wearable audio device102. Additionally, second orientation176is a non-neutral position, e.g., a position of user's head looking to the right with respect to the neutral position about imaginary vertical axis A1, and first motion174is a horizontal rotation about imaginary vertical axis A1from first orientation164to second orientation176. As wearable audio device102is moved via first motion174, wearable audio device102is arranged to cycle through different routines170of plurality of user routines172. The switch between each routine170can be in response to completion of the degree of rotation178of wearable audio device102about imaginary vertical axis A1. In this example, a user may have a comfortable range of neck rotation of approximately 150 degrees, i.e., 75 degrees of rotation to the left with respect to imaginary vertical axis A1and 75 degrees of rotation to the right with respect to imaginary vertical axis A1. Sensor134may be arranged to obtain changes in sensor data136corresponding to changes of approximately 10 degrees of motion to the left or to the right of first orientation164. In this example, the user may cycle between routines170of plurality of user routines172incrementally as wearable audio device completes every 10 degrees of rotation to the right with respect to first orientation164. Conversely, may cycle through the available user routines of plurality of user routines172incrementally for each 10 degree rotation to the left with respect to first orientation164.

In one example, the user may adjust setting166or cycle between routines170of plurality of user routines172by achieving a single threshold of rotation. In this example, first orientation164corresponds with a neutral head position of the user i.e., looking horizontally forward parallel with the ground upon which the user would be standing or sitting while using wearable audio device102. Additionally, second orientation176is a non-neutral position, e.g., a position of user's head looking to the right with respect to the neutral position about imaginary vertical axis A1, and first motion174is a horizontal rotation about imaginary vertical axis A1from first orientation164to second orientation176. As wearable audio device102is moved via first motion174, wearable audio device102is arranged to cycle through different routines170of plurality of user routines172. The switch between each routine170can be in response to completion of the degree of rotation178of wearable audio device102about imaginary vertical axis A1. In this example, a user may have a comfortable range of neck rotation of approximately 150 degrees, i.e., 75 degrees of rotation to the left with respect to imaginary vertical axis A1and 75 degrees of rotation to the right with respect to imaginary vertical axis A1. Sensor134may be arranged to obtain changes in sensor data136corresponding to changes of, e.g., 30 degrees of motion to the left or to the right of first orientation164. In this example, while in active control state162, i.e., while first input140is engaged, the user may cycle between different settings166or different routines170of plurality of user routines172every time the user completes a rotation that hits the 30 degree rotation threshold to the right or the left with respect to first orientation164. It should further be appreciated that, while the rotation of the meets the 30 degree rotational threshold to the right or the left of first orientation, wearable audio device102can be configured to continuously, or after a predetermined time limit, cycle through the available settings166until the user disengages from first input140.

It should be appreciated that the foregoing description could be utilized to cycle through any user setting, file, folder, available devices capable of establishing a wired or wireless connection with wearable audio device, etc. For example, the user may, while in the active control state162, cycle between available audio files or audio streams, available folders in a graphical user interface, or adjust any conceivable setting associated with wearable audio device102or first peripheral device104. Additionally, although the foregoing description utilizes the engagement or disengagement of first user input140to switch wearable audio device102between the default control state160and active control state162, it should be appreciated that any of the inputs described above could be utilized to switch wearable audio device102between the default control state160and active control state162, e.g., second user input150of first peripheral device104, voice data obtained by first microphone132or second microphone158, etc. Furthermore, although, in one example, first sensor134is capable of discriminating rotational movements in increments of 10 degrees with respect to imaginary vertical axis A1, it should be appreciated that first sensor can be more or less precise, i.e., capable of discriminating rotational movements in increments ranging from 1-75 degrees.

As illustrated inFIG. 7, the present disclosure includes a method of adjusting a user setting, i.e., method200. Method200can include, for example: providing a wearable audio device102having a sensor134arranged to determine a first motion174of the first wearable audio device102from a first orientation164to a second orientation176(step202); receiving a first input140of the wearable audio device102or a first peripheral device104while the first wearable device is in the first orientation164(step204); receiving the first input140while the wearable audio device102is moved via the first motion174to the second orientation176(step206); determining, via circuitry (116,142) of the wearable audio device102or the first peripheral device104that the first input140has been released during or after the first motion174(step208); and, adjusting a setting166of the wearable audio device102or the first peripheral device104based at least in part on the first motion174from the first orientation164to the second orientation176(step210).

The above-described examples of the described subject matter can be implemented in any of numerous ways. For example, some aspects may be implemented using hardware, software or a combination thereof. When any aspect is implemented at least in part in software, the software code can be executed on any suitable processor or collection of processors, whether provided in a single device or computer or distributed among multiple devices/computers.

Other implementations are within the scope of the following claims and other claims to which the applicant may be entitled.