PATENT DOCUMENT

Publication Number: US-10970030-B2
Application Number: US-201816120081-A
Country: US
Kind Code: B2

Title: Changing companion communication device behavior based on status of wearable device

Abstract:
Systems, methods, and non-transitory computer-readable storage media for detecting a wearing status of a wearable device, the wearing status indicating whether a user is wearing the wearable device and sending wearing status data to a companion communication device to control a behavior of the companion communication device.

Claims:
What is claimed is: 
     
       1. A method comprising:
 by a wireless ear bud paired with a companion communication device:
 detecting a first wearing status indicating that the wireless ear bud is inserted in an ear of a user, 
 sending, responsive to detecting the first wearing status, a first signal to the companion communication device to cause an operating system component of the companion communication device to publish availability of a first audio route of a plurality of audio routes in the companion communication device to allow user-selectable controls i) to indicate availability of the first audio route to route audio data from an application running on the companion communication device and ii) to transmit audio data from the application based on a user selection via the first audio route to the wireless ear bud, 
 detecting, subsequent to sending the first signal, a change in wearing status from the first wearing status to a second wearing status indicating that the wireless ear bud is not inserted in the ear of the user, and 
 sending, responsive to detecting the change in wearing status to the second wearing status, a second signal to the companion communication device to cause the operating system component of the companion communication device to un-publish availability of the first audio route i) to disallow the user-selectable controls to indicate availability of the first audio route for applications to use for audio data routing and ii) to disable transmitting the audio data via the first audio route to the wireless ear bud. 
 
 
     
     
       2. The method of  claim 1 , wherein the companion communication device transmits the audio data to the wireless ear bud via a wireless communication interface. 
     
     
       3. The method of  claim 1 , wherein the second signal causes the companion communication device to revert to transmitting the audio data via a default audio route of the plurality of audio routes in the companion communication device. 
     
     
       4. The method of  claim 1 , wherein:
 the wireless ear bud is paired with a second wireless ear bud; and 
 the second wearing status indicates that neither the wireless ear bud nor the second wireless ear bud is inserted in an ear of the user. 
 
     
     
       5. The method of  claim 1  wherein the second signal causes the companion communication device to revert to transmitting the audio data via a previously used audio route of the plurality of audio routes in the companion communication device. 
     
     
       6. The method of  claim 1 , wherein the second signal indicates that the companion communication device is to pause the audio data. 
     
     
       7. The method of  claim 1 , further comprising:
 detecting a second change in wearing status from the second wearing status to the first wearing status; and 
 sending, responsive to detecting the second change in wearing status, a third signal to the companion communication device to cause the operating system component of the companion communication device to re-publish availability of the first audio route of the plurality of audio routes to allow the user-selectable controls to indicate availability of the first audio route to route audio data from the application or from a second application running on the companion communication device via the first audio route to the wireless ear bud. 
 
     
     
       8. The method of  claim 7 , wherein:
 the third signal coincides with an in-coming voice call; 
 the second application comprises a voice application; and 
 the third signal indicates to the companion device to answer the in-coming voice call. 
 
     
     
       9. The method of  claim 8 , wherein, subsequent to transmitting the third signal, the wireless ear bud is configured to transmit audio data obtained via a microphone of the wireless ear bud to the companion communication device. 
     
     
       10. The method of  claim 7 , wherein the third signal indicates that audio associated with a received text message is to be transmitted to the wireless ear bud. 
     
     
       11. A wireless ear bud, comprising:
 a sensor configured to detect when the wireless ear bud is inserted in an ear; 
 a communications interface that enables the wireless ear bud to communicate wirelessly with a second wireless ear bud and with a companion communication device; and 
 a processor configured to execute instructions that cause the wireless ear bud to:
 receive audio data from the companion communication device via the communications interface, 
 detect, via the sensor, that the wireless ear bud is removed from the ear; and 
 send, responsive to detecting that the wireless ear bud is removed from the ear, a signal to the companion communication device via the communications interface to cause an operating system component of the companion communication device to un-publish availability of a first audio route of a plurality of audio routes i) to disallow user-selectable controls to indicate availability of a first audio route of a plurality of audio routes in the companion communication device for applications to use for audio data routing and ii) to disable transmitting the audio data via the first audio route to the wireless ear bud. 
 
 
     
     
       12. The wireless ear bud of  claim 11 , wherein execution of the instructions further causes the wireless ear bud to send one or more signals to the companion communication device indicating whether the wireless ear bud and/or the second wireless ear bud are inserted in an ear to cause the operating system component of the companion communication device to publish availability of the first audio route of the plurality of audio routes in the companion communication device to allow the user-selectable controls i) to indicate availability of the first audio route to route audio data from an application running on the companion communication device and ii) to transmit audio data from the application based on a user selection via the first audio route to the wireless ear bud and/or to the second wireless ear bud. 
     
     
       13. The wireless ear bud of  claim 12 , wherein the companion communication device is configured to:
 transmit the audio data to the wireless ear bud in mono when one of the wireless ear bud or the second wireless ear bud is inserted in an ear, and 
 transmit the audio data to the wireless ear bud in stereo when both the wireless ear bud and the second wireless ear bud are inserted in respective ears. 
 
     
     
       14. The wireless ear bud of  claim 12 , wherein, when the one or more signals indicates that the second wireless ear bud is inserted in an ear and the wireless ear bud is not inserted in an ear, the companion communication device re-routes the audio data to the second wireless ear bud. 
     
     
       15. The wireless ear bud of  claim 11 , further comprising:
 a second sensor configured to detect an in ear status of the wireless ear bud, 
 wherein the sensor and the second sensor are different types of sensors. 
 
     
     
       16. The wireless ear bud of  claim 11 , further comprising:
 a microphone configured to capture audio signals, 
 wherein execution of the instructions further causes the wireless ear bud to transmit, via the communications interface, the captured audio signals to the companion communication device. 
 
     
     
       17. A companion communication device communicatively coupled with a primary wireless ear bud and a secondary wireless ear bud, the companion communication device comprising:
 a communications interface configured to communicate wirelessly with the primary and secondary wireless ear buds; 
 a speaker for outputting audio; 
 a processor coupled to the communications interface; and 
 a memory storing instructions that, when executed by the processor, cause the companion communication device to:
 receive an in-ear status signal indicating an in-ear status for each of the primary wireless ear bud and the secondary wireless ear bud; 
 publish, by an operating system component of the companion communication device, availability of a first audio route of a plurality of audio routes in the companion communication device to allow user-selectable controls i) to indicate availability of the first audio route to route audio data from an application running on the companion communication device, ii) to output audio data from the application based on a user selection via the first audio route to the primary wireless ear bud in mono when the in-ear status signal indicates that only the primary wireless ear bud is inserted; and iii to output audio data from the application based on the user selection via the first audio route to the primary wireless ear bud in stereo when the in-ear status signal indicates that both the primary wireless ear bud and the secondary wireless ear bud are inserted; and 
 un-publish, by the operating system component, availability of the first audio route, when previously selected for audio routing, i) to disallow the user-selectable controls to indicate availability of the first audio route for applications to use for audio routing and ii) to disable transmitting the audio data via the first audio route, when the in-ear status signal indicates that neither the primary wireless ear bud nor the secondary wireless ear bud is inserted. 
 
 
     
     
       18. The companion communication device of  claim 17 , wherein the companion communication device is capable of receiving an in-coming voice call. 
     
     
       19. The companion communication device of  claim 18 , wherein execution of the instructions further causes the companion communication device to answer the in-coming voice call responsive to determining a change in the in-ear status signal indicating that the primary wireless ear bud is inserted. 
     
     
       20. The companion communication device of  claim 17 , wherein the primary wireless ear bud includes at least two sensors used to generate the in-ear status signal.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
     This Application is a continuation of U.S. patent application Ser. No. 15/172,070, entitled “CHANGING COMPANION DEVICE BEHAVIOR BASED ON STATUS OF WEARABLE DEVICE”, filed Jun. 2, 2016, set to issue as U.S. Pat. No. 10,067,734 on Sep. 4, 2018, which claims the benefit of U.S. Provisional Application No. 62/171,338, entitled “CHANGING COMPANION DEVICE BEHAVIOR BASED ON STATUS OF WEARABLE DEVICE”, filed Jun. 5, 2015, the content of which are incorporated herein by reference in their entirety for all purposes. 
    
    
     FIELD 
     The present technology pertains to controlling a device, including to controlling a device paired with a wearable device based on the status of the wearable device. 
     BACKGROUND 
     Electronic devices can change their behavior based on whether a peripheral device is connected to the electronic device. For example, a music player device can route audio to a pair of headphones when the headphones are connected to a headphone jack of the music player device. 
     Additionally, some peripheral devices can wirelessly connect to an electronic device, and a user can send information to the electronic device by providing an input to the peripheral device. For example, a wireless headset can wirelessly connect with a mobile phone and can include a button on the wireless headset that can be used to answer a voice call on the mobile phone. However, requiring user interaction with a peripheral device to communicate a user command can be non-intuitive, can involve hard-to-press controls, and can otherwise be burdensome. 
     SUMMARY 
     Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be obvious from the description, or can be learned by practice of the herein disclosed principles. The features and advantages of the disclosure can be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. These and other features of the disclosure will become more fully apparent from the following description and appended claims, or can be learned by the practice of the principles set forth herein. 
     The present technology involves a wearable device pairing with a companion communication device and sending data to the paired companion communication device, the data describing a wearing status that indicates whether a user is wearing the wearable device and/or whether the wearing status of the wearable device changes. The companion communication device can determine, based on the wearing status data received from the wearable device, one or more actions to take, such as how to route audio data, when to change a behavior of the companion communication device, or when/how to change aspects of an application executing on the companion communication device. 
     In some embodiments of the present technology, the wearable device is a wireless ear bud that includes sensors for determining when the wireless ear bud is worn in a user&#39;s ear. The wireless ear bud can send a signal that indicates changes to the wearing status of the wireless ear bud to indicate whether the wireless ear bud is worn in a user&#39;s ear. A paired companion communication device, e.g., a phone, can detect the signal sent by the wireless ear bud and can determine whether to route audio data to the wireless ear bud based on the wearing status of the wireless ear bud. For example, the companion communication device can route audio data to the wireless ear bud when the wireless ear bud is worn in a user&#39;s ear and can route audio data to an alternate output of the companion communication device when the wireless ear bud is not worn in a user&#39;s ear. 
     Additionally, a companion communication device paired with a wireless ear bud can determine to control other behaviors of the paired companion communication device based on the signal that indicates changes to the wearing status of the wireless ear bud, e.g., based on whether the wireless ear bud is worn in a user&#39;s ear. In some embodiments, a phone call being received at a companion communication device paired with a wireless ear bud is answered and audio data from the phone call is routed to the wireless ear bud in response to detecting that the wireless ear bud is worn in a user&#39;s ear without requiring additional user setup, configuration, etc. Also, in some embodiments, when a media application is being played on a companion communication device that is paired with a wireless ear bud, the companion communication device can route audio data to the wireless ear bud when the wireless ear bud is worn in a user&#39;s ear and playback can be paused when the wireless ear bud is not worn in (e.g., removed from) the user&#39;s ear. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       In order to describe the manner in which the above-recited and other advantages and features of the disclosure can be obtained, a more particular description of the principles briefly described above will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. Understanding that these drawings depict only exemplary embodiments of the disclosure and are not therefore to be considered to be limiting of its scope, the principles herein are described and explained with additional specificity and detail through the use of the accompanying drawings. 
         FIG. 1A  illustrates an example wireless ear bud that wirelessly pairs with a companion communication device according to some embodiments of the present technology. 
         FIG. 1B  illustrates an example system having two coupled wearable wireless ear buds paired with one or more companion communication devices according to some embodiments of the present technology. 
         FIG. 2  illustrates an example method of controlling the behavior of a companion communication device wirelessly paired with a wireless ear bud according to some embodiments of the present technology. 
         FIGS. 3A-3N  illustrate examples of changes to a wearing status of wireless ear buds paired with companion communication devices resulting in changing the behavior of the companion communication devices according to some embodiments of the present technology. 
         FIG. 4  illustrates an example wireless ear bud case according to some embodiments of the present technology. 
         FIG. 5A  and  FIG. 5B  illustrate exemplary possible system embodiments. 
     
    
    
     DETAILED DESCRIPTION 
     Various embodiments of the disclosure are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations may be used without parting from the spirit and scope of the disclosure. 
     The disclosed technology addresses the need in the art for wearable devices that can pair with a companion communication device and control behaviors of the paired combination of wearable device and companion communication device based at least in part on the wearing status of the device, e.g., whether the wearable device is being worn, being put on, or being taken off. The present technology involves systems, methods, and non-transitory media for pairing one or more wearable devices with a companion communication device and for changing one or more behaviors of the wearable device and/or the companion communication device based on whether the wearable device is worn by a user and/or a change in the wearing status of the wearable device. 
     As used throughout this disclosure, the terms “wearing,” “wearing status,” and “worn” can be used to refer to various ways to have on, or otherwise associate with, a user&#39;s body wearable technology in one or more manners that allow the wearable technology to be used. 
     In some embodiments of the present technology, sensors are included as part of wearable devices to determine a wearing status of the wearable devices, and the wearable devices are configured to communicate the wearing status of the wearable device, and changes to the wearing status of the wearable device, to a companion communication device in order to affect a behavior of the companion communication device. Many examples described herein involve a wearing status of a wireless ear bud affecting the behavior of a companion communication device. However, a wide range of wearable technology can be configured to take advantage of the benefits of the present technology. For example, the wearable device can include eyeglasses, sunglasses, headphones, a watch, etc., that include sensors for detecting a wearing status of the wearable device and also include a communication interface for communicating the wearing status of the wearable device to a paired companion communication device. 
       FIG. 1A  illustrates a wireless ear bud  165  that wirelessly couples with a companion communication device according to some embodiments of the present technology. The wireless ear bud  165  includes a communication interface  175  that can be used to pair the wireless ear bud  165  with the companion communication device. The communication interface  175  can also be used to couple the wireless ear bud  165  with another wireless ear bud to form a pair of untethered, wireless ear buds. 
     The wireless ear bud  165  includes an audio output  170  for converting a received signal into sound. The signal can be received from a paired companion communication device (not shown) via the communication interface  175 . The wireless ear bud  165  also can include a processor  180 , memory  185 , a battery  190 , a microphone  199 , and one or more sensors  195  for detecting when the wireless ear bud  165  is placed in an ear. The sensors  195  can be any number and any type of sensor(s) that can detect when the wireless ear bud is in a user&#39;s ear. For example, the sensors  195  can include any or all of optical proximity sensors, pressure sensors, heat sensors, moisture sensors, etc. Further, the sensors  195  can be of a single type or multiple types. 
     The wireless ear bud  165  can be coupled with another wireless ear bud to form a pair of untethered, wireless ear buds. In some cases, one of the coupled wireless ear buds takes a primary role, while the other of the coupled wireless ear buds takes a secondary role, where the former can be referred to as the primary wireless ear bud, while the latter can be referred to as the secondary wireless ear bud. The primary wireless ear bud can perform a number of actions including: (i) pairing with a companion communication device, (ii) receiving audio data from the companion communication device, (iii) routing audio data to the secondary wireless ear bud, (iv) receiving in-ear status information from the secondary wireless ear bud, and (v) sending, to the companion communication device, data regarding the in-ear status of the primary wireless ear bud and/or of the secondary wireless ear bud. 
     The wireless ear bud  165 , in some embodiments, does not include any type of user input such as a button, so a user cannot explicitly provide a manual input to the wireless ear bud  165  to indicate that the user wants the wireless ear bud  165  to perform an action. For example, known headphones can include a button on the headphones that is used to answer an incoming voice call from a connected smartphone. 
     Accordingly, the present technology involves using a wearing status of a wearable device and using changes in the wearing status of the wearable device to cause changes to a behavior of companion communication devices, which can include changes to the behavior of applications running on companion communication devices. 
     A wide variety of behaviors on the companion communication device can be changed based on a change in the wearing status of either or both of the wireless ear buds. For example, audio information associated with a music application can be routed to a paired wireless ear bud when the wireless ear bud is inserted into a user&#39;s ear. Further, the routing of an audio stream can be changed, e.g., from a speaker to the wireless ear bud, when the wireless ear bud is inserted into a user&#39;s ear. Likewise, a control component (e.g., a “play” instruction or a “pause” instruction) can be executed when a paired wireless ear bud is inserted into or is removed from a user&#39;s ear. 
     In another example, an in-coming voice call received at a paired companion communication device, such as a paired smartphone, can be automatically answered by the companion communication device when the companion communication device receives data indicating that a paired wireless ear bud is placed in (or inserted into) a user&#39;s ear. Also, the audio from the voice call can be sent to the paired wireless ear bud, and the companion communication device can receive, from the paired wireless ear bud, voice data of the user acquired via the microphone of the paired wireless ear bud. In some embodiments, the voice call can be processed by a voice application executing on the companion communication device. 
     In some embodiments of the present technology, an operating system or operational settings of a device, e.g., a companion communication device, can be changed in response to a wearing status or to a change in wearing status of a paired wearable device, e.g., a paired wireless ear bud. For example, a companion communication device can have a default setting embedded in its operating system to require a fingerprint sensor to confirm a user&#39;s fingerprint before unlocking the companion communication device or before completing a purchase request using the companion communication device. According to the present technology, a pair of glasses with a camera that can perform retinal scanning can detect a user putting on the glasses, scan a user&#39;s retina to confirm the user&#39;s identity based on the change in wearing status, and automatically send a signal to cause an operating system of a companion communication device to confirm the user&#39;s identity and to unlock the companion communication device or to allow the user to complete a purchase request. 
     Although a number of behaviors are described explicitly herein, those with ordinary skill in the art having the benefit of the present disclosure will readily appreciate that a wide variety of other behaviors can be changed by a companion communication device that receives a wearing status or a change in a wearing status from a paired wearable device. 
       FIG. 1B  illustrates a system  100  having two coupled wearable wireless ear buds  165 ,  110  paired with one or more companion communication devices  115 ,  120 ,  125  according to some embodiments of the present technology. Wireless ear bud  165  can serve as a primary wireless ear bud, and wireless ear bud  110  can serve as a secondary wireless ear bud. The primary wireless ear bud  165  can pair with one or more of the companion communication devices  115 ,  120 ,  125  and also can route audio data to the secondary wireless ear bud  110 . 
     The wireless ear buds  165 ,  110  can detect, via sensors  195 , when the wireless ear buds  165 ,  110  are worn in a user&#39;s ear. The primary wireless ear bud  165  can receive data from the secondary wireless ear bud  110  that describes the wearing status of the secondary wireless ear bud  110 . Also, the primary wireless ear bud  165  can send its own wearing status and the wearing status of the secondary wireless ear bud  110  to the companion communication devices  115 ,  120 ,  125  with which the primary wireless ear bud  165  is paired. Likewise, the primary wireless ear bud  165  can receive data from the paired companion communication devices  115 ,  120 ,  125 , and the data can reflect a changed behavior of the companion communication devices  115 ,  120 ,  125  responsive to a change in the wearing status of one or more of the wireless ear buds  110 ,  165 . 
       FIG. 2  illustrates a flowchart  200  of an exemplary method of controlling the behavior of a companion communication device wirelessly paired with a wireless ear bud according to some embodiments of the present technology. The method includes, at  210 , the companion communication device receiving a signal, from the paired wireless ear bud, that indicates a wearing status of the paired wireless ear bud. The method further includes, at  220 , the companion communication device routing audio data of the companion communication device to an output of the companion communication device based on the wearing status of the paired wireless ear bud. For example, the signal received from the paired wireless ear bud can indicate the wearing status of the paired wireless ear bud, and when the wearing status of the paired wireless ear bud is that the paired wireless ear bud is worn in a user&#39;s ear, the companion communication device can route the audio data of the companion communication device to the paired wireless ear bud. On the other hand, when the signal received from the paired wireless ear bud indicates that the wearing status of the paired wireless ear bud is such that the paired wireless ear bud not worn in the user&#39;s ear, the companion communication device can route the audio data to an alternate output such as to a default output, a most recently used output, another available wireless output, or other output of the companion communication device. 
     At  230 , the method also includes the companion communication device receiving a signal from the paired wireless ear bud indicating that the wearing status of the wireless ear bud has changed. In response, at  240 , the behavior of the companion communication device can change based at least in part on the wearing status of the paired wireless ear bud as indicated in the signal received from the paired wireless ear bud. 
       FIGS. 3A to 3N  illustrate examples of changes in wearing status of wireless ear buds paired to companion communication devices, where the changes in wearing status changes the behavior of companion communication devices according to some embodiments of the present technology. 
       FIG. 3A  illustrates a wireless ear bud  300  paired with a companion communication device  350  with a voice call being received, but with the on-screen call answering button of the companion communication device  350  not being pressed. As shown in  FIG. 3B , the wireless ear bud  300  can detect when it is worn in an ear and can send a signal to the companion communication device  350  indicating a change in wearing status from out-of-ear to in-ear. The companion communication device  350  can use the received signal to perform one or more actions, such as to automatically answer the incoming voice call, to route audio from the voice call to the paired wireless ear bud  300 , and to receive user audio data obtained via the microphone of the wireless ear bud  300 . 
     The present technology allows the action of placing a wireless ear bud into an ear to automatically answer a voice call without any user setup, configuration, etc. Also, as explained in greater detail below, in some embodiments, the wireless ear buds can be made discoverable and can pair with a user&#39;s companion communication device by opening a wireless ear bud case that houses a pair of wireless ear buds. Accordingly, the present technology can provide a user with the ability to automatically answer a voice call by placing one or both wireless ear buds in the user&#39;s ear after opening a wireless ear bud case and without requiring user configuration. 
     Next, as shown in  FIG. 3C , the companion communication device  350  can receive a signal from the paired wireless ear bud  300  that the wearing status of the wireless ear bud has changed from in-ear to out-of-ear, such as when the wireless ear bud is removed from the user&#39;s ear. Similarly, as shown in  FIG. 3D , the companion communication device  350  can determine that the wireless ear bud  300  is no longer paired with the companion communication device  350 . For the events shown in  FIGS. 3C and 3D , the companion communication device  350  can determine to route audio for the voice call to a different output of the companion communication device  350 , such as to a speaker of the companion communication device  350 , an alternate output (e.g., a previously connected wireless speaker, a vehicle wireless system, etc.), or the like. 
       FIG. 3E  illustrates a wireless ear bud  300  paired with a companion communication device  350  with a voice call being received and an on-screen call answering button of the companion communication device  350  being pressed. Initially, as shown in  FIG. 3F , the voice call is answered with the audio routed to a speaker of the companion communication device  350  (or to an alternate output as specified by the user of the companion communication device  350 ). However, as shown in  FIG. 3G , when the companion communication device  350  receives a signal indicating a change in a wearing status of the wireless ear bud  300 , which indicates that the wireless ear bud  300  is worn in a user&#39;s ear, the companion communication device  350  routes audio from the voice call to the paired wireless ear bud  300 . Additionally, the companion communication device  350  receives user audio output from the wireless ear bud  300 , the user audio being obtained via a microphone of the wireless ear bud  300 . 
       FIG. 3H  illustrates a wireless ear bud  300  paired with a companion communication device  350  and a voice call received on the companion communication device  350 . When the voice call is answered by the user by pressing an on-screen call answering button of the companion communication device  350 , the companion communication device  350  can, based on a signal received from the wireless ear bud  300  that indicates an in-ear status for the wireless ear bud  300 , route audio of the voice call to the paired wireless ear bud  300  automatically. Additionally, the companion communication device  350  can receive from the wireless ear bud  300  user audio data for the voice call obtained via the microphone of the wireless ear bud  300 . 
     As explained above, a wide variety of behaviors of a companion communication device can be controlled based at least in part on the companion communication device receiving a signal that indicates a wearing status and/or a change in wearing status of a paired wearable device. 
       FIG. 3I  illustrates a wireless ear bud  300  paired with a companion communication device  350  playing audio through a music application or other media application executing on the companion communication device  350 . As shown in  FIG. 3J , the wireless ear bud  300  can detect when the wireless ear bud  300  is placed in an ear and can send a signal to the companion communication device  350  indicating a change in a wearing status of the wireless ear bud  300 , e.g., from out-of-ear to in-ear. The companion communication device  350  can use the signal received from the wireless ear bud  300  to automatically route audio for the music/media application executing on the companion communication device  350  to the paired wireless ear bud  300 . 
     Next, as shown in  FIGS. 3K and 3L , the companion communication device  350  can receive a signal from the paired wireless ear bud  300  indicating that the wearing status of the wireless ear bud  300  has changed, such as when the wireless ear bud  300  is removed from the user&#39;s ear. As illustrated in  FIG. 3K , the companion communication device  350  can determine to pause the playback of music/audio, or, as illustrated in  FIG. 3L , the companion communication device  350  can determine to route the music/audio to a speaker of the companion communication device  350  or to an alternate output of the companion communication device  350  (e.g., to a previously connected wireless speaker, to a vehicle wireless system, etc.), or the like. In some embodiments, a user of the companion communication device  350  can press an on-screen button on the companion communication device  350  to play a music application, after the companion communication device  2350  pauses the music application due to a change in wearing status of a paired wireless ear bud  300 , e.g., from in-ear to out-of-ear. Alternatively, the companion communication device  350  can receive a subsequent signal that indicates a change in wearing status of the paired wireless ear bud  300 , e.g., from out-of-ear to in-ear, and can cause the music application executing on the companion communication device  350  to resume playback of music/audio and to route the music/audio to the paired wireless ear bud  300 . 
     In some cases, the behavior of a companion communication device can be based on the wearing status of both wireless ear buds in a pair of coupled wireless ear buds. For example, a primary wireless ear bud in a pair of coupled wireless ear buds can receive wearing status data from a secondary wireless ear bud and provide the companion communication device with the wearing status of both wireless ear buds. Alternatively, each wireless ear bud in the pair of coupled wireless ear buds can provide wearing status to the companion communication device. In either case, the companion communication device can change its behavior based on the wearing status of both of the wireless ear buds. For instance, a companion communication device can automatically pause audio only when both wireless ear buds of a pair of coupled wireless ear buds are not worn in ears of the user. In another example, the companion communication device can route audio to a wireless ear bud in mono when only one wireless ear bud is worn in an ear of the user and can route audio to both wireless ear buds in stereo when both wireless ear buds are worn in ears of the user. In some cases, the companion communication device can change its behavior in response to receiving wearing status from a single device, from a pair of devices, from two or more unrelated devices, etc. For example, when a companion communication device detects that a user is wearing a wireless ear bud that can provide audio output and is also wearing glasses that can provide visual output, the companion communication device can route audio information of a video call to the wireless ear bud and can route a video component of the video call to the glasses. 
       FIG. 3M  illustrates a wireless ear bud  300  paired with a companion communication device  360  that is receiving a text message. The wireless ear bud  300  can detect when the wireless ear bud  300  is placed in an ear of a user and can send a signal to the companion communication device  360  indicating a change in a wearing status of the wireless ear bud  300 , e.g., from out-of-ear to in-ear. As shown in  FIG. 3N , responsive to the companion communication device  360  receiving the signal indicating a change in wearing status of the wireless ear bud  300  from out-of-ear to in-ear under a predetermined condition (e.g., within a predetermined threshold time period), the companion communication device  360  can use text-to-speech software to cause the text message to be converted and sent as audio data to the paired wireless ear bud  300  to play back to the user. In addition, after playback of the audio corresponding to the text message ends, the wireless ear bud  300  can send to the companion communication device  360 , voice data of the user obtain via a microphone of the wireless ear bud, and the companion communication device  360  can automatically compose a reply text message using speech-to-text software. 
     In some embodiments, a companion communication device can send a signal to a paired wearable device to override one or more features to allow signals indicating a wearing status and/or changes in a wearing status to cause changes in operating behavior of the companion communication device. 
     In some embodiments of the present technology, a companion communication device can receive a signal from a paired wearable device indicating that the wearable device is being charged, being housed in a case, charging in a case, etc. The companion communication device can determine whether to perform certain actions based on such types of events. For example, when a companion communication device is paired with a wearable device that is housed within a case, the companion communication device can perform a polling procedure to locate other devices with which to pair the companion communication device. 
       FIG. 4  illustrates a wireless ear bud case  400  according to some embodiments of the present technology. The wireless ear bud case  400  houses a pair of wireless ear buds  405 ,  410  and can connect the wireless ear buds  405 ,  410  while housed within the wireless ear bud case  400 . The wireless ear bud case  400  can include a cover  445  that closes to cover the wireless ear buds  405 ,  410  housed within the wireless ear bud case  400 , and the wireless ear bud case  400  can include a sensor  455  that detects when the cover  445  of the wireless ear bud case  400  is opened and when the cover  445  of the wireless ear bud case  400  is closed. In some embodiments, the wireless ear buds  405 ,  410  are configured to pair with a companion communication device automatically when the wireless ear bud case  400  is opened for a first time. 
     The wireless ear bud case  400  also includes a battery  430  that can be used for re-charging the wireless ear buds  405 ,  410  and a charging interface  435  for connecting the battery  430  to a power source. The wireless ear bud case  400  can also include an indicator  440  to show a charge status of the wireless ear buds  405 ,  410  and of the wireless ear bud case  400 . The wireless ear bud case  400  also includes an input  460 , such as a depressible button, to receive manual input to cause the wireless ear buds  405 ,  410  in the wireless ear bud case  400  to pair to each other and/or to become discoverable to other devices, such as to companion communication devices. 
     The wireless ear bud case  400  can also include a processor  420 , memory  425 , and a communication interface  450  that can be used to create a link  415  between the wireless ear buds  405 ,  410  via the communication interface  450 . 
     The wireless ear buds  405 ,  410  can be paired to a companion communication device. The companion communication device can receive a signal from a pair of wireless ear buds  405 ,  410 , the signal indicating that the wireless ear buds  405 ,  410  are housed in the wireless ear bud case  400 , are charging in the wireless ear bud case  400 , etc. The companion communication device can determine whether to perform certain actions based on such events, e.g., based at least in part on a wearing status of one or more wireless ear buds  405 ,  410 , a housing indication for the one or more wireless ear buds  405 ,  410 , and/or a charging status of the one or more wireless ear buds  405 ,  410 . 
     In some embodiments of the present technology, a companion communication device can execute an operating system that allows customization of operating system settings, application preference settings, user interface settings, etc. As a result, multiple applications that have audio components can execute simultaneously on the companion communication device. Therefore, a decision to automatically route audio (or more generally media) to a wearable device in response to occurrence of an event (e.g., when music is output by a music player) is not intuitive. Accordingly, some embodiments of the present technology involve a wearable device pairing with a companion communication device and causing the companion communication device to provide an indication that allows audio (or more generally media) to a wearable device. For example, pairing a wireless ear bud with a laptop and subsequently receiving a signal from the wireless ear bud that indicates the wireless ear bud is worn in an ear of a user can cause the laptop to publish an audio route that allows user-selectable controls to route audio from an application running on the laptop (e.g., a video chat application, a music player application, etc.) to the wearable device. When the companion communication device receives a signal indicating that the wireless ear bud is not worn, e.g., removed, from an ear of the user, the companion communication device can revoke (e.g., un-publish) the wireless ear bud as an audio route and revert to another audio route, such as a default audio route or a previously used audio route. 
     In an embodiment, a method, performed by a companion communication device, includes: determining, based on a first signal received from a wireless ear bud, a first wearing status indicating whether a user is wearing the wireless ear bud; sending audio information of the companion communication device to a first output based on the first wearing status; detecting, based on a second signal received from the wireless ear bud, a change in wearing status of the wireless ear bud to a second wearing status; and changing a behavior of the companion communication device based at least in part on the change in the wearing status of the wireless ear bud. 
     In some embodiments, sending the audio information of the companion communication device to the first output includes sending the audio information of the companion communication device to the wireless ear bud via a wireless communication interface of the companion communication device when the first wearing status indicates that the user is wearing the wireless ear bud or that the user placed the wireless ear bud in an ear of the user. In some embodiments, detecting the change in the wearing status of the wireless ear bud to the second wearing status includes detecting when the wireless ear bud is removed from the ear of the user. In some embodiments, changing the behavior of the companion communication device includes sending the audio information of the companion communication device to an alternate output when the user is not wearing the wireless ear bud of the wireless ear bud is removed from the ear of the user. In some embodiments, the alternate output includes an output of the companion communication device used for audio reproduction before sending the audio information of the companion communication device to the wireless ear bud. In some embodiments, changing the behavior of the companion communication device includes pausing the audio information of the companion communication device when the wireless ear bud is removed from the ear of the user. In some embodiments, detecting the change in the wearing status of the wireless ear bud includes detecting when the wireless ear bud is placed in an ear of the user. In some embodiments, changing the behavior of the companion communication device includes sending the audio information of the companion communication device to the wireless ear bud via a wireless communication interface of the companion communication device when the wireless ear bud is placed in the ear of the user. In some embodiments, the audio information of the companion communication device comprises audio information associated with a voice application for voice calls, and changing the behavior of the companion communication device includes, when the wireless ear bud is placed in the ear of the user, answering an in-coming voice call, and sending the audio information associated with the voice application for the in-coming voice call to the wireless ear bud via a wireless communication interface of the companion communication device. 
     In an embodiment, a wearable device includes: a processor; a sensor configured to determine a first wearing status indicating whether the wearable device is being worn; and a communication interface configured to pair the wearable device to a companion communication device and to send a signal to the companion communication device to cause the companion communication device to send audio information of the companion communication device to a first output based on the first wearing status, where the sensor is further configured to detect a change in wearing status of the wearable device to a second wearing status, and the communication interface is further configured to send a signal to the companion communication device to cause the companion communication device to change a behavior of the companion communication device based at least in part on the change in the wearing status of the wearable device. 
     In some embodiments, the wearable device further includes a speaker, where the communication interface is further configured to receive the audio information of the companion communication device, and the processor is configured to play the audio information of the companion communication device via the speaker of the wearable device as the first output. In some embodiments, the sensor is further configured to detect when the wearable device is not worn by the user. In some embodiments, the signal sent to the companion communication device causes the companion communication device to send the audio information of the companion communication device to an alternate output when the wearable device is not being worn. In some embodiments, the signal to the companion communication device to cause the companion communication device to change the behavior of the companion communication device includes a signal to pause the audio information when the wearing status of the wearable device changes to indicate that the wearable device is no longer being worn. In some embodiments, the sensor is further configured to detect when the wearable device is placed into an ear. In some embodiments, the signal to the companion communication device causing the companion communication device to change the behavior of the companion communication device causes the companion communication device to route the audio information of the companion communication device to the wearable device when the wearable device is placed into the ear. In some embodiments, the audio information of the companion communication device includes audio information of a voice application for voice calls, and changing the behavior of the companion communication device includes, when the wearable device is placed into the ear, answering an in-coming voice call; and sending the audio information of the voice application for the in-coming voice call to the wearable device. 
     In an embodiment, a method performed by a companion communication device includes: determining, based on a first signal received from a wireless ear bud, a first wearing status indicating whether a user is wearing the wireless ear bud; receiving an incoming voice call at the companion communication device; and when the first wearing status indicates the user is wearing the wireless ear bud, answering the voice call; and sending audio information of the voice call to the wireless ear bud. 
     In some embodiments, the method further includes: when the first wearing status indicates the user is not wearing the wireless ear bud, detecting, based on a second signal received from the wireless ear bud, a change in wearing status of the wireless ear bud to a second wearing status indicating that the user inserted the wireless ear bud into an ear of the user; and responsive to the detecting the change in the wearing status of the wireless ear bud to the second wearing status, sending the audio information of the voice call to the wireless ear bud. In some embodiments, the method further includes: detecting, based on a third signal received from the wireless ear bud, a further change in the wearing status of the wireless ear bud to a third wearing status indicating that the user removed the wireless ear bud from the ear of the user; and responsive to the detecting the change in the wearing status of the wireless ear bud to the third wearing status, sending the audio information of the voice call to a speaker of the companion communication device. 
     In an embodiment, a method of changing a behavior of a companion communication device by a wearable device includes: pairing the wearable device with the companion communication device; determining, using a sensor of the wearable device, a first wearing status indicating whether a user is wearing the wearable device; sending a signal to the companion communication device to cause the companion communication device to send audio information of the companion communication device to a first output based on the first wearing status; detecting a change in wearing status of the wearable device to a second wearing status; and sending a signal to the companion communication device to cause the companion communication device to change a behavior of the companion communication device based at least in part on the change in wearing status of the wearable device. 
     In an embodiment, a non-transitory computer-readable storage medium stores instructions that, when executed by a computing device, cause the computing device to perform a method including: determining, based on a first signal received from a wireless ear bud, a first wearing status indicating whether a user is wearing the wireless ear bud; sending audio information of the computing device to a first output based on the first wearing status; detecting, based on a second signal received from the wireless ear bud, a change in wearing status of the wireless ear bud to a second wearing status; and changing a behavior of the computing device based at least in part on the change in the wearing status of the wireless ear bud. 
     In an embodiment, an apparatus includes: means for determining, based on a first signal received from a wireless ear bud, a first wearing status indicating whether a user is wearing the wireless ear bud; means for sending audio information of the computing device to a first output based on the first wearing status; means for detecting, based on a second signal received from the wireless ear bud, a change in wearing status of the wireless ear bud to a second wearing status; and means for changing a behavior of the computing device based at least in part on the change in the wearing status of the wireless ear bud. 
       FIG. 5A  and  FIG. 5B  illustrate exemplary possible system embodiments.  FIG. 5A  illustrates a conventional system bus computing system architecture  500  wherein the components of the system are in electrical communication with each other using a bus  505 . Exemplary system  500  includes a processing unit (CPU or processor)  510  and a system bus  505  that couples various system components including the system memory  515 , such as read only memory (ROM)  520  and random access memory (RAM)  525 , to the processor  510 . The system  500  can include a cache of high-speed memory connected directly with, in close proximity to, or integrated as part of the processor  510 . The system  500  can copy data from the memory  515  and/or the storage device  530  to the cache  512  for quick access by the processor  510 . In this way, the cache can provide a performance boost that avoids processor  510  delays while waiting for data. These and other modules can control or be configured to control the processor  510  to perform various actions. Other system memory  515  may be available for use as well. The memory  515  can include multiple different types of memory with different performance characteristics. The processor  510  can include any general purpose processor and a hardware module or software module, such as module  1   532 , module  2   534 , and module  3   536  stored in storage device  530 , configured to control the processor  510  as well as a special-purpose processor where software instructions are incorporated into the actual processor design. The processor  510  may essentially be a completely self-contained computing system, containing multiple cores or processors, a bus, memory controller, cache, etc. A multi-core processor may be symmetric or asymmetric. 
     To enable user interaction with the computing device  500 , an input device  545  can represent any number of input mechanisms, such as a microphone for speech, a touch-sensitive screen for gesture or graphical input, keyboard, mouse, motion input, speech and so forth. An output device  535  can also be one or more of a number of output mechanisms known to those of skill in the art. In some instances, multimodal systems can enable a user to provide multiple types of input to communicate with the computing device  500 . The communications interface  540  can generally govern and manage the user input and system output. There is no restriction on operating on any particular hardware arrangement and therefore the basic features here may easily be substituted for improved hardware or firmware arrangements as they are developed. 
     Storage device  530  is a non-volatile memory and can be a hard disk or other types of computer readable media which can store data that are accessible by a computer, such as magnetic cassettes, flash memory cards, solid state memory devices, digital versatile disks, cartridges, random access memories (RAMs)  525 , read only memory (ROM)  520 , and hybrids thereof. 
     The storage device  530  can include software modules  532 ,  534 ,  536  for controlling the processor  510 . Other hardware or software modules are contemplated. The storage device  530  can be connected to the system bus  505 . In one aspect, a hardware module that performs a particular function can include the software component stored in a computer-readable medium in connection with the necessary hardware components, such as the processor  510 , bus  505 , output device  535 , and so forth, to carry out the function. 
       FIG. 5B  illustrates a computer system  550  having a chipset architecture that can be used in executing the described method and generating and displaying a graphical user interface (GUI). Computer system  550  is an example of computer hardware, software, and firmware that can be used to implement the disclosed technology. System  550  can include a processor  555 , representative of any number of physically and/or logically distinct resources capable of executing software, firmware, and hardware configured to perform identified computations. Processor  555  can communicate with a chipset  560  that can control input to and output from processor  555 . In this example, chipset  560  outputs information to output  565 , such as a display, and can read and write information to storage device  570 , which can include magnetic media, and solid state media, for example. Chipset  560  can also read data from and write data to RAM  575 . A bridge  580  for interfacing with a variety of user interface components  585  can be provided for interfacing with chipset  560 . Such user interface components  585  can include a keyboard, a microphone, touch detection and processing circuitry, a pointing device, such as a mouse, and so on. In general, inputs to system  550  can come from any of a variety of sources, machine generated and/or human generated. 
     Chipset  560  can also interface with one or more communication interfaces  590  that can have different physical interfaces. Such communication interfaces can include interfaces for wired and wireless local area networks, for broadband wireless networks, as well as personal area networks. Some applications of the methods for generating, displaying, and using the GUI disclosed herein can include receiving ordered datasets over the physical interface or be generated by the machine itself by processor  555  analyzing data stored in storage device  570 . Further, the machine can receive inputs from a user via user interface components  585  and execute appropriate functions, such as browsing functions by interpreting these inputs using processor  555 . 
     It can be appreciated that exemplary systems  500  and  550  can have more than one processor  510  or be part of a group or cluster of computing devices networked together to provide greater processing capability. 
     For clarity of explanation, in some instances the present technology may be presented as including individual functional blocks including functional blocks comprising devices, device components, steps or routines in a method embodied in software, or combinations of hardware and software. 
     In some embodiments the computer-readable storage devices, mediums, and memories can include a cable or wireless signal containing a bit stream and the like. However, when mentioned, non-transitory computer-readable storage media expressly exclude media such as energy, carrier signals, electromagnetic waves, and signals per se. 
     Methods according to the above-described examples can be implemented using computer-executable instructions that are stored or otherwise available from computer readable media. Such instructions can comprise, for example, instructions and data which cause or otherwise configure a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Portions of computer resources used can be accessible over a network. The computer executable instructions may be, for example, binaries, intermediate format instructions such as assembly language, firmware, or source code. Examples of computer-readable media that may be used to store instructions, information used, and/or information created during methods according to described examples include magnetic or optical disks, flash memory, Universal Serial Bus (USB) devices provided with non-volatile memory, networked storage devices, and so on. 
     Devices implementing methods according to these disclosures can comprise hardware, firmware and/or software, and can take any of a variety of form factors. Typical examples of such form factors include laptops, smart phones, small form factor personal computers, personal digital assistants, and so on. Functionality described herein also can be embodied in peripherals or add-in cards. Such functionality can also be implemented on a circuit board among different chips or different processes executing in a single device, by way of further example. 
     The instructions, media for conveying such instructions, computing resources for executing them, and other structures for supporting such computing resources are means for providing the functions described in these disclosures. 
     Although a variety of examples and other information was used to explain aspects within the scope of the appended claims, no limitation of the claims should be implied based on particular features or arrangements in such examples, as one of ordinary skill would be able to use these examples to derive a wide variety of implementations. Further and although some subject matter may have been described in language specific to examples of structural features and/or method steps, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to these described features or acts. For example, such functionality can be distributed differently or performed in components other than those identified herein. Rather, the described features and steps are disclosed as examples of components of systems and methods within the scope of the appended claims.

Metadata:
Filing Date: 20180831
Publication Date: 20210406
Grant Date: 20210406
Priority Date: 20150605
Inventors: WATSON, ROBERT D.
SHAW, David John
CHAWAN, Arun Dhyaneshwar
GILLETTE, Matthew
GANAPATHI BATTA, Ganesha Adkasthala
MOORE, JEFFREY CHANDLER
BERNHARD, Patrick Ian
CHANG, Baek San
COFFMAN, PATRICK LEE
BENNETT, JONATHAN ANDERSON
GUETTA, ANTHONY
MINOO, JAHAN CHRISTIAN
RAUENBUEHLER, KEITH WALTER
Assignee: APPLE INC
CPC Classifications: [{"code": "H04R1/1041", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R29/001", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R2420/07", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04R1/1016", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04M1/72442", "inventive": true, "first": false, "tree": "[]"}, {"code": "G08C17/02", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R29/001", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/162", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F3/162", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R1/1016", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R29/001", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R2420/07", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04R1/1016", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04R1/1025", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/165", "inventive": true, "first": true, "tree": "[]"}, {"code": "H04R2420/07", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04R1/1041", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R1/1041", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/165", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F3/165", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/165", "inventive": true, "first": true, "tree": "[]"}, {"code": "H04R2420/07", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04R1/1016", "inventive": false, "first": false, "tree": "[]"}, {"code": "H04R1/1041", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R29/001", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/162", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04W4/20", "inventive": true, "first": true, "tree": "[]"}, {"code": "H04W76/14", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/162", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F3/165", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R1/1091", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R3/12", "inventive": true, "first": false, "tree": "[]"}, {"code": "H04R2420/07", "inventive": false, "first": false, "tree": "[]"}]
Family ID: 57442029