Patent Description:
A conventional personal sound system typically includes an audio device configured to generate audio signals and a set of headphones configured to output sound derived from those audio signals into the ears of a user. For example, a conventional digital music player generates audio signals based on a music file and then transmits those signals to a pair of headphones or earbuds that output sound into the ears of the user.

Conventional personal sound systems function well in the specific context of a user listening to sound in isolation. However, such systems must be adapted to operate in the wider context of a user listening to sound in proximity to others. In particular, in a social setting, a user of a personal sound system may wish to facilitate the shared experience of listening to sound with others.

In such situations, users of personal sound systems oftentimes share one headphone or earbud with other listeners. Such approaches can be cumbersome, though, because headphone wires are usually too short to allow comfortable listening and may become tangled easily. In addition, when using only one headphone or earbud, any stereo effects are lost, resulting in a much less immersive listening experience. Further, such approaches enable sound to be shared between no more than two people. Thus, as a general matter, conventional personal sound systems cannot easily be used with multiple listeners. Publication <CIT> discloses an audio system having a computing apparatus for generating a sound field in a room using beamforming transducers. The audio system is configured to dynamically provide customized sound to different listeners, and each listener can choose the kind of sound that he prefers. Publications <CIT> and <CIT> disclose a shoulder-mounted speakers with a sensor for determining a speaker direction and directing the sound to the ear of a listener. Publications <CIT> and <CIT> disclose head-mounted speaker assemblies for targeting the sound toward the ears of a user. Publication <CIT> discloses a hand-held electronic device includes an earpiece, a first speaker having a first primary audio output ported to the earpiece, a second speaker having a second primary audio output and a second bass reflex output, with the second bass reflex audio output also being ported to the earpiece. The device includes a use case manager configured to determine a mode of operation of the device, and a controller configured to drive the first and second speakers in either a broadcast mode or a private mode in response to a signal from the use case manager. The polarity of the signal driving the second speaker is inverted for frequencies below the bass reflex port resonance frequency, to thereby provide a higher total combined energy in the vicinity of port resonance. The controller is configured to apply a first signal to the first speaker and a second signal to the second speaker. The controller is further configured to apply said first and second signals in phase to said first and second speakers, respectively, for all frequencies when said device is operating in said broadcast mode; apply said first and second signals in phase to said first and second speakers, respectively, for all frequencies above a predetermined threshold when said device is operating in said private mode; and apply said first and second signals out of phase to said first and second speakers, respectively, for all frequencies below said predetermined threshold when said device is operating in said private mode, such that the primary output of the first speaker and the bass reflex output of the secondary speaker are in phase throughout the frequency range of interest for both speakers.

As the foregoing illustrates, a more effective approach to sharing sound across multiple listeners would be useful.

One or more embodiments set forth a method for distributing sound between listeners using a wearable device, wherein the wearable device is worn by a first listener and comprises an input/output subsystem that includes a sensor array and a speaker array. The method includes configuring the speaker array to operate in a first mode, where, in the first mode, the speaker array generates a first sound field in which sound is output towards a first listener and away from a second listener by targeting the sound toward an ear of the first user and avoiding emitting sounds elsewhere, transitioning the speaker array from the first mode to a second mode in response to a first triggering event, and configuring the speaker array to operate in the second mode, where, in the second mode, the speaker array generates a second sound field in which sound is output towards the first listener and the second listener by broadcasting the sound multidirectionally and allowing the second listener to listen to the sound. The method further comprises detecting the first triggering event based on sensor data associated with the first listener or based on sensor data associated with an environment in which the first listener resides.

Further embodiments provide, among other things, a system and a computer-readable medium configured to implement the method set forth above.

One advantage of the techniques described herein is that users of the audio sharing system can listen to sound in isolation from others at some times, and selectively share sound with nearby listeners at other times.

So that the manner in which the above recited features can be understood in detail, a more particular description of the various embodiments, briefly summarized above, may be had by reference to certain embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments and are therefore not to be considered limiting of scope, for the contemplated embodiments may admit to other equally effective embodiments.

In the following description, numerous specific details are set forth to provide a more thorough understanding of the various embodiments.

As discussed above, conventional personal sound systems are specifically designed to emit audio to one listener in isolation from others, and therefore cannot easily be used in social contexts. Specifically, conventional personal sound systems do not have any inbuilt mechanism for sharing audio between multiple listeners.

To address this issue, various embodiments include an audio sharing system configured to operate in at least two modes of operation. In a private mode, the audio sharing system outputs sound only to the user and may isolate the user from the surrounding acoustic environment. In a public mode of operation, the audio sharing system broadcasts sound to the user and to any other listeners in proximity to the user, thereby sharing sound in a social manner. The audio sharing system may also operate in other modes of operation that allow the selective sharing of sounds. One advantage of the techniques described herein is that users of the audio sharing system can listen to sound in isolation from others at some times, and selectively share sound with nearby listeners at other times.

<FIG> illustrate an audio sharing system configured to implement one or more aspects of the present embodiments. As shown in <FIG>, audio sharing system <NUM> is configured to be worn by a user <NUM>. In particular, components of audio sharing system <NUM> may be coupled with the head <NUM> and/or shoulders <NUM> of user <NUM>. Other components of audio sharing system <NUM> can be stored in the clothing of user or carried by user, among other options. Various implementations of audio sharing system are discussed in greater detail below in conjunction with <FIG>.

In operation, audio sharing system <NUM> is configured to emit sound to generate a sound field <NUM>(A). In this configuration, audio sharing system <NUM> operates in a "private" mode of operation and therefore generates sound field <NUM>(A) in the immediate proximity of user <NUM>. When operating in private mode, audio sharing system <NUM> may implement directional sound techniques to direct sound targeting user <NUM> and to avoid emitting sound that can be perceived by nearby listeners <NUM>(<NUM>) and <NUM>(<NUM>). These directional sound techniques may involve beamforming and/or steerable sound arrays, as discussed specifically in conjunction with <FIG>. These directional sound techniques may also involve mechanical approaches to directing sound, as discussed specifically in conjunction with <FIG>.

In response to various triggering events, audio sharing system <NUM> is configured to transition between different modes of operation. A triggering event may be identified based on input received from user <NUM>, or input received from the environment surrounding user <NUM>. For example, and without limitation, audio sharing system <NUM> could transition between modes of operation in response to voice commands received from user <NUM>. Alternatively, audio sharing system <NUM> could transition between modes of operation upon identifying other nearby listeners. Other triggering events are discussed in greater detail below in conjunction with <FIG>. Additional modes of operation are discussed below.

Audio sharing system <NUM> may generate different sound fields corresponding to each different mode of operation. <FIG> illustrates a sound field generated when audio sharing system <NUM> operates in a "public" mode of operation.

As shown in <FIG>, audio sharing system <NUM> is configured to generate a sound field <NUM>(B) when operating in public mode. Sound field <NUM>(B) represents an expanded version of sound field <NUM>(A). Sound field <NUM>(B) may be perceptible by user <NUM> as well as listeners <NUM>(<NUM>) and <NUM>(<NUM>). In this manner, audio sharing system <NUM> facilitates the sharing of sound in a social context, thereby overcoming restrictions associated with conventional personal sound systems.

Audio sharing system <NUM> may also generate more precisely formed sound fields. <FIG> illustrates a sound field generated when audio sharing system <NUM> operates in a "selective" mode of operation.

As shown in <FIG>, audio sharing system <NUM> is configured to generate a sound field <NUM>(C) when operating in selective mode. Sound field <NUM>(C) is precisely formed to be perceptible by user <NUM> and listener <NUM>(<NUM>) and may not be perceptible by listener <NUM>(<NUM>). This approach may be implemented in a social context that includes subgroupings of listeners. For example, and without limitation, user <NUM> and listeners <NUM> could collectively share a public space, although user <NUM> and listener <NUM>(<NUM>) could form a subgroup, such as a conversational grouping, that does not include listener <NUM>(<NUM>). Accordingly, user <NUM> could wish to share sound with listener <NUM>(<NUM>) without disturbing or including listener <NUM>(<NUM>).

Audio sharing system <NUM> may also generate focused sound fields targeting specific listeners. <FIG> illustrates a sound field generated when audio sharing system <NUM> operates in a "spotlight" mode of operation.

As shown in <FIG>, audio sharing system <NUM> is configured to generate sound field <NUM>(D) when operating in spotlight mode. Sound field <NUM>(D) specifically targets listener <NUM>(<NUM>) and excludes user <NUM>. Accordingly, listener <NUM>(<NUM>) may perceive sound generated by audio sharing system <NUM> and user <NUM> may not perceive that sound. This particular mode of operation may be implemented when user <NUM> wishes to share sound with a nearby listener but does not wish to hear that sound. For example, and without limitation, user <NUM> could wish to share a voice message with listener <NUM>(<NUM>). User <NUM> could have already listened to that voice message and therefore wish to avoid listening to the message again. Thus, user <NUM> would cause audio sharing system <NUM> to generate sound field <NUM>(D) targeting listener <NUM>(<NUM>) and excluding user <NUM>.

As an example, audio sharing system <NUM> may also generate multiple sound fields simultaneously. <FIG> illustrates sound fields generated when audio sharing system <NUM> operates in a "multi" mode of operation.

As shown in <FIG>, audio sharing system <NUM> is configured to generate sound fields <NUM>(A) of <FIG>, sound field <NUM>(C) of <FIG>, as well as sound field <NUM>(E), simultaneously and in conjunction with one another. These different sound fields target different subgroups of user <NUM> and listeners <NUM>. In particular, sound field <NUM>(A) targets user <NUM> and may thus only be perceptible by user <NUM>, as previously discussed. Sound field <NUM>(C) targets both user <NUM> and listener <NUM>(<NUM>), and may thus only be perceptible by user <NUM> and listener <NUM>(<NUM>), as also discussed. In addition, sound field <NUM>(E) targets user <NUM> and listener <NUM>(<NUM>) and may thus only be perceptible by user <NUM> and listener <NUM>(<NUM>).

Each of the different sound fields shown may be derived from a different source of audio or may be derived from a common audio source modulated with different settings. For example, and without limitation, sound field <NUM>(A) could represent audio associated with a personal digital assistant that user <NUM> wishes to keep private. Further, sound field <NUM>(C) could represent audio to which listener <NUM>(<NUM>) has expressed interest in listening, while sound field <NUM>(E) could represent different audio to which listener <NUM>(<NUM>) has expressed interest in listening. In another example, sound field <NUM>(C) could be derived from a specific audio source and emitted with a first volume level, while sound field <NUM>(E) could also be derived from that same audio source although be emitted with a second volume level. In one embodiment, a given listener <NUM> may interact with audio sharing system <NUM> to configure settings that are specifically applied to sound fields associated with that listener <NUM>. In the manner discussed herein, audio sharing system <NUM> is configured to operate in multiple different modes simultaneously to generate different sound fields <NUM> in conjunction with one another.

In one embodiment, audio sharing system <NUM> generates and manages sound fields associated with multiple different conversational agents simultaneously. The different sound fields corresponding to each different conversational agent may be directed towards different groups of listeners. Each group of listeners may interact with a different conversational agent via the associated sound field. Audio sharing system <NUM> may coordinate conversations between these different groups of listeners and the corresponding conversational agents independently of one another. Alternatively, audio sharing system <NUM> may direct each different conversation based on the other conversations. In one example, without limitation, audio sharing system <NUM> may converse with a user who resides inside an automobile, and also converse with a pedestrian outside of the vehicle. These two conversations could occur via two different conversational agents that may or may not interact with one another (transparently to the user, in some cases), or via a single conversational agent.

Referring generally to <FIG>, when generating any of the sound fields <NUM> discussed above, audio sharing system <NUM> may perform digital signal processing or other sound modulation techniques to implement additional functionalities, as described in greater detail herein.

In one embodiment, audio sharing system <NUM> may generate modulated sound that appears, for a given listener (e.g., user <NUM> and/or listeners <NUM>), to be emitted from a specific direction. For example, and without limitation, when generating sound field <NUM>(A) shown in <FIG>, audio sharing system <NUM> could modulate sound field <NUM>(A) so that sound appears to originate from a specific location in the environment surrounding user <NUM>. Audio sharing system <NUM> could also modulate sound field <NUM>(A) to preserve this localized effect when user <NUM> moves through the environment. In this manner, audio sharing system <NUM> can simulate sources of sound that remain fixed in the surrounding environment.

In another embodiment, audio sharing system <NUM> may generate modulated sound to produce a sound field <NUM> that moves and/or changes shape over time. For example, and without limitation, when generating sound field <NUM>(C) shown in <FIG>, audio sharing system <NUM> could modulate sound field <NUM>(C) when listener <NUM>(<NUM>) moves relative to user <NUM> in order to continue emitting sound specifically to user <NUM> and listener <NUM>(<NUM>) during this movement.

In yet another embodiment, audio sharing system <NUM> may generate modulated sound that selectively incorporates environmental sounds into a sound field. For example, and without limitation, when generating sound field <NUM>(A) shown in <FIG>, audio sharing system <NUM> could modulate sound field <NUM>(A) to include environmental sounds emitted from nearby traffic, thereby providing user <NUM> with a certain degree of situational awareness.

As mentioned previously, audio sharing system <NUM> may include various types of audio devices configured to emit sound in a directional manner to generate sound fields <NUM>. <FIG> and <FIG>, respectively, set forth two examples of such devices.

<FIG> illustrate exemplary shoulder and/or neck mounted audio devices associated with the audio sharing system of <FIG>, according to various embodiments. As shown in each of <FIG>, user <NUM> wears a steerable acoustic array <NUM> on shoulder <NUM>. Steerable acoustic array <NUM> includes a collection of acoustic transducers configured to interoperate to generate highly directional sound, thereby allowing the formation of precisely shaped sound fields. Steerable acoustic array <NUM> could include, for example and without limitation, a set of microelectromechanical system (MEMS) devices, a set of ultrasonic transducers, or a set of micro-acoustic devices, among other possibilities.

As shown in <FIG>, via steerable acoustic array <NUM>, audio sharing system <NUM> may generate sound field <NUM>(A) that specifically targets the ear of user <NUM> and avoids emitting sound elsewhere. This configuration corresponds to the private mode of operation discussed previously. Audio sharing system <NUM> may then transition to public mode and adjust the output of steerable acoustic array <NUM> accordingly.

As shown in <FIG>, via steerable acoustic array <NUM>, audio sharing system may then generate sound field <NUM>(B) to broadcast sound multidirectionally, thereby allowing nearby listeners <NUM> to listen to shared audio. This configuration corresponds to the public mode of operation discussed previously. <FIG> depict another implementation of audio devices associated with audio sharing system <NUM>.

As shown in <FIG>, user <NUM> wears a neck-mounted acoustic array <NUM>. Neck-mounted acoustic array <NUM> may include a collection of acoustic transducers configured to interoperate to generate highly directional sound, thereby allowing the formation of precisely shaped sound fields, similar to steerable acoustic array <NUM> of <FIG>. Via neck mounted acoustic array <NUM>, audio sharing system <NUM> may generate sound field <NUM>(A) when operating in private mode, as shown in <FIG>. Audio sharing system <NUM> may then transition to public mode and generate sound field <NUM>(B), as shown in <FIG>. Audio sharing system <NUM> may also include audio devices that can be mounted to head <NUM> of user <NUM>, as described in greater detail below in conjunction with <FIG>.

<FIG> illustrate exemplary head-mounted audio devices associated with the audio sharing system of <FIG>, according to various embodiments. As shown in each of <FIG>, user <NUM> wears robotic hat <NUM> on head <NUM>. Robotic hat <NUM> includes mechanical flaps <NUM> configured to fold between a folded-down position and a folded-up position. Mechanical flaps may include actuators, electric motors, servomechanisms, steppers, solenoids, or other robotic elements configured to effect translation and/or rotation. Mechanical flaps may also actuate via shape change materials, including shape memory alloys, shape memory polymers, thermoplastics, dielectric electroactive polymers, and so forth.

When mechanical flaps are configured in the folded down position, as shown in <FIG>, each mechanical flap <NUM> covers a different ear of user <NUM> and directs sound into the respective ear. In this configuration, audio sharing system <NUM> operates in private mode and emits limited sound to the environment surrounding user <NUM>. When mechanical flaps <NUM> are configured in the folded-up position, as shown in <FIG>, each mechanical flap <NUM> faces outwards and directs sound into the surrounding environment. In this configuration, audio sharing system <NUM> operates in public mode.

In one embodiment, robotic hat <NUM> may further include one or more display screens coupled to a mechanically actuated brim of robotic hat <NUM>. This mechanically actuated brim may fold downwards to present a first display screen to user <NUM>. A second display screen on the opposite side of the brim may also be visible to other nearby listeners when the mechanically actuated brim is folded downwards. Audio sharing system <NUM> may selectively display visual content on either or both of these display screens depending on the current mode of operation. For example, and without limitation, when operating in private mode, audio sharing system <NUM> may display visual content only on the first display screen and therefore only to user <NUM>. When operation in public mode, however, audio sharing system <NUM> may also display visual content on the second display screen. In a related embodiment, robotic hat <NUM> may be a fully-featured augmented reality (AR) device or virtual reality (VR) device configured to transition between a private mode, where user <NUM> is partially or fully immersed in a simulated reality, and a public mode, where aspects of the simulated reality are shared with nearby listeners. Persons skilled in the art will recognize that the techniques associated with robotic hat <NUM> may also be implemented in the context of other forms of clothing and wearable items, including jacket collars, scarves, necklaces, backpacks, and so forth, for example and without limitation. Any of the embodiments involving video displays discussed above may also be combined with any of the audio-related embodiments discussed previously, as well.

As shown in <FIG>, the mechanisms discussed above in conjunction with <FIG> may also be applied to other types of hats. In particular, hat <NUM> shown in <FIG> may include a speaker <NUM>. When the brim of hat <NUM> is folded downwards, as shown in <FIG>, audio sharing system <NUM> operates in private mode. Then, when the brim of hat <NUM> is folded upwards, as shown in <FIG>, audio sharing system <NUM> operates in public mode.

Referring generally to <FIG>, the audio devices discussed in conjunction with these Figures may be implemented in combination with one another to generate any of the sound fields discussed above in conjunction with <FIG>. In addition, the audio devices described above may also be implemented in combination with various digital signal processing techniques to generate any of the described sound fields.

As a general matter, audio sharing system <NUM> performs specific configurations to transition between modes of operation via any technically feasible approach or combination of approaches. For example, and without limitation, audio sharing system <NUM> could implement mechanical actuations such as those described above or could perform digital signal processing techniques such as those also mentioned previously. Additionally, audio sharing system <NUM> could implement both mechanical and digital signal processing techniques in conjunction with one another, among other possibilities. With any of these techniques, audio sharing system <NUM> configures one or more audio output devices to implement any and all combinations of the sound fields <NUM> discussed above.

Various computing components included in audio sharing system <NUM> are described in greater detail below in conjunction with <FIG>.

<FIG> are more detailed illustrations of the audio sharing system of <FIG>, according to various embodiments. As shown, audio sharing system <NUM> includes a computing device <NUM> coupled to a wearable device <NUM>. Computing device <NUM> includes a processor <NUM>, input/output (I/O) devices <NUM>, and memory <NUM>, coupled together.

Processor <NUM> may be any technically feasible hardware unit configured to process data and execute program instructions. Processor <NUM> could be, for example and without limitation, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), and any combination thereof. I/O devices <NUM> include devices for receiving input, devices for providing output, and devices for both receiving and providing input and output, respectively. For example, and without limitation, I/O devices <NUM> could include a touchscreen configured to receive input and provide output. Memory <NUM> may include any technically feasible storage medium for storing data and software applications. Memory could be, for example and without limitation, a random-access memory (RAM) module. Memory <NUM> includes a control application <NUM> and a datastore <NUM>.

Control application <NUM> is a software application including program code that, when executed by processor <NUM>, coordinates the operation of audio sharing system <NUM>. In doing so, control application <NUM> implements transitions between the various modes of operation associated with audio sharing system <NUM> and manages the generation of the sound fields <NUM> corresponding to each such mode. In doing so, control application <NUM> interoperates with wearable device <NUM>.

Wearable device <NUM> is configured to be worn or otherwise coupled to user <NUM>. For example, and without limitation, wearable device <NUM> could be robotic hat <NUM> discussed above in conjunction with <FIG>. In some embodiments, wearable device <NUM> includes a mechanical subsystem <NUM>. Mechanical subsystem <NUM> includes any robotic hardware configured to perform actuation operations. For example, and without limitation, mechanical subsystem <NUM> could include electric motors configured to actuate mechanical flaps <NUM> affixed to robotic hat <NUM>. Mechanical subsystem <NUM> may be omitted in embodiments that do not involve mechanical actuation.

Wearable device <NUM> also includes I/O subsystem <NUM>. I/O subsystem <NUM> includes sensor arrays configured to capture sensor data associated with user <NUM> and/or the environment surrounding user <NUM>. For example, and without limitation, I/O subsystem <NUM> could include a gyroscope configured to measure the head orientation of user <NUM>, an inertial measurement unit (IMU) configured to measure the motion of user <NUM> through space, a set of acoustic transducers configured to measure ambient sound, one or more optical sensors configured to measure visual or infrared light, a Light Detection and Ranging (LIDAR) sensor, a distance sensor, a time of flight sensor, a brightness sensor, or any other technically feasible form of sensing apparatus.

I/O subsystem <NUM> also includes devices configured to generate output. For example, and without limitation, I/O subsystem <NUM> could include steerable acoustic array <NUM> discussed above in conjunction with <FIG>. I/O subsystem <NUM> may also include other forms of audio and/or visual output devices, including, for example and without limitation, acoustic arrays, ultrasonic devices, visual display devices, bone conduction transducers, flexible displays, beam forming speakers, optical pass through devices, heads-up displays, or any other technically feasible form of emission apparatus.

Computing device <NUM> and wearable device <NUM> may be integrated together to form a single physical component or may be separate modular components. Computing device <NUM> may communicate with wearable device <NUM> via a wired connection or a wireless connection, as well. In one embodiment, computing device <NUM> is a mobile device and control application <NUM> is an application (app) that executes on that computing device <NUM>, potentially alongside other apps, to coordinate the operation of wearable device <NUM>. Control application <NUM> is described in greater detail below in conjunction with <FIG>.

As shown in <FIG>, control application <NUM> includes a transition module <NUM>, a hardware controller <NUM>, and an audio generator <NUM>. Transition module <NUM> is a software module configured to receive input, including sensor data, from I/O subsystem <NUM>, and to then implement transitions between operating modes via interactions with hardware controller <NUM> and audio generator <NUM>.

In doing so, transition module <NUM> analyzes the input data received from I/O subsystem <NUM> to detect specific triggering events. Each triggering event may correspond to a different operating mode. Transition module <NUM> may be preconfigured to detect a specific set of triggering events and may also be configured by user <NUM> to detect custom triggering events. Transition module <NUM> may implement any technically feasible form of data processing to detect a given triggering event.

Transition module <NUM> may include a voice recognition module that identifies spoken commands issued by user <NUM>. Each different command may initiate a transition to a different operating mode. For example, and without limitation, user <NUM> could issue a command, such as "transition to private mode," and transition module <NUM> would then, in response, initiate a transition to private mode via interactions with hardware controller <NUM> and audio generator <NUM>. Other triggering events may include the spoken expression of the name of user <NUM>, the detection of a specific nearby listener, the identification of a certain dangerous circumstance, or the detection of other instances of audio sharing system <NUM>, among others.

Transition module <NUM> may implement computer vision techniques to identify people or objects nearby to user <NUM>, and then initiate a transition to an appropriate mode of operation. For example, and without limitation, when a listener <NUM> approaches user <NUM>, transition module <NUM> could detect the presence of that listener and then initiate a transition to public mode. In another example, and without limitation, transition module <NUM> could detect an approaching automobile, and then transition out of private mode in order to reduce audio immersion of user <NUM> and/or to alert user <NUM> to potential danger. Audio sharing system <NUM> may also warn user <NUM> of potential danger without transitioning between modes. In addition, audio sharing system <NUM> may perform steps to transmit warnings externally to the environment based on triggering events. For example, and without limitation, audio sharing system <NUM> could transmit a warning to an approaching automobile that user <NUM> may be pre-occupied and unaware of potential anger.

In response to any triggering event, transition module <NUM> may cause hardware controller <NUM> to implement specific mechanical actuations with mechanical subsystem <NUM>. In doing so, hardware controller <NUM> may issue commands to one or more mechanical components. For example, and without limitation, when transition module <NUM> initiates a transition to public mode, hardware controller could actuate mechanical flaps <NUM> of robotic hat <NUM> in order to fold those flaps upwards.

In response to any triggering event, transition module <NUM> may also cause audio generator <NUM> to perform various audio processing techniques to generate audio signals for transmission to I/O subsystem <NUM>. I/O subsystem <NUM> may then generate sound fields <NUM> based on those audio signals. Audio generator <NUM> may access audio library <NUM> to retrieve sound files, and then decode those sound fields to generate the audio signals. Audio library <NUM> could include, for example and without limitation, a collection of Motion Picture Experts Group-<NUM> Audio Layer-<NUM> (MP3) files. Audio generator <NUM> generally coordinates various digital signal processing techniques, and may rely on a discrete digital signal processor (not shown) to do so. Those techniques may be associated with audio beamforming, active noise cancelation, and three-dimensional (3D) sound, among others. For example, and without limitation, audio generator <NUM> could generate a cancelation signal that cancels selected sound at the location of a nearby listener <NUM>.

Referring generally to <FIG>, persons skilled in the art will understand that the overarching functionality of computing device <NUM> and wearable device <NUM> may be performed according to other technically feasible implementations beyond those discussed above. For example, the functionality of computing device <NUM> and wearable device <NUM> may be implemented as a single integrated circuit embedded into a piece of clothing. As general matter, any technically feasible approach to generating the sound fields <NUM> shown in <FIG> fall squarely in the scope of the present disclosure. <FIG> illustrate procedures implemented by audio sharing system <NUM> to perform the various techniques discussed thus far.

<FIG> is a flow diagram of method steps for transitioning between audio sharing modes, according to various embodiments. Although the method steps are described in conjunction with the systems of <FIG>, persons skilled in the art will understand that the method steps can be performed in any order by any system.

As shown, a method <NUM> begins at step <NUM>, where audio sharing system <NUM> operates in private mode to generate a private sound field exclusively associated with user <NUM>. In doing so, audio sharing system <NUM> may generate sound field <NUM>(A) shown in <FIG>. At step <NUM>, audio sharing system <NUM> determines whether a transition to public mode is triggered. Audio sharing system <NUM> may implement many possible criteria for determining whether to transition to public mode, and in doing so, may process data associated with user <NUM> and/or the environment where user <NUM> resides. The method <NUM> returns to step <NUM> if a transition to public mode is not triggered. Otherwise, the method <NUM> proceeds to step <NUM>.

At step <NUM>, audio sharing system <NUM> implements a transition to public mode. Audio sharing system <NUM> may implement mechanical actuations to generate sound field <NUM>(B) and/or perform digital signal processing operations to condition audio signals for public broadcast. At step <NUM>, audio sharing system <NUM> operates in public mode to generate a public sound field associated with user <NUM> and with the surrounding environment. Audio sharing system may generate sound field <NUM>(B) upon transitioning to public mode, thereby sharing sound with listeners in proximity to user <NUM>.

At step <NUM>, audio sharing system determines whether a transition to private mode is triggered. If no such transition is triggered, the method returns to step <NUM> and audio sharing system <NUM> remains in public mode. Otherwise, the method proceeds to step <NUM>, where audio sharing system <NUM> transitions back to private mode. The method <NUM> then returns to step <NUM> and proceeds as described above. Audio sharing system <NUM> implements the method <NUM> to implement the essential functionality of transitioning between private and public mode. Audio sharing system <NUM> may also implement a more complex approach that involves the generation of multiple sound fields simultaneously, as described in greater detail below in conjunction with <FIG>.

<FIG> is a flow diagram of method steps for operating in multiple audio sharing modes simultaneously, according to various embodiments. Although the method steps are described in conjunction with the systems of <FIG>, persons skilled in the art will understand that the method steps can be performed in any order by any system.

As shown, a method <NUM> begins at step <NUM>, where audio sharing system <NUM> identifies a first trigger event associated with a first type of audio data. The first trigger event is associated with user <NUM> or the environment where user <NUM> resides. The first trigger event may also be associated with a specific type of audio data. For example, and without limitation, the first trigger event could be associated with a specific voice command issued by user <NUM> indicating that a first audio file should be played. At step <NUM>, audio sharing system <NUM> generates a first sound field to output the first type of audio data to a first subset of nearby listeners. The first subset of listeners may include user <NUM> and specific other listeners <NUM>, a subset of listeners <NUM> that does not include user <NUM>, or user <NUM> alone.

At step <NUM>, audio sharing system <NUM> identifies a second trigger event associated with a second type of audio data. Similar to the first trigger event, the second trigger event may be associated with user <NUM> or the environment where user <NUM> resides, and may also be associated with a specific type of audio data. For example, and without limitation, the second trigger event could be associated with an environmental cue that triggers music to be broadcast into the environment. At step <NUM>, audio sharing system <NUM> generates a second sound field to output the second type of audio data to a second subset of nearby listeners in conjunction with generating the first sound field. The second subset of listeners may include listeners in the first subset or may include a distinct set of listeners.

The approach described above allows audio sharing system <NUM> to operate in multiple modes of operation simultaneously. For example, and without limitation, audio sharing system <NUM> could generate the first sound field for user <NUM> only, thereby operating in private mode to output the first type of audio data, and generate the second sound field for multiple nearby listeners, thereby also operating in public mode to output the second type of audio data.

Although the techniques discussed thus far relate to sharing sound via acoustic transmissions, persons skilled in the art will understand that sound may also be shared digitally, example which does not fall within the scope of the claimed invention. For example, and without limitation, when operating in public mode, audio sharing system <NUM> could stream digital audio signals to selected mobile devices associated with nearby listeners. With this approach, audio sharing system <NUM> can avoid broadcasting acoustic signals into the environment while still permitting audio to be shared across many listeners.

In sum, an audio sharing system is configured to operate in at least two modes of operation. In a private mode, the audio sharing system outputs sound only to a user and may isolate the user from the surrounding acoustic environment. In a public mode of operation, the audio sharing system broadcasts sound to the user and to any other listeners in proximity to the user, thereby sharing sound in a social manner. The audio sharing system may also operate in other modes of operation that allow the selective sharing of sounds.

One advantage of the techniques described herein is that users of the audio sharing system can listen to sound in isolation from others at some times, and selectively share sound with nearby listeners at other times. Accordingly, the disclosed audio sharing system represents a technological advancement over conventional approaches that cannot easily facilitate the sharing of sound with others.

Aspects of the present embodiments may be embodied as a system, method or computer program product. Accordingly, aspects of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "module" or "system. " Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.

These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure.

Claim 1:
A method (<NUM>) for distributing sound between listeners using a wearable device (<NUM>; <NUM>; <NUM>; <NUM>; <NUM>), wherein the wearable device is worn by a first listener (<NUM>) and comprises an input/output (I/O) subsystem (<NUM>) that includes a sensor array and a speaker array, the method comprising:
configuring the speaker array to operate in a first mode, wherein, in the first mode, the speaker array generates a first sound field (<NUM>(A)) in which sound is output towards the first listener (<NUM>) and away from a second listener (<NUM>(<NUM>)) by targeting the sound toward an ear of the first listener (<NUM>) and avoiding emitting sounds elsewhere (<NUM>);
transitioning the speaker array from the first mode to a second mode in response to a first triggering event (<NUM>);
configuring the speaker array to operate in the second mode, wherein, in the second mode, the speaker array generates a second sound field (<NUM>(B)) in which sound is output towards the first listener (<NUM>) and the second listener (<NUM>(<NUM>)) by broadcasting the sound multidirectionally and allowing the second listener (<NUM>(<NUM>)) to listen to the sound (<NUM>); and
detecting the first triggering event based on sensor data associated with the first listener (<NUM>) or based on sensor data associated with an environment in which the first listener (<NUM>) resides.