Patent Description:
This disclosure relates to display systems and, in particular, audio output devices therefor.

Virtual reality systems provide content to a user, which may include visual and aural content. The visual content may be provided by a head-mounted display unit (HMD), while the aural content is often provided by headphones that are physically separate from the head-mounted display unit. <CIT> discloses a system comprising a video display device, an audio output device and a computing device comprising one or more processors configured to (i) determine orientation angles of a spherical video based on an input, (ii) extract a viewport from the spherical video based on the orientation angles, (iii) output the viewport to the video display device, (iv) render a sound field based on the orientation angles and the audio output device and (v) output the sound field to the audio output device, wherein sound sources that comprise the sound field are adjusted to align with the viewport, and the sound sources outside of the viewport are attenuated. <CIT> discloses a combined headphone set including a speaker assembly including a headband having a speaker headphone on opposing ends of the headband, wherein each of the speaker headphones includes an exterior speaker for public listening and an interior speaker for personal listening by the user, and one of the speaker headphones includes switching means for listening to the interior speaker or to the exterior speaker or to the interior and exterior speakers simultaneously from each of the speaker headphones, wherein each of the speaker headphones includes an audio signal wire connected from an output jack of an audio device to the speaker headphones. <CIT> discloses a processing method for an earphone and a user equipment including: receiving a sense signal sent by a proximity sensor; obtaining a distance between an earphone and an ear corresponding to the earphone according to the sense signal and comparing the distance with a first preset threshold; and within a first preset time, if the distance is greater than the first preset threshold, closing an audio playing program or closing an earphone channel of the earphone.

The present invention is defined by the features of the independent claim(s). Preferred advantageous embodiments thereof are defined by the sub-features of the dependent claims.

Disclosed herein are implementations of display systems. In one aspect, a display system includes a head-mounted display unit and a detachable speaker unit. The head- mounted display unit outputs visual content to a user and provides a visual pass-through of a real environment to the user. The detachable speaker unit is detachably coupleable to the head-mounted display unit for providing aural content to the user. At least one of the visual content or the aural content is changed according to a position of the detachable speaker unit relative to the head-mounted display unit.

The head-mount display may include a built-in speaker. Output of the aural content by one or more of the detachable speaker unit or the built-in speaker according to the position. Audio signal processing of the aural content output by the detachable speaker unit may change as the detachable speaker unit is moved toward a coupling location on the head- mounted display unit. The audio signal processing includes one or more of changing a volume, equalization, or dynamic range of the aural content output by the detachable speaker unit. When the detachable speaker unit is in a field of view of the head-mounted display unit, the visual content may include a visual indicator in spatial proximity to the detachable speaker unit. The visual indicator may indicate a sound output capability of the detachable speaker unit to the user.

In another aspect, a display system includes a head-mounted display unit and an audio headset. The head-mounted display unit includes first and second built-in speakers. The audio headset includes first and second detachable speaker units that are detachably coupleable to the head-mounted display unit.

In another aspect, a method is provided for providing content with a display system having a head-mounted display unit, a movable audio output devices that is movable relative to the head-mounted display unit, a controller, and a sensor. The method includes determining, by the controller with the sensor, a position of the movable audio output device, and providing content with the head-mounted display unit according to the position of the movable audio output device.

Disclosed herein are embodiments of display systems that include a head-mounted display unit and an audio output device, such as an audio headset. The audio output device is detachable from or is otherwise movable relative to the head-mounted display unit in various manners described herein. Aural content provided from the audio output device and/or a built-in audio output device may be output according to the position of the movable audio output device in various manners described herein. Visual content may also be provided according to the position of the movable audio output device in various manners described herein.

Referring to <FIG>, a display system <NUM> includes a head-mounted display unit <NUM> and an audio headset <NUM> that is physically movable relative to the head-mounted display unit <NUM>, such as being detachable therefrom (as shown) or articulating relative thereto. As discussed in further detail below, the display system <NUM> may form a mechanical and/or electrical connection between the head-mounted display unit <NUM> and the audio headset <NUM>, may provide sound to the user by the head-mounted display unit <NUM> itself and the audio headset <NUM>, and/or may provide cues and/or feedback to the user related to use of the audio headset <NUM> with the head-mounted display unit <NUM>. The term "audio headset <NUM>" refers to an audio output device or a set of audio output devices (e.g., detachable speaker units <NUM>, as described below) to be held in close proximity to the user's ear or ears. In the case of multiple audio output devices (e.g., two), the audio output devices of the audio headset <NUM> may be separate or separable from each other (e.g., need not be affixed to each other, for example, with a headband extending therebetween). The audio headset <NUM> may also be referred to as a headphone, headphones, an earphone, or earphones.

The display systems disclosed herein may be configured to provide computer-generated reality (e.g., virtual reality or mixed reality), as described below. The term "virtual," as used generally refers to content or an experience that is "computer-generated. " For example, the content described herein may be referred to as virtual or computer-generated content, such as visual content (e.g., also referred to as virtual or computer-generated visual content or graphics) and aural content (e.g., also referred to as virtual or computer-generated aural content or audio).

The head-mounted display unit <NUM> generally includes a support <NUM> and a display screen <NUM>. The support is configured to be worn on a user's head H to thereby support the display screen <NUM> in a suitable position relative to eyes of the user. As shown, the support is configured as a strap that surrounds the head H of the user. The display screen <NUM>, such as the screen of a smartphone or a dedicated screen, provides the visual content to the user. In the case of the display screen <NUM> being a smartphone or other video output device that is removable, the head-mounted display unit <NUM> may be considered coupleable to the display screen <NUM>.

The display system <NUM> may be configured to provide a mixed reality experience by providing a visual pass-through by which the user may view the real environment. As shown, the head-mounted display unit <NUM> utilizes a video pass-through in which case one or more cameras <NUM> of the head-mounted display unit <NUM> capture images of the real environment, which are displayed by the display screen <NUM> to the user. Such a display system <NUM> may also function to provide a virtual reality experience in which case images of the real environment are not displayed by the display screen <NUM> and the real environment is otherwise partially or wholly blocked from the view of the user. As an alternative to video pass-through, the head-mounted display unit <NUM> may utilize an optical pass-through in which case the user views the real environment directly. For example, the head-mounted display unit <NUM> may include a reflector that both permits light from the real environment to pass therethrough to eyes of the user and reflects light from the display screen <NUM> to eyes of the user to provide the visual content.

The head-mounted display unit <NUM> may additionally include speakers <NUM>, which transmit or output aural content to ears of the user. The speakers <NUM> are, for example, coupled to the support <NUM> in proximity to ears E of the user and direct sound thereto. The speakers <NUM> are fixedly coupled to the head-mounted display unit <NUM> (e.g., to the support <NUM> or a housing of the display screen <NUM>), so as to not be easily removable therefrom. This stands in contrast to the speaker units <NUM> of the audio headset <NUM>, which are detachably coupleable to the head-mounted display unit <NUM>, so as to be easily removable therefrom. As such, the speakers <NUM> may be referred to as fixed audio output devices, fixed speakers, built-in speakers, or HMD speakers, while the speaker units <NUM> may be referred to as detachable speakers or detachable speaker units. The audio headset <NUM> and the detachable speaker units <NUM> may also be referred to as audio output devices or movable audio output devices.

The HMD speakers <NUM> additionally permit sound from the real environment to reach the ears of the user. For example, the HMD speakers <NUM> may be positioned above and/or in front of the ears of the user, thereby not obstructing sound from the real environment from reaching the ears of the user. Thus, the head-mounted display unit <NUM> may provide the mixed reality experience aurally to the user by allowing the user to hear the real environment, while simultaneously transmitting the aural content to the user. As such, the HMD speakers <NUM> may also be referred to as extra-aural speakers.

As discussed in further detail below, the HMD speakers <NUM> are additionally configured to allow the audio headset <NUM> to provide the aural content to the user in conjunction with or exclusive of the HMD speakers <NUM>. In some embodiments, the HMD speakers <NUM> may be omitted in which case the aural content is provided by the audio headset <NUM>.

The head-mounted display unit may also include various sensors that detect conditions pertaining to the user, the head-mounted display unit <NUM>, and/or the audio headset <NUM>. For example, in addition to the camera <NUM>, the head-mounted display unit <NUM> may include motion sensors <NUM>, such one or more of accelerometers, gyroscopes, magnetometers, inertial measurement units (IMU), cameras, or the like, which measure conditions pertaining to the position and/or orientation of the head H of the user and/or the head-mounted display unit <NUM>. The camera <NUM> and/or motion sensors <NUM> may also be configured to determine the position, orientation, and/or motion of the audio headset <NUM> relative thereto, for example, using visual recognition of the audio headset <NUM>, being configured to detect, locate, and/or track markers of the detachable speaker unit <NUM>, and/or being configured to detect, locate, and/or track beacon signals emitted from the detachable speaker unit <NUM>. The head-mounted display unit <NUM> may also include eye sensors <NUM>, such as cameras, which are used to measure conditions of the user's eye (e.g., focal distance, pupil size, etc.).

The audio headset <NUM> includes the detachable speaker units <NUM>, which provide aural content to the user by transmitting sound to the ears E of the user. The detachable speaker units <NUM>, for example, include a right detachable speaker unit 132r and a left detachable speaker unit <NUM>, which are to be physically associated with a right ear E and a left ear E, respectively, of the user for providing the aural content thereto.

Each of the detachable speaker units <NUM> generally includes a housing <NUM>, as well as one or more speakers <NUM> and electronics <NUM> of various types. The housing <NUM> contains the one or more speakers <NUM> and the electronics <NUM>, and is configured to connect to the support <NUM> of the head-mounted display unit <NUM> to be supported thereby, receive audio signals therefrom, and/or receive electric power therefrom. The speaker <NUM> outputs the sound (i.e., of the aural content) to the user. The electronics <NUM> are cooperatively configured with the speaker <NUM> to provide the sound output, and may provide other functionality.

As illustrated, the audio headset <NUM> may have an over-ear configuration in which case the housing <NUM> is configured to surround an entirety of the ear of the user. Alternatively, the audio headset <NUM> may have an on-ear configuration in which case the housing <NUM> is configured to rest on the ear of the user, or have an in-ear configuration in which a portion of the housing <NUM> is positioned in the ear E (e.g., partially in the ear canal) of the user.

As shown schematically in <FIG>, the electronics <NUM> of the speaker unit <NUM> may include an amplifier 138a, power electronics 138b, signal electronics 138c, sensing electronics 138d, and/or ambient sound electronics 138e. The amplifier 138a is configured to drive the speaker <NUM> for outputting the sound. The power electronics 138b are configured to power the various other electronics of the detachable speaker unit <NUM>, such as the amplifier 138a, the signal electronics 138c, and/or the sensing electronics 138d. The power electronics 138b may, for example, provide for wired power and/or locally stored power, such as with a battery. The signal electronics 138c are configured to receive and/or send signals to and/or from the head-mounted display unit <NUM> or another component, such as a controller <NUM> discussed below. The signal electronics 138c may, for example, include communications interfaces to send and/or receive signals, such as via wireless, conductive, or optical connections. Such signals may, for example, include audio signals received for outputting the aural content from the detachable speaker unit <NUM> and/or sensing signals for providing sensing information of the detachable speaker unit <NUM> (e.g., position). The signal electronics 138c may also provide outputs to assist determining the position and/or orientation of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM>, for example, by providing a passive or active marker (e.g., visible or invisible light source) or a beacon (e.g., emitting another type of detectable and locatable output signal). The sensing electronics 138d are configured to sense various parameters of the detachable speaker unit <NUM>, such as a position, orientation, and/or motion (e.g., changes in position and orientation) of the detachable speaker unit <NUM> in real space or relative to another part of the display system <NUM>, such as the head-mounted display unit <NUM>, the support <NUM> thereof, or coupling locations or features thereon. The sensing electronics 138d may include one or more appropriate sensors for detecting such position, orientation, and/or motion, such as accelerometer(s), gyroscope(s), inertial measurement unit (IMU), proximity sensor(s), and/or cameras (e.g., for video recognition).

The ambient sound electronics 138e function to detect ambient sounds (e.g., from the real environment using a microphone 138e'), process the detected ambient sounds (e.g., with a signal processor 138e"), and cause the speaker <NUM> to output a processed sound according thereto (e.g., using the amplifier 138a). The processed sound may, for example, provide acoustic transparency and/or active noise canceling. With acoustic transparency, the ambient sound from the real environment is generally reproduced without significant alteration as the processed sound, which may be referred to as processed ambient sound and is output by the speaker <NUM>. As a result, the user may still hear the real environment, for example, when the detachable speaker unit <NUM> is placed against the user's ear E and might otherwise hinder (e.g., by insulating and/or blocking) the ambient sound of the real environment from reaching the user's ear E directly. With active noise canceling, the ambient sound is processed to provide processed sound that generally cancels or counters the ambient sound (e.g., by having the same amplitude but inverted phase as the ambient sound), which may be referred to as the processed canceling sound and is output by the speaker <NUM>.

It should be noted that the speaker electronics <NUM> (e.g., the amplifier 138a, the power electronics 138b, the signal electronics 138c, the sensing electronics 138d, and/or the ambient sound electronics 138e), or different electronics performing similar functions, may instead or additionally be incorporated into the head-mounted display unit <NUM>. For example, the speaker <NUM> may have a wired connection to the head-mounted display unit <NUM> and/or the controller <NUM>, while amplification, power, sensing, and ambient sounds functions are performed by electronics of the head-mounted display unit <NUM> and/or the controller <NUM>.

In addition to the head-mounted display unit <NUM> and the audio headset <NUM>, the display system <NUM> additionally includes the controller <NUM>. As illustrated, the controller <NUM> may be external to the head-mounted display unit <NUM> and the audio headset <NUM> and is in communication therewith, such as with a wired or wireless connection. The controller <NUM> is generally configured to process various input information (e.g., signals), such as the location and/or orientation of the user, the head-mounted display unit <NUM>, and/or the audio headset <NUM>, process such information, and provide output signals for controlling the head-mounted display unit <NUM> (e.g., to output the visual content and the aural content) and the audio headset <NUM> (e.g., to output the aural content). A hardware configuration for the controller <NUM> is discussed below with reference to <FIG>. While depicted as a singular unit separate from and external to the head-mounted display unit <NUM> and the audio headset <NUM>, the controller <NUM> may instead include multiple such controllers or be subdivided into separate units that cooperatively function as the controller <NUM>, and the controller <NUM> may be incorporated into one or more of the head-mounted display unit <NUM> and the detachable speaker units <NUM>.

As referenced above, the head-mounted display unit <NUM> and the audio headset <NUM> may be cooperatively configured provide mechanical, electrical, and/or data connections between the head-mounted display unit <NUM> and the audio headset <NUM>, cooperatively provide sound to the user, and/or provide cues and/or feedback to the user related to use of the audio headset <NUM> with the head-mounted display unit <NUM>.

Referring to <FIG>, each of the detachable speaker units <NUM> of the audio headset <NUM> is detachable from the head-mounted display unit <NUM>. When attached to the head-mounted display unit <NUM>, each of the detachable speaker units <NUM> is physically supported thereby, and may further be in communication therewith and/or receive electric power therefrom.

Referring to <FIG>, a display system <NUM> includes an audio headset <NUM> having detachable speaker units <NUM> that are releasably coupleable to a head-mounted display unit <NUM> with magnetic force. The head-mounted display unit <NUM> is configured as the head-mounted display unit <NUM>, while additionally including one or more magnetic attachments <NUM>, which may be referred to as HMD magnetic attachments. The detachable speaker unit <NUM> is configured as the detachable speaker unit <NUM>, while including one or more magnetic attachments <NUM> that correspond to the HMD magnetic attachments <NUM> of the head-mounted display unit <NUM>. The magnetic attachments <NUM>, <NUM> of the head-mounted display unit <NUM> and the detachable speaker unit <NUM> may be referred to as HMD magnetic attachments <NUM> and speaker magnetic attachments <NUM>, respectively. The magnetic attachments <NUM>, <NUM> are configured to attract each other with magnetic force, for example, with one of the magnetic attachments <NUM>, <NUM> including a permanent magnetic and the other including ferromagnetic material or another permanent magnet of opposite orientation.

In the example shown in <FIG>, the head-mounted display unit <NUM> includes two HMD magnetic attachments <NUM>, one being forward of and the other being rearward of the ear E of the user. As shown, the two HMD magnetic attachments <NUM> may be coupled to the support <NUM> of the head-mounted display unit <NUM>, for example, to flanges 212a (e.g., protrusions) that extend downward to positions forward and rearward of the ear E of the user. The two HMD magnetic attachments <NUM> include permanent magnets, which may be incorporated into or otherwise coupled to the support <NUM> of the head-mounted display unit <NUM>.

The detachable speaker unit <NUM>, such as the housing <NUM> or padding <NUM> thereof, may protrude (e.g., extend inward) of the support <NUM> (e.g., inward of the flanges 212a) to be positioned against the user, for example, engaging the head H around the ear E (e.g., over ear configuration) or engaging the ear E of the user (e.g., on ear configuration). As a result, the detachable speaker unit <NUM> may be considered to have an inner portion (e.g., the padding <NUM> and/or the housing <NUM>) that extends laterally inward (e.g., toward the user) from an outer portion (e.g., formed by the speaker magnetic attachments <NUM>) that is coupled to the head-mounted display unit <NUM>. The padding <NUM> may engage and/or circumscribe the ear E of the user (e.g., in an on ear and/or over ear configuration).

Each of the detachable speaker units <NUM> includes the two speaker magnetic attachments <NUM>, which are magnetically coupleable to the two HMD magnetic attachments <NUM> of the head-mounted display unit <NUM>. For example, the two speaker magnetic attachments <NUM> may extend forward and rearward of the ear E of the user, so as to be magnetically coupleable to the HMD magnetic attachments <NUM>. The speaker magnetic attachments <NUM> may, for example, be elongated and extend forward and rearward from the housing <NUM> of the detachable speaker unit <NUM>. As shown, the speaker magnetic attachments <NUM> may be configured as posts that include the ferromagnetic material or permanent magnets of opposite orientation for being attracted to the permanent magnets of the HMD magnetic attachments <NUM> of the head-mounted display unit <NUM>. Alternatively, the HMD magnetic attachments <NUM> may include ferromagnetic material, while the speaker magnetic attachments <NUM> include permanent magnets to be attracted thereto.

The head-mounted display unit <NUM> and the detachable speaker unit <NUM> may also be configured to guide the detachable speaker units <NUM> to a pre-determined position relative thereto (e.g., a coupling location of the head-mounted display unit <NUM> over the ear E of the user). For example, each set of the magnetic attachments <NUM>, <NUM> (e.g., front and rear pairs of the magnetic attachments <NUM>, <NUM>) provide magnetic force to guide the speaker magnetic attachments <NUM> of the detachable speaker unit <NUM> to the HMD magnetic attachment <NUM> of the head-mounted display unit <NUM> corresponding. Additionally, the magnetic attachments <NUM>, <NUM> that do not correspond to each other may also function to repel each other, for example, by having permanent magnets with the same orientation. As a result, the detachable speaker unit <NUM> is pushed away from non-predetermined positions. These attraction and/or repulsion forces may be useful to help the user guide the detachable speaker units <NUM> to their respective coupling locations on the head-mounted display unit <NUM>, which are outside the user's field of view, by providing tactile feedback to the user.

Instead of or in addition to using magnetic force to guide the detachable speaker units <NUM> to proper positions, the head-mounted display unit <NUM> and the detachable speaker unit <NUM> may include mechanically cooperative guide features. For example, the head-mounted display unit <NUM> may include detents in the support <NUM>, which receive and guide the speaker magnetic attachments <NUM> of the detachable speaker unit <NUM> to the predetermined location.

The detachable speaker unit <NUM> may be configured to pivot about the speaker magnetic attachments <NUM>, for example, to be biased toward or otherwise accommodate the ear E of the user. In one example, the speaker magnetic attachments <NUM> are cylindrical posts that extend forward and rearward (e.g., forming a pivot axis 244a). The cylindrical posts roll along surfaces of the HMD magnetic attachments <NUM> or the support <NUM> of the head-mounted display unit <NUM>, so as to pivot relative thereto. In another example, the housing <NUM> pivots relative to the speaker magnetic attachments <NUM> without the speaker magnetic attachments moving (e.g., without rolling) relative to the HMD magnetic attachments <NUM> of the head-mounted display unit <NUM>, thereby still allowing the housing <NUM> and the speaker <NUM> therein to pivot relative to the head-mounted display unit <NUM>.

The pivot axis 244a of the detachable speaker unit <NUM> is, for example, formed by the speaker magnetic attachments <NUM>. The pivot axis 244a may, as shown, be arranged in a central position of the detachable speaker unit <NUM> (e.g., horizontally and vertically), or may be biased vertically (e.g., toward an upper end of the detachable speaker unit <NUM>) and/or horizontally (e.g., toward an inner or outer side of the detachable speaker unit <NUM>). Additionally, the pivot axis 244a may, as shown, be arranged outward of the support <NUM> of the head-mounted display unit <NUM>.

The detachable speaker unit <NUM> may additionally be configured to biased toward the ear E of the user about the pivot axis 244a, such as with a spring or magnets. In the example shown in <FIG>, the detachable speaker unit <NUM> may be biased toward the ear E of the user with magnetic force. The head-mounted display unit <NUM> may include a magnet <NUM> of one orientation positioned above the ear E of the user, while the detachable speaker unit <NUM> includes another magnet <NUM> of opposite orientation above the ear E of the user, for example, by forming or being incorporated in an elongated member extending upward from the housing <NUM>. The magnets <NUM>, <NUM> of the head-mounted display unit <NUM> and the detachable speaker unit <NUM> repel each other, so as to bias the detachable speaker unit <NUM> about the pivot axis 244a and toward the ear E of the user.

The head-mounted display unit <NUM> and the detachable speaker unit <NUM> are additionally configured for the head-mounted display unit <NUM> to provide electric power to the detachable speaker unit <NUM>. As shown, the magnetic attachments <NUM>, <NUM> conduct electricity from the head-mounted display unit <NUM> to the detachable speaker unit <NUM>, so as to provide power to the amplifier 138a and other electronics (e.g., the signal electronics 138c and/or the sensing electronics 138d). For example, a first set of the magnetic attachments <NUM>, <NUM> are for power (positive) and a second set of the magnetic attachments <NUM>, <NUM> are for ground. The magnetic attachments <NUM>, <NUM> may also transmit audio signals via conduction from the head-mounted display unit <NUM> to the detachable speaker unit <NUM> in conjunction with conducting electric power.

Alternatively, electric power may be conducted from the head-mounted display unit <NUM> to the detachable speaker unit <NUM> with electrical contacts that are independent of the magnetic attachments <NUM>, <NUM>, which may also transmit audio signals. In other variations, audio signals may be transmitted independent of the electric power, such as with separate contacts and/or an optical connection. In embodiments of the detachable speaker units <NUM> having the sensing electronics 138d, sensor signals may be transmitted from the detachable speaker unit <NUM> to the head-mounted display unit <NUM> with the magnetic attachments <NUM>, <NUM>, the separate contacts, the optical connection, or wirelessly. Electrical power may also be provided from the head-mounted display unit <NUM> inductively.

Referring to <FIG>, a display system <NUM> includes an audio headset <NUM> having a detachable speaker unit <NUM> that is releasably coupleable to a head-mounted display unit <NUM>. The head-mounted display unit <NUM> is configured as the head-mounted display unit <NUM>, and additionally includes a magnetic attachment <NUM> having a female configuration, such as a socket. The detachable speaker unit <NUM> is configured as the detachable speaker unit <NUM>, while additionally including a magnetic attachment <NUM> having a male configuration, such as a ball, which is received by the magnetic attachment <NUM> of the head-mounted display unit <NUM>. The magnetic attachments <NUM>, <NUM> of the head-mounted display unit <NUM> and the detachable speaker unit <NUM> may be referred to as an HMD or female magnetic attachment, and a speaker or male magnetic attachment, respectively.

In the example shown in <FIG>, the head-mounted display unit <NUM> includes one HMD magnetic attachment <NUM> positioned above the ear E of the user. As shown, the HMD magnetic attachment <NUM> is coupled to the support <NUM> of the head-mounted display unit <NUM> above the ear E of the user. The speaker magnetic attachment <NUM> is coupled to the housing <NUM> of detachable speaker unit <NUM>, for example, being formed at the end of an elongated protrusion (e.g., shaft) extending upward from the housing <NUM>.

The magnetic attachments <NUM>, <NUM> have complementary profiles that allow receipt of the speaker magnetic attachment <NUM> by the HMD magnetic attachment <NUM>, such as a spherical shape. The magnetic attachments <NUM>, <NUM> may also be configured to permit movement of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM>, while still being supported thereby. For example, the detachable speaker unit <NUM> may be permitted to displace inward and outward, forward and backward, and rotate, as illustrated by the arrows in <FIG>.

The head-mounted display unit <NUM> and the detachable speaker unit <NUM> are additionally configured for the head-mounted display unit <NUM> to provide electric power to the detachable speaker unit <NUM>. As shown, the magnetic attachments <NUM>, <NUM> conduct electricity from the head-mounted display unit <NUM> to the detachable speaker unit <NUM>, so as to provide power to the amplifier 138a and/or other electronics <NUM> thereof. For example, each of the magnetic attachments <NUM>, <NUM> are subdivided to provide power and ground contacts, which maintain physical contact for conducting electricity as the detachable speaker unit <NUM> moves relative to the head-mounted display unit <NUM>.

For example, as shown in <FIG>, the HMD magnetic attachment <NUM> may include a first power contact 324a (e.g., positive) and a second power contact 324b (e.g., ground) that are spaced apart along the spherical surface of the HMD magnetic attachment <NUM> and are electrically isolated from each other. As shown in <FIG>, the speaker magnetic attachment <NUM> is includes a first power contact 344a (e.g., positive) and a second power contact 344b (e.g., ground), which are electrically isolated from each other and have larger conductive surface areas than the first power contact 324a and the second power contact 324b of the HMD magnetic attachment <NUM> corresponding there to. As a result, as shown in <FIG>, the detachable speaker unit <NUM> may move inward/outward, forward/backward, and/or rotate in limited ranges of motion, while still maintaining conductive contact between the power contacts 344a, 344b and 324a, 324b to conduct electric power therebetween. The magnetic attachments <NUM>, <NUM> may also transmit audio signals from the head-mounted display unit <NUM> to the detachable speaker unit <NUM> in conjunction with conducting electric power. The power contacts 324a, 324b of the HMD magnetic attachment <NUM> may, for example, be permanent magnets or be made of or otherwise include ferromagnetic material, while the power contacts 344a, 344b of the speaker magnetic attachment <NUM> may be made of a ferromagnetic material or be permanent magnets of opposite orientation from those of the HMD magnetic attachment <NUM>.

While the detachable speaker units <NUM>, <NUM> are discussed as being movable relative to the head-mounted display units <NUM>, <NUM>, variations of the magnetic attachments <NUM>, <NUM> and the magnetic attachments <NUM>, <NUM> may instead be configured to prevent movement therebetween.

Further, while the detachable speaker units <NUM>, <NUM> are discussed as being releasably coupleable to the head-mounted display units <NUM>, <NUM> with magnetic force, they may instead be coupled to each other with other releasable mechanisms, such as buckles, clamps, or fasteners. In such cases, power and signals may be conducted through such releasable mechanisms or separate power connections and data connections.

Referring to <FIG>, a display system <NUM> includes an audio headset <NUM> having detachable speaker units <NUM>, such as a right detachable speaker unit 432r and a left detachable speaker unit <NUM>, that are detachably coupleable to a head-mounted display unit <NUM> and to each other. Each of the detachable speaker units <NUM> is configured as one of the detachable speaker units <NUM>, <NUM>, <NUM> and additionally includes coupling features <NUM>. In one example, the coupling features <NUM> couple the detachable speaker units <NUM> to each other using magnetic force. For example, the coupling features <NUM> of the right detachable speaker unit 432r may be or may include permanent magnets or ferromagnetic material, while the coupling features <NUM> of the left detachable speaker unit <NUM> are configured to be attracted magnetically thereto, for example, being or including permanent magnets (e.g., of opposite orientation) or ferromagnetic material.

The coupling features <NUM>, when configured to detachably couple the detachable speaker units <NUM> to each other with magnetic force, may be hidden from view (e.g., being contained within the housing <NUM> or the pad <NUM>).

The coupling features <NUM> may, instead of or in addition to using magnetic force, be mechanical mechanisms (e.g., buckles, clamps, or fasteners) that detachably couple the detachable speaker units <NUM> to each other.

Referring additionally to <FIG>, the coupling features <NUM> may also function to couple the detachable speaker units <NUM> to the head-mounted display unit <NUM>. For example, the head-mounted display unit <NUM> may be configured as the head-mounted display unit <NUM> and include coupling features <NUM> that correspond to the coupling features <NUM>. For example, as illustrated in <FIG>, the coupling features <NUM> on a right side of the head-mounted display unit <NUM> may include one or more of the coupling features <NUM> in a similar arrangement (e.g., position, magnetic pole orientation if using magnetic force, or common male/female configuration if using mechanical engagement) to the coupling features <NUM> of the left detachable speaker unit <NUM>. As a result, the right side of the head-mounted display unit <NUM> may couple to the right detachable speaker unit 432r in a similar manner to which the left detachable speaker unit <NUM> couples to the right detachable speaker unit 432r.

Referring <FIG>, for any one of the display systems <NUM>, <NUM>, <NUM>, <NUM>, the head-mounted display unit <NUM>, <NUM>, <NUM>, <NUM> and the audio headset <NUM>, <NUM>, <NUM>, <NUM>, or both output sound according to a condition of the audio headset <NUM>, <NUM>, <NUM>, <NUM>. For simplicity in the discussion that follows, only the display system <NUM> will be referred to, though it should be understood that the other display systems <NUM>, <NUM>, <NUM> may be configured as described with respect to <FIG>. As discussed in further detail below, the condition of the audio headset <NUM> according to which sound is output may be one or more of whether the detachable speaker units <NUM> are coupled to each other (i.e., forming an audio unit as described previously), or a position or relative movement of the audio headset <NUM> or the detachable speaker units <NUM> relative to the head-mounted display unit <NUM>.

Referring to <FIG>, in one example, the HMD speakers <NUM> of the head-mounted display unit <NUM> output sound when the detachable speaker units <NUM> are decoupled from each other, for example, upon decoupling the detachable speaker units <NUM> from each other and a duration thereafter. In such cases, the sound output from the HMD speakers <NUM> of the head-mounted display unit <NUM> may represent activation of the audio headset <NUM> or the detachable speaker units <NUM> thereof, so as to provide an audio cue or feedback suggesting the sound output capability of the audio headset <NUM> (e.g., the detachable speaker units <NUM> thereof).

<FIG> illustrates a method <NUM> for outputting sound from HMD speakers <NUM> according to a decoupling of the detachable speaker units <NUM> from each other. The method may, for example, be implemented with the controller <NUM> and the various sensors of the head-mounted display unit <NUM> and the detachable speaker units <NUM>.

In a first operation <NUM> decoupling of the detachable speaker units <NUM> from each other is determined. Decoupling of the detachable speaker units <NUM> may, for example, occur due to the user pulling apart the detachable speaker units <NUM>. Decoupling of the detachable speaker units <NUM> may be determined, for example, by the controller <NUM> using sensors of the head-mounted display unit <NUM>, such as by processing video received from a camera <NUM>, or the sensing electronics 138d of the detachable speaker units <NUM>, such as by detecting relative movement therebetween or change in proximity therebetween.

In a second operation <NUM>, based on decoupling of the detachable speaker units <NUM> having been determined, sound is output from the HMD speakers <NUM> of the head-mounted display unit <NUM>. For example, the controller <NUM> may cause audio signals and/or power to be sent to the HMD speaker <NUM> to output sound therefrom. The sound output from the HMD speakers <NUM> contains aural content. Such aural content may include an audio indicator related to the detachable speaker units <NUM>.

In a third operation <NUM>, sound is output from the detachable speaker units <NUM> of the audio headset <NUM>. For example, the controller <NUM> may cause audio signals and/or power to be sent to the detachable speaker units <NUM>. The sound output from the detachable speaker units <NUM> may contain aural content, such as pertaining to a virtual or mixed reality experience.

In the operations, <NUM>, <NUM>, the sound may be output from the detachable speaker units <NUM> according to the manners described below with reference to <FIG> and <FIG>.

Referring to <FIG> and <FIG>, audio signal processing is performed (e.g., by the controller <NUM>), such that the HMD speakers <NUM> of the head-mounted display unit <NUM> and the detachable speaker units <NUM> output sounds according to the position of the audio headset <NUM> and/or the detachable speaker units <NUM> thereof. As discussed in further detail below, such audio signal processing or other audio controls may include adjusting the volume (see <FIG> and related discussion), equalization (see <FIG> and related discussion), and/or dynamic range (see <FIG>).

With reference to <FIG>, the detachable speaker units <NUM> may be configured to not output sound until coupled to the head-mounted display unit <NUM>. For example, the detachable speaker units <NUM> may not have a power source independent of the head-mounted display unit <NUM> (e.g., do not have internal batteries, do not have a wired connection to a power source independent of the head-mounted display unit <NUM>, or are otherwise powered only when detachably coupled to the head-mounted display unit <NUM>). In other examples, the detachable speaker units <NUM> may receive audio signals associated with the head-mounted display unit <NUM> (e.g., the virtual audio content) only when physically coupled thereto, such as via a conductive or optical data connection. In still further examples, the detachable speaker units <NUM> are otherwise configured to not output the sound until detachably coupled to the head-mounted display unit <NUM> (e.g., due to software programming).

In such scenarios, the HMD speakers <NUM> of the head-mounted display unit <NUM> may output sound so as to simulate or otherwise represent sound being emitted by the detachable speaker units <NUM>, while the detachable speaker units <NUM> are not coupled to the head-mounted display unit. Upon connecting the detachable speaker units <NUM> to the head-mounted display unit <NUM>, sound output from the detachable speaker units <NUM> increases to become the primary sound source (e.g., turning on), while sound output from the HMD speakers <NUM> may simultaneously or subsequently decrease substantially (e.g., to emit no sound).

<FIG> depicts a plot of volume of sound output from the HMD speakers <NUM> of the head-mounted display unit <NUM> and the detachable speaker units <NUM> of the audio headset <NUM> as a function of distance of the detachable speaker units <NUM> to a predetermined coupling location at which the detachable speaker unit <NUM> is coupleable to the audio headset <NUM>. The zero distance (i.e., at the coupling location) is shown on the right of the plot, such that moving rightward on along the plots reflects moving the detachable speaker unit <NUM> toward the coupling location. The plot also depicts a coupled state indicated by C in which the detachable speaker unit <NUM> is coupled to the detachable speaker unit <NUM> at the coupling location. The coupled state C is illustrated after the zero distance, but should be understood as representing a change of state of the coupling state of the detachable speaker unit <NUM> and not necessarily a further change of distance between the detachable speaker unit <NUM> and the coupling location. As used herein, the term "volume" generally refers to the level of sound output by an audio output device, and may also be referred to as "sound output level.

As shown, a volume 118v of the HMD speaker <NUM> increases as the detachable speaker unit <NUM> is moved closer to the coupling location and reaches a peak volume when the detachable speaker unit <NUM> is at or near the coupling location. A volume 132v of the detachable speaker unit <NUM> stays at zero until the detachable speaker unit <NUM> reaches the coupling location and/or is coupled to the head-mounted display unit <NUM>.

At the coupling location or upon being in the coupled state C, a volume 132v of the detachable speaker unit <NUM> is increased, for example, to become the primary sound source to the user. Sound output from the speaker unit <NUM> is maintained while in the coupled state C.

Coincident with the volume 132v of the detachable speaker unit <NUM> increasing (e.g., when the detachable speaker unit <NUM> is moved into the coupling location or upon coupling to the head-mounted display unit <NUM>), the volume 118v of the HMD speaker <NUM> decreases. For example, the volume 118v of the HMD speaker <NUM> may go to and/or be maintained at zero when the detachable speaker unit <NUM> is in the coupled state C.

<FIG> illustrates a method <NUM> for outputting sound from the HMD speakers <NUM> according to a position of the audio headset <NUM> and/or the detachable speaker units <NUM> individually relative to the head-mounted display unit <NUM> (e.g., to a coupling location on the head-mounted display unit <NUM>). The method <NUM> may, for example, be implemented with the controller <NUM> and the various sensors of the head-mounted display unit <NUM> and the detachable speaker units <NUM>. While discussed in conjunction with respect to one of the detachable speaker units <NUM>, the method <NUM> should be understood to be applicable to each of the detachable speaker units <NUM> and the audio headset <NUM>.

In a first operation <NUM>, a change of position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> (e.g., the coupling location thereon) is determined. The position of the detachable speaker unit <NUM> may be changed relative to the head-mounted display unit <NUM>, for example, as the user moves relative to the detachable speaker unit <NUM> (e.g., toward, away, rotating head) or as the user moves the detachable speaker unit <NUM> (e.g., moving the detachable speaker unit <NUM> to the coupling location). The change of position or relative motion of the detachable speaker unit <NUM> may be determined, for example, by the controller <NUM> using sensors of the head-mounted display unit <NUM>, such as by processing video received from the camera <NUM>, or the sensing electronics 138d of the detachable speaker units <NUM> (e.g., if the detachable speaker units <NUM> are powered independent of being coupled to the head-mounted display unit <NUM>), such as by detecting movement toward the head-mounted display unit and or change in proximity therebetween.

In a second operation <NUM>, based on the change of the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM>, the volume 118v of the HMD speaker <NUM> is changed. For example, as shown in <FIG>, the volume 118v is increased or decreased as the detachable speaker unit <NUM> is, respectively, moved toward or away from the head-mounted display unit <NUM> (e.g., the coupling location thereon). The controller <NUM> may cause audio signals and/or power to be sent to the HMD speaker <NUM> to output sound therefrom at the volume 118v. The sound output from the HMD speaker <NUM> contains the aural content, such as that pertaining to the virtual or mixed reality experience.

In a third operation <NUM>, based on determining that the detachable speaker unit <NUM> is at a zero distance relative to the head-mounted display unit <NUM> or upon coupling the detachable speaker unit <NUM> to the head-mounted display unit <NUM> at the predetermined location, the volume 132v of the detachable speaker unit <NUM> is substantially increased. For example, the controller <NUM> may determine that the detachable speaker unit <NUM> is at the zero distance using the sensors of the head-mounted display unit <NUM> and/or the detachable speaker unit <NUM> as described above with respect to the second operation <NUM>, and/or by determining that the detachable speaker unit <NUM> is coupled to the head-mounted display unit <NUM>. The controller <NUM> may cause audio signals and/or power to be sent to the detachable speaker unit <NUM> to output sound therefrom at the substantially increased volume 132v. For example, the volume 132v of the detachable speaker unit <NUM> may be increased from zero to provide the primary or only sound output to the user.

In a fourth operation <NUM>, based the determination of the zero distance, coupling of the detachable speaker unit <NUM>, or according to the volume 132v of the detachable speaker unit <NUM> having been substantially increased, the volume 118v of the HMD speaker <NUM> is substantially reduced (e.g., to zero). For example, the controller <NUM> may cause audio signals and/or power to be sent to the HMD speaker <NUM> to reduce the volume 118v or to not be sent to the HMD speaker <NUM> to reduce the volume 118v to zero. The fourth operation <NUM> may occur coincident with the third operation <NUM>, such as simultaneously therewith or shortly thereafter.

In a fifth operation <NUM>, while the detachable speaker unit <NUM> is coupled to the head-mounted display unit <NUM> (e.g., is in the coupled state shown in <FIG>), the detachable speaker unit <NUM> continues to provide sound output to the user, while the HMD speaker <NUM> provides secondary or no sound to the user.

In a sixth operation <NUM>, acoustic transparency of the detachable speaker unit <NUM> may be activated. Acoustic transparency is implemented by the ambient sound electronics 138e (e.g., the microphone 138e' and signal processor 138e"), so as to produce the processed ambient sound as described above. Acoustic transparency may be activated automatically upon coupling of the detachable speaker unit <NUM> to the head-mounted display unit <NUM>, for example, if the display system <NUM> is operating in a mixed reality mode or by default, or may be activated by selection of the user. Acoustic transparency may provide a mixed reality experience by transmitting the processed ambient sound to the user despite the detachable speaker unit <NUM> physically hindering passage of ambient sound directly to the user's ear E.

In a seventh operation <NUM>, noise cancellation of the detachable speaker unit <NUM> may be activated. Noise cancellation is implemented by the ambient sound electronics 138e, so as to produce the processed cancelling sound as described above. Noise cancellation may be activated automatically upon coupling of the detachable speaker unit <NUM> to the head-mounted display unit <NUM>, for example, if the display system <NUM> is operating in a virtual reality mode (e.g., when providing virtual visual content with no visual pass through), or by default (e.g., after passage of a predetermined time period after connecting the detachable speaker unit <NUM> to the head-mounted display unit <NUM>, or after a predetermined time of operating the acoustic transparency), or may be activated by selection of the user. Noise cancellation may provide a virtual reality experience by further inhibiting hearing of sounds from the real environment by the user. It should be noted that noise cancellation may not be activated or may be activated without activating acoustic transparency (e.g., one, the other, or both of the sixth operation <NUM> and the seventh operation <NUM> may be performed).

In a variation of the method <NUM>, the first operation <NUM> and the second operation <NUM> of determining the position of the detachable speaker unit <NUM> (i.e., the first operation <NUM>) and changing the volume 118v of the HMD speaker <NUM> (i.e., the second operation <NUM>) based thereon may be omitted. In such cases, the third operation <NUM> and the fourth operation <NUM> of increasing the volume 132v of the detachable speaker unit <NUM> based on determining the zero position or upon coupling (i.e., the third operation <NUM>) and decreasing the volume 118v of the HMD speaker <NUM> (i.e., the fourth operation <NUM>) are still performed.

The method <NUM> and the aforementioned variation thereof may be used in conjunction with the method <NUM> described previously, for example, in the third operation <NUM>.

With reference to <FIG>, the detachable speaker units <NUM> may be configured output sound prior to being coupled to the head-mounted display unit <NUM>. For example, the detachable speaker units <NUM> may be powered independent of being coupled the head-mounted display unit (e.g., by having internal batteries or a wired connection to a power source). In such scenarios, the HMD speakers <NUM> of the head-mounted display unit <NUM> and the detachable speaker units <NUM> may blend sound output to limit fluctuating volume experienced by the user, such as prior to the detachable speaker unit <NUM> being coupled to the head-mounted display unit <NUM>.

The HMD speakers <NUM> of the head-mounted display unit <NUM> and the detachable speaker units <NUM> output sounds according to movement of the audio headset <NUM> (e.g., when the detachable speaker units <NUM> are coupled to each other) and/or movement of the detachable speaker units <NUM> individually. For example, when the detachable speaker unit <NUM> is a relatively far distance from the head-mounted display unit <NUM>, sound be output from only the HMD speakers <NUM>. As the detachable speaker units <NUM> are moved closer to the head-mounted display unit <NUM>, the detachable speaker units <NUM> may increase in volume, such that the user hears sound being simultaneously emitted from both the HMD speakers <NUM> of the head-mounted display unit <NUM> and the detachable speaker units <NUM>. As the detachable speaker units <NUM> are moved still closer to the head-mounted display unit <NUM>, such as for coupling the detachable speaker units <NUM> thereto, the HMD speakers <NUM> and the detachable speaker units <NUM> may cooperatively provide sound output to limit volume fluctuation by decreasing volume from the HMD speakers <NUM>, while simultaneously increasing and then decreasing volume from the detachable speaker unit <NUM>. This may help limit fluctuation in volume perceived by the user fluctuations in volume perceived by the user.

<FIG> depicts a plot of volume of sound output from the HMD speakers <NUM> and the detachable speaker units <NUM> as a function of distance of the detachable speaker units <NUM> to a predetermined coupling location at which the detachable speaker unit <NUM> is coupleable to the audio headset <NUM>. The zero distance (i.e., at the coupling location) is shown on the right of the plot, such that moving rightward along the plot reflects moving the detachable speaker unit <NUM> toward the coupling location.

As shown, at relatively far distances between the detachable speaker unit <NUM> and the coupling location on the head-mounted display unit <NUM>, the HMD speaker <NUM> outputs sound at the volume 118v, while the detachable speaker unit <NUM> outputs no sound. At such relatively far distances, the volume 118v of the HMD speaker <NUM> may be independent of such distance and/or be constant. As the detachable speaker unit <NUM> is moved still closer to the coupling location, the volume 118v of the HMD speaker <NUM> may decrease, while the volume 132v of the detachable speaker unit <NUM> increases. At such closer distances, the user may hear sound from output from both the HMD speaker <NUM> and the detachable speaker unit <NUM>. At close distances, such as when moving to the zero distance at which the detachable speaker unit couples to the head-mounted display unit <NUM> over the user's ear E, the volume 118v output by the HMD speaker <NUM> reduces to zero, while the volume 132v of the detachable speaker unit <NUM> may reduce to a final output level. The reduction in the volume 132v of the detachable speaker unit <NUM> may, for example, account for an increase in volume that might otherwise be perceived by the user due to reduced distances and/or sound isolation that might be perceived from the real environment due to the housing <NUM> or the padding <NUM> of the detachable speaker unit <NUM> engaging the ear E of the user.

<FIG> illustrates a method <NUM> for outputting sound from the HMD speakers <NUM> and the detachable speaker units <NUM> according to a position of the audio headset <NUM> and/or the detachable speaker units <NUM> individually relative to the head-mounted display unit <NUM> (e.g., to a coupling location on the head-mounted display unit <NUM>). The method <NUM> may, for example, be implemented with the controller <NUM> and the various sensors of the head-mounted display unit <NUM> and the detachable speaker units <NUM>. While discussed in conjunction with respect to just one of the detachable speaker units <NUM>, the method <NUM> should be understood to be applicable to each of the detachable speaker units <NUM> and the audio headset <NUM>.

In a first operation <NUM>, a position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> (e.g., the predetermined coupling location thereon) is determined, which may be performed in the manner described above for the first operation <NUM> of the method <NUM>.

In a second operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being relatively far (e.g., greater than a threshold distance), the HMD speaker <NUM> outputs sounds (i.e., the volume 118v is greater than zero), while the detachable speaker unit <NUM> outputs no sound (i.e., the volume 132v is zero). The controller <NUM> may cause audio signals and/or power to be sent to the HMD speaker <NUM> to output the sound therefrom. The sound output from the HMD speaker <NUM> contains the aural content, such as that pertaining to the virtual or mixed reality experience.

In a third operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being in intermediate range (e.g., below the threshold distance and above a second threshold) and reducing, the volume 118v of the HMD speaker <NUM> is reduced, while the volume 132v of the detachable speaker unit <NUM> is simultaneously increased. The controller <NUM> may cause audio signals and/or power to be sent to the HMD speaker <NUM> and the detachable speaker unit <NUM>.

In a fourth operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being in close proximity (e.g., below the second threshold distance to the zero distance) and reducing to the zero distance, the volume 118v of the HMD speaker <NUM> is reduced to zero and the volume 132v of the detachable speaker unit <NUM> is reduced slightly to a non-zero value. The controller <NUM> may cause audio signals and/or power to be sent to the HMD speaker <NUM> to output the sound therefrom.

In a fifth operation <NUM>, while the detachable speaker unit <NUM> is coupled to the head-mounted display unit <NUM>, the detachable speaker unit <NUM> continues to provide sound output to the user with the volume 132v being greater than zero, while the HMD speaker <NUM> provides no sound to the user.

In a sixth operation <NUM>, acoustic transparency of the detachable speaker unit <NUM> may be activated, as described previously for the sixth operation <NUM> of the method <NUM>.

In a seventh operation <NUM>, noise cancellation of the detachable speaker unit <NUM> may be activated, as described previously for the seventh operation <NUM> of the method <NUM>.

It should be noted that aspects of the method <NUM> may be incorporated into the method <NUM> in which case the volume 118v of the HMD speaker <NUM> may change to simulate movement of the detachable speaker unit <NUM> with sound being emitted therefrom. For example, in the second operation <NUM>, the volume 118v may increase to simulate the detachable speaker unit <NUM> being moved closed to the coupling location on the head-mounted display unit <NUM>, and in the third operation <NUM> may increase or stay constant. Further, the method <NUM> may be used in conjunction with the method <NUM> described previously, for example, in the third operation <NUM>.

With reference to <FIG>, for the detachable speaker units <NUM> that are configured to output sound when detached from the head-mounted display unit <NUM>, equalization of the sound output by the detachable speaker units <NUM> may be varied according to the distance from the detachable speaker unit <NUM> to the head-mounted display unit <NUM> (e.g., the coupling location thereon). For example, the gain of low frequency sounds (e.g., in a bass range) may increase and the gain of higher frequency sounds may decrease as the detachable speaker unit <NUM> is moved close to the head-mounted display unit <NUM>. Decreasing the gain at the low frequency and increasing the gain at the higher frequencies concentrates power output on the higher frequency sounds, which generally consume less power than low frequency sounds for a given volume output. Since power output of the detachable speaker units <NUM> may be limited due to the portable/detachable nature (e.g., being battery powered) and/or primary use case (e.g., being held in close proximity to the user's ear E), equalization in this manner may allow the user to experience louder sound while the detachable speaker units <NUM> are at relatively far distances than if equalization were not performed.

Referring to <FIG>, the gain of low frequency sound that is to be output by the detachable speaker unit <NUM> is referred to as the low frequency gain <NUM>, while the gain of the higher frequency sound that is to be output by the detachable speaker unit <NUM> is referred to as the high frequency gain <NUM>. The low frequency gain <NUM> and the high frequency gain <NUM> are represented by plots with the Y-axis being gain and the X-axis being distance between the detachable speaker unit <NUM> and the head-mounted display unit <NUM> (e.g., the coupling location thereon) with the zero distance on the right (i.e., the detachable speaker unit <NUM> moves closer to the coupling location moving rightward along the plots).

At relatively far distances between the detachable speaker unit <NUM> and the head- mounted display unit <NUM>, the low frequency gain <NUM> is below one, for example, starting at zero. As the distance decreases, such as when the user moves the detachable speaker unit <NUM> toward the head-mounted display unit <NUM> (e.g., to the coupling location over the user's ear E), the low frequency gain increases, for example, ending at one. Conversely, the high frequency gain <NUM> is above one at relatively far distances and decreases as the distance decreases, for example, ending at one. As a result, at relatively far distances, the low frequency gain <NUM> is below one and the high frequency gain <NUM> is above one, and the difference between the low frequency gain <NUM> and the high frequency gain <NUM> decreases as the distance decreases, for example, with the difference ending at zero.

According to the invention as claimed, at relatively close distances, the gain for low frequency sound may be increased to above one at relatively close distances, such as when the detachable speaker unit <NUM> is in the user's hand and being moved toward the head-mounted display unit <NUM> to be coupled thereto. Such low frequency sound may have a tendency to roll off (e.g., be attenuated) when the detachable speaker unit <NUM> is held by the user, and increasing the gain for such low frequency sound may provide flatter sound, or the perception of flatter sound, to the user. Thus, referring again to <FIG>, an alternative gain of low frequency sound that is to be output by the detachable speaker unit <NUM> is referred to as the low frequency gain <NUM>'. At relatively close distances between the detachable speaker unit <NUM> and the head-mounted display unit <NUM>, the low frequency gain <NUM>' may increase to above one and, as the distance decreases, decrease in a gradual (as shown) or stepped manner,.

for example, toward and/or to one. At relatively far distances, the low frequency gain <NUM>' may be the same as the low frequency gain <NUM> (e.g., starting below one, such as at zero, and increasing as the distance decreases) or other value (e.g., being one).

<FIG> illustrates a method <NUM> for outputting sound from the detachable speaker units <NUM> using equalization audio signal processing according to a position of the audio headset <NUM> and/or the detachable speaker units <NUM> individually relative to the head-mounted display unit <NUM> (e.g., to a coupling location on the head-mounted display unit <NUM>). The method <NUM> may, for example, be implemented with the controller <NUM> and the various sensors of the head-mounted display unit <NUM> and the detachable speaker units <NUM>. While discussed in conjunction with respect to just one of the detachable speaker units <NUM>, the method <NUM> should be understood to be applicable to each of the detachable speaker units <NUM> and the audio headset <NUM>. The method <NUM> may be referred to as an equalization method or an equalization audio signal processing method, and may be used alone and/or in conjunction with the method <NUM>.

In a second operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being relatively far (e.g., greater than a threshold distance), the low frequency gain <NUM> is below one and/or the high frequency gain <NUM> is above one, and sound is output from the detachable speaker unit <NUM> according to the low frequency gain <NUM> and/or the high frequency gain <NUM>. The controller <NUM> may adjust the low frequency gain <NUM> and the high frequency gain <NUM>, for example as shown in <FIG>, and cause audio signals and/or power to be sent to the detachable speaker unit <NUM> to output the sound therefrom according to such adjusted gains. The output sound may contain the aural content, such as that pertaining to the virtual or mixed reality experience.

In a third operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being in an intermediate range (e.g., below the threshold distance and above a second threshold) and reducing, the low frequency gain <NUM> is increased and/or the high frequency gain <NUM> is decreased, and sound is output from the detachable speaker unit <NUM> according to the low frequency gain <NUM> and/or the high frequency gain <NUM> (as adjusted). The controller <NUM> may adjust the low frequency gain <NUM> and the high frequency gain <NUM>, for example as shown in <FIG>, and cause audio signals and/or power to be sent to the detachable speaker unit <NUM> to output the sound therefrom according to such adjusted gains.

In a fourth operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being in a relatively close range (e.g., below the second threshold) and reducing, the low frequency gain may optionally be increased to above one and may thereafter further optionally decease toward one as the distance reduces to zero. The controller <NUM> may adjust the low frequency gain <NUM>', and cause audio signals and/or power to be sent to the detachable speaker unit <NUM> to output the sound therefrom according to such gain.

With reference to <FIG>, for the detachable speaker units <NUM> that are configured output sound when detached from the head-mounted display unit <NUM>, the dynamic range of the sound output by the detachable speaker units <NUM> may be varied according to the distance of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> (e.g., the coupling location thereon). The dynamic range generally refers to the range of volume between loud and soft sounds, while dynamic range compression refers to audio signal processing of decreasing the volume of the louder sounds and/or amplifying the quieter sounds. For example, dynamic range compression may be applied at decreasing levels as the detachable speaker unit <NUM> is moved closer to the head-mounted display unit <NUM>, thereby resulting in a lower dynamic range at relatively far distances and higher dynamic range at lower distances. Applying dynamic range compression in this manner may, for example, allow the user to hear more sounds and/or experience a consistent louder volume from the detachable speaker unit <NUM> at relatively far distances.

Referring to <FIG>, the dynamic range 932R of the sound that is to be output by the detachable speaker unit is illustrated as a function of the distance between the detachable speaker unit <NUM> and the head-mounted display unit <NUM> (e.g., the coupling location thereon). As the distance decreases, less dynamic compression is applied, such that the dynamic range 932R increases.

<FIG> illustrates a method <NUM> for outputting sound from the detachable speaker units <NUM> using dynamic range compression audio signal processing according to a position of the audio headset <NUM> and/or the detachable speaker units <NUM> individually relative to the head-mounted display unit <NUM> (e.g., to a coupling location on the head-mounted display unit <NUM>). The method <NUM> may, for example, be implemented with the controller <NUM> and the various sensors of the head-mounted display unit <NUM> and the detachable speaker units <NUM>. While discussed in conjunction with respect to just one of the detachable speaker units <NUM>, the method <NUM> should be understood to be applicable to each of the detachable speaker units <NUM> and the audio headset <NUM>. The method <NUM> may be referred to as a dynamic range compression method or a dynamic range compression audio signal processing method, and may be used alone and/or in conjunction with the method <NUM> and/or the method <NUM>.

In a second operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being relatively far (e.g., greater than a threshold distance), a relatively high level of dynamic range compression is applied to achieve a relatively low dynamic range. The controller <NUM> may apply dynamic range compression, for example, to achieve the dynamic range 932R shown in <FIG>, and cause audio signals and/or power to be sent to the detachable speaker unit <NUM> to output the sound therefrom according to such dynamic range. The output sound may contain the aural content, such as that pertaining to the virtual or mixed reality experience.

In a third operation <NUM>, based on the position of the detachable speaker unit <NUM> relative to the head-mounted display unit <NUM> being in intermediate range (e.g., below the threshold distance) and reducing, the level of dynamic range compression applied is reduced to achieve a relatively high dynamic range. The controller <NUM> may apply dynamic range compression, for example, to achieve the dynamic range 932R shown in <FIG>, and cause audio signals and/or power to be sent to the detachable speaker unit <NUM> to output the sound therefrom according to such dynamic range.

Referring to <FIG>, the display system <NUM> may be configured to display a visual indicator <NUM> associated with the audio headset <NUM>. For example, prior to the detachable speaker units <NUM> being coupled to the head-mounted display unit <NUM>, the head-mounted display unit <NUM> may provide visual content that includes the visual indicator <NUM>, such as an animation, icon, or other indicator, which may be in spatial proximity to the audio headset <NUM>. The visual indicator <NUM> may suggest or otherwise indicate the sound output capability of the audio headset <NUM> and/or provide instructions for use thereof. While discussed in conjunction with the display system <NUM> and the components thereof (e.g., the head-mounted display unit <NUM> and the audio headset <NUM>), the concepts and method discussed with respect to <FIG> are applicable to the display systems <NUM>, <NUM>, <NUM>.

For example, in <FIG>, the user may view the display screen <NUM> of the head-mounted display unit <NUM> and see the audio headset <NUM> within the field of view as a real object in a mixed reality experience (e.g., via video or optical pass-through as described above), or as a virtual object in a virtual reality experience, wherein the audio headset <NUM> is depicted by rendered graphics. For illustrative purposes, the audio headset <NUM> is positioned on a table of the real environment. As shown in <FIG>, the display screen <NUM> may also display the visual indicator <NUM>, which may be visually associated with the audio headset <NUM>, for example, by being depicted in close proximity thereto, such as by surrounding and/or overlaying the audio headset <NUM>.

The visual indicator <NUM> suggests or otherwise communicates the audio capabilities and/or use of the audio headset <NUM>. In one example, the visual indicator is an audio-related icon, such as sound waves (as shown), a depiction of traditional headphones, or other icon suggestive of the audio capabilities or use of the audio headset <NUM>. Instead or additionally, the visual indicator <NUM> may be an animation, such as sound waves emitting from the audio headset <NUM>. The motion and/or intensity of the visual indicator <NUM> (e.g., animation of sound waves) may be correlated to the sound related thereto. , for example, by changing appearance in accordance with the sound being output. For example, the visual indicator <NUM> may visually pulsate according to a beat of the sound or music (e.g., faster or slower according to a faster or slower beat, respectively, of the sound) or intensity of a sonic event (e.g., increasing in size and/or pulsating faster coincident with a real or virtual event expected to produce a loud and/or intense sound, such as an explosion).

The visual indicator <NUM> may be positioned in spatial proximity (e.g., in close proximity, overlaying, and/or surrounding) to the audio headset <NUM> and/or the detachable speaker units <NUM> individually. The location of the audio headset <NUM> may be determined in the manners described above, for example, by using the sensors of the head-mounted display unit <NUM> (e.g., the camera <NUM> for video recognition of the audio headset <NUM>, or the motion sensors <NUM>) and/or the sensing electronics 138d of the detachable speaker units <NUM> (e.g., camera, motion sensors, etc.).

The visual indicator <NUM> or variations thereof may suggest or otherwise communicate how to use the audio headset <NUM>, for example, displaying one or more diagrams illustrating how to use the audio headset <NUM>. Referring to <FIG>, for example, when the detachable speaker units <NUM> are not in the field of view of the user, a visual indicator <NUM> may guide the user in moving the detachable speaker unit <NUM> to the coupling location on the head-mounted display unit <NUM>. The visual indicator <NUM> includes an illustration 1070a representing the detachable speaker unit <NUM> and another illustration 1070b representing the coupling location. The illustrations 1070a, 1070b may be displayed in a spatial relationship to each other representing the physical spatial arrangement between the detachable speaker unit <NUM> and the coupling location on the head-mounted display unit <NUM>, thereby communicating to the user required movement for coupling the detachable speaker unit <NUM>. For example, as shown, the illustration 1070a (i.e., representing the detachable speaker unit <NUM>) is positioned downward and rightward of the illustration 1070b (i.e., representing the coupling location on the head-mounted display unit <NUM>), which may represent the right detachable speaker unit <NUM> being forward of and lower than the coupling location. The visual indication <NUM> may instead or additionally include iconography (e.g., arrows), text (e.g., written text), and/or animations (e.g., depicting movement of the illustration 1070a toward the illustration 1070b) instructing the user where to move the detachable speaker unit <NUM> for being coupled to the head-mounted display unit <NUM>.

Referring to <FIG>, a method <NUM> for providing visual content with a display system and, in particular, for providing a visual indicator related to an audio output device. The display system may, for example, be one of the display systems <NUM>, <NUM>, <NUM>, <NUM>. The method <NUM> may, for example, be implemented with the controller <NUM> and the various sensors of the head-mounted display unit <NUM> and the detachable speaker units <NUM>. For simplicity, the method <NUM> is discussed in conjunction with the display system <NUM> but should be understood as being applicable to the display systems <NUM>, <NUM>, <NUM>. Additionally, while discussed generally with respect to the detachable speaker unit <NUM> below, the method <NUM> should be understood to be applicable to each of the detachable speaker units <NUM>, the audio headset <NUM>, or another audio output device, such as an external speaker.

In a first operation <NUM>, a position of the audio output device (e.g., the audio headset <NUM>, the detachable speaker unit <NUM>, or other audio output device) is determined. The position of the audio output device may be determined, for example, by the controller <NUM> using sensors of the head-mounted display unit <NUM>, such as by processing video received from the camera <NUM>, or the sensing electronics 138d of the detachable speaker units <NUM> (e.g., if the detachable speaker units <NUM> are powered independent of being coupled to the head-mounted display unit <NUM>), such as by detecting movement toward the head-mounted display unit <NUM> and or change in proximity therebetween.

In a second operation <NUM>, while the audio output device is in the field of view of the head-mounted display unit, a visual indicator <NUM> is displayed in spatial proximity to the audio output device. For example, the controller <NUM> may send display signals to the head-mounted display unit <NUM> for displaying the visual indicator <NUM> with the display screen <NUM> according to the position determined in the first operation <NUM>. The visual indicator <NUM> may, as described above, visually communicate to the user an audio characteristic of the audio output device (e.g., showing an icon or animation resembling sound waves or type of audio device, such as headphones) and/or instructions for using the audio output device (e.g., for coupling the detachable speaker unit <NUM> to the head-mounted display unit <NUM>). The field of view of the head-mounted display unit <NUM> is that portion of the real environment which is viewable by the user at a given time.

In a third operation <NUM>, when the audio output device is outside the field of view of the display screen <NUM>, the visual indicator <NUM> is displayed to illustrate the physical proximity of the audio output device to the head-mounted display unit (e.g., of the detachable speaker unit <NUM> to the coupling location). For example, the controller <NUM> may send display signals to the head-mounted display unit <NUM> for displaying the visual indicator <NUM> with the display screen <NUM> according to the position determined in the first operation <NUM>. As discussed above, the visual indicator <NUM> may include the illustration 1070a representing the detachable speaker unit <NUM>, and the illustration 1070b representing the coupling location in spatial relationship thereto representing the physical spatial relationship (e.g., the physical proximity) of the detachable speaker unit <NUM> to the coupling location on the head-mounted display unit <NUM>. It should be noted that one, the other, or both of the second operation <NUM> and the third operation <NUM> may be performed.

In a fourth operation <NUM>, which may occur simultaneous to the second operation <NUM> (i.e., when the audio output device is within the field of view) and/or the third operation <NUM> (i.e., when the audio output device is outside the field of view), the virtual aural content may be output by the HMD speakers <NUM>, which may spatially simulate sound being emitted from the audio output device (e.g., being spatially balanced left-to-right and/or changing in volume to represent the left-right orientation and/or distance, respectively, of the audio output device). The virtual aural content may correspond to the visual indicator <NUM> or the visual indicator <NUM>, for example, coinciding in time with display thereof.

While the method <NUM> is discussed as providing both of the visual indicators <NUM>, <NUM>, the method <NUM> may instead include operations for providing only one of the visual indicators <NUM>, <NUM>.

As referenced above, the method <NUM> may be used with an audio output device other than the audio headset <NUM> or the detachable speaker units <NUM>, which is associated with the display system <NUM>. For example, another audio output device may be an external speaker that is not physically coupleable to the head-mounted display unit.

Furthermore, the method <NUM> may be used in conjunction with the methods <NUM>, <NUM>, <NUM> discussed above. For example, the visual indicators <NUM>, <NUM> may be displayed simultaneous with the sound output from the HMD speakers <NUM> and/or the detachable speaker units <NUM> as described with the methods <NUM>, <NUM>, <NUM>, <NUM>, <NUM>.

Referring to <FIG>, the controller <NUM> may have the hardware configuration as shown and described, or other suitable configuration. The controller <NUM> may include a processor <NUM>, memory <NUM>, storage <NUM>, a communications interface <NUM>, and a bus <NUM> connecting such components or devices for communication therebetween. The processor <NUM> is operable to execute computer program instructions and perform operations described by such instructions. As an example, the processor <NUM> may be a central processing unit or o other conventional processing device. The memory <NUM> may be a volatile, high-speed, short-term information storage device (e.g., random-access memory module). The storage <NUM> may be a non-volatile information storage device (e.g., a hard drive). The communications interface <NUM> is configured to send and/or receive signals (e.g., wired or wirelessly), such as to and/or from the head-mounted display unit <NUM> and/or the audio headset <NUM>.

A physical environment refers to a physical world that people can sense and/or interact with without aid of electronic systems. Physical environments, such as a physical park, include physical articles, such as physical trees, physical buildings, and physical people. People can directly sense and/or interact with the physical environment, such as through sight, touch, hearing, taste, and smell.

In contrast, a computer-generated reality (CGR) environment refers to a wholly or partially simulated environment that people sense and/or interact with via an electronic system. In CGR, a subset of a person's physical motions, or representations thereof, are tracked, and, in response, one or more characteristics of one or more virtual objects simulated in the CGR environment are adjusted in a manner that comports with at least one law of physics. For example, a CGR system may detect a person's head turning and, in response, adjust graphical content and an acoustic field presented to the person in a manner similar to how such views and sounds would change in a physical environment. In some situations (e.g., for accessibility reasons), adjustments to characteristic(s) of virtual object(s) in a CGR environment may be made in response to representations of physical motions (e.g., vocal commands).

A person may sense and/or interact with a CGR object using any one of their senses, including sight, sound, touch, taste, and smell. For example, a person may sense and/or interact with audio objects that create 3D or spatial audio environment that provides the perception of point audio sources in 3D space. In another example, audio objects may enable audio transparency, which selectively incorporates ambient sounds from the physical environment with or without computer-generated audio. In some CGR environments, a person may sense and/or interact only with audio objects.

Examples of CGR include virtual reality and mixed reality.

A virtual reality (VR) environment refers to a simulated environment that is designed to be based entirely on computer-generated sensory inputs for one or more senses. A VR environment comprises a plurality of virtual objects with which a person may sense and/or interact. For example, computer-generated imagery of trees, buildings, and avatars representing people are examples of virtual objects. A person may sense and/or interact with virtual objects in the VR environment through a simulation of the person's presence within the computer-generated environment, and/or through a simulation of a subset of the person's physical movements within the computer-generated environment.

In contrast to a VR environment, which is designed to be based entirely on computer-generated sensory inputs, a mixed reality (MR) environment refers to a simulated environment that is designed to incorporate sensory inputs from the physical environment, or a representation thereof, in addition to including computer-generated sensory inputs (e.g., virtual objects). On a virtuality continuum, a mixed reality environment is anywhere between, but not including, a wholly physical environment at one end and virtual reality environment at the other end.

In some MR environments, computer-generated sensory inputs may respond to changes in sensory inputs from the physical environment. Also, some electronic systems for presenting an MR environment may track location and/or orientation with respect to the physical environment to enable virtual objects to interact with real objects (that is, physical articles from the physical environment or representations thereof). For example, a system may account for movements so that a virtual tree appears stationery with respect to the physical ground.

Examples of mixed realities include augmented reality and augmented virtuality.

An augmented reality (AR) environment refers to a simulated environment in which one or more virtual objects are superimposed over a physical environment, or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person may directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, so that a person, using the system, perceives the virtual objects superimposed over the physical environment. Alternatively, a system may have an opaque display and one or more imaging sensors that capture images or video of the physical environment, which are representations of the physical environment. The system composites the images or video with virtual objects, and presents the composition on the opaque display. A person, using the system, indirectly views the physical environment by way of the images or video of the physical environment, and perceives the virtual objects superimposed over the physical environment. As used herein, a video of the physical environment shown on an opaque display is called "pass-through video," meaning a system uses one or more image sensor(s) to capture images of the physical environment, and uses those images in presenting the AR environment on the opaque display. Further alternatively, a system may have a projection system that projects virtual objects into the physical environment, for example, as a hologram or on a physical surface, so that a person, using the system, perceives the virtual objects superimposed over the physical environment.

An augmented reality environment also refers to a simulated environment in which a representation of a physical environment is transformed by computer-generated sensory information. For example, in providing pass-through video, a system may transform one or more sensor images to impose a select perspective (e.g., viewpoint) different than the perspective captured by the imaging sensors. As another example, a representation of a physical environment may be transformed by graphically modifying (e.g., enlarging) portions thereof, such that the modified portion may be representative but not photorealistic versions of the originally captured images. As a further example, a representation of a physical environment may be transformed by graphically eliminating or obfuscating portions thereof.

An augmented virtuality (AV) environment refers to a simulated environment in which a virtual or computer generated environment incorporates one or more sensory inputs from the physical environment. The sensory inputs may be representations of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, but people with faces photorealistically reproduced from images taken of physical people. As another example, a virtual object may adopt a shape or color of a physical article imaged by one or more imaging sensors. As a further example, a virtual object may adopt shadows consistent with the position of the sun in the physical environment.

There are many different types of electronic systems that enable a person to sense and/or interact with various CGR environments. Examples include head mounted systems, projection-based systems, heads-up displays (HUDs), vehicle windshields having integrated display capability, windows having integrated display capability, displays formed as lenses designed to be placed on a person's eyes (e.g., similar to contact lenses), headphones/earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop/laptop computers. A head mounted system may have one or more speaker(s) and an integrated opaque display. Alternatively, a head mounted system may be configured to accept an external opaque display (e.g., a smartphone). The head mounted system may incorporate one or more imaging sensors to capture images or video of the physical environment, and/or one or more microphones to capture audio of the physical environment. Rather than an opaque display, a head mounted system may have a transparent or translucent display. The transparent or translucent display may have a medium through which light representative of images is directed to a person's eyes. The display may utilize digital light projection, OLEDs, LEDs, uLEDs, liquid crystal on silicon, laser scanning light source, or any combination of these technologies. The medium may be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to become opaque selectively. Projection-based systems may employ retinal projection technology that projects graphical images onto a person's retina. Projection systems also may be configured to project virtual objects into the physical environment, for example, as a hologram or on a physical surface.

As described above, one aspect of the present technology is the gathering and use of data available from various sources to display visual content and output audio content, which may include varying content based on movement or conditions of the head or eyes of the user. The present disclosure contemplates that in some instances, this gathered data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data can include demographic data, location-based data, telephone numbers, email addresses, twitter ID's, home addresses, data or records relating to a user's health or level of fitness (e.g., vital signs measurements, medication information, exercise information), date of birth, or any other identifying or personal information.

The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to output content. Accordingly, use of such personal information data enables users an enhanced user experience. Further, other uses for personal information data that benefit the user are also contemplated by the present disclosure. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.

Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, in the case of observing conditions or movements of the head or eyes of the user, the present technology can be configured to allow users to select to "opt in" or "opt out" of participation in the collection of personal information data during registration for services or anytime thereafter. In another example, users can select not to provide user movement or condition data or can select to limit the length of time user observation data is observed or maintained. In addition to providing "opt in" and "opt out" options, the present disclosure contemplates providing notifications relating to the access or use of personal information. For instance, a user may be notified upon downloading an app that their personal information data will be accessed and then reminded again just before personal information data is accessed by the app.

Claim 1:
A display system (<NUM>) comprising:
a head-mounted display unit (<NUM>) configured to output visual content to a user;
a controller (<NUM>); and
a detachable speaker unit (<NUM>) detachably coupleable to the head-mounted display unit for providing aural content to the user and adapted to be physically supported by the head-mounted display unit;
wherein audio signal processing of the aural content output by the detachable speaker unit is configured to change as the detachable speaker unit is moved toward a predetermined coupling location at which the detachable speaker unit is coupleable to the head-mounted display unit, and the audio signal processing includes equalization, and
wherein the controller is configured to perform the audio signal processing and wherein the audio signal processing includes at least one of:
the equalization that includes increasing low frequency gain as the detachable speaker unit is moved toward the predetermined coupling location; and
increasing the dynamic range as the detachable speaker unit is moved toward the predetermined coupling location.