Patent Description:
A headphone reproduces audio when connected to a receiver (e.g., a stereo receiver, a surround receiver, etc.), a television (TV) set, a radio, a music player, an electronic sound producing device (e.g., a smartphone), video players, etc..

<CIT> discloses a method and apparatus to enable different types of headphones to provide high quality sound by matching a measured response of a headphone to a target response.

<CIT> discloses a method and apparatus to compensate for a frequency response characteristic of earphones.

<CIT> discloses a sound reproducing apparatus for an earphone configured to produce a listening state equivalent to a state where the canal is not blocked by wearing the earphone. <CIT> discloses an apparatus for cancelling resonance in the outer-ear canal developed when a person listens to music according to the outer-ear canal structure of each person.

<CIT> discloses an earphone adapted to reduce noise by attenuating acoustic noise approaching a wearer's ear.

In accordance with the present invention, there is provided a headphone device providing personalized headphone equalization according to claim <NUM> and a method of personalized headphone equalization according to claim <NUM>. These and other features, aspects and advantages of the one or more embodiments will become understood with reference to the following description, appended claims, and accompanying figures.

The following description is made for the purpose of illustrating the general principles of one or more embodiments and is not meant to limit the inventive concepts claimed herein. Further, particular features described herein can be used in combination with other described features in each of the various possible combinations and permutations. Unless otherwise specifically defined herein, all terms are to be given their broadest possible interpretation including meanings implied from the specification as well as meanings understood by those skilled in the art and/or as defined in dictionaries, treatises, etc..

One embodiment provides a method of personalized headphone equalization system for a headphone. The method comprises obtaining a measurement of sound pressure level at a microphone mounted in a near field of a headphone driver of the headphone and inside a cavity formed by the headphone and a user's ear. The method further comprises providing personalized equalization (EQ) of output reproduced via a headphone driver by performing EQ correction of the output based on the measurement of sound pressure level and a pre-determined target frequency response for the headphone, resulting in an equalized output that is adapted to individual characteristics of the user's ear.

Another embodiment provides a personalized headphone equalization system for a headphone. The system comprises at least one processor, and a processor-readable memory device storing instructions that when executed by the at least one processor causes the at least one processor to perform operations. The operations include obtaining a measurement of sound pressure level at a microphone mounted in a near field of a headphone driver of the headphone and inside a cavity formed by the headphone and a user's ear. The operations further include providing personalized EQ of output reproduced via a headphone driver by performing EQ correction of the output based on the measurement of sound pressure level and a pre-determined target frequency response for the headphone, resulting in an equalized output that is adapted to individual characteristics of the user's ear.

One embodiment provides a headphone device providing personalized headphone equalization. The headphone device comprises a headphone driver, a microphone mounted in a near field of the headphone driver and inside a cavity formed by the headphone device and a user's ear, and a processor. The processor is configured to obtain a measurement of sound pressure level at the microphone. The processor is further configured to provide personalized EQ of output reproduced via a headphone driver by performing EQ correction of the output based on the measurement of sound pressure level and a pre-determined target frequency response for the headphone device, resulting in an equalized output that is adapted to individual characteristics of the user's ear.

There are different types of headphones such as, but not limited to, circumaural (i.e., around the ear) headphones, supra-aural (i.e., over the ear) headphones, closed-back headphones, open-back headphones, in-ear earbuds (i.e., earphones), bone conduction headphones, headsets, etc. Each headphone comprises a headphone driver (i.e., transducer) for reproducing sound, wherein the headphone driver is disposed inside a housing of the headphone. For example, if the headphone is a circumaural headphone or a supra-aural headphone, the headphone driver is disposed inside a can for covering an external part of a user's ear. As another example, if the headphone is an in-ear earbud, the headphone driver is disposed inside the earbud for insertion into an ear canal of a user's ear.

Many conventional headphones include noise cancellation systems that utilize microphones and real-time digital signal processing (DSP) to sense (i.e., measure) noise inside of and/or outside of the headphones for purposes of canceling or reducing the noise sensed as much as possible.

Embodiments of the invention can be integrated in headphones with active noise control (ANC) or noise cancelation systems. Embodiments of the invention can be integrated in virtual reality systems that utilize headphones. Embodiments of the invention provide a solution to issues of variability arising from placement and/or positioning of headphones to a user's ears, specifically providing correction of output of the headphones in accordance with individual characteristics of the user.

<FIG> illustrates an example personalized headphone equalization system <NUM> for a headphone <NUM>, in accordance with an embodiment. In one embodiment, the system <NUM> is configured to provide personalized (i.e., customized) equalization of output reproduced via a headphone driver <NUM> of the headphone <NUM> by automatically adapting the output based on individual characteristics of user's ear that the headphone <NUM> is placed and/or positioned relative to.

In one embodiment, the system <NUM> is integrated in headphones that include the headphone <NUM>. For example, in one embodiment, the system <NUM> is included in digital signal processing (DSP) of an ANC or a noise cancelation system for the headphones. In another embodiment, the headphone <NUM> is connected to an electronic device such as a mobile device (e.g., a smartphone), a PC, etc., and the system <NUM> operates on the electronic device.

The system <NUM> is suitable for different types of headphones such as, but not limited to, circumaural headphones, supra-aural headphones, in-ear earbuds, bone conduction headphones, etc. The headphone <NUM> can be any type of headphone that includes a microphone <NUM> (e.g., a built-in miniature microphone) mounted in the near field of the headphone driver <NUM> and inside a cavity formed from the headphone <NUM> and the user's ear including ear canal. The cavity encompasses different spatial points, such as the headphone driver <NUM>, the microphone <NUM>, the ear canal open to an external part of the user's ear, an eardrum at an end of the ear canal, etc. The microphone <NUM> is configured to sense (i.e., measure) sound pressure level inside the cavity at discrete frequencies. In one embodiment, the microphone <NUM> is configured to perform a real-time measurement of a transfer function from electrical/voltage terminals of the headphone driver <NUM> to a point inside the cavity. For example, in one embodiment, the microphone <NUM> is configured to compute an impulse response representing the transfer function from the electrical/voltage terminals of the headphone driver <NUM> to the microphone <NUM>.

As described in detail later herein, in one embodiment, the system <NUM> is configured to: (<NUM>) receive a real-time measurement of sound pressure level at the microphone <NUM> (i.e., sound pressure level sensed by the microphone <NUM>), (<NUM>) determine a degree of acoustical coupling of the headphone <NUM> to the user's ear based on the measurement, and (<NUM>) apply personalized EQ correction to output reproduced via the headphone driver <NUM> to improve or increase sound quality of the headphone <NUM>. The degree of acoustical coupling enables the user to determine how well the headphone <NUM> is coupled (i.e., attached) to the user's ear, and provides an automatic measurement of acoustical leakages resulting from the coupling.

In one embodiment, sound pressure level sensed by the microphone <NUM> is amplified via a mic pre-amp <NUM> of the headphone <NUM>.

Embodiments of the invention provide several advantages such as, but not limited to, an automatic measurement of acoustical leakages resulting from coupling of headphones to a user's ears, correction for the acoustical leakages at low frequencies, EQ correction of output reproduced by the headphones to a pre-determined target EQ for the headphones, personalized equalization of the output from <NUM> to approximately <NUM>, improved or increased sound quality of the headphones including bass reproduction, improved sound balance between left and right cans or earbuds of the headphones, alerts in response to prolonged exposure of the user's ears to high sound pressure levels, etc..

<FIG> illustrates the personalized headphone equalization system <NUM> in detail, in accordance with an embodiment. In one embodiment, the system <NUM> comprises a transfer function measurement unit <NUM> configured to: (<NUM>) receive a signal indicative that the headphone <NUM> is turned on, (<NUM>) perform a real-time measurement of a transfer function from electrical terminals of the headphone driver <NUM> to a point inside the cavity formed by the headphone <NUM> and the user's ear including ear canal, and (<NUM>) determine a degree of acoustical coupling of the headphone <NUM> to individual characteristics of the user's ear based on the real-time measurement of the transfer function. The degree of acoustical coupling provides an automatic measurement of acoustical leakages resulting from coupling the headphone to the user's ear.

In one embodiment, the real-time measurement of the transfer function involves utilizing the microphone <NUM> to sense sound pressure level inside the cavity, resulting in measurement data <NUM> comprising a frequency response of sound pressure level at the microphone <NUM>.

In one embodiment, the real-time measurement of the transfer function is based on different methods such as, but not limited to, using a test signal (e.g., a music program), using a logarithmic sweep method, using a multi-tone method, using maximum length sequences (MLS) sequences, etc..

If the headphone <NUM> is a circumaural headphone or a supra-aural headphone, a volume of the cavity formed from covering an external (i.e., outer) part of the user's ear with a can of the headphone <NUM> is small relative to frequency wavelengths below approximately <NUM>. Below these frequencies, the cavity will act as a pressure chamber where sound pressure is the same at any point inside the cavity. In one embodiment, the system <NUM> provides an accurate estimation of sound pressure levels reproduced inside the cavity based on information relating to sensitivities of the headphone driver <NUM> and the microphone <NUM>.

Resonances in an ear canal ("ear canal resonances") of a user's ear typically fluctuates from <NUM> to <NUM> due to the individual characteristics of the user's ear, such as size, volume, and length. A frequency response of sound pressure level at the microphone <NUM> allows for detection of electro-acoustic system resonances including ear canal resonances and/or headphone driver resonances, all formed inside the cavity by the headphone driver <NUM> and the user's ear. Let fr generally denote a frequency at which a resonance is detected in the frequency response.

In one embodiment, the system <NUM> comprises an electro-acoustic system resonance detection unit <NUM> configured to detect one or more resonances (e.g., ear canal resonances and/or headphone driver resonances) based on a frequency response of sound pressure level at the microphone <NUM> (e.g., measurement data <NUM> from the transfer function measurement unit <NUM>). For example, in one embodiment, the electro-acoustic system resonance detection unit <NUM> is configured to detect a resonance in a portion of the frequency response that spans a pre-determined frequency range (e.g., from about <NUM> to about <NUM>) by detecting a maximum sound pressure level of the portion, wherein the maximum sound pressure level is a peak in the portion.

In one embodiment, the electro-acoustic system resonance detection unit <NUM> is configured to detect a different amount (i.e., number) of electro-acoustic system resonances in the frequency response for different types of headphone.

In one embodiment, the electro-acoustic system resonance detection unit <NUM> is configured to determine a gain and a quality factor (Q) for a resonance detected. Let gr generally denote a gain for a resonance detected at a frequency fr. For example, in one embodiment, the electro-acoustic system resonance detection unit <NUM> is configured to detect a gain gr<NUM> and a Q for a first electro-acoustic system resonance detected at a frequency fr<NUM>. As another example, in one embodiment, the electro-acoustic system resonance detection unit <NUM> is configured to detect a gain and a Q for a subsequent electro-acoustic system resonance detected instead (e.g., a second electro-acoustic system resonance detected at a frequency fr<NUM>); this example is suitable for a type of headphone that is more rigid (e.g., the headphone driver <NUM> is surrounded by hardware).

In one embodiment, the electro-acoustic system resonance detection unit <NUM> provides data <NUM> comprising: (<NUM>) for each electro-acoustic system resonance detected, a corresponding frequency fr at which the electro-acoustic system resonance is detected in the frequency response, and (<NUM>) a gain gr and a Q for either a first electro-acoustic system resonance detected or a subsequent electro-acoustic system response detected, if any.

In one embodiment, the system <NUM> comprises a main equalization unit <NUM> configured to provide personalized EQ correction (i.e., personalized headphone equalization) of output reproduced via the headphone driver <NUM> in accordance with a pre-determined target frequency response for the headphone <NUM>. Specifically, in one embodiment, the main equalization unit <NUM> is configured to: (<NUM>) construct (i.e., create) a main equalization filter <NUM> based on the pre-determined target frequency response, a frequency response of sound pressure level at the microphone <NUM> (e.g., measurement data <NUM> from the transfer function measurement unit <NUM>), and an electro-acoustic system resonance detected (e.g., data <NUM> from the electro-acoustic system resonance detection unit <NUM>), and (<NUM>) provide equalization by using the main equalization filter to equalize a frequency response of the headphone <NUM>, resulting in an equalized frequency response that closely matches the pre-determined target response.

In one embodiment, the pre-determined target frequency response is based on subjective evaluations on human subjects.

In one embodiment, a main equalization filter <NUM> constructed by the main equalization unit <NUM> is based on different methods such as, but not limited to, using infinite impulse response (IIR) filters with a number of bi-quads or parametric equalization (PEQ) filters that can be combined with a minimum phase finite impulse response filter (FIR), etc..

Let EQmain generally denote a main equalization filter <NUM> constructed by the main equalization unit <NUM>. In one embodiment, for a frequency bandwidth from dc to <NUM>, no equalization is performed, as represented by equation (<NUM>) in dB provided below:
<MAT>.

In one embodiment, for a frequency bandwidth from <NUM> to a frequency fr at which an electro-acoustic system resonance is detected, the main equalization filter EQmain is represented in accordance with equation (<NUM>) provided below:
<MAT> ,wherein.

In one embodiment, for a frequency bandwidth from the frequency fr to <NUM>, the main equalization filter EQmain is represented in accordance with equation (<NUM>) provided below:
<MAT>.

A frequency response of the main equalization filter EQmain is equal to a constant value from the frequency fr to <NUM>.

In one embodiment, the system <NUM> comprises a resonance equalization unit <NUM> configured to provide additional EQ correction of output reproduced via the headphone driver <NUM> to compensate for an electro-acoustic system resonance (e.g., ear canal resonance and/or a headphone driver resonance) detected at a frequency fr. Specifically, in one embodiment, the resonance equalization unit <NUM> is configured to: (<NUM>) construct (i.e., create) a PEQ filter <NUM> centered on the frequency fr with an approximate gain gr (e.g., -<NUM> dB) and a low Q (e.g., Q = <NUM>) for the resonance detected (e.g., based on data <NUM> from the electro-acoustic system resonance detection unit <NUM>), and (<NUM>) provide additional equalization to compensate for the resonance detected (i.e., electro-acoustic system resonance equalization, such as ear canal resonance equalization) by adding the PEQ filter <NUM> to the main equalization filter <NUM>.

Let PEQfr generally denote a PEQ filter <NUM> constructed by the resonance equalization unit <NUM> to compensate for a resonance detected at a frequency fr.

In one embodiment, the main equalization filter EQmain and the PEQ filter PEQfr are based on a frequency fr<NUM> at which a first resonance is detected (i.e., fr = fr<NUM>). In another embodiment, the main equalization filter EQmain and the PEQ filter PEQfr are based on a frequency at which a subsequent resonance (e.g., a second resonance) is detected (e.g., fr = fr2).

In one embodiment, the system <NUM> comprises a low pass filtering unit <NUM> configured to provide low pass filtering to reduce one or more high peaks in a frequency response of the headphone <NUM> at frequencies above <NUM>. Specifically, in one embodiment, low pass filtering unit <NUM> is configured to: (<NUM>) construct (i.e., create) a first order low pass filter <NUM> with at a pre-determined cut off frequency fc (e.g., <NUM>), and (<NUM>) provide the low pass filtering by adding the low pass filter <NUM> to the main equalization filter <NUM>. The low pass filter <NUM> is adjustable based on user preferences.

Let LPfc generally denote a low pass filter <NUM> constructed by the low pass filtering unit <NUM> with at a pre-determined cut off frequency fc. In one embodiment, the pre-determined cut off frequency fc is based on user input. For example, in one embodiment, the pre-determined cut off frequency fc is equal to a frequency fr<NUM> at which a second resonance is detected in the frequency response. As another example, the pre-determined cut off frequency fc is equal to a frequency fr<NUM> at which a first resonance is detected in the frequency response.

Let EQear generally denote an amount of additional equalization and low pass filtering applied to a frequency response of the headphone <NUM>. In one embodiment, EQear is represented in accordance with equation (<NUM>) provided below:
<MAT>.

Let EQfinal generally denote a final (i.e., total) amount of equalization and low pass filtering applied to a frequency response of the headphone <NUM>. In one embodiment, EQfinal is represented in accordance with equation (<NUM>) provided below:
<MAT>.

In one embodiment, each individual filter (e.g., the main equalization filter EQmain, the PEQ filter PEQfr, and the low pass filter LPfc ) is calculated and/or adapted by a DSP processor. An initial routine can be used to perform a measurement using different types of test signals, multi-tones, pink noise, etc. For example, in one embodiment, the system <NUM> implements an adaptive process using a music program as a test signal. The adaptive process can be based on different techniques for real-time adaptive transfer function measurement, such as using Kalman filters, using Least Squares Spectral Approximation, etc. Once each individual filter is constructed, the system <NUM> runs a periodic routine to update the individual filter in case the headphone <NUM> has been moved to a slightly different position, therefore changing its coupling to the user's ear.

<FIG> illustrates an example circumaural closed-back headphone <NUM> on a user's head <NUM>, wherein the system <NUM> is integrated in the headphone <NUM> or operates on an electronic device connected to the headphone <NUM>, in accordance with an embodiment. As shown in <FIG>, a cavity <NUM> is formed from the headphone <NUM> covering an external (i.e., outer) ear part <NUM> of the user's head <NUM>. The headphone <NUM> comprises: (<NUM>) a headphone driver <NUM> for reproducing audio, (<NUM>) a protection grid <NUM> separating the headphone driver <NUM> from the external ear part <NUM>, (<NUM>) a headphone cushion <NUM> completely surrounding the external ear part <NUM>, such that the headphone <NUM> fully encloses the external ear part <NUM>, and (<NUM>) a near field microphone <NUM> for sensing sound pressure levels inside the cavity <NUM> at discrete frequencies. In one embodiment, the microphone <NUM> is mounted in the near field of a diaphragm of the headphone driver <NUM> by mounting the microphone <NUM> at the protection grid <NUM>.

<FIG> illustrates an example circumaural open-back headphone <NUM> on a user's head <NUM>, wherein the system <NUM> is integrated in the headphone <NUM> or operates on an electronic device connected to the headphone <NUM>, in accordance with an embodiment.

As shown in <FIG>, a cavity <NUM> is formed from the headphone <NUM> covering an external (i.e., outer) ear part <NUM> of the user's head <NUM>. The headphone <NUM> comprises: (<NUM>) a headphone driver <NUM> for reproducing audio, (<NUM>) a protection grid <NUM> separating the headphone driver <NUM> from the external ear part <NUM>, (<NUM>) a headphone cushion <NUM> completely surrounding the external ear part <NUM>, such that the headphone <NUM> fully encloses the external ear part <NUM>, and (<NUM>) a near field microphone <NUM> for sensing sound pressure levels inside the cavity <NUM> at discrete frequencies. In one embodiment, the microphone <NUM> is mounted in the near field of a diaphragm of the headphone driver <NUM> by mounting the microphone <NUM> at the protection grid <NUM>.

Design features of headphones and physical characteristics of a user's head and ears affects a degree of acoustical coupling of the headphones to the user's ears. For example, if the headphones are circumaural headphones or supra-aural headphones, the placement of the headphones on the user's head, the material used in ear pads of cans of the headphones, the cushioning of the ear pads, the effectiveness of a headband over the top of the user's head to hold the cans in place, the size of the user's head, and the size of the user's ears are all factors that affect variability of the degree of acoustical coupling.

For expository purposes, the term "loose coupling" as used in this specification generally denotes a particular degree of acoustical coupling in which a headphone is not pushed firmly, tightly, or closely towards a user's ear when the headphone is placed over the user's ear, around the user's ear, or inside an ear canal of the user's ear, resulting in a loose coupling between the headphone and a cavity formed from the headphone and the user's ear including the ear canal.

For expository purposes, the term "tight coupling" as used in this specification generally denotes a particular degree of acoustical coupling in which a headphone is pushed firmly, tightly, or closely towards a user's ear when the headphone is placed over the user's ear, around the user's ear, or inside an ear canal of the user's ear, resulting in a tight coupling between the headphone and a cavity formed from the headphone and the user's ear including the ear canal.

<FIG> is an example graph <NUM> illustrating different frequency responses of a circumaural closed-back headphone on a head and torso simulator with an artificial ear coupler (i.e., eardrum simulator). A horizontal axis of the graph <NUM> represents frequency in Hertz (Hz). A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the ear coupler when there is tight coupling between the headphone and a cavity formed from the headphone and the ear coupler including ear canal, and (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the ear coupler when there is loose coupling between the headphone and the cavity.

Each curve <NUM>, <NUM> is a measurement of sound pressure level sensed by the ear coupler, and obtained by reproducing, via a headphone driver of the headphone, an input signal (e.g., a test signal) with the same input voltage. As shown in <FIG>, a frequency response of the headphone with tight coupling (i.e., curve <NUM>) is higher.

<FIG> is an example graph <NUM> illustrating frequency response of the circumaural closed-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when there is loose coupling between the headphone <NUM> and a cavity formed from the headphone <NUM> and the ear coupler including ear canal, and (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the ear coupler when there is loose coupling between the headphone <NUM> and the cavity.

The curves <NUM> and <NUM> are different measurements of sound pressure level at different points inside the cavity, simultaneously sensed using different sensors. Specifically, the first curve <NUM> is a first measurement of sound pressure level at the headphone driver <NUM> (<FIG>), sensed by the near field microphone <NUM>. The second curve <NUM> is a second measurement of sound pressure level at an end of the ear canal, sensed by the ear coupler.

As shown in <FIG>, the curves <NUM> and <NUM> are similar from <NUM> to <NUM>. The curves <NUM> and <NUM> start to separate from each other from about <NUM> onwards. The curves <NUM> and <NUM> have similar tendency between <NUM> and <NUM>. The curves <NUM> and <NUM> have similar response and tendency between <NUM> to <NUM>.

As shown in <FIG>, a peak in the first curve <NUM> at about <NUM> represents an electro-acoustic system resonance. In one embodiment, a main equalization filter EQmain constructed by the system <NUM> (e.g., via the main equalization unit <NUM>) is applied to provide individualized headphone equalization from <NUM> to <NUM> to improve sound quality of output reproduced via the headphone driver <NUM>.

<FIG> is an example graph <NUM> illustrating a pre-determined target frequency response for the circumaural closed-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when there is loose coupling between the headphone <NUM> and a cavity formed from the headphone <NUM> and the ear coupler including ear canal, and (<NUM>) a second curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>.

<FIG> is an example graph <NUM> illustrating equalized frequency response of the circumaural closed-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when there is loose coupling between the headphone <NUM> and a cavity formed from the headphone <NUM> and the ear coupler including ear canal, (<NUM>) a second curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>, and (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> after equalization. The third curve <NUM> is an equalized frequency response resulting from performing EQ correction in accordance with the pre-determined target frequency response (e.g., using a main equalization filter EQmain constructed by the system <NUM>).

<FIG> is an example graph <NUM> illustrating different equalized frequency responses of the circumaural closed-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>, (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the ear coupler after equalization, and (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) after equalization. Both the second curve <NUM> and the third curve <NUM> are equalized frequency responses resulting from performing EQ correction in accordance with the pre-determined target frequency response (e.g., using a main equalization filter EQmain constructed by the system <NUM>).

As shown in <FIG>, after equalization, a frequency response of the headphone <NUM> is corrected towards the pre-determined target response up to around <NUM> (i.e., the second curve <NUM> substantially matches the first curve <NUM> up to around <NUM>), and starts to deviate from the pre-determined target response as frequency increases.

As shown in <FIG>, after equalization, there is a boost of about <NUM> dB to <NUM> dB at around <NUM> and <NUM>, and some peaks in the frequency response of the headphone <NUM> are left higher than a nominal frequency response around <NUM> to <NUM> (see non-equalized peaks in the second curve <NUM>).

As shown in <FIG>, a first peak fr<NUM> in the third curve <NUM> at about <NUM> represents an electro-acoustic system resonance. Each subsequent peak fr<NUM> and fr<NUM> in the third curve <NUM> after <NUM> also represent another electro-acoustic system resonance.

<FIG> is an example graph <NUM> illustrating frequency response of a main equalization filter EQmain constructed by the system <NUM> (<FIG>), in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises a curve <NUM> representing the frequency response of the main equalization filter EQmain. As shown in <FIG>, the frequency response of the main equalization filter EQmain is equal to a constant value from <NUM> to <NUM>.

In one embodiment, the system is configured to: (<NUM>) detect an electro-acoustic system resonance fc based on a frequency response of sound pressure reproduced by a headphone, and (<NUM>) perform additional equalization to compensate for the electro-acoustic system resonance fc (e.g., ear canal resonance equalization) from about <NUM> to about <NUM>, resulting in an equalized frequency response that more closely matches the pre-determined target response.

<FIG> is an example graph <NUM> illustrating frequency response of a circumaural closed-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>, (<NUM>) a second curve <NUM> representing frequency response of sound pressure level at the ear coupler after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, and (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering. Both the second curve <NUM> and the third curve <NUM> are equalized frequency responses resulting from applying a main equalization filter EQmain constructed by the system <NUM>, adding a PEQ filter PEQfr constructed by the system <NUM> to the main equalization filter EQmain , and adding a low pass filter LPfc constructed by the system <NUM> to the main equalization filter EQmain ·.

As shown in <FIG>, after the electro-acoustic system resonance equalization and low pass filtering, the equalized frequency response of the headphone <NUM> is corrected towards the pre-determined target response up to around <NUM> (i.e., the second curve <NUM> more closely matches the first curve <NUM> up to around <NUM>). From <NUM> up to <NUM>, the equalized frequency response of the headphone <NUM> is close to the pre-determined target response.

As shown in <FIG>, the equalized frequency response includes non-equalized peaks p<NUM> and p<NUM> at about <NUM> and <NUM>, respectively. In one embodiment, the system determines not to equalize some high peaks (e.g., p<NUM> and p<NUM>) in a frequency response of a headphone because these peaks require a first order low pass filter with a very high Q.

<FIG> is an example graph <NUM> illustrating frequency response of a main equalization filter EQmain constructed by the system <NUM> (<FIG>), with electro-acoustic system resonance equalization and low pass filtering added, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises: (<NUM>) a first curve <NUM> representing a frequency response of the main equalization filter EQmain without electro-acoustic system resonance equalization and low pass filtering added, and (<NUM>) a second curve <NUM> representing the frequency response of the main equalization filter EQmain with electro-acoustic system resonance equalization and low pass filtering added (i.e., EQfinal, as represented by equation (<NUM>) provided above).

<FIG> is an example graph <NUM> illustrating frequency response of the circumaural closed-back headphone <NUM> (<FIG>) with tight coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when there is tight coupling between the headphone <NUM> and a cavity formed from the headphone <NUM> and the ear coupler including ear canal, and (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the ear coupler when there is tight coupling between the headphone <NUM> and the cavity.

<FIG> is an example graph <NUM> illustrating frequency response of a circumaural closed-back headphone <NUM> (<FIG>) with tight coupling on a head and torso simulator with an artificial ear coupler, after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>, (<NUM>) a second curve <NUM> representing frequency response of sound pressure level at the ear coupler after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, and (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering. Both the second curve <NUM> and the third curve <NUM> are equalized frequency responses resulting from applying a main equalization filter EQmain constructed by the system <NUM>, adding a PEQ filter PEQfr constructed by the system <NUM> to the main equalization filter EQmain , and adding a low pass filter LPfc constructed by the system <NUM> to the main equalization filter EQmain.

<FIG> is an example graph <NUM> illustrating frequency response of the circumaural open-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when there is loose coupling between the headphone <NUM> and a cavity formed from the headphone <NUM> and the ear coupler including ear canal, and (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the ear coupler when there is loose coupling between the headphone <NUM> and the cavity.

As shown in <FIG>, the curves <NUM> and <NUM> are similar from <NUM> to <NUM>.

<FIG> is an example graph <NUM> illustrating frequency response of a circumaural open-back headphone <NUM> (<FIG>) with loose coupling on a head and torso simulator with an artificial ear coupler, after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>, (<NUM>) a second curve <NUM> representing frequency response of sound pressure level at the ear coupler after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, and (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering. Both the second curve <NUM> and the third curve <NUM> are equalized frequency responses resulting from applying a main equalization filter EQmain constructed by the system <NUM>, adding a PEQ filter PEQfr constructed by the system <NUM> to the main equalization filter EQmain , and adding a low pass filter LPfc constructed by the system <NUM> to the main equalization filter EQmain ·.

<FIG> is an example graph <NUM> illustrating frequency response of the circumaural open-back headphone <NUM> (<FIG>) with tight coupling on a head and torso simulator with an artificial ear coupler, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when there is tight coupling between the headphone <NUM> and a cavity formed from the headphone <NUM> and the ear coupler including electro-acoustic system, and (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the ear coupler when there is tight coupling between the headphone <NUM> and the cavity.

<FIG> is an example graph <NUM> illustrating frequency response of a circumaural open-back headphone <NUM> (<FIG>) with tight coupling on a head and torso simulator with an artificial ear coupler, after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a pre-determined target frequency response for the headphone <NUM>, (<NUM>) a second curve <NUM> representing frequency response of sound pressure level at the ear coupler after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering, and (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) after personalized headphone equalization, electro-acoustic system resonance equalization and low pass filtering. Both the second curve <NUM> and the third curve <NUM> are equalized frequency responses resulting from applying a main equalization filter EQmain constructed by the system <NUM>, adding a PEQ filter PEQfr constructed by the system <NUM> to the main equalization filter EQmain , and adding a low pass filter LPfc constructed by the system <NUM> to the main equalization filter EQmain ·.

<FIG> illustrates an example in-ear earbud <NUM> inserted into a human ear <NUM> of a human user/person <NUM>, wherein the system <NUM> is integrated in the in-ear earbud <NUM> or operates on an electronic device connected to the in-ear earbud <NUM>, in accordance with an embodiment. As shown in <FIG>, the in-ear earbud <NUM> is inserted via an external part <NUM> of the human ear <NUM>, such that a portion of the in-ear earbud <NUM> is disposed inside a portion of an ear canal <NUM> of the human ear <NUM>. A cavity <NUM> is formed by the in-ear earbud <NUM> and an ear drum <NUM> that separates the ear canal <NUM> from an internal part <NUM> of the human ear. The in-ear earbud <NUM> comprises: (<NUM>) a headphone driver <NUM> for reproducing audio, and (<NUM>) a near field microphone <NUM> for sensing sound pressure levels inside the cavity <NUM> at discrete frequencies. In one embodiment, the microphone <NUM> is mounted in the near field of a diaphragm of the headphone driver <NUM>.

<FIG> illustrates the example in-ear earbud <NUM> inserted into a head and torso simulator <NUM>, in accordance with an embodiment. As shown in <FIG>, the in-ear earbud <NUM> is inserted via an anthropometric pinna <NUM> of the simulator <NUM>, such that a portion of the in-ear earbud <NUM> is disposed inside a portion of an anthropometric ear canal <NUM> of the simulator <NUM>. A cavity <NUM> is formed by the in-ear earbud <NUM> and an ear drum simulator <NUM> of the simulator <NUM>, wherein the ear drum simulator <NUM> is disposed at an end of the ear canal <NUM>.

In one embodiment, the head and torso simulator <NUM> represents an average human user/person. Let EDest generally denote an eardrum estimation filter representing an estimation of acoustic frequency response at an ear drum of a human ear. In one embodiment, the system <NUM> is configured to compute the eardrum estimation filter EDest in accordance with equation (<NUM>) provided below:
<MAT> wherein EDsim is a frequency response at the eardrum simulator <NUM> in dB, and NF is a frequency response at the near field microphone <NUM> in dB.

<FIG> is an example graph <NUM> illustrating frequency response of the in-ear earbud <NUM> (<FIG>) when inserted into the head and torso simulator <NUM>, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing a frequency response of sound pressure level at the eardrum simulator <NUM> (i.e., EDsim), (<NUM>) a second curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>), and (<FIG>) a third curve <NUM> representing a frequency response of an eardrum estimation filter (i.e., EDest ) (with <NUM> dB added for visualization purposes).

In one embodiment, based on the eardrum estimation filter EDest computed, the system <NUM> is configured to construct an equalization filter to a pre-determined target frequency response for the in-ear earbud <NUM>. For example, in one embodiment, the system <NUM> adds the eardrum estimation filter EDest to a measured frequency response of sound pressure level at the near field microphone <NUM>.

<FIG> is an example graph <NUM> illustrating a pre-determined target frequency response for the in-ear earbud <NUM> (<FIG>) when inserted into the human ear, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing the estimated frequency response at the eardrum when the in-ear earbud <NUM> is inserted into a left human ear, (<NUM>) a second curve <NUM> representing the estimated frequency response at the eardrum when the in-ear earbud <NUM> is inserted into a right human ear, (<NUM>) a third curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when the in-ear earbud <NUM> is inserted into the left human ear, (<NUM>) a fourth curve <NUM> representing a frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when the in-ear earbud <NUM> is inserted into the right human ear, and (<NUM>) a fifth curve <NUM> representing a pre-determined target frequency response for the in-ear earbud <NUM>.

<FIG> is an example graph <NUM> illustrating equalized frequency response of the in-ear earbud <NUM> (<FIG>) when inserted into the human ear, in accordance with an embodiment. A horizontal axis of the graph <NUM> represents frequency in Hz. A vertical axis of the graph <NUM> represents sound pressure level in dB. The graph <NUM> comprises each of the following: (<NUM>) a first curve <NUM> representing the estimated equalized frequency response at the eardrum when the in-ear earbud <NUM> is inserted into a left human ear, (<NUM>) a second curve <NUM> representing the estimated equalized frequency response at the eardrum when the in-ear earbud <NUM> is inserted into a right human ear, (<NUM>) a third curve <NUM> representing an equalized frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when the in-ear earbud <NUM> is inserted into the left human ear, (<NUM>) a fourth curve <NUM> representing an equalized frequency response of sound pressure level at the near field microphone <NUM> (<FIG>) when the in-ear earbud <NUM> is inserted into the right human ear, and (<NUM>) a fifth curve <NUM> representing a pre-determined target frequency response for the in-ear earbud <NUM>. The curves <NUM>-<NUM> are equalized frequency responses resulting from performing EQ correction in accordance with the pre-determined target frequency response (e.g., using an equalization filter constructed by the system <NUM>).

<FIG> is an example flowchart of a process <NUM> for personalized headphone equalization, in accordance with an embodiment. Process block <NUM> includes obtaining a measurement of sound pressure level at a microphone mounted in a near field of a headphone driver of a headphone and inside a cavity formed by the headphone and a user's ear. Process block <NUM> includes providing personalized EQ of output reproduced via a headphone driver by performing EQ correction of the output based on the measurement of sound pressure level and a pre-determined target frequency response for the headphone, resulting in an equalized output that is adapted to individual characteristics of the user's ear.

In one embodiment, one or more components of the personalized headphone equalization system <NUM> are configured to perform process blocks <NUM>-<NUM>.

<FIG> is a high-level block diagram showing an information processing system comprising a computer system <NUM> useful for implementing various disclosed embodiments. The computer system <NUM> includes one or more processors <NUM>, and can further include an electronic display device <NUM> (for displaying video, graphics, text, and other data), a main memory <NUM> (e.g., random access memory (RAM)), storage device <NUM> (e.g., hard disk drive), removable storage device <NUM> (e.g., removable storage drive, removable memory module, a magnetic tape drive, optical disk drive, computer readable medium having stored therein computer software and/or data), user interface device <NUM> (e.g., keyboard, touch screen, keypad, pointing device), and a communication interface <NUM> (e.g., modem, a network interface (such as an Ethernet card), a communications port, or a PCMCIA slot and card).

The communication interface <NUM> allows software and data to be transferred between the computer system <NUM> and external devices. The nonlinear controller <NUM> further includes a communications infrastructure <NUM> (e.g., a communications bus, cross-over bar, or network) to which the aforementioned devices/modules <NUM> through <NUM> are connected.

Information transferred via the communications interface <NUM> may be in the form of signals such as electronic, electromagnetic, optical, or other signals capable of being received by communications interface <NUM>, via a communication link that carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, a radio frequency (RF) link, and/or other communication channels. Computer program instructions representing the block diagrams and/or flowcharts herein may be loaded onto a computer, programmable data processing apparatus, or processing devices to cause a series of operations performed thereon to produce a computer implemented process. In one embodiment, processing instructions for process <NUM> (<FIG>) may be stored as program instructions on the memory <NUM>, storage device <NUM>, and/or the removable storage device <NUM> for execution by the processor <NUM>.

Embodiments have been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products. In some cases, each block of such illustrations/diagrams, or combinations thereof, can be implemented by computer program instructions. The computer program instructions when provided to a processor produce a machine, such that the instructions, which executed via the processor create means for implementing the functions/operations specified in the flowchart and/or block diagram. Each block in the flowchart /block diagrams may represent a hardware and/or software module or logic. In alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures, concurrently, etc..

The terms "computer program medium," "computer usable medium," "computer readable medium," and "computer program product," are used to generally refer to media such as main memory, secondary memory, removable storage drive, a hard disk installed in hard disk drive, and signals. These computer program products are means for providing software to the computer system. The computer readable medium allows the computer system to read data, instructions, messages or message packets, and other computer readable information from the computer readable medium. The computer readable medium, for example, may include non-volatile memory, such as a floppy disk, ROM, flash memory, disk drive memory, a CD-ROM, and other permanent storage. It is useful, for example, for transporting information, such as data and computer instructions, between computer systems. Computer program instructions may be stored in a computer readable medium that can direct a computer, other programmable data processing apparatuses, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block(s).

As will be appreciated by one skilled in the art, aspects of the embodiments may be embodied as a system, method or computer program product. Accordingly, aspects of the embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit," "module," or "system. " Furthermore, aspects of the embodiments may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.

The computer readable medium may be a computer readable storage medium (e.g., a computer readable storage medium).

Computer program code for carrying out operations for aspects of one or more embodiments may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.

In some cases, aspects of one or more embodiments are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatuses (systems), and computer program products. In some instances, it will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block(s).

These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block(s).

The computer program instructions may also be loaded onto a computer, other programmable data processing apparatuses, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatuses, or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatuses provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block(s).

References in the claims to an element in the singular is not intended to mean "one and only" unless explicitly so stated, but rather "one or more. " All structural and functional equivalents to the elements of the above-described exemplary embodiment that are currently known or later come to be known to those of ordinary skill in the art are intended to be encompassed by the present claims. No claim element herein is to be construed under the provisions of pre-AIA <NUM> U. section <NUM>, sixth paragraph, unless the element is expressly recited using the phrase "means for" or "step for.

Claim 1:
A headphone device (<NUM>) providing personalized headphone equalization (<NUM>), comprising:
a headphone driver (<NUM>);
a microphone (<NUM>) mounted in a near field of the headphone driver (<NUM>) and inside a cavity formed by the headphone device (<NUM>) and a user's ear; and
a processor (<NUM>) configured to:
obtain a measurement of sound pressure level at the microphone (<NUM>);
detect an electro-acoustic system resonance based on the measurement of sound pressure level;
construct a main equalization filter (<NUM>) based on a pre-determined target frequency response and the electro-acoustic system resonance detected, wherein the electro-acoustic system resonance includes at least one of an ear canal resonance or a headphone driver resonance;
determine a gain and a quality factor, Q, for a resonance frequency at which the electro-acoustic system resonance is detected;
construct a parametric equalization, PEQ, filter (<NUM>) centered on the resonance frequency at which the electro-acoustic system resonance is detected with the gain and the Q determined;
add the PEQ filter (<NUM>) to the main equalization filter (<NUM>) to compensate for the electro-acoustic system resonance detected;
; and
provide the personalized equalization (EQ) of acoustic output reproduced via the headphone driver by applying the main equalization filter to a frequency from <NUM> to the resonance frequency and applying the PEQ filter to the resonance frequency based on the measurement of sound pressure level and the pre-determined target frequency response for the headphone device (<NUM>).