Patent ID: 12223940

DETAILED DESCRIPTION

In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant disclosure. However, it should be apparent to those skilled in the art that the present disclosure may be practiced without such details. In other instances, well-known methods, procedures, systems, components, and/or circuitry have been described at a relatively high-level, without detail, in order to avoid obscuring aspects of the present disclosure unnecessarily. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments shown, but to be accorded the widest scope consistent with the claims.

It will be understood that the term “system,” “engine,” “unit,” “module,” and/or “block” used herein are one method to distinguish different components, elements, parts, sections or assembly of different levels in ascending order. However, the terms may be displaced by other expressions if they may achieve the same purpose.

It will be understood that when a unit, engine, module, or block is referred to as being “on,” “connected to,” or “coupled to” another unit, engine, module, or block, it may be directly on, connected or coupled to, or communicate with the other unit, engine, module, or block, or an intervening unit, engine, module, or block may be present, unless the context clearly indicates otherwise. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprise,” “comprises,” and/or “comprising,” “include,” “includes,” and/or “including,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

Spatial and functional relationships between elements (for example, between layers) are described using various terms, including “connected,” “engaged,” “interfaced,” and “coupled.” Unless explicitly described as being “direct,” when a relationship between first and second elements is described in the present disclosure, that relationship includes a direct relationship where no other intervening elements are present between the first and second elements, and also an indirect relationship where one or more intervening elements are present (either spatially or functionally) between the first and second elements. In contrast, when an element is referred to as being “directly” connected, engaged, interfaced, or coupled to another element, there are no intervening elements present. In addition, a spatial and functional relationship between elements may be achieved in various ways. For example, a mechanical connection between two elements may include a welded connection, a key connection, a pin connection, an interference fit connection, or the like, or any combination thereof. Other words used to describe the relationship between elements should be interpreted in a like fashion (e.g., “between,” versus “directly between,” “adjacent,” versus “directly adjacent,” etc.).

An aspect of the present disclosure relates to a noise control system. The noise control system may include a data processing device, a detector, and a bone conduction speaker. The detector may be configured to generate a noise signal. The noise signal may be a representation of a primary noise (e.g., an ambient sound) or a residual noise (e.g., a noise received by a cochlea of a user). The data processing device may be configured to determine a noise correction signal based on the noise signal. The bone conduction speaker may be configured to generate an anti-noise sound based on the noise correction signal to reduce or cancel the noise.

According to some embodiments of the present disclosure, the system may reduce the noise using a noise correction signal determined in a feedforward noise control path, a feedback noise control path, or a hybrid noise control path. The noise correction signal may be determined by performing phase modulation and/or amplitude modulation on the noise signal. In some embodiments, the phase modulation and/or the amplitude modulation may be performed by taking one or more factors including, such as a transmitting property of sound via different transmission paths and/or through different transmission mediums, individual differences, or the like, or any combination thereof, into consideration. This may enhance the effect of noise reduction and provide a good user experience.

In addition, in some embodiments, the noise control system disclosed herein may be utilized in an open design headphone. The anti-noise sound outputted by the bone conduction speaker may be transmitted and perceived by a user via a bone conduction pathway. In the bone conduction pathway, sound (e.g., the anti-noise sound) may be converted into mechanical vibrations in different frequencies and transmitted through a skull, an osseous labyrinth, a lymphoid fluid of an inner ear, an organum spiral, an auditory nerve, an auditory center of the user, or any combination thereof. Active noise reduction may be achieved in cases that the ears of the user are open or partially open by using the bone conduction technique. Compared with traditional air conduction headphones which use a closed design for noise reduction, the open design headphone may be more comfortable for ears and enhance the user experience.

The following description is provided to help better understanding of noise reduction methods and/or systems. The term “noise” used in this disclosure may refer to an unwanted sound judged to be unpleasant, loud or disruptive to hearing. The noise may be a broadband noise (e.g., an impulse noise of a gunshot) or a narrowband noise (e.g., a noise caused by a car's combustion engine). The term “noise signal” used in this disclosure may refer to a signal generated by an electrical device (e.g., a detector) that may represent a noise. This is not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, a certain amount of variations, changes, and/or modifications may be deducted under the guidance of the present disclosure. Those variations, changes, and/or modifications do not depart from the scope of the present disclosure.

FIG.1is a schematic diagram illustrating an exemplary noise control system100according to some embodiments of the present disclosure. The noise control system100may be configured to reduce or cancel a noise. The noise control system100may be applied various areas and/or devices, such as a wearable device (e.g., a noise-canceling headphone, a bone conduction headphone), a medical device (e.g., a breathing assistance device, a Continuous Positive Airway Pressure (CPAP) device), a muffler, an anti-snoring device, or the like, or any combination thereof. In some embodiments, the noise control system100may be an open ear noise control system that is used in an open design headphone. As used herein, an open design headphone refers to a headphone designed to allow some outside noise (e.g., an ambient sound) to mix with the headphone's output (e.g., music).

In some embodiments, the noise control system100may be an active noise control system to reduce or cancel a noise (e.g., an unwanted sound). The active noise control system may include an electroacoustic or electromechanical sub-system that neutralizes the noise on the basis of a superposition principle. For example, the reduction or cancelation of the noise may be carried out by generating an anti-noise sound having the same amplitude as and a reverse phase to the noise by the noise control system100and combining it with the noise. The anti-noise sound may be determined based on a noise correction signal for reducing the noise and a noise signal representing the noise.

The noise control system100may be a feedforward noise control system, a feedback noise control system, or a hybrid noise control system. One or more components of the feedforward noise control system may constitute a feedforward noise control path. Signals (e.g., a feedforward noise signal, a feedforward noise correction signal) may be transmitted through the feedforward noise control path. One or more components of the feedback noise control system may constitute a feedback noise control path. Signals (e.g., a feedback noise signal, a feedback noise correction signal) may be transmitted through the feedback noise control path.

In an exemplary feedforward noise control system, a feedforward detector (e.g., a microphone) may be placed outside a headset to determine a feedforward noise signal in the feedforward noise control path. The feedforward noise signal may be a primary noise signal. The primary noise signal may be a representation of a primary noise, such as ambient noise. The feedforward noise control system may be configured to determine a primary noise correction signal (or referred to as a feedforward noise correction signal) based on the feedforward noise signal.

In an exemplary feedback noise control system, a feedback detector (e.g., an error microphone) may be located inside of a headset or earbud. The feedback detector may generate a feedback noise signal by detecting a feedback noise in a user's ear (e.g., a noise received by an inner ear of the user). The feedback noise control system may be configured to determine a feedback noise correction signal based on the feedback noise signal. For example, the feedback noise signal may be a residual noise signal representing a residual noise. The feedback noise correction signal may be also referred to as a residual noise correction signal.

An exemplary hybrid noise control system may employ a feedforward detector and a feedback detector. The hybrid noise control system may be configured to determine a noise correction signal based on both a feedforward noise signal generated by the feedforward detector and a feedback noise signal generated by the feedback detector. The hybrid noise control system may include both the feedforward noise control path and the feedback noise control path as aforementioned. A major part of noise (e.g., an ambient noise) may be reduced or canceled by the feedforward noise control path. The feedback noise control path may be used to monitor a residual noise and reduce or cancel the residual noise.

As used herein, the term “noise control” may include any type and/or extent of control, adjustment, or regulation of any noise parameter (e.g., tone, pitch, loudness (or amplitude or intensity), quality, and/or phase), such as full or partial noise reduction, cancellation, leveling, or smoothing, for example.

As shown inFIG.1, the noise control system100may include a data processing device110, a detector120, a speaker130, a storage device140, a communication device150, an I/O device160, and a power supply device170. In some embodiments, two or more components of the noise control system100may be connected to and/or communicate with each other. For example, the I/O device160and the storage device140may be electrically connected to the communication device150. As another example, the speaker130may communicate to the data processing device110through the communication device150or a network180. As used herein, a connection between two components may include a wireless connection, a wired connection, any other communication connection that can enable data transmission and/or reception, and/or any combination of these connections. The wireless connection may include, for example, a Bluetooth™ link, a Wi-Fi™ link, a WiMax™ link, a WLAN link, a ZigBee link, a mobile network link (e.g., 3G, 4G, 5G, etc.), or the like, or a combination thereof. The wired connection may include, for example, a coaxial cable, a communication cable (e.g., a telecommunication cable), a flexible cable, a spiral cable, a non-metallic sheath cable, a metal sheath cable, a multi-core cable, a twisted-pair cable, a ribbon cable, a shielded cable, a double-strand cable, an optical fiber, an electrical cable, an optical cable, a telephone wire, or the like, or any combination thereof.

The data processing device110may be configured to process data. The data may include a sound signal (e.g., a noise signal and a speech signal), information relating to a human characteristic (e.g., a bone density), information relating to the environmental (e.g., a temperature), or the like, or any combination thereof. The data may be obtained by the detector120or retrieved from another source (e.g., the storage device140). For example, the data may include one or more noise signals obtained by the detector120. Based on the data, the data processing device110may be configured to determine a user characteristic, recognize a noise, recognize a speech, perform a noise reduction operation, generate a control signal, perform an analog-to-digital conversion, perform a digital-to-analog conversion, convert a signal between the time domain and the frequency domain, divide a signal into a plurality of sub-band signals with different frequency bands, or the like, or any combination thereof.

In some embodiments, the data processing device110may be configured to determine a noise correction signal based on a noise signal. The noise signal may be a representation of noise. The noise may be a primary noise, a residual noise, or the like, or any combination thereof. A noise source of the noise may be related to or not related to the noise control system100. The noise correction signal may be used to determine an anti-noise sound to reduce or cancel the noise. For example, the anti-noise sound may have the same amplitude as but an inverted phase (as known as antiphase) to the noise as shown inFIG.4. The noise correction signal may be a digital signal or an analog signal. The noise correction signal may be a time domain signal or a frequency domain signal. The noise correction signal may be a broadband signal or a narrowband signal. In some embodiments, the noise correction signal may include a plurality of sub-band noise correction signals. The data processing device110may output the noise correction signal in any form, for example, a pulse width modulation (PWM), a digital signal, an analog signal. In some embodiments, the noise correction signal may include a plurality of signals, the data processing device110may output a combined signal of the signals, or output the signals respectively or in parallel.

In some embodiments, the data processing device110may include a signal processor (e.g., a feedforward signal processor521, a feedback signal processor522as shown inFIGS.5-7), a filter, a sensor, a memory, or the like, or any combination thereof. For example, the data processing device110may include one or more components as shown inFIGS.8-13. In some embodiments, the data processing device110may be a digital signal processor (DSP). For example, the data processing device110may be implemented on a chip (SOC), a Bluetooth chip, a DSP chip, or codec with DSP integrated circuits (ICs).

The detector120may be configured to generate a noise signal. The noise signal may be a representation of noise. The noise signal may be a digital signal or an analog signal. The noise signal may be a time domain signal or a frequency domain signal. The noise signal may be a broadband signal or a narrowband signal. The noise signal may be a full-band noise signal or a sub-band noise signal. In some embodiments, the noise signal may include a plurality of sub-band noise signals. In some embodiments, the noise signal may be a feedforward noise signal corresponding to a feedforward noise control path or a feedback noise signal corresponding to a feedback noise control path.

The noise signal may be detected based on a physical, chemical, and/or biological effect. For example, the noise may be converted into a measurable physical quantity (e.g., an electrical voltage, an electrical current, an electrical charge, an electrical impedance, a magnetic field strength), and the measurable physical quantity may be converted into a noise signal in the form of an electrical signal. For another example, the noise may be converted into a measurable chemical or biological quantity, and the chemical or biological quantity may be converted into a noise signal in the form of an electrical signal.

The detector120may generate the noise signal by detecting the noise directly or indirectly. For example, the detector120may generate the noise signal base on mechanical vibration of the noise. As another example, the detector120may generate the noise signal through an intermediate quantity (e.g., a brain wave) corresponding to the noise.

In some embodiments, the noise signal generated by the detector120may include a primary noise signal. The primary noise signal may be a representation of a primary noise (e.g., an ambient noise). The primary noise signal may be processed in the feedforward noise control path as a feedforward noise signal. Additionally or alternatively, the noise signal may include a residual noise signal. The residual noise signal may be a representation of residual noise. The residual noise signal may be processed in the feedback noise control path as a feedback noise signal.

In some embodiments, the detector120may be configured to evaluate a noise reduction effect. The evaluation of the noise reduction effect may be performed based on one or more parameters, for example, an intensity of residual noise, a difference between a reference value and a transmission time of a sound through a bone conduction pathway of a user. In some embodiments, the detector120may be a detector array including a plurality of detectors, which may be arranged in, for example, a linear design, a planar design, a cylindrical design, or a spherical design.

The detector120may include an acoustic electric transducer, a photoelectric transducer, an electrochemical sensor, a nerve monitoring device, a brain wave monitoring device, or the like, or any combination thereof. For example, the detector120may include an accelerometer to detect vibrations associated with noise. As another example, the detector120may include an acoustic electric transducer, for example, a microphone, an error microphone. Exemplary microphones may include a ribbon microphone, a Micro-Electro-Mechanical System (MEMS) microphone, a dynamic microphone, a piezoelectric microphone, a condenser microphone, a carbon microphone, an analogue microphone, a digital microphone, or the like, or any combination thereof. The microphone may include an omnidirectional microphone, a unidirectional microphone, a bidirectional microphone, a cardioid microphone, or the like, or any combination thereof. In some embodiments, the microphone may be sensitive to a sound having a particular frequency (such as 20 Hz-20,000 Hz, 1000 Hz-3000 Hz, 300 Hz-3000 Hz, 20 Hz-200 Hz, etc.).

In some embodiments, the detector120may include a plurality of acoustic electric transducers. The frequency response characteristics of the acoustic electric transducers may be the same or different. For example, the detector120may include a plurality of acoustic electric transducers with different frequency response characteristics so as to detect a plurality of sub-band noise signals. Optionally, the acoustic electric transducers may be arranged in any configuration. For example, the detector120may include two omnidirectional microphones that are used in a headset. The two omnidirectional microphones may be placed at different positions with respect to the mouth of a user of the headset.

In some embodiments, the detector120may include a biological monitoring device (e.g., a neurotransmitter sensor, a neuro monitoring device, an electroencephalograph monitoring device). The biological monitoring device may be configured to determine a noise signal representing a noise perceived by a user by monitoring one or more biological characteristics of the user. For example, the noise perceived by the user may be a residual noise. The biological characteristic(s) of the user may include the brainwave, the body temperature, activities of neurons, or the like of the user, or any combination thereof. In some embodiments, the biological monitoring device may be configured to determine a time difference between a reference value and a transmission time of a sound through a bone conduction pathway of a user. The reference value may be a preset value. In some embodiments, the detector120may be an audio sensor510or a feedback signal detector530as shown inFIGS.5-7.

The speaker130may be configured to generate a sound based on a sound signal. The speaker130may include one or more bone conduction speakers, air conduction speakers, or the like, or a combination thereof. In some embodiments, the speaker130may include a bone conduction speaker. For example, the bone conduction speaker may include a vibration board and a transducer. The transducer may be configured to generate vibrations by, for example, converting an electrical signal to mechanical vibrations. The transducer may drive the vibration board to vibrate. Merely by way of example, the vibration board may be mechanically connected to the transducer and vibrate with the transducer. The vibration board may touch the skin of the user and pass vibrations to auditory nerves through human tissues and bones, which in turn, may enable the user to hear a sound. In some embodiments, the bone conduction speaker may generate an anti-noise sound based on a noise correction signal. The noise correction signal may be determined by the data processing device110or retrieved from another source (e.g., the storage device140). The anti-noise sound may be configured to reduce or cancel a noise based on a destructive interference between the anti-noise sound and the noise. In some embodiments, the noise control system100may include a plurality of speakers130, which may be arranged in, for example, a linear design array, a planar array, a cylindrical array, or a spherical array.

The storage device140may store data and/or instructions. In some embodiments, the storage device140may store data obtained from the detector120and/or the data processing device110. In some embodiments, the storage device140may store data and/or instructions that the noise control system100may execute or use to perform exemplary methods described in the present disclosure. In some embodiments, the storage device140may include a mass storage device, a removable storage device, a volatile read-and-write memory, a read-only memory (ROM), or the like, or any combination thereof. Exemplary mass storage devices may include a magnetic disk, an optical disk, a solid-state drive, etc. Exemplary removable storage devices may include a flash drive, a floppy disk, an optical disk, a memory card, a zip disk, a magnetic tape, etc. Exemplary volatile read-and-write memory may include a random access memory (RAM). Exemplary RAM may include a dynamic RAM (DRAM), a double date rate synchronous dynamic RAM (DDR SDRAM), a static RAM (SRAM), a thyristor RAM (T-RAM), and a zero-capacitor RAM (Z-RAM), etc. Exemplary ROM may include a mask ROM (MROM), a programmable ROM (PROM), an erasable programmable ROM (PEROM), an electrically erasable programmable ROM (EEPROM), a compact disk ROM (CD-ROM), and a digital versatile disk ROM, etc. In some embodiments, the storage device140may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof.

In some embodiments, the storage device140may be connected to the network180to communicate with one or more components in the noise control system100(e.g., the data processing device110, the detector120, the speaker130, etc.). One or more components in the noise control system100may access the data or instructions stored in the storage device140via the network180. In some embodiments, the storage device140may be directly connected to or communicate with one or more components in the noise control system100(e.g., the data processing device110, the detector120, the speaker130, etc.). In some embodiments, the storage device140may be part of the data processing device110.

The communication device150may be configured to communicate with one or more components of the noise control system100or other devices (e.g., a smartphone). The communication device150may use one or more communication protocols, for example, Bluetooth, ZigBee, Wi-Fi, cellular network, NB-IoT(Narrow Band Internet of Things)/5G, 2G/3G/4G, GPRS, Z-Wave, or the like, or any combination thereof. For example, the communication device150may communicate with an APP embedded in a device to receive control signals.

The I/O device160may input and/or output signals, data, information, etc. In some embodiments, the I/O device160may enable user interaction with the noise control system100. For example, the I/O device160may be configured to receive a control signal to control one or more components of the noise control system100. In some embodiments, the I/O device160may include an input device and an output device. The input device may include alphanumeric and other keys that may be input via a keyboard, a touch screen (for example, with haptics or tactile feedback), a speech input, an eye-tracking input, a brain monitoring system, or any other comparable input mechanism. The input information received through the input device may be transmitted to another component (e.g., the processing device140) via, for example, a bus, for further processing. Other types of input devices may include a cursor control device, such as a mouse, a trackball, or cursor direction keys, etc. The output device may include a display (e.g., a liquid crystal display (LCD), a light-emitting diode (LED)-based display, a flat panel display, a curved screen, a television device, a cathode ray tube (CRT), a touch screen), a speaker, a printer, or the like, or a combination thereof.

The power supply device170may be configured to supply power to one or more components of the noise control system100. For example, the power supply device170may be a battery, such as a rechargeable battery, a detachable battery, a lithium battery, or the like. In some embodiments, the noise control system100may operate in one or more modes. The noise control system100may be sensitive to reduce or cancel a noise having a particular frequency in each of the one or more modes.

It should be noted that the above descriptions of the noise control system100are intended to be illustrative, and not to limit the scope of the present disclosure. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and/or alternative exemplary embodiments. For example, the noise control system100may include one or more additional components. Additionally or alternatively, one or more components of the noise control system100described above may be omitted. For example, the storage device140and/or the I/O device160may be omitted. As another example, two or more components of the noise control system100may be integrated into a single component. Merely by way of example, the storage device140and/or the I/O device160may be integrated into the data processing device110. Additionally or alternatively, the communication device150may be integrated into the I/O device160.

FIG.2Ais a schematic diagram illustrating exemplary anatomy of an ear200A of a user. The ear200A may include a pinna201, an ear canal202, an eardrum203, an ossicular chain204, a eustachian tube205, a semicircular canal206, a cochlea207, and an auditory nerve208. An out ear may include the pinna201and the ear canal202. A middle ear may include the eardrum203, the ossicular chain204, and the eustachian tube205. An inner ear may include semicircular canal206and the cochlea207. Human beings may hear sound through their bones (i.e., bone conduction) and/or their eardrums (i.e., air conduction).

As shown inFIG.2, an air conduction (AC) pathway211may include the ear canal202, the eardrum203, and the cochlea207. In the air conduction pathway211, the eardrum203may convert sound waves of a noise210into vibrations and transmit the vibrations to the cochlea207. The cochlea207may be connected to the auditory nerve208, which may transmit signals corresponding to the noise210to the brain of the user.

A bone conduction (BC) pathway221may be formed by one or more bones of the user, the cochlea207, and a bone conduction device (e.g., a bone conduction speaker220). In the bone conduction pathway221, the bone conduction device may have the same or similar functions as the eardrum203of the air conduction pathway211as aforementioned. The bone conduction device may generate sound waves and convert the sound waves into vibrations, which may be transmitted to and received by the cochlea207through bones (or skull) and the skin of the user. The cochlea207may be connected to the auditory nerve208, which may transmit signals corresponding to the sound to the brain of the user. It should be noted that the above descriptions of the bone conduction pathway221are intended to be illustrative, and not to limit the scope of the present disclosure. For example, the bone conduction pathway221may include jaw bones and/or cheekbones of the user.

FIG.2Bis a schematic diagram illustrating an exemplary air conduction pathway211and an exemplary bone conduction pathway221according to some embodiments of the present disclosure. A sound may be transmitted to a cochlea207of a user through the air conduction pathway211or the bone conduction pathway221. The sound transmission loss (STL) of the sound may be affected by, for example, a property (e.g., the frequency) and a sound transmission pathway (e.g., a transmission medium) of the sound. In an active noise control system, the sound transmission loss of different sound transmission pathways may need to be taken into consideration.

In the air conduction pathway211, noise210(or referred to as an air conduction noise) may be transmitted through an ear canal202to the cochlea207of the user. The sound intensity of the noise210may be denoted as EAC. The noise210may be transmitted to, absorbed or reflected by a barrier (e.g., the ear canal202and the eardrum203as shown inFIG.2A) in the air conduction pathway211. The noise210may be transmitted along the air conduction pathway211and received by the cochlea207of the user. For illustration purposes, the noise210received by the user may be denoted as a noise A. The sound intensity of the noise A received by the user may be denoted as UAC. A transfer function HACof the air conduction pathway211may be determined according to Equation (1) as below:

HAC=UACEAC.(1)

In the bone conduction pathway221, an anti-noise sound (or referred to as a bone conduction sound) for reducing or suppressing the noise210may be transmitted through one or more bones224(e.g., a temporal bone) to the cochlea207of the user. The anti-noise sound may be generated by a bone conduction speaker223. The anti-noise sound may be transmitted to, absorbed or reflected by a barrier (e.g., a temporal bone and muscle of the user) in the bone conduction pathway221. For example, the anti-noise sound may be transmitted along the bone conduction pathway221and received by the cochlea207of the user. For illustration purposes, the anti-noise sound received by the user may be denoted as an anti-noise sound B. The sound intensity of the original anti-noise sound may be denoted as EBC. The sound intensity of the anti-noise sound B received by the user may be denoted as UBC. A transfer function HBCof the bone conduction pathway221may be determined according to Equation (2) as below:

HBC=UBCEBC.(2)

In some embodiments, in order to achieve a desired destructive interference between the noise A and the anti-noise sound B, the sound intensity of the noise A (i.e., UAC) and the sound intensity of the anti-noise sound B (i.e., UBC) may need to be equal to each other. Ideally, if the transfer function HACof the air conduction pathway211is equal to the transfer function HBCof the bone conduction pathway221, and the sound intensity EACof the noise210is equal to the sound intensity EBCof the original anti-noise sound, the sound intensity UACof the noise A may be equal to the sound intensity UBCof the anti-noise sound B. However, a difference between the transfer functions of the air conduction pathway211and the bone conduction pathway221may exist and lead to a difference between UACand UBCeven if EACis equal to EBC. In such cases, the amplitude of the anti-noise sound may need to be modulated such that the sound intensity UBCof the anti-noise sound B may be equal to the sound intensity UACof the noise A.

A relationship between the transfer functions of the air conduction pathway211and the bone conduction pathway221may be determined according to Equation (3) as below:

At=HACHBC,(3)
where Atrefers to an amplitude adjustment coefficient in determining the anti-noise sound in a feedforward noise control path.

In some embodiments, in order to achieve a desired destructive interference between the noise A and the anti-noise sound B at the cochlea207, a modulation operation may be performed by the data processing device110in generating a noise correction signal according to Equation (4) as below:
AtS′n(n)HBC+Sn(n)HAC=0,  (4)
where Sn(n) refers to a noise signal representing the noise210to be reduced, Atrefers to the amplitude adjustment coefficient, AtS′n(n) refers to a noise correction signal, and S′n(n) refers to a signal having the same amplitude as but an inverted phase to the noise signal Sn(n). The noise correction signal may be used as an input signal of the bone conduction speaker223to generate the anti-noise sound for reducing the noise210.

In some embodiments, the noise signal representing the noise210may include N sub-band noise signals having different frequency bands. The noise correction signal AtSn′(n) may include a plurality of sub-band noise correction signals. For example, the noise correction signal may be represented as Σi=1NAiSi′(n), wherein Airefers to an amplitude adjustment coefficient for an ithsub-band noise signal, N refers to a count (or number) of the sub-band noise signals, and Si′(n) refers to a signal having the same amplitude as but inverted phase to the sub-band noise signal Si(n).

In some embodiments, a time difference may exist between a time when the noise A is transmitted to the cochlea207along the air conduction pathway211and a time when the anti-noise sound B is transmitted to the cochlea207along the bone conduction pathway221. The time difference may lead to a phase difference between the noise signal Sn(n) and its phase reversed signal S′n(n). The phase difference may need to be compensated to reduce or eliminate an effect of the phase difference on the stability of a filter and an ambient noise (e.g., a high frequency ambient noise) caused by the phase difference. For example, the phase compensation may need to be performed in generating a noise correction signal of the noise210. A phase shift in the frequency domain may be mapped to a delay in the time domain. The phase compensation may be performed based on a time difference ΔT between a first time needed for an air conduction sound to transmit to the cochlea207along the air conduction pathway211and a second time for a bone conduction sound to transmit to the cochlea207along the bone conduction pathway221. For example, a noise correction signal with phase compensation may be represented as AtS′n(n−ΔT). As another example, the noise correction signal with phase compensation may include a plurality of sub-band noise correction signals. For example, the noise correction signal with phase compensation may be represented as Σi=1NAiS′i(n−ΔT).

In some embodiments, in order to achieve a desired destructive interference between the noise A and the anti-noise sound B at the cochlea207, a modulation operation may be performed by the data processing device110in generating a noise correction signal according to Equation (5) as below:
AtS′n(n−ΔT)HBC+Sn(n)HAC=0.  (5)

For different users, the density or size of the skulls, the length of ear canals, and/or the internal sound transmission efficiency of the ears may be different. The sound transmission speeds of a certain conduction pathway (e.g., a bone conduction pathway and/or an air conduction pathway) may be different for different users. Although the acoustic velocity in a solid material is fast, the transmission times of the same sound in the conduction pathways of different users may still be different. The difference in the transmission times may correspond to a phase shift, which may have an influence on the noise reduction effect, especially for some high frequency narrow-band noise. A time difference kemay be introduced to determine a noise correction signal. The time difference kemay be a time difference between a reference value and a transmission time of a sound through a bone conduction pathway of a user. The reference value may be a preset value. The preset value may be determined through a statistical method or set manually. The time difference kemay be detected by a feedback detector. A noise correction signal with the time difference may be AtSn(n−ΔT−ke).

In some embodiments, the noise correction signal may include a plurality of sub-band noise correction signals. For example, the noise correction signal with phase compensation may be represented as Σi=1NAiS′i(n−ΔT−ke).

In some embodiments, in order to achieve a desired destructive interference between the noise A and the anti-noise sound B at the cochlea207, a modulation operation may be performed by the data processing device110in generating a noise correction signal according to Equation (6) as below:
AtS′i(n−ΔT−ke)HBC+Sn(n)HAC=0.  (6)

FIG.3Ais a flowchart illustrating an exemplary process300A for active noise control according to some embodiments of the present disclosure. Process300A may be performed by one or more components of the noise control system100, for example, the detector120, the data processing device110, and the speaker130.

In311, a noise signal may be generated in response to a detected noise to be reduced. The noise signal may be a representation of the noise. In some embodiments, the detection of the noise may be performed by the detector120. The noise signal may be a digital signal or an analog signal. The noise signal may be a broadband signal or a narrowband signal. The noise signal may be a full-band noise signal that has the same frequency band as the noise. Alternatively, the noise signal may include a plurality of sub-band noise signals. Each of the plurality of sub-band noise signals may have a sub-band of the frequency band of the noise. More descriptions regarding the sub-band noise signal(s) may be found elsewhere in the present disclosure. See, e.g.,FIG.9and relevant descriptions thereof.

In some embodiments, the noise signal may be a primary noise signal representing a primary noise (e.g., an ambient noise around the ear of a user). The primary noise signal may be a feedforward noise signal corresponding to a feedforward noise control path (which will be described in detail in connection withFIGS.8-13). The primary noise signal may be generated by an audio sensor (e.g., an audio sensor510as shown inFIGS.5-7). Alternatively, the noise signal may be a residual noise signal representing a residual noise. The residual noise signal may be a feedback noise signal corresponding to a feedback noise control path (which will be described in detail in connection withFIGS.8-12). The residual noise signal may be generated by a feedback signal detector (e.g., a feedback signal detector530as shown inFIGS.5and6). Alternatively, the noise signal may be a combined signal of the primary noise signal and the residual noise signal, which represents both the primary noise and the residual noise.

In313, a noise correction signal may be determined based on the noise signal.

In some embodiments, the determination of the noise correction signal may be performed by the data processing device110. One or more operations, such as phase modulation and amplitude modulation, may be performed to determine the noise correction signal. Optionally, one or more algorithms may be used to determine the noise correction signal. For example, the Least Mean Square (LMS) algorithm, the normalized Least Mean Square (NLMS) algorithm, the Filtered-x Least Mean Square (FxLMS) algorithm, the Filtered-u Least Mean Square (FuLMS) algorithm, or the like, or any combination thereof, may be used in generating the noise correction signal.

In some embodiments, the noise correction signal may include a primary noise correction signal and/or a residual noise correction signal. The primary noise correction signal may be used to reduce or cancel the primary noise. The residual noise correction signal may be used to reduce or cancel the residual noise. The primary noise correction signal and/or the residual noise correction signal may be determined by performing process300B as shown inFIG.3B. In some embodiments, the noise correction signal may include a plurality of sub-band noise correction signals. More descriptions regarding the plurality of sub-band noise correction signals may be found elsewhere in the present disclosure. See, e.g.,FIG.9and relevant descriptions thereof.

In315, a bone conduction speaker (e.g., the speaker130) may be driven based on the noise correction signal. For example, the bone conduction speaker may generate a bone conduction sound for reducing or canceling the primary noise and/or the residual noise. The bone conduction sound may be transmitted to the user's inner ear via, for example, a bone conduction pathway (e.g., the bone conduction pathway221as shown inFIGS.2A and2B).

FIG.3Bis a flowchart illustrating an exemplary process300B for active noise control according to some embodiments of the present disclosure. In some embodiments, the process300B may be performed by a feedforward signal processor521(e.g.,521a,521b,521c,521d,521e, and521f) and/or a feedback signal processor522(e.g.,522a,522d, and522e) as described elsewhere in this disclosure (e.g.,FIGS.8-13and the relevant descriptions).

In321, a noise signal may be received. The noise signal may be a representation of a primary noise and/or a residual noise. The noise signal may be detected by a detector (e.g., the detector120). The noise signal may be an analog signal or a digital signal. The noise signal may be similar to that described in connection with311inFIG.3A, and the descriptions thereof are not repeated here.

In323, the noise signal may be converted into a digital noise signal if the noise signal is an analog signal.

The conversion may be performed by an A/D converter, for example, one of A/D converters810,820, and1370as shown inFIGS.8-10and12-13. A sampling frequency fs, of the A/D converter may be greater than 2Wa, wherein Warefers to a maximum frequency of the noise signal. In some embodiments, the sampling frequency fsmay be determined according to Formula (7) as below:
fs>kWa,  (7)
where k refers to any positive number, such as 1.5, 2.0, 2.5, 3.5, or 5.0.

In325, a noise correction signal may be determined based on a modulation of the digital noise signal.

In some embodiments, the determination of the noise correction signal may be performed by a data processing device110(e.g.,110A,110B,110C,110D,110E, and110F) as described elsewhere in this disclosure. For example, a modulator of the data processing device110may modulate the digital noise signal to determine the noise correction signal. The modulation of the digital noise signal may include amplitude modulation, phase modulation (e.g., a phase inversion and/or a phase compensation), or the like, or a combination thereof. In some embodiments, the modulation may be performed based on a phase adjustment coefficient (e.g., ΔT) and/or an amplitude adjustment coefficient according to equations (4)-(6). In some embodiments, operation323may be omitted if the noise signal received in321is a digital noise signal. In325, the noise correction signal may be generated by modulating the noise signal.

FIG.4is a schematic diagram illustrating an exemplary noise signal411and an exemplary noise correction signal413according to some embodiments of the present disclosure.

As shown inFIG.4, the noise correction signal413(e.g., S′n(n)) may have the same amplitude as but a reversed phase to the noise signal411(e.g., Sn(n)). As used herein, “a reversed phase” refers to under a particular frequency, the maximum value of noise correction signal413corresponds to the minimum value of the noise signal411. Ideally, the noise signal411and the noise correction signal413may neutralize each other due to destructive interference.

FIG.5is a schematic diagram illustrating an exemplary noise control system500according to some embodiments of the present disclosure. The noise control system500may include an audio sensor510, a data processing device110, a feedback signal detector530, and a bone conduction speaker540. The data processing device110may include a feedforward signal processor521and a feedback signal processor522. The noise control system500may be configured to reduce or cancel a noise. The noise control system500may be an exemplary embodiment of the noise control system100.

The feedforward signal processor521may form a feedforward noise control path configured to reduce a primary noise590(e.g., ambient noise of the user550). The audio sensor510may be configured to detect the primary noise590and generate a primary noise signal representing the primary noise590. The primary noise signal may be also referred to as a feedforward noise signal corresponding to the feedforward noise control path. In some embodiments, the audio sensor510may be placed near an ear pinna of a user to detect an ambient noise that enters an ear of the user.

In some embodiments, the primary noise signal may be an electrical signal in the time domain or the frequency domain. The primary noise signal may include a full-band primary noise signal and/or a sub-band primary noise signal. In some embodiments, the primary noise signal may include a plurality of sub-band primary noise signals. For example, the audio sensor510may include one or more acoustic-electric transducers, each of which may be configured to generate one of the sub-band primary noise signals. As another example, the audio sensor510may generate a full-band primary noise signal and divide the full-band primary noise signal into a plurality of sub-band primary noise signals with different frequency bands according to a sub-band decomposition technology.

Each of the plurality of sub-band primary noise signals may be corresponding to a sub-band of the primary noise. For a plurality of sub-band primary noises of the primary noise, their corresponding transfer functions may be the same or different. In the noise control system100, a first transfer function of a sub-band primary noise transmitted in a first medium and a second transfer function of the same sub-band primary noise transmitted in a second medium may be the same or different. For different frequency of sounds, their transfer functions of air conduction pathway (or bone conduction pathway) may be different. In some embodiments, transfer functions for noises of different frequencies (i.e., different sub-band primary signals) may be different. In some embodiments, the noise control system100may cancel or reduce noise having a practicality frequency.

The feedforward signal processor521may be configured to process data associated with the feedforward noise control path. For example, the feedforward signal processor521may generate a primary noise correction signal for reducing the primary noise based on the primary noise signal. The primary noise correction signal may also be referred to as a feedforward noise correction signal. In some embodiments, the feedforward signal processor521may include an A/D converter, a modulator, a filter, or the like, or any combination thereof.

The primary noise correction signal may be used as an input signal of the bone conduction speaker540to determine a primary anti-noise sound for reducing the primary noise. The primary anti-noise sound may be transmitted through the bone conduction pathway to the cochlea207of the user550.

In some embodiments, a major part of the primary noise may be reduced or canceled by the primary anti-noise sound. However, a residual noise may exist due to, for example, a difference between the air conduction transfer function and the bone conduction transfer function, a physiological structure of an ear of the user, or the like. For example, the user550may detect the residual noise as a signal Ig. In some other embodiments, the residual noises corresponding to the same primary noise may be different for different users. That may due to that, for different users, the transfer functions of the air conduction pathway (and/or bone conduction pathway) may be different. In such cases, a feedback noise reduction system may be needed to reduce the residual noise.

The feedback signal processor522and feedback signal detector530may form a feedback noise control path configured to reduce the residual noise. The residual noise may refer to a noise that still exists at the cochlea207of the user550after the interference between the primary noise transmitted through the air conduction pathway and the primary anti-noise sound transmitted through the bone conduction pathway.

The feedback signal detector530may be configured to detect the residual noise and generate a residual noise signal representing the residual noise. In some embodiments, the feedback signal detector530may include any device that can detect the residual noise. For example, the feedback signal detector530may be a biological monitoring device (e.g., a brain wave monitoring device, a nerve monitoring device) that may detect the residual noise by measuring biological characteristic(s) of the user.

In some embodiments, the residual noise signal may be an electrical signal, such as an analog signal or a digital signal. Optionally, if the residual noise signal is an analog signal (denoted as en(t)), the feedback signal detector530may be coupled to a sampling module that is configured to generate a digital residual noise signal en(n) by sampling the analogy residual noise signal en(t). The sampling frequency of the sampling module may be greater than 2Wr, wherein Wrrefers to a maximum frequency of the analog residual noise signal en(t).

The feedback signal processor522may be configured to process data associated with the feedback noise control path. For example, the feedback signal processor522may generate a residual noise correction signal. The residual noise correction signal may be configured to reduce or cancel the residual noise. In some embodiments, the feedback signal processor522may include an A/D converter, a modulator, a filter, or the like, or a combination thereof.

For example, the feedback signal processor522may be configured to determine a residual noise correction signal e′n(n) by performing a phase inversion on the digital residual noise signal en(n). The residual noise correction signal e′n(n) may be used to cancel or reduce the noise signal en(n) through destructive interference.

In some embodiments, the residual noise correction signal may be determined by performing a phase inversion operation and amplitude modulation on the residual noise signal without performing a phase compensation. The generation of the residual noise correction signal by the feedback signal processor522may be performed in a similar manner as the generation of the primary noise correction signal by the feedforward signal processor521. The residual noise correction signal may be a full-band residual correction noise signal having the same frequency band as the residual noise. For example, the residual noise correction signal may be represented as Abe′n(n), where Abrefers to an amplitude adjustment coefficient of the feedback noise control path. For another example, the residual noise correction signal may include a plurality of sub-band residual correction noise signals, each of which has a sub-band frequency of the residual noise. The residual noise correction signal may be represented as Σi=1NAie′i(n), where Airefers to an amplitude adjustment coefficient for an itthsub-band residual noise signal, N refers to a number of the sub-band residual noise signal, and e′i(n) refers to a signal having the same amplitude as but an inverted phase (as known as antiphase) to an itthsub-band residual noise signal ei(n).

The bone conduction speaker540may be an embodiment of the speaker130as shown inFIG.1configured to output a sound based on the primary noise correction signal and/or the residual noise correction signal. For example, the bone conduction speaker540may generate the sound base on a combined signal of the primary noise correction signal and the residual noise correction signal. As another example, the bone conduction speaker540may generate a sound based on the primary noise correction signal and a sound based on the residual noise correction signal in sequence. The sound(s) outputted by the bone conduction speaker540may be transmitted to the cochlea207of the user550through the bone conduction pathway221. The primary noise590may be transmitted to the cochlea207of the user550through the air conduction pathway211. The sound(s) outputted by the bone conduction speaker540may interfere with the primary noise590at the cochlea207to reduce or cancel the primary noise590.

FIG.6is a schematic diagram illustrating an exemplary noise control system600according to some embodiments of the present disclosure. The noise control system600may include a data processing device110, a feedback signal detector530, and a bone conduction speaker540. The data processing device110may include a feedback signal processor522. The noise control system600may be an exemplary embodiment of the noise control system100.

The feedback signal detector530may generate a residual noise signal (e.g., en(n), en(t)) represents a residual noise. The residual noise signal may be an electrical signal and transmitted to the feedback signal processor522for further processing. In some embodiments, the feedback signal detector530may be configured to determine a time difference keas described elsewhere in the present disclosure (e.g.,FIG.2Band relevant descriptions thereof).

The feedback signal processor522may be configured to generate a residual noise correction signal (e.g., e′n(n)) based on the residual noise signal (e.g., en(n)). For example, the feedback signal processor522may include an A/D converter, a modulator, a D/A converter, or the like, or any combination thereof. The A/D converter of the feedback signal processor522may be configured to convert an analog residual noise signal en(t) to a digital residual noise signal en(n). The sampling frequency of the A/D converter may be greater than two times of a maximum frequency of the analog residual noise signal en(t). The modulator may be configured to perform a phase inversion on the digital residual noise signal en(n) to generate the residual noise correction signal e′n(n). In some embodiments, the feedback signal processor522may determine the residual noise correction signal e′n(n) based on the digital residual noise signal en(n) and ke. The D/A converter may be configured to perform digital to an analog convention to convert the residual noise correction signal e′n(n) into an analog residual noise correction signal e′n(t). The analog residual noise correction signal e′n(t) may be used as an input signal of the bone conduction speaker540. The bone conduction speaker540may be configured to determine an anti-noise sound for reducing or canceling the residual noise based on the analog residual noise correction signal e′n(t).

FIG.7is a schematic diagram illustrating an exemplary noise control system700according to some embodiments of the present disclosure. The noise control system700may include an audio sensor510, a data processing device110, and a bone conduction speaker540. The data processing device110may include a feedforward signal processor521. The noise control system700may be an exemplary embodiment of the noise control system100.

The audio sensor510may detect a primary noise590and generate a primary noise signal representing the primary noise590.

The feedforward signal processor521may be configured to generate a primary noise correction signal based on the primary noise signal.

The primary noise correction signal may be used as an input of the bone conduction speaker540to generate an anti-noise sound for suppressing the primary noise. The anti-noise sound may be transmitted to an inner ear of the user550via a bone conduction pathway, and the primary noise590may be transmitted to the inner ear of the user550via an air conduction pathway.

It should be noted that the above descriptions of the noise control systems500,600and700are intended to be illustrative, and not to limit the scope of the present disclosure. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and/or alternative exemplary embodiments. For example, a noise control system (e.g., anyone of the noise control systems500,600and700) may include one or more additional components. Additionally or alternatively, one or more components of the noise control system described above may be omitted. For example, in the noise control system500, one of the feedforward signal processor521and the feedback signal processor522may be omitted. As another example, two or more components of the noise control system may be integrated into a single component. Merely by way of example, in the noise control system500, the A/D convertor of the feedforward signal processor521may be integrated into the audio sensor510, and/or the D/A convertor of the data processing device110may be integrated into the bone conduction speaker540.

FIGS.8-10and12-13are schematic diagrams illustrating exemplary data processing devices110A-C and110E-F according to some embodiments of the present disclosure. Each of the data processing devices110A-C and110E-F may be configured to obtain and process a noise signal. The noise signal may be a digital signal or analog signal. For illustration purposes, unless stated otherwise or obvious from the context, the present disclosure is described with reference to a noise signal in the form of a digital signal, and not intended to limit the scope of the present disclosure. Each of the data processing devices110A-C and110E-F may include one or more components for processing digital signals. It should be understood that this is not indented to be limiting. The noise signal may be an analog signal, and a data processing device may include one or more components for processing analog signals as described elsewhere in this disclosure (e.g.,FIG.11and the relevant descriptions).

FIG.8is a schematic diagram illustrating an exemplary data processing device110A according to some embodiments of the present disclosure. The data processing device110A may include a feedforward signal processor521aand a feedback signal processor522a. The data processing device110A may be configured to determine a noise correction signal815for reducing a primary noise and a residual noise. The feedforward signal processor521aand the feedback signal processor522amay be exemplary embodiments of the feedforward signal processor521and the feedback signal processor522, respectively.

The feedforward signal processor521amay be configured to receive an analog primary noise signal Sn(t) and determine a primary noise correction signal811based on the analog primary noise signal Sn(t) in a feedforward noise control path. The analog primary noise signal Sn(t) may be an analog electrical signal representing the primary noise (e.g., an ambient noise). The feedforward signal processor521amay include an A/D converter810and a modulator850.

The A/D converter810may be configured to convert the analog primary noise signal Sn(t) into a digital primary noise signal Sn(n). The sampling frequency of the A/D converter810may be greater than 2Wmax, wherein Wmaxrefers to the maximum frequency of the analog primary noise signal Sn(t). The modulator850may be configured to determine the primary noise correction signal811based on the digital primary noise signal Sn(n). In some embodiments, the modulator850may include a phase modulator for performing phase modulation and an amplitude modulator for performing amplitude modulation.

The phase modulation may be performed by the phase modulator. For example, the phase modulator may perform a phase inversion and optionally a phase compensation on the digital primary noise signal Sn(n) to generate a signal S′n(n−ΔT), wherein ΔT refers to a time difference between a first time for an air conduction sound to transmit to the cochlea207along the air conduction pathway211and a second time for a bone conduction sound to be transmitted to the cochlea207along the bone conduction pathway221. The amplitude modulator may perform amplitude modulation on the signal S′n(n−ΔT) according to an amplitude adjustment coefficient Atto generate a primary noise correction signal AtS′n(n−ΔT).

The feedback signal processor522amay be configured to receive a residual noise signal and determine a residual noise correction signal813(e.g., Abe′n(n)) based on the residual noise signal in a feedback noise control path. The residual noise signal may be an electrical signal representing a residual noise. The feedback signal processor522amay include an A/D converter820and a modulator860. The modulator860may include a phase modulator and/or an amplitude modulator. The modulator860may have similar functions to the modulator850as described above.

In some embodiments, the modulator850and/or the modulator860may include a sub-band modulator group. More descriptions regarding the sub-band modulator group may be found elsewhere in the present disclosure. See, e.g.,FIG.9and relevant descriptions thereof.

The data processing device110A may combine the primary noise correction signal811(e.g., AtS′n(n−ΔT)) and the residual noise correction signal813(e.g., Abe′n(n)) to determine a noise correction signal815(e.g., AtS′n(n−ΔT)+Abe′n(n)).

In some embodiments, the noise correction signal815determined by the data processing device110A may be a full-band signal. The noise correction signal815may be determined according to Equation (8) as below:
Sf(n)=AtS′n(n−ΔT)+Abe′(n)  (8)

In some embodiments, the data processing device110A may respectively output the feedforward noise correction signal811and the feedback noise correction signal813through two communication channels.

FIG.9is a schematic diagram illustrating an exemplary data processing device110B according to some embodiments of the present disclosure. The data processing device110B may be similar to the data processing device110A as described in connection withFIG.8, except for certain components or features. As shown inFIG.9, the data processing device110B may include a feedforward signal processor521band the feedback signal processor522a. The feedforward signal processor521bmay be coupled with a sub-band sensor910(which is an exemplary embodiment of the audio sensor510as described in connection withFIG.5).

The sub-band sensor910may be configured to detect a primary noise590and determine a plurality of sub-band primary noise signals (e.g., S1(n), S2(n), . . . , SN(n)) representing the primary noise590. The primary noise590may be an audio signal having a certain frequency band. A sub-band primary noise signal may refer to a signal having a frequency band narrower than and within the frequency band of the primary noise590. For example, the primary noise590may have a frequency band of 10-30,000 HZ. The frequency band of a sub-band primary noise signal may be 100-200 HZ, which is within the frequency band of the primary noise590. The transmission of a sound through bones (e.g., an amplitude change of the sound during the transmission) may be influenced by the frequency of the sound. For sounds of different frequencies, their transfer functions in a bone conduction path may be different. A sub-band noise reduction technology may be used to improve the noise reduction effect.

In some embodiments, at least two of the sub-band primary noise signals may have different frequency bands. Optionally, each of the sub-band primary noise signals may have a distinctive frequency band different from the frequency band(s) of the other sub-band primary noise signal(s). Different sub-band noise signals may have the same frequency bandwidth or different frequency bandwidths. In some embodiments, an overlap between the frequency bands of a pair of adjacent sub-band noise signals in the frequency domain may be avoided, so as to improve the noise reduction effect. As used herein, two sub-band noise signal whose center frequencies are adjacent to each other among the sub-band noise signals may be regarded as being adjacent to each other in the frequency domain.

In some embodiments, the spectrum of a first sub-band primary noise signal and a second sub-band primary noise signal may intersect at a half-power point of the first sub-band primary noise signal and/or a half-power point of the second sub-band primary noise signal. A half power point of a certain signal may refer to a frequency point with a specific attenuation of power level (e.g., −3 dB). In some embodiments, a combination of the frequency bands of the sub-band primary noise signals may cover the frequency band of the primary noise590. The frequency bandwidths of different sub-band primary noise signals may be the same as or different from each other. Additionally or alternatively, an overlap between the frequency bands of a pair of adjacent sub-band primary noise signals in the frequency domain may be avoided.

In some embodiments, the sub-band sensor910may be configured to convert the primary noise into an electrical signal and divide the electrical signal into the sub-band primary noise signals. For example, the sub-band sensor910may include an acoustic-electric transducer configured to convert the primary noise into an electrical signal, and a band-dividing module configured to divide the electrical signal into the sub-band primary noise signals. For example, the band-dividing module may include a plurality of band-pass filters. Each of the band-pass filters may have a unique frequency response and be configured to generate one of the sub-band primary noise signals by processing the electrical signal. The band-pass filters may include an active band-pass filter and/or a passive band-pass filter. The band-pass filters may include a Butterworth filter, a Chebyshev filter, or a Cauer filter, or the like, or any combination thereof.

In some embodiments, the sub-band sensor910may include a plurality of acoustic-electric transducers. Each of the acoustic-electric transducers may have a unique frequency response and configured to generate a sub-band primary noise signal by processing the primary noise. Descriptions regarding the generation of a sub-band noise signal may be found in PCT Application No. PCT/CN2019/109301, entitled “SYSTEMS AND METHODS FOR NOISE REDUCTION USING SUB-BAND NOISE REDUCTION TECHNIQUE” filed on Sep. 30, 2019, the contents of which are hereby incorporated by reference.

The feedforward signal processor521bmay be configured to receive the sub-band primary noise signals from the sub-band sensor910and generate a primary noise correction signal911for reducing the primary noise590. For example, the feedforward signal processor521bmay include a modulator group920and a combination module930. In some embodiments, the sub-band primary noise signals may be transmitted from the sub-band sensor910to the modulator group920through parallel transmitters. Optionally, a sub-band primary noise signal may be transmitted via a transmitter according to a certain communication protocol for transmitting digital signals. Exemplary communication protocols may include AES3 (audio engineering society), AES/EBU (European broadcast union))EBU (European broadcast union), ADAT (Automatic Data Accumulator and Transfer), I2S (Inter—IC Sound), TDM (Time Division Multiplexing), MIDI(Musical Instrument Digital Interface), CobraNet, Ethernet AVB (Ethernet Audio/VideoBridging), Dante, ITU(International Telecommunication Union)-T G.728, ITU-T G.711, ITU-T G.722, ITU-T G.722.1, ITU-T G.722.1 Annex C. AAC (Advanced Audio Coding)-LD, or the like, or a combination thereof. In some alternative embodiments, the sub-band primary noise signals may be processed to a single-channel signal using, e.g., a frequency-division multiplexing technique, and transmitted to the modulator group920.

The modulator group920may include a plurality of modulators920a-920N. The number (or count) of the modulators920a-920N (i.e., N) may be set base on requirements of the noise control system100. For example, the number of the modulators920a-920N may be equal to any positive integer greater than 1, such as 5, 10, 15, or the like. In some embodiments, the number (or count) of the modulators920a-920N may be equal to the number (or count) of the sub-band primary noise signals generated by the sub-band sensor910.

Each of the plurality of modulators920a-920N may be configured to receive one of the sub-band primary noise signals from the sub-band sensor910and generate a corresponding sub-band primary noise correction signal by modulating the received sub-band primary noise signal. Taking the modulator920ifor instance, the modulation performed by the modulator920imay include amplitude modulation and/or phase modulation (e.g., a phase reversal and/or a phase compensation) on the corresponding sub-band primary noise signal Si(n). In some embodiments, the phase modulation and the amplitude modulation may be performed in sequence or simultaneously on the sub-band primary noise signal Si(n). For example, the modulator920imay perform amplitude modulation on the Si(n) based on an amplitude adjustment coefficient Aicorresponding to the Si(n) to generate a signal AiSi(n), where Ai=HACi/HBCi, HACirefers to a transfer function of the air conduction pathway211for an itthsub-band primary noise signal, and HBCirefers to a transfer function of the bone conduction pathway221of the itthsub-band primary noise signal. The modulator920imay further perform a phase inversion on the signal AiSi(n) to generate a corresponding sub-band primary noise correction signal AiS′i(n).

As another example, the modulator920imay perform the amplitude modulation, the phase inversion, and a phase compensation on the sub-band primary noise signal Si(n) to determine the corresponding sub-band primary noise correction signal. For example, the sub-band primary noise correction signal determined by the modulator920imay be represented as AiS′i(n−ΔT), wherein ΔT refers to a time difference between a first time for an air conduction sound to transmit to the cochlea207along the air conduction pathway211and a second time for a bone conduction sound to transmit to the same cochlea207along the bone conduction pathway221as described in connection withFIG.2B.

The combination module930may be configured to combine the plurality of sub-band primary noise correction signals generated by the modulator group920to generate the primary noise correction signal911. For example, the primary noise correction signal911may be represented as Σi=1NAiS′i(n). As another example, the primary noise correction signal911may be represented as Σi=1NAiS′i(n−ΔT).

The combination module930may include any component that can combine a plurality of signals. For example, the combination module930may generate a mixed-signal (i.e., the primary noise correction signal) according to a signal combination technique, such as a frequency division multiplexing technique. In some alternative embodiments, the combination module930may be an independent component or part of a component of the feedforward signal processor521b. Alternatively, the combination module930may be omitted and the sub-band primary noise correction signals may be transmitted in parallel for output.

The feedback signal processor522amay be configured to receive a residual noise signal (e.g., en(n), en(t)) and determine a residual noise correction signal813(e.g., Abe′n(n)) based on the residual noise signal in a feedback noise control path as described in connection withFIG.8.

In some embodiments, a noise correction signal915(e.g., Sf(n)) may be generated by combining the primary noise correction signal911and the residual noise correction signal813.

For example, the noise correction signal915may be determined according to Equation (9) as below:
Sf(n)=Σi=1NAiSi(n−ΔT)+Abe′(n).  (9)

In some embodiments, the noise correction signal915may be a digital signal, an analog signal, or a pulse width modulation (PWM) signal. The noise correction signal915may be transmitted to another component (e.g., a bone conduction speaker) for output. In some embodiments, the data processing device110B may output the primary noise correction signal911and the residual noise correction signal813, respectively, through two communication channels.

FIG.10is a schematic diagram illustrating an exemplary data processing device110C according to some embodiments of the present disclosure. The data processing device110C may be similar to the data processing device110A as described in connection withFIG.8, except for certain components or features. As shown inFIG.10, the data processing device110C may include a feedforward signal processor521cand the feedback signal processor522a. The data processing device110C may be configured to determine a noise correction signal1015.

The feedforward signal processor521cmay be configured to receive a primary noise signal representing a primary noise, and generate a primary noise correction signal1011for reducing the primary noise based on the primary noise signal in a feedforward noise control path. The noise signal may be a full-band signal or a sub-band signal. For example, the feedforward signal processor521cmay include an A/D converter810and a modulator1050. The feedforward signal processor521cmay be an embodiment of the feedforward signal processor521.

For example, the primary noise signal may be an analog primary noise signal Sn(t). The A/D converter810may be configured to convert the analog primary noise signal Sn(t) into a digital primary noise signal Sn(n) as described in connection withFIGS.3B and8.

The modulator1050may be configured to determine the primary noise correction signal1011based on the digital primary noise signal Sn(n). In some embodiments, the modulator1050may include a phase modulator for performing phase modulation and an amplitude modulator for performing amplitude modulation.

For example, the phase modulator may perform a phase inversion and optionally a phase compensation on the digital primary noise signal Sn(n) to generate a signal S′n(n−ΔT−ke), wherein kerefers to a time difference between a reference value of a sound transmission time through a bone conduction pathway. More descriptions regarding the time difference kemay be found elsewhere in the present disclosure. See, e.g.,FIG.2Band relevant descriptions thereof. The amplitude modulator may perform an amplitude modulation on the signal S′n(n−ΔT−ke) according to an amplitude modulation coefficient Atto generate a primary noise correction signal AtS′n(n−ΔT−ke).

The feedback signal processor522amay be configured to receive a residual noise signal (e.g., en(n), en(t)) and determine a residual noise correction signal813(e.g., Abe′n(n)) based on the residual noise signal in a feedback noise control path as described in connection withFIG.8.

In some embodiments, the noise correction signal1015may be generated by combining the primary noise correction signal1011and the residual noise correction signal813. For example, the noise correction signal1015may be represented as AtS′n(n−ΔT−ke)+Abe′n(n). In some other embodiments, the data processing device110C may respectively output the primary noise correction signal1011and the residual noise correction signal813through two communication channels.

FIG.11is a schematic diagram illustrating an exemplary data processing device110D according to some embodiments of the present disclosure. The data processing device110D may include one or more analog signal processing components, such as a feedforward signal processor521dand a feedback signal processor522das shown inFIG.11. The data processing device110D may be configured to determine a noise correction signal1115for reducing a primary noise and a residual noise.

The feedforward signal processor521dmay include a modulator1150configured to receive a primary noise signal Sn(t) in a form of an analog electrical signal. The modulator1150may be further configured to generate a primary noise correction signal1111based on the primary noise signal Sn(t). For example, the modulator1150may perform phase modulation and amplitude modulation on the primary noise signal Sn(t) to generate a primary noise correction signal AtS′n(t−ΔT), where Atrefers to an amplitude adjustment coefficient corresponding to the feedforward noise control path, and ΔT refers to a time difference between a first time for an air conduction sound to transmit to the cochlea207along the air conduction pathway211and a second time for a bone conduction sound to be transmitted to the same cochlea207along the bone conduction pathway221.

The feedback signal processor522dmay be configured to determine a residual noise correction signal1113in a feedback noise control path. The feedback signal processor522dmay include a modulator1160. The modulator1160may include a phase modulator and/or an amplitude modulator. The feedback signal processor522dmay be an embodiment of a feedback signal processor522. For example, the phase modulator may perform a phase inverted operation on the residual noise signal en(t) to generate a residual noise correction signal e′n(t).

In some embodiments, the modulator1150and/or the modulator1160may include one or more analog circuit components configured to perform phase modulation and/or amplitude modulation. For example, the modulator1150and/or the modulator1160may employ an amplifier (e.g., an inverting amplifier) to act as a phase and/or amplitude filter. The primary noise correction signal AtS′n(t−ΔT) may be determined using the amplifier or some other analog circuits. For another example, the data processing device110D may employ a delay circuit (e.g., an all-pass inductor-capacitor (LC) circuit delay line, an active analog delay line), or some other analog circuits to perform a phase compensation on the primary noise signal.

In some embodiments, the modulator1150may include a first modulator group configured to receive a plurality of sub-band primary noise signals (in the form of analog signals) and generate a plurality of sub-band primary noise correction signals. Additionally or alternatively, the modulator1160may include a second modulator group configured to receive a plurality of sub-band residual noise signals (in the form of analog signals) and generate a plurality of sub-band residual noise correction signals. More descriptions regarding a modulator group may be found elsewhere in the present disclosure. See, e.g.,FIG.9and relevant descriptions thereof.

In some embodiments, the data processing device110D may combine the primary noise correction signal1111(e.g., AtS′n(t−ΔT)) and the residual noise correction signal1113(e.g., Abe′n(t)) to determine a combined noise correction signal1115(e.g., AtS′n(t−ΔT)+Abe′n(t)) for output. As another example, the data processing device110D may output the primary noise correction signal1111and the residual noise correction signal1113, respectively, through two communication channels.

By using analog signal processing component(s) as described above, the data processing device110D may reduce the primary noise and the residual noise without performing A/D conversion and/or D/A conversion, thereby simplifying the data processing device110D, reducing the load of chips, and improving the operation speed of noise reduction or cancellation. However, compared with the digital signal processing component(s), the analog signal processing component(s) may be less flexible and suitable for achieving self-adaption functions, and require more operational circuits.

FIG.12is a schematic diagram illustrating an exemplary data processing device110E according to some embodiments of the present disclosure. The data processing device110E may include a feedforward signal processor521eand a feedback signal processor522e. The data processing device110E may be configured to determine a primary noise correction signal1211for reducing a primary noise and a residual noise correction signal1213for reducing a residual noise.

The feedforward signal processor521emay be configured to receive a primary noise signal (e.g., Sn(t)) and determine a primary noise correction signal1211(e.g., Sf1(t)) based on the primary noise signal in a feedforward noise control path. The primary noise signal may be a full-band signal or a sub-band signal. The feedforward signal processor521emay include an A/D converter810, an inverter1230, a modulator1250, and a D/A converter1270.

The A/D converter810may be configured to convert an analog primary noise signal Sn(t) into a digital primary noise signal Sn(n). The sampling frequency of the A/D converter810may be greater than 2Wmax, wherein Wmaxrefers to the maximum frequency of the noise signal. More descriptions regarding the A/D conversion may be found elsewhere in the present disclosure. See, e.g.,FIG.3Band relevant descriptions thereof.

The inverter1230may be configured to determine a phase inverted signal S′n(n) based on the digital noise signal Sn(n).

The modulator1250may be configured to determine a digital primary noise correction signal AtS′n(n−ΔT) by performing phase modulation and/or amplitude modulation on the phase inverted signal S′n(n). The modulator1250may include a phase modulator and/or an amplitude modulator. For example, the phase modulator may perform a phase compensation on the phase inverted signal S′n(n) to generate a signal S′n(n−ΔT). The amplitude modulator may perform amplitude modulation on the signal S′n(n−ΔT) according to an amplitude modulation coefficient Atto generate the digital primary noise correction signal AtS′n(n−ΔT).

The D/A converter1270may be configured to convert the digital primary noise correction signal AtS′n(n−ΔT) into an analog primary noise correction signal Sf1(t).

The feedback signal processor522emay be configured to determine a residual noise correction signal (e.g., Sf2(t)) for reducing a residual noise in a feedback noise control path. The feedback signal processor522emay include an A/D converter820, a modulator860, and a D/A converter1280. The D/A converter1280may have similar functions as the D/A converter1270as described above. More descriptions regarding the A/D converter820and the modulator860may be found elsewhere in the present disclosure. See, e.g.,FIG.8and relevant descriptions thereof.

In some embodiments, the modulator1250and the modulator860may include a sub-band modulator group, respectively. More descriptions regarding a sub-band modulator group may be found elsewhere in the present disclosure. See, e.g.,FIG.9and relevant descriptions thereof.

The data processing device110E may output one or more noise correction signals. For example, the data processing device110E may combine the primary noise correction signal1211(e.g., Sf1(t)) and the residual noise correction signal1213(e.g., Sf2(t)) to output a combined noise correction signal (e.g., Sf1(t)+Sf2(t)). For another example, the data processing device110E may output the primary noise correction signal1211and the residual noise correction signal1213, respectively, through two communication channels.

In some embodiments, the primary noise correction signal1211and the residual noise correction signal1213may be sent to a first bone conduction speaker and a second bone conduction speaker, respectively, for output.

FIG.13is a schematic diagram illustrating an exemplary data processing device110F according to some embodiments of the present disclosure. The data processing device110F may include a feedforward signal processor521f. The feedforward signal processor521fmay include an A/D converter810, a modulator1350and an A/D converter820. The data processing device110F may be configured to determine a noise correction signal1311.

The feedforward signal processor521cmay be configured to receive a primary noise signal representing a primary noise, and determine a primary noise correction signal1311for reducing the primary noise based on the primary noise signal in a feedforward noise control path. The primary noise signal may be in a form of an analog signal Sn(t).

The A/D converter810may be configured to convert the analog signal Sn(t) to a digital primary noise signal Sn(n). More descriptions regarding the A/D conversion may be found elsewhere in the present disclosure. See, e.g.,FIG.3Band relevant descriptions thereof.

The digital primary noise signal Sn(n) may be processed by the modulator1350. The modulator1350may perform amplitude modulation and/or phase modulation (e.g., a phase inversion, a phase compensation) on the digital primary noise signal Sn(n). For example, the modulator1350may perform the phase inversion on the digital primary noise signal Sn(n) to generate a primary noise correction signal S′n(n) having the same amplitude as and an inverted phase to the digital primary noise signal Sn(n). As another example, the modulator1350may determine the primary noise correction signal as AtS′n(n−ΔT), where Atrefers to an amplitude adjustment coefficient, and ΔT refers to a time difference between a first time for an air conduction sound to transmit to the cochlea207along the air conduction pathway211and a second time for a bone conduction sound to transmit to the same cochlea207along the bone conduction pathway221. More descriptions regarding the phase compensation and the amplitude modulation may be found elsewhere in the present disclosure. See, e.g.,FIG.2Band relevant descriptions thereof.

An error detector (not shown inFIG.13) may be configured to determine an error signal e1n(t) by a superposition of a primary sound field and a secondary sound field. The primary sound field may correspond to a primary noise (i.e., an ambient noise). The secondary sound field may correspond to an anti-noise sound determined based on the primary noise.

One or more components of the data processing device110F (e.g., a filter) may be configured to perform an adaptive control, for example, an adjustment of the amplitude adjustment coefficient Atand/or an adjustment of the time difference ΔT to make e1n(n)→0. By the adaptive control, an active noise control may be achieved.

It should be noted that the above descriptions of the data processing devices110A-F are intended to be illustrative, and not to limit the scope of the present disclosure. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and/or alternative exemplary embodiments. For example, the data processing devices110A-F may include one or more additional components. Additionally or alternatively, one or more components of the data processing devices110A-F described above may be omitted. For example, one or more of the A/D converters810,820, and1370, and the D/A converters1280and1270may be omitted. As another example, two or more components of the data processing devices110A-F may be integrated into a single component. Merely by way of example, in the A/D convertor810(or820) may be integrated into the modulator1250(or860), and/or the D/A convertor1270(or1280) may also be integrated into the modulator1250(or860).

Having thus described the basic concepts, it may be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. Various alterations, improvements, and modifications may occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested by this disclosure and are within the spirit and scope of the exemplary embodiments of this disclosure.

Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment,” “an embodiment,” and/or “some embodiments” mean that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” in various portions of this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the present disclosure.

Further, it will be appreciated by one skilled in the art, aspects of the present disclosure may be illustrated and described herein in any of a number of patentable classes or context including any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof. Accordingly, aspects of the present disclosure may be implemented entirely hardware, entirely software (including firmware, resident software, micro-code, etc.) or combining software and hardware implementation that may all generally be referred to herein as a “unit,” “module,” or “system.” Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon.

A computer-readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including electromagnetic, optical, or the like, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium that is not a computer-readable storage medium and that may communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable signal medium may be transmitted using any appropriate medium, including wireless, wireline, optical fiber cable, RF, or the like, or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB. NET, Python or the like, conventional procedural programming languages, such as the “C” programming language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby, and Groovy, or other programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (e.g., through the Internet using an Internet Service Provider) or in a cloud computing environment or offered as a service such as a Software as a Service (SaaS).

Furthermore, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations, therefore, is not intended to limit the claimed processes and methods to any order except as may be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful embodiments of the disclosure, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover modifications and arrangements that are within the spirit and scope of the disclosed embodiments. For example, although the implementation of various components described above may be embodied in a hardware device, it may also be implemented as a software-only solution, e.g., an installation on an existing server or mobile device.

Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various embodiments. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, claimed subject matter may lie in less than all features of a single foregoing disclosed embodiment.