Patent ID: 11956623
Assignee: APPLE INC.
Field: Measurement (Instruments)
Classification: CPC H  G | IPC H

Claim 0:
1. A method for processing sound in an enhanced reality environment, the method comprising:
receiving an image captured by a camera, the image showing a physical environment;
generating, based on the image, an estimated model of the physical environment, wherein the estimated model comprises
a three dimensional representation of the physical environment, and
environmental parameters of the physical environment wherein the environmental parameters include one or more acoustic surface material parameters or one or more scattering parameters;

receiving audio signals captured by a microphone array, the audio signals capturing a sound in the physical environment;
generating one or more measured acoustic parameters of the physical environment based on the received audio signals; and
processing a target audio signal using the estimated model and the measured acoustic parameters, resulting in a plurality of output audio channels having a virtual sound source with a virtual location, the output audio channels used to drive a plurality of speakers
wherein processing the target audio signal using the estimated model and the measured acoustic parameters includes:
modifying the one or more acoustic surface material parameters or the one or more scattering parameters in the estimated model, based on the measured acoustic parameters, to result in an updated model of the physical environment;
selecting or generating one or more impulse responses based on the updated model; and
convolving the target audio signal and a target location with the one or more impulse responses to generate the plurality of output audio channels.