Patent ID: 11956623
Assignee: APPLE INC.
Field: Measurement (Instruments)
Classification: CPC H  G | IPC H

Claim 23:
24. An article of manufacture that processes audio in an enhanced reality environment, comprising:
a non-transitory machine readable medium having stored therein instructions that, when executed by a processor, cause a computing system to perform the following:
generating, based on an image of a physical environment captured by a camera, an estimated model of the physical environment, wherein the estimated model comprises
a three dimensional representation of the physical environment, and

environmental parameters of the physical environment wherein the environmental parameters include one or more acoustic surface material parameters or one or more scattering parameters;
generating one or more measured acoustic parameters of the physical environment based on a plurality of audio signals generated by a microphone array that capture a sound in the physical environment; and
processing a target audio signal using the estimated model and the measured acoustic parameters, resulting in a plurality of output audio channels having a virtual sound source with a virtual location, wherein processing the target audio signal using the estimated model and the measured acoustic parameters includes:
modifying the one or more acoustic surface material parameters or the one or more scattering parameters in the estimated model, based on the measured acoustic parameters, to result in an updated model of the physical environment;
selecting or generating one or more impulse responses based on the updated model; and
convolving the target audio signal and a target location with the one or more impulse responses to generate the plurality of output audio channels.