Patent ID: 8767968

Claim:
A method comprising: collecting sensor data pertaining to a room and a position of a listener in the room, the sensor data includes depth information pertaining to an ear of the listener; determining real physical characteristics of the room based on the sensor data; determining virtual physical characteristics of a virtual environment; applying the virtual physical characteristics to the real physical characteristics of the room; building a model of the room that includes the virtual physical characteristics applied to the real physical characteristics of the room, including replacing real physical characteristics of a real object in the room with virtual physical characteristics of a virtual object from the virtual environment; determining a location of the listener in the room based on the sensor data; determining physical characteristics of the ear of the listener from the depth information pertaining to the ear of the listener; determining a head related transfer function (HRTF) for the listener from a library of HRTFs based on the physical characteristics of the ear of the listener; and determining a 3D audio signal based on the model of the room that includes the virtual physical characteristics applied to the real physical characteristics of the room, the location of the listener in the room, and the HRTF for the listener, determining the 3D audio signal based on the model of the room that includes the virtual physical characteristics applied to the real physical characteristics of the room includes determining how the virtual physical characteristics of the virtual object will affect sound reflections.