Patent ID: 11893207
Assignee: APPLE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method comprising:
at a device including a non-transitory memory and one or more processors coupled with the non-transitory memory:
obtaining environmental data corresponding to a physical environment;
determining, based on the environmental data, a bounding surface of the physical environment;
detecting a physical element located within the physical environment based on the environmental data;
determining a semantic label for the physical element based on at least a portion of the environmental data corresponding to the physical element;
generating a semantic construction of the physical environment based on the environmental data, wherein the semantic construction of the physical environment includes a representation of the bounding surface, a representation of the physical element and the semantic label for the physical element; and
providing the semantic construction of the physical environment to a virtual intelligent agent (VIA) that generates actions for a graphical object that represents the VIA.