Patent ID: 11868583
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method, comprising:
capturing, by a camera of a computing device, image data associated with an ambient environment;
identifying, in the image data, a physical object in the ambient environment;
detecting an input to associate a virtual user interface with the physical object;
designating the physical object as a physical user interface apparatus in response to the input;
triggering display, by a display device of the computing device, of the virtual user interface as a virtual object overlaid on the physical object in the ambient environment;
attaching the virtual object corresponding to the virtual user interface to the physical object;
mapping at least one virtual feature of the virtual user interface to at least one physical feature of the physical object to enable coordinated movement of the virtual user interface with the physical object;
detecting a physical manipulation of the physical object designated as the physical user interface apparatus;
associating the physical manipulation of the physical object with a corresponding user interaction with the virtual user interface attached to the physical object; and
in response to the physical manipulation of the physical object and the corresponding user interaction with the virtual user interface, triggering a change in a control algorithm associated with the virtual user interface corresponding to the physical manipulation of the physical object and the corresponding user interaction with the virtual user interface.