Patent ID: 11954268
Assignee: SNAP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. An interactive augmented reality method for use with eyewear having a frame, an optical member supported by the frame, a camera configured to capture a plurality of frames including a remote mobile device, a display coupled to the optical member, and a processor, the processor:
displaying a virtual object on the display;
using the camera to identify the remote mobile device in the plurality of frames in real-time;
displaying an overlay comprising a reference image having a boundary on the display, wherein the overlay guides a user in initial positioning of the remote mobile device within the boundary and with respect to the eyewear;
using the camera to identify movements of the remote mobile device by a user in real- time, wherein the movements are representative of a three-dimensional (3D) positioning of the remote mobile device;
modifying the virtual object on the display in 3D as a function of, and correlated to, the identified 3D movements of the remote mobile device in real-time when the remote mobile device is moved in 3D space, wherein the virtual object appears to be painted by a brush stroke in 3D by movement of the remote mobile device;
determining a position of the remote mobile device relative to the eyewear; and
selecting an attribute of a next brush stroke as a function of the determined position.