Patent ID: 11863730
Assignee: SNAP INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC F  G  H

Claim 22:
23. A method of registration of a VR/MR/AR display system, the method comprising
capturing stereo images using first and second optical cameras of a binocular system, the first and second cameras being optically coupled to respective outputs of first and second optical waveguide combiners of the binocular system and having a field of view of at least one displayable virtual object and of at least one real object;, determining an estimated distance of the real object(s) from the optical waveguide combiners using the optical cameras and/or estimated spatial location of the real object(s) using the optical cameras;
generating the virtual object(s) for display by the optical waveguide combiners based on the estimated distance and/or estimated spatial location;
projecting into the optical waveguide combiners a display image of the virtual object(s);
displaying, by the optical waveguide combiners, the display image as the virtual object(s);
capturing an image of the displayed virtual object(s) and real object(s) using the optical cameras;
comparing the displayed virtual object(s) to the real object(s) using the captured image;
determining a registration error between the real object(s) and the virtual object(s) based on the comparison;
adjusting the virtual object(s) being displayed to substantially correct the registration error.