Patent ID: 11961291
Assignee: APPLE INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 16:
17. A non-transitory machine-readable medium comprising instructions that, when executed by a processor, causes the processor to perform operations comprising:
obtaining, by a system process of a computing device, an image being displayed by an application at the computing device;
identifying, by the system process and responsive to providing the image to one or more machine learning model at the computing device, an element of interest in the image, the identifying further comprising:
identifying a plurality of elements in the image using the one or more machine learning models;
ranking the plurality of elements based on a ranking algorithm; and
based on the ranking, determining the element of interest, from amongst the plurality of elements; and

displaying a visual indicator for the element of interest overlaid on the image at a location corresponding to the element of interest, wherein the visual indicator is selectable to cause a display of information associated with the element of interest.