Patent Document ID: 20170330336
Application ID: 15154957
Patent Status: 0

Claim One:
1. A method, comprising: capturing, by one or more processors, a screenshot image that captures at least a portion of a display provided to a user by a computing device of the user; segmenting the screenshot image into at least a first region and a second region, the segmenting being by one or more of the processors based on a plurality of pixels of the screenshot image; assigning a first semantic type to the first region, the assigning being by one or more of the processors and being based on a plurality of the pixels of the first region; generating interactive content based on the first region and the first semantic type of the first region; providing the interactive content for presentation to the user via the computing device of the user, wherein user selection of the interactive content via a user interface input device of the computing device of the user causes the computing device of the user to perform one or more actions that are tailored to the first region.