Patent ID: 9116604
Filing Date: 2015-08-25
Classification: G06F

Abstract:
1. An apparatus comprising a computer processor and a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause a first device of the apparatus to carry out the steps of: displaying a representation of a user interface displayed by a second device such representation based on images of the user interface displayed by the second device which are captured by a camera of the first device, the representation containing one or more element representations, each element representation corresponding to an element contained within the user interface displayed by the second device; receiving from a user of the first device, a selection of a particular element representation of the representation, the particular element representation corresponding to a particular element contained within the user interface; transmitting to the second device, a contextual information request corresponding to the selection; in response to transmitting the contextual information request, receiving from the second device, contextual information corresponding to the selection; and generating based on the contextual information, a contextual list of actions associated with the particular element.