Patent Document ID: 9740506
Application ID: 12772013
Patent Status: 1

Claim One:
1. A computer-implemented method comprising: determining a target object in a graphical user interface (GUI) for a software application input action based upon socially identifying information of the target object, the socially identifying information describing the target objects relationship to one or more peer objects of a same type as the target object and/or descendent objects in the GUI and comprising: a type of the target object's parent, a rank of the target object relative to the one or more peer objects of the same type as the target object, wherein the rank indicates a location of the target object in the GUI relative to the one or more peer objects of the same type as the target object, and a location of a label of the target object, wherein the label is separate from the target object and the location of the label describes a position of the label in the GUI relative to the target object; and applying the input action to the target object.