Patent Document ID: 10133953
Application ID: 15416484
Patent Status: 1

Claim One:
1. A method for enabling graphic-based interoperability with a run-time application, performed on a computer having a processor, a memory, and one or more code sets stored in the memory and executed by the processor, the method comprising: during a design-time mode: receiving, by the processor, a design-time application image; identifying, by the processor, one or more design-time visual objects within the design-time application image; generating, by the processor, one or more design-time bounding shape objects, wherein each of the one or more design-time bounding shape objects bounds one or more of the one or more design-time visual objects identified within the design-time application image; defining, by the processor, one or more bounding shape properties for at least one of the one or more design-time bounding shape objects; and storing, by the processor, as a scene, data relating to the design-time application image, the one or more design-time visual objects, the one or more design-time bounding shape objects, and the one or more bounding shape properties, for later recall; and during a run-time mode: recalling, by the processor, the scene stored during the design-time mode; capturing, by the processor, a run-time application image displaying on a display in a remote desktop environment; identifying, by the processor, one or more run-time visual objects within the run-time application image based on the scene; generating, by the processor, one or more run-time bounding shape objects, and applying, by the processor, one or more of the one or more bounding shape properties to one or more of the generated one or more run-time bounding shape objects in the display.