Patent ID: 11966724
Assignee: XXV INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 16:
17. A method for building desktop graphical user interface assisted automations, comprising:
capturing a state of one or more objects on a desktop before and after at least one input that is given to at least one of the objects on the desktop;
compiling an assisted automation based upon said capturing to convert a raw keyboard and mouse input and state of one or more objects on the desktop into at least one compact semantic description of intent as a program in a formal programming language;
executing the assisted automation to accomplish a step-by-step change in the state of one or more objects on the desktop towards an eventual task objective of a desktop task;
evaluating a consistency of the step-by-step change with an expectation comprising a generalization of the state of one or more objects on the desktop encountered during recordings;
converting at least one program step of the program into an executable runtime action;
synthesizing an iteratively improving automation based upon the executed assisted automation by recording the state of one or more objects on the desktop and the at least one input that is given to at least one of the objects during runtime execution; and
combining a result of said compiling the assisted automation with at least one result of a previous compiling of the assisted automation to provide a single program that includes one or more synthesized expressions for automatically computable values and for computable decisions.