Patent ID: 11928307
Assignee: CATERPILLAR PAVING PRODUCTS INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A non-transitory computer-readable medium having instructions stored therein, wherein the instructions, when executed, cause a processor to:
generate, at a controller, a first set of graphical user interfaces associated with setup of an operator training application;
display, via a display screen of a head mountable display device in communication with the controller, the first set of graphical user interfaces;
receive, from at least one hand control in communication with the controller, data based on at least one virtual object displayed via the first set of graphical user interfaces;
generate, based in part on the data, a second set of graphical user interfaces associated with at least one task associated with a training scenario corresponding to operating a machine on a work site, the second set of graphical user interfaces including one or more representations of at least a portion of the machine, the at least one task requires the operator to utilize the at least one hand control to interact with the one or more representations of at least a portion of the machine, and the second set of graphical user interfaces depict the operator's interactions with the one or more representations of at least a portion of the machine as they occur via the at least one hand control;
display the second set of graphical user interfaces via the display screen; and
receive data from the at least one hand control indicating the operator's interaction with the one or more representations of at least a portion of the machine.