On a computing device, a method for monitoring performance of a process utilizing one or more objects, the method comprising: receiving an input of a set of rules defining one or more portions of the process; receiving from a remote service in response to a user input or to a determination by the computing device that a user is performing the process an input of object identification information regarding the one or more objects, wherein the object identification information includes three-dimensional object data usable to identify the one or more objects in a plurality of different orientations from image information and an identification function; for a selected portion of the process, receiving from an image sensor an input of image information of a physical scene, wherein the image information comprises three-dimensional image information; from the image information received, the object identification information, and the identification function, segmenting the image information into one or more segmented objects and classifying the one or more segmented objects in order to determine the identity of each object; from the image information and object identification information received, identifying an operation performed with the one or more identified objects in the physical scene; comparing the operation identified in the image information to the set of rules; and outputting to a display device an indication of whether the operation satisfies a rule of the set of rules associated with the selected portion of the process and, if the operation does not satisfy the rule, outputting an instruction to instruct a user how to satisfy the rule including an augmented reality view of the physical scene displayed on the display device. receiving an input of a set of rules defining one or more portions of the process; receiving from a remote service in response to a user input or to a determination by the computing device that a user is performing the process an input of object identification information regarding the one or more objects, wherein the object identification information includes three-dimensional object data usable to identify the one or more objects in a plurality of different orientations from image information and an identification function; for a selected portion of the process, receiving from an image sensor an input of image information of a physical scene, wherein the image information comprises three-dimensional image information; from the image information received, the object identification information, and the identification function, segmenting the image information into one or more segmented objects and classifying the one or more segmented objects in order to determine the identity of each object; from the image information and object identification information received, identifying an operation performed with the one or more identified objects in the physical scene; comparing the operation identified in the image information to the set of rules; and outputting to a display device an indication of whether the operation satisfies a rule of the set of rules associated with the selected portion of the process and, if the operation does not satisfy the rule, outputting an instruction to instruct a user how to satisfy the rule including an augmented reality view of the physical scene displayed on the display device. receiving from an image sensor an input of image information of a physical scene, wherein the image information comprises three-dimensional image information; from the image information received, the object identification information, and the identification function, segmenting the image information into one or more segmented objects and classifying the one or more segmented objects in order to determine the identity of each object; from the image information and object identification information received, identifying an operation performed with the one or more identified objects in the physical scene; comparing the operation identified in the image information to the set of rules; and outputting to a display device an indication of whether the operation satisfies a rule of the set of rules associated with the selected portion of the process and, if the operation does not satisfy the rule, outputting an instruction to instruct a user how to satisfy the rule including an augmented reality view of the physical scene displayed on the display device.