A surgical hub comprising: a communication array configured to be operably connected to at least one display, an augmented reality device and at least one surgical instrument, wherein the AR device comprises any one of: safety glasses with an AR display, AR goggles or a head mounted display; and a processor configured to: obtain, from a surgical instrument of the at least one surgical instrument, a data stream for displaying on a display of the at least one display; generate AR content for overlaying on the display; determine whether a user of the AR device is viewing the display; and upon detecting the user of the AR device viewing the display, overlay the AR content on the content displayed on the display via the AR device; characterized in that the processor is further configured to: receive an indication of an intended action on a target area, wherein the indication comprises a visualization captured via the AR device or a surgical scope, the visualization indicating a surgical instrument being placed on or proximate to a target area; obtain a predicted outcome associated with performing the intended action on the target area by determining the predicted outcome based on visual data received from a surgical scope and surgical data received from the at least one surgical instrument; and include the predicted outcome in the AR content. a communication array configured to be operably connected to at least one display, an augmented reality device and at least one surgical instrument, wherein the AR device comprises any one of: safety glasses with an AR display, AR goggles or a head mounted display; and a processor configured to: obtain, from a surgical instrument of the at least one surgical instrument, a data stream for displaying on a display of the at least one display; generate AR content for overlaying on the display; determine whether a user of the AR device is viewing the display; and upon detecting the user of the AR device viewing the display, overlay the AR content on the content displayed on the display via the AR device; characterized in that the processor is further configured to: receive an indication of an intended action on a target area, wherein the indication comprises a visualization captured via the AR device or a surgical scope, the visualization indicating a surgical instrument being placed on or proximate to a target area; obtain a predicted outcome associated with performing the intended action on the target area by determining the predicted outcome based on visual data received from a surgical scope and surgical data received from the at least one surgical instrument; and include the predicted outcome in the AR content. obtain, from a surgical instrument of the at least one surgical instrument, a data stream for displaying on a display of the at least one display; generate AR content for overlaying on the display; determine whether a user of the AR device is viewing the display; and upon detecting the user of the AR device viewing the display, overlay the AR content on the content displayed on the display via the AR device; characterized in that the processor is further configured to: receive an indication of an intended action on a target area, wherein the indication comprises a visualization captured via the AR device or a surgical scope, the visualization indicating a surgical instrument being placed on or proximate to a target area; obtain a predicted outcome associated with performing the intended action on the target area by determining the predicted outcome based on visual data received from a surgical scope and surgical data received from the at least one surgical instrument; and include the predicted outcome in the AR content. receive an indication of an intended action on a target area, wherein the indication comprises a visualization captured via the AR device or a surgical scope, the visualization indicating a surgical instrument being placed on or proximate to a target area; obtain a predicted outcome associated with performing the intended action on the target area by determining the predicted outcome based on visual data received from a surgical scope and surgical data received from the at least one surgical instrument; and include the predicted outcome in the AR content.