A system for guiding placement of surgical ports on a body, the system comprising: an image capture device configured to: capture an image of an operating environment including a body; and generate image data based on the captured image; a head mounted display device; and a computing device including a processor and a memory storing instructions which, when executed by the processor, cause the computing device to: obtain information regarding a location of a surgical site within the body; receive the image data from the image capture device; generate graphical guidance virtual placement for placing a virtual surgical port on the body based on the location of the surgical site within the body and the image data; cause the head mounted display device to display the generated graphical guidance virtual placement over the body, the system being characterized in that the instructions, when executed by the processor, further cause the the computing device to: receive an adjusted placement for placing the virtual surgical port on the body from additional image data from the capture device capturing a movement of a user's hand; and, by determining that the user is adjusting a pose of the virtual surgical port, providing an alert when a distance between the virtual placement and the adjusted placement is greater than a predetermined distance based on the location of the surgical site and a type of a surgical procedure. an image capture device configured to: capture an image of an operating environment including a body; and generate image data based on the captured image; capture an image of an operating environment including a body; and generate image data based on the captured image; a head mounted display device; and a computing device including a processor and a memory storing instructions which, when executed by the processor, cause the computing device to: obtain information regarding a location of a surgical site within the body; receive the image data from the image capture device; generate graphical guidance virtual placement for placing a virtual surgical port on the body based on the location of the surgical site within the body and the image data; cause the head mounted display device to display the generated graphical guidance virtual placement over the body, the system being characterized in that the instructions, when executed by the processor, further cause the the computing device to: receive an adjusted placement for placing the virtual surgical port on the body from additional image data from the capture device capturing a movement of a user's hand; and, by determining that the user is adjusting a pose of the virtual surgical port, providing an alert when a distance between the virtual placement and the adjusted placement is greater than a predetermined distance based on the location of the surgical site and a type of a surgical procedure. obtain information regarding a location of a surgical site within the body; receive the image data from the image capture device; generate graphical guidance virtual placement for placing a virtual surgical port on the body based on the location of the surgical site within the body and the image data; cause the head mounted display device to display the generated graphical guidance virtual placement over the body, the system being characterized in that the instructions, when executed by the processor, further cause the the computing device to: receive an adjusted placement for placing the virtual surgical port on the body from additional image data from the capture device capturing a movement of a user's hand; and, by determining that the user is adjusting a pose of the virtual surgical port, providing an alert when a distance between the virtual placement and the adjusted placement is greater than a predetermined distance based on the location of the surgical site and a type of a surgical procedure.