Patent ID: 9123155
Filing Date: 2015-09-01
Classification: A61B,G06K,G06T,G09G,H04N

Abstract:
1. A method for augmenting data onto a video image, the method comprising: generating a pre-operative image of an anatomical section of a patient; generating a video image of a surgical site within the patient, wherein the video image includes an image of at least a portion of a surgical tool operated by a user; processing the pre-operative image to generate data about the anatomical section of the patient, the data including a label for the anatomical section and a peripheral margin of at least a portion of the anatomical section, the peripheral margin configured to guide a surgeon to a cutting location relative to the anatomical section; embedding the data and an identity of the user within the video image to supply an augmented reality display to the user about the anatomical section of the patient; sensing a loading condition on the surgical tool; generating a feedback signal based on the sensed loading condition; and updating, in real time, the data and a location of the identity of the user operating the surgical tool embedded within the video image in response to a change in a location of the surgical tool within the video image.