Patent ID: 9547940
Date: 2017-01-17
CPC Classifications: A61B,G06T

Claim:
1. A method for providing augmented reality in minimally invasive surgery, the method comprising: capturing pre-operative image data of internal organs of a patient; creating a first three-dimensional surface model based upon the captured pre-operative image data, the first three-dimensional surface model comprising a model of a surface of at least one of the internal organs; capturing intra-operative image data of the internal organs with an endoscope during a surgical procedure; creating a second three-dimensional surface model based on the captured intra-operative image data, the second three-dimensional surface model comprising a model of a surface of at least one of the internal organs; registering the three-dimensional surface models in real time during the surgical procedure; tracking the position and orientation of the endoscope during the surgical procedure; and augmenting the intra-operative image data captured by the endoscope in real time with a rendering of at least a portion of an internal organ of the patient that is in registration with the real time intra-operative image data from the endoscope but outside of the field of view of the endoscope.