Patent Document ID: 9675319
Application ID: 15199630
Patent Status: 1

Claim One:
1. A method of presenting virtual content to a user of a head mounted display, the method comprising: receiving emplacement data associated with a first emplacement sensor with respect to a first coordinate system; receiving emplacement data associated with a second emplacement sensor with respect to the first coordinate system; receiving emplacement data associated with a third emplacement sensor with respect to a second coordinate system, the third emplacement sensor associated with a head mounted display; determining a first emplacement of a first virtual medical device with respect to a third coordinate system based at least in part on the received emplacement data associated with the first emplacement sensor, a predetermined offset, and the received emplacement data associated with the third emplacement sensor; determining a first emplacement of a second virtual medical device with respect to the third coordinate system based at least in part on the received emplacement data associated with the second emplacement sensor, the predetermined offset, and the received emplacement data associated with the third emplacement sensor; receiving a real-time medical imaging stream associated with the second virtual medical device; determining a first emplacement of the real-time medical imaging stream with respect to the third coordinate system based at least in part on the received emplacement data associated with the second emplacement sensor, the predetermined offset, and the received emplacement data associated with the third emplacement sensor; determining a second emplacement of the first virtual medical device with respect to a fourth coordinate system based at least in part on the received emplacement data associated with the first emplacement sensor, the predetermined offset, and the received emplacement data associated with the third emplacement sensor; determining a second emplacement of the second virtual medical device with respect to the fourth coordinate system based at least in part on the received emplacement data associated with the second emplacement sensor, the predetermined offset, and the received emplacement data associated with the third emplacement sensor; determining a second emplacement of the real-time medical imaging stream with respect to the fourth coordinate system based at least in part on the received emplacement data associated with the second emplacement sensor, the predetermined offset, and the received emplacement data associated with the third emplacement sensor; causing a first opaque stereoscopic display of the head mounted display to display a first 3D rendered view of a virtual 3D volume including: a 3D rendering of the first virtual medical device based at least in part on the determined first emplacement of the first virtual medical device, a 3D rendering of the second virtual medical device based at least in part on the determined first emplacement of the second virtual medical device, and a 3D rendering of the real-time medical imaging stream based at least in part on the determined first emplacement of the real-time medical imaging stream; and causing a second opaque stereoscopic display of the head mounted display to display a second 3D rendered view of the virtual 3D volume including: a 3D rendering of the first virtual medical device based at least in part on the determined second emplacement of the first virtual medical device, a 3D rendering of the second virtual medical device based at least in part on the determined second emplacement of the second virtual medical device, and a 3D rendering of the real-time medical imaging stream based at least in part on the determined second emplacement of the real-time medical imaging stream, wherein the first 3D rendered view and the second 3D rendered view change in relation to a change in the emplacement data associated with the third emplacement sensor.