Patent ID: 9355574
Filing Date: 2016-05-31
CPC Classification: G06F,G06T,G09B

Claim Text:
1. A method for a 3D virtual training system including a 3D display screen and a physical operating device, comprising: initializing a virtual medical training session to be displayed on the 3D display screen, 3D display contents including at least a 3D virtual image of a surgery site; configuring an operating mode of the physical operating device to be a desired virtual surgery device from a plurality of predefined virtual surgery devices for the physical operating device, wherein a 3D image of a retractable portion of the physical operating device is displayed on the 3D display screen as the desired virtual surgery device without changing the physical operating device; obtaining user interaction inputs via the physical operating device and the 3D display screen to determine at least a contact condition of the physical operating device with respect to the 3D display screen, and displaying on the 3D display screen the desired virtual surgery device based on the contact condition of the physical operating device and a virtual surgery operation on the surgery site by the virtual surgery device; determining an operation consequence based on the user interaction inputs and the surgery site; rendering the operation consequence based on the surgery site and effects of the virtual surgery operation; and displaying 3D virtual images of the rendered operation consequence on the 3D display screen.