Source: https://patents.google.com/patent/JP6370789B2/en
Timestamp: 2020-01-19 04:39:44
Document Index: 84467608

Matched Legal Cases: ['Application No. 61', 'Application No. 14', 'Application No. 61', 'Application No. 61', 'Application No. 13', 'Application No. 61', 'Application No. 61', 'application No. 61', 'Application No. 61', 'Application No. 61', 'Application No. 2015']

JP6370789B2 - Navigation system with optical and non-optical sensors - Google Patents
Navigation system with optical and non-optical sensors Download PDF
JP6370789B2
JP6370789B2 JP2015533296A JP2015533296A JP6370789B2 JP 6370789 B2 JP6370789 B2 JP 6370789B2 JP 2015533296 A JP2015533296 A JP 2015533296A JP 2015533296 A JP2015533296 A JP 2015533296A JP 6370789 B2 JP6370789 B2 JP 6370789B2
JP2015533296A
JP2015534480A (en
JP2015534480A5 (en
ウー，チュンウー
ストライカー・コーポレイション
2012-09-26 Priority to US201261705804P priority Critical
2012-09-26 Priority to US61/705,804 priority
2013-09-24 Priority to US14/035,207 priority patent/US9008757B2/en
2013-09-24 Priority to US14/035,207 priority
2013-09-25 Application filed by ストライカー・コーポレイション filed Critical ストライカー・コーポレイション
2013-09-25 Priority to PCT/US2013/061642 priority patent/WO2014052428A1/en
2015-12-03 Publication of JP2015534480A publication Critical patent/JP2015534480A/en
2016-10-27 Publication of JP2015534480A5 publication Critical patent/JP2015534480A5/ja
2018-08-08 Publication of JP6370789B2 publication Critical patent/JP6370789B2/en
The present invention generally relates to a navigation system that tracks an object by determining a change over time in at least one of the position and orientation of the object in space. More specifically, the present invention relates to a navigation system that determines at least one of the position and orientation of an object using an optical sensor and a non-optical sensor.
This application claims priority and benefit based on US Provisional Patent Application No. 61 / 705,804 filed September 26, 2012 and US Non-Provisional Application No. 14/035207 filed September 24, 2013. It is. The entire contents of these US applications are hereby incorporated by reference.
The navigation system assists the user in accurately locating the target. For example, navigation systems are used in industrial, aerospace, defense, and medical applications. In the medical field, navigation systems assist surgeons to accurately place surgical instruments relative to a patient's anatomy.
Surgery in which the navigation system is used includes neurosurgery and orthopedic surgery. In many cases, both the instrument and the anatomy are tracked by their relative movement displayed on the display. The navigation system can display moving instruments along with pre- or intra-operative images of anatomy. Preoperative images are usually created by MRI or CT scans, while intraoperative images can be created using a fluoroscope, low level x-ray, or any similar device. Alternatively, some systems are image-less, in which the patient's anatomy is “painted” by the navigation probe and mathematically fitted into a anatomical model for display.
The navigation system can use optical signals, sound waves, magnetic fields, RF signals, etc. to track at least one of the position and orientation of the instrument and anatomy. Optical navigation systems are widely used due to the accuracy of such systems.
Conventional optical navigation systems typically include one or more camera units that contain one or more optical sensors (charge coupled devices, ie CCDs, etc.). The optical sensor detects light emitted from a tracker attached to the instrument and anatomy. Each tracker has a plurality of light emitters such as light emitting diodes (LEDs). These LEDs periodically send light to the sensor to determine the position of the LEDs.
The position of the LED on the instrument tracker is related to the coordinates of the working end of the instrument relative to the camera coordinate system. The position of the LED in the tracker (s) of the anatomical tissue is related to the coordinates of the target area of the anatomical tissue in the three-dimensional space with reference to the camera coordinate system. Accordingly, it is possible to track and display at least one of the position and orientation of the working end of the instrument with respect to the target area of the anatomical tissue.
The navigation system can be used in a closed loop manner to control the movement of the surgical instrument. In these navigation systems, trackers are provided on both the instrument and the target anatomy, so that the navigation system can track their position and orientation. Information from the navigation system is then provided to the control system to control or guide the movement of the instrument. In some cases, the instrument is held by a robot and information is sent from the navigation system to the robot's control system.
In order for the control system to quickly grasp the relative movement between the instrument and the target anatomy, the accuracy and speed of the navigation system must meet the desired tolerance of the procedure. There is. For example, tolerances for cementless knee implants may be very small to ensure sufficient compatibility and function of the implant. Thus, the accuracy and speed of the navigation system may need to exceed a relatively rough cutting procedure.
One limitation on the accuracy and speed of the optical navigation system is that it relies on a line-of-sight between the LED and the optical sensor in the camera unit. If the line of sight is blocked, the system cannot accurately determine the position and orientation of the tracked instrument and anatomy. As a result, surgery can encounter many starts and stops. For example, if the line of sight is interrupted during robot-assisted cutting control, the cutting tool must be disabled until the line of sight is obtained again. This can cause significant delays and additional costs for the procedure.
Another limitation on accuracy arises when using active LEDs in trackers. In such systems, the LEDs are often lit in sequence. In this case, only the position of the actively lit LED is measured and determined by the system, while the position of the remaining unmeasured LEDs is unknown. In these systems, the positions of the remaining unmeasured LEDs are approximated. This approximation is usually based on linear velocity data extrapolated by the last known measurement position of the LED that is not currently measured. However, since the LEDs are lit in sequence, there may be a considerable delay between the measurement of any LED. This delay increases each time a tracker is added and used in the system. In addition, this approximation does not take into account the rotation of the tracker, which can result in further errors in the tracker position data.
In this technical field, non-optical based additional data is used to improve tracking and to determine at least one of the position and orientation of an object in high precision surgical procedures such as robot-assisted surgical cutting There is a need for an optical navigation system that provides a certain level of accuracy and speed.
The present invention relates to a system and method for determining at least one of a position and an orientation of an object using an optical sensor and a non-optical sensor.
According to one aspect of the invention, a navigation system for tracking an object is provided. The navigation system includes an optical sensor that receives optical signals from one or more markers in the tracker. The tracker includes a non-optical sensor that generates a non-optical signal. The computing system determines the position of one of the markers at a first time based on the first optical signal. The computing system also determines the position of one or more other markers at a first time based on the first optical signal and the non-optical signal from the non-optical sensor. The determined position is associated with the object and the position of the object is tracked.
According to another aspect of the invention, a navigation system for tracking an object is provided. This navigation system includes an optical sensor that sequentially receives optical signals from three markers in the tracker. The tracker also includes a non-optical sensor that generates a non-optical signal. The computing system determines the position of the first marker among the markers at the first time based on the first optical signal from the first marker. The computing system obtains positions of the second marker and the third marker of the markers at the first time based on the first optical signal and the non-optical signal from the non-optical sensor. The determined position is associated with the object and the position of the object is tracked.
According to yet another aspect of the invention, a robotic surgical cutting system is provided. The system includes a robot manipulator and a cutting tool. The robot control system controls or restricts the movement of the cutting tool with at least 5 degrees of freedom. The navigation system communicates with this robot control system. The navigation system includes at least one optical sensor and a tracker attached to the robot manipulator. A tracker attached to the patient's anatomy is also provided. This anatomical tracker has three markers and a non-optical sensor. The optical sensor receives an optical signal from the marker, and the non-optical sensor generates a non-optical signal. The navigation system sends position data indicating the position of the anatomical tissue to the robot control system, and the cutting of the anatomical tissue is controlled so that the cutting is performed within a predetermined boundary.
In accordance with another aspect of the invention, a navigation system is provided that includes a localizer having at least one optical sensor. The tracker communicates with the optical sensor. This tracker includes three markers and a non-optical sensor. The computing system determines the position of each of the three markers in the localizer coordinate system based on the optical and non-optical signals. The computing system executes a matching algorithm to determine the position determined for one or more of the markers in the localizer coordinate system as one or more of the markers in the tracker model defined relative to the tracker coordinate system. The conversion matrix for converting the tracker coordinate system to the localizer coordinate system is obtained by collating with the position of.
In another aspect of the invention, a system for tracking an object is provided. The system includes at least two optical sensors and a tracker attached to the object. This tracker has three markers and a non-optical sensor. These at least two optical sensors receive an optical signal from the marker with an optical-sensing frequency of at least 100 Hz. Non-optical sensors generate non-optical signals with a non-optical sensing frequency of at least 100 Hz.
A method of tracking an object is also provided. The method includes operating an optical sensor to sequentially receive an optical signal from a marker and operating a non-optical sensor to generate a non-optical signal. The position of the first marker among the markers at the first time is obtained based on the first optical signal from the first marker. The positions of the second marker and the third marker among the markers at the first time are obtained based on the first optical signal and the non-optical signal from the non-optical sensor. The positions determined for these first marker, second marker, and third marker are associated with the object to track the position of the object during the surgical procedure.
Another method is provided for tracking a subject during a surgical procedure. In this method, the three markers are positioned in the field of view of the optical sensor so that the optical sensor can sequentially receive optical signals from the three markers. Next, the computing system is operated to determine the position of the first marker at the first time based on the first optical signal from the first marker of the markers, and the first optical signal and the non-optical sensor The positions of the second marker and the third marker among the markers at the first time are obtained based on the non-optical signal from the first time. These locations are then associated with the subject to track the location of the subject during the surgical procedure.
The advantages of the present invention will be readily understood as the invention is better understood by reference to the following detailed description taken in conjunction with the accompanying drawings, in which:
It is a perspective view of the navigation system of the present invention used with a robot manipulator. It is explanatory drawing of a navigation system. It is explanatory drawing of the coordinate system used with a navigation system. 3 is a flowchart of steps performed by a localization engine of a navigation system. It is explanatory drawing which collates the measured LED with a tracker model, and obtains a conversion matrix. 3 is a flow diagram of steps performed by a localization engine in a first alternative embodiment. It is explanatory drawing of the tracker model which has actual LED and virtual LED. 6 is a flowchart of steps performed by a localization engine in a second alternative embodiment. FIG. 4 is a flow diagram of steps performed by a localization engine when measurement of one or more LEDs is interrupted.
[I. Overview]
A surgical navigation system 20 is shown in FIG. System 20 is shown as being for surgery, such as a medical facility operating room. The navigation system 20 is set up to track the movement of various objects in the operating room. Such objects include, for example, the surgical instrument 22, the patient's femur F, and the patient's tibia T. The navigation system 20 controls the movement of the surgical instrument 22 to indicate to the surgeon the relative position and orientation of these objects and, in some cases, relative to a predetermined path or anatomical boundary. Or track the subject to limit.
The surgical navigation system 20 includes a computer cart assembly 24 that houses a navigation computer 26. The navigation interface can communicate with the navigation computer 26. This navigation interface comprises a display 28 located outside the sterile field and a display 29 located inside the sterilization field. Displays 28 and 29 are adjustably attached to computer cart assembly 24. Input devices 30, 32, such as a mouse and keyboard, can be used to input information to the navigation computer 26, or can be used to select or control several aspects of the navigation computer 26. Other input devices including a touch screen (not shown) on the display 28, 29 or voice drive are also contemplated.
Localizer 34 communicates with navigation computer 26. In the illustrated embodiment, the localizer 34 is an optical localizer and includes a camera unit 36. The camera unit 36 has an outer casing 38 that houses one or more optical sensors 40. In some embodiments, at least two optical sensors 40, preferably three optical sensors, are used. These optical sensors 40 can be three separate high-resolution charge-coupled devices (CCDs). In one embodiment, three one-dimensional CCDs are used. It should be appreciated that in other embodiments, separate camera units or separate camera units each having two or more CCDs may be placed in the operating room. The CCD detects an infrared (IR) signal.
The camera unit 36 is attached to an adjustable arm so that the optical sensor 40 is located above the zone where the procedure is to be performed and the tracker field of view described below is provided to the camera unit 36. This field of view is ideally free of obstacles.
The camera unit 36 includes a camera controller 42 that communicates with the optical sensor 40 and receives signals from the optical sensor 40. The camera controller 42 communicates with the navigation computer 26 by either wired connection or wireless connection (not shown). One such connection can be an IEEE 1394 interface, which is a serial bus interface standard for high-speed communication and isochronous real-time data transfer. A company-specific protocol can also be used for connection. In other embodiments, the optical sensor 40 communicates directly with the navigation computer 26.
Position and orientation signals and / or data are sent to the navigation computer 26 to track the object. Computer cart assembly 24, display 28, and camera unit 36 are similar to those described in US Pat. No. 7,725,162, issued May 25, 2010, entitled “Surgery System” to Malackowski et al. Can be. The contents of this US patent are hereby incorporated by reference.
The navigation computer 26 can be a personal computer or a laptop computer. The navigation computer 26 includes a display 28, at least one of a central processing unit (CPU) and another processor, a memory (not shown), and a storage device (not shown). The navigation computer 26 is loaded with software as described below. This software converts the signal received from the camera unit 36 into data representing the position and orientation of the tracking target.
The navigation system 20 includes a plurality of tracking devices 44, 46, 48, also referred to herein as trackers. In the illustrated embodiment, one tracker 44 is rigidly attached to the patient's femur F and another tracker 46 is rigidly attached to the patient's tibia T. The trackers 44 and 46 are firmly attached to the bone portion. Trackers 44, 46 can be attached to femur F in the manner shown in US Pat. No. 7,725,162. The contents of this US patent are hereby incorporated by reference. In another embodiment, an additional tracker (not shown) is attached to the patella to track the position and orientation of the patella. In further embodiments, trackers 44, 46 can be attached to other tissue types or portions of anatomy.
The instrument tracker 48 is firmly attached to the surgical instrument 22. The instrument tracker 48 can be integrated into the surgical instrument 22 at the time of manufacture or can be separately attached to the surgical instrument 22 in preparation for a surgical procedure. The working end of the surgical instrument 22 being tracked can be a rotating bar, an electrical ablation device, or the like. In the illustrated embodiment, the surgical instrument 22 is an end effector of a surgical manipulator. Such a device is shown in US Provisional Patent Application No. 61 / 679,258, entitled “Surgical Manipulator Capable of Controlling a Surgical Instrument in either a Semi-Autonomous Mode or a Manual, Boundary Constrained Mode”. The disclosure of this US provisional patent application is hereby incorporated by reference. Such a device is also shown in US patent application Ser. No. 13 / 958,834 entitled “Navigation System for use with a Surgical Manipulator Operable in Manual or Semi-Autonomous Mode”. The disclosure of this US patent application is hereby incorporated by reference.
The trackers 44, 46, 48 may be battery powered using an internal battery, and preferably have leads that receive power through the navigation computer 26 that receives external power, such as the camera unit 36. You can also.
In other embodiments, the surgical instrument 22 can be manually positioned only by the user's hand without the assistance of any cutting guide, jib, or other constraint mechanism such as a manipulator or robot. Such a surgical instrument is a US Provisional Patent Application No. 61 / 662,070 entitled “Surgical Instrument Including Housing, a Cutting Accessory that Extends from the Housing and Actuators that Establish the Position of the Cutting Accessory Relative to the Housing”. In the issue. The contents of this US provisional patent application are incorporated herein by reference. Such a surgical instrument is also disclosed in U.S. Patent Application No. 13/600, entitled “Surgical Instrument Including Housing, a Cutting Accessory that Extends from the Housing and Actuators that Establish the Position of the Cutting Accessory Relative to the Housing”. No. 888. The contents of this US patent application are hereby incorporated by reference.
The optical sensor 40 of the localizer 34 receives optical signals from the trackers 44, 46 and 48. In the illustrated embodiment, the trackers 44, 46, 48 are active trackers. In this embodiment, each tracker 44, 46, 48 has at least three active markers 50 that send optical signals to the optical sensor 40. The active marker 50 can be a light emitting diode or LED 50. The optical sensor 40 preferably has a sampling rate of 100 Hz or more, more preferably 300 Hz or more, and most preferably 500 Hz or more. In some embodiments, the optical sensor 40 has a sampling rate of 1000 Hz. This sampling rate is a rate at which the optical sensor 40 receives an optical signal from the LEDs 50 that are sequentially turned on. In some embodiments, the light signal from the LED 50 is lit at a different rate for each tracker 44, 46, 48.
As shown in FIG. 2, each of the LEDs 50 is connected to a tracker controller 62 located within the housing (not shown) of the associated tracker 44, 46, 48. This tracker controller transmits and receives data to and from the navigation computer 26. In one embodiment, the tracker controller 62 transmits data on the order of several megabytes / second via a wired connection with the navigation computer 26. In other embodiments, a wireless connection can be used. In these embodiments, the navigation computer 26 includes a transceiver (not shown) that receives data from the tracker controller 62.
In other embodiments, the trackers 44, 46, 48 may have passive markers (not shown) such as reflectors that reflect light emitted from the camera unit 36. The reflected light is received by the optical sensor 40. Active and passive devices are well known in the art.
Each of the trackers 44, 46, 48 also includes a three-dimensional gyroscope sensor 60 that measures the angular velocity of the trackers 44, 46, 48. As is well known to those skilled in the art, the gyroscope sensor 60 outputs a reading indicating the angular velocity with respect to the x-axis, y-axis, and z-axis of the gyroscope coordinate system. These readings are multiplied by a conversion constant determined by the manufacturer to obtain measurements in degrees / second for each of the x-axis, y-axis, and z-axis of the gyroscope coordinate system. And these measured values are angular velocity vectors defined in radians / second.
The angular velocity measured by the gyroscope sensor 60 provides additional non-optical based kinematic data as the navigation system 20 tracks the trackers 44, 46, 48. The gyroscope sensor 60 can be oriented along the axis of each coordinate system of the trackers 44, 46, 48. In other embodiments, each gyroscope coordinate system has its tracker coordinates such that the gyroscope data reflects the angular velocities about the x-axis, y-axis, and z-axis of the tracker 44, 46, 48 coordinate system. It is converted into a system.
Each of the gyroscope sensors 60 communicates with a tracker controller 62 that is within the housing of the associated tracker. This tracker controller transmits and receives data to and from the navigation computer 26. The navigation computer 26 has one or more transceivers (not shown) that receive data from the gyroscope sensor 60. This data can be received by either a wired connection or a wireless connection.
The gyroscope sensor 60 preferably has a sampling rate of 100 Hz or higher, more preferably 300 Hz or higher, and most preferably 500 Hz or higher. In some embodiments, the gyroscope sensor 60 has a sampling rate of 1000 Hz. The sampling rate of the gyroscope sensor 60 is a rate at which a signal is sent from the gyroscope sensor 60 for conversion into angular velocity data.
The sampling rates of the gyroscope sensor 60 and the optical sensor 40 are set or timed so that for each optical measurement of position, there is a corresponding non-optical measurement of angular velocity.
Each of the trackers 44, 46, 48 also includes a three-axis accelerometer 70 that measures acceleration along each of the x-axis, y-axis, and z-axis of the accelerometer coordinate system. The accelerometer 70 provides additional non-optical based data as the navigation system 20 tracks the trackers 44, 46, 48.
Each of the accelerometers 70 communicates with a tracker controller 62 within the associated tracker housing. This tracker controller transmits and receives data to and from the navigation computer 26. One or more of the navigation computer transceivers (not shown) receive data from the accelerometer 70.
The accelerometer 70 can be oriented along the axis of each coordinate system of the trackers 44, 46, 48. In other embodiments, each accelerometer coordinate system has its tracker coordinates such that the accelerometer data reflects the acceleration with respect to the x, y, and z axes of the tracker 44, 46, 48 coordinate system. It is converted into a system.
The navigation computer 26 includes a navigation processor 52. The camera unit 36 receives optical signals from the LEDs 50 of the trackers 44, 46, and 48, and outputs signals related to the positions of the LEDs 50 of the trackers 44, 46, and 48 with respect to the localizer 34 to the processor 52. The gyroscope sensor 60 sends a non-optical signal related to the three-dimensional angular velocity measured by the gyroscope sensor 60 to the processor 52. Based on the received optical and non-optical signals, the navigation processor 52 generates data indicating the relative positions and orientations of the trackers 44, 46, 48 with respect to the localizer 34.
It should be understood that the navigation processor 52 can include one or more processors that control the operation of the navigation computer 26. These processors can be any type of microprocessor system or multiprocessor system. The term processor is not intended to limit the scope of the invention to a single processor.
Additional data is loaded into the navigation processor 52 prior to the start of the surgical procedure. Based on the position and orientation of the trackers 44, 46, 48 and the pre-loaded data, the navigation processor 52 determines the position of this working end relative to the tissue to which the working end of the surgical instrument 22 is applied. And the orientation of the surgical instrument 22 is determined. In some embodiments, the navigation processor 52 sends these data to the manipulator controller 54. The manipulator controller 54 is described in US Provisional Patent Application No. 61 / 679,258 entitled “Surgical Manipulator Capable of Controlling a Surgical Instrument in either a Semi-Autonomous Mode or a Manual, Boundary Constrained Mode”. As described in US patent application Ser. No. 13 / 958,834 entitled “Navigation System for use with a Surgical Manipulator Operable in Manual or Semi-Autonomous Mode”, The robot manipulator 56 can be controlled. The disclosures of these US provisional patent applications and US patent applications are hereby incorporated by reference.
The navigation processor 52 also generates an image signal that indicates the position of the surgical instrument working end relative to the surgical site. These image signals are applied to the displays 28 and 29. The displays 28 and 29 generate an image based on these signals. These images allow surgeons and staff to see the relative position of the surgical instrument working end relative to the surgical site. The displays 28, 29 can include a touch screen or other input / output device that allows entry of commands, as described above.
[II. Coordinate system and transformation]
As shown in FIG. 3, object tracking is generally performed with reference to a localizer coordinate system LCLZ. The localizer coordinate system has an origin and a direction (combination of x axis, y axis, and z axis). One goal during the procedure is to keep the localizer coordinate system LCLZ stationary. As will be described further below, the accelerometer attached to the camera unit 36 may cause a sudden movement or unexpected movement of the localizer coordinate system LCLZ, such as may occur when the camera unit 36 is inadvertently bumped by a surgical person. Can be used to track movement.
Each tracker 44, 46, 48 and tracked object also has its own coordinate system, separate from the localizer coordinate system LCLZ. Components of the navigation system 20 having a unique coordinate system are bone trackers 44, 46 and an instrument tracker 48. These coordinate systems are represented as a bone tracker coordinate system BTRK1, BTRK2, and an instrument tracker coordinate system TLTR, respectively.
The navigation system 20 monitors the position of the patient's femur F and tibia T by monitoring the position of the bone trackers 44, 46 firmly attached to the bone. The femur coordinate system is FBONE, and the tibia coordinate system is TBONE. These coordinate systems are bone coordinate systems to which the bone trackers 44 and 46 are firmly attached.
Prior to the start of the procedure, preoperative images of the femur F and tibia T (or preoperative images of other tissues in other embodiments) are generated. These images can be based on an MRI scan, a radiation scan, or a computed tomography (CT) scan of the patient's anatomy. These images are mapped to the femur coordinate system FBONE and the tibial coordinate system TBONE using methods well known in the art. In one embodiment, using a pointer device P as disclosed in US Pat. No. 7,725,162 to Malackowski et al. With its own tracker PT (see FIG. 2), the femoral coordinate system FBONE and The tibial coordinate system TBONE can be mapped to the preoperative image. The contents of this US patent are hereby incorporated by reference. These images are fixed in the femur coordinate system FBONE and the tibial coordinate system TBONE.
In the early stages of the procedure, the bone trackers 44, 46 are firmly attached to the patient's bone. The postures (position and orientation) of the coordinate systems FBONE and TBONE are mapped to the coordinate systems BTRK1 and BTRK2, respectively. Given a fixed relationship between the bones and the bone trackers 44, 46, the postures of the coordinate systems FBONE and TBONE are kept fixed with respect to the coordinate systems BTRK1 and BTRK2, respectively, throughout the procedure. . Data representing this posture is stored in a memory integrated with both the manipulator controller 54 and the navigation processor 52.
The working end of surgical instrument 22 (also called the distal end of the energy applicator) has its own coordinate system EAPP. The origin of the coordinate system EAPP can represent, for example, the center of gravity of the surgical cutting bar. The posture of the coordinate system EAPP is fixed to the posture of the instrument tracker coordinate system TLTR before the treatment is started. Accordingly, the postures of these coordinate systems EAPP and TLTR with respect to each other are determined. Data representing this posture is stored in a memory integrated with both the manipulator controller 54 and the navigation processor 52.
[III. software]
As shown in FIG. 2, the localization engine (position measurement engine) 100 is a software module that can be regarded as a part of the navigation system 20. The elements of the localization engine 100 operate on the navigation processor 52. In some forms of the invention, the localization engine 100 can operate on the manipulator controller 54.
The localization engine 100 receives as input an optical-based signal from the camera controller 42 and a non-optical-based signal from the tracker controller 62. Based on these signals, the localization engine 100 obtains the postures (position and orientation) of the bone tracker coordinate systems BTRK1 and BTRK2 in the localizer coordinate system LCLZ. Based on similar signals received for the instrument tracker 48, the localization engine 100 determines the attitude of the instrument tracker coordinate system TLTR in the localizer coordinate system LCLZ.
The localization engine 100 sends a signal representing the posture of the trackers 44, 46, 48 to the coordinate conversion unit 102. The coordinate conversion unit 102 is a navigation system software module that operates on the navigation processor 52. The coordinate conversion unit 102 refers to data that defines the relationship between the preoperative image of the patient and the trackers 44 and 46 of the patient. The coordinate conversion unit 102 also stores data indicating the posture of the working end of the surgical instrument with respect to the instrument tracker 48.
During the treatment, the coordinate conversion unit 102 receives data indicating the relative postures of the trackers 44, 46, and 48 with respect to the localizer 34. Based on these data and preloaded data, the coordinate transformation unit 102 generates data indicating the relative position and orientation of the coordinate system EAPP and the bone coordinate systems FBONE and TBONE with respect to the localizer coordinate system LCLZ. .
Then, the coordinate conversion unit 102 generates data indicating the position and orientation of the working end of the surgical instrument 22 with reference to a tissue (for example, bone) to which the instrument working end is applied. Image signals representing these data are sent to displays 28, 29 where the surgeon and staff can review this information. In one embodiment, another signal representing these data can be sent to the manipulator controller 54 to control the manipulator 56 and the movement of the corresponding surgical instrument 22.
Since the steps for obtaining the postures of the tracker coordinate systems BTRK1, BTRK2, and TLTR in the localizer coordinate system LCLZ are the same, only one will be described in detail. The steps shown in FIG. 4 are based on only one active tracker, ie tracker 44 only. In the following description, the LEDs of the tracker 44 are represented by reference numerals 50a, 50b, and 50c indicating the first LED 50a, the second LED 50b, and the third LED 50c.
The steps described in FIG. 4 illustrate the determination of the position of the LEDs 50a, 50b, 50c of the tracker 44 using optical and non-optical based sensor data. From these positions, the navigation processor 52 can determine the position and orientation of the tracker 44, and therefore the position and orientation of the femur F to which the tracker is attached. Optical-based sensor data derived from signals received from the optical sensor 40 provides line-of-sight data depending on the line of sight between the LEDs 50a, 50b, 50c and the optical sensor 40. On the other hand, the gyroscope sensor 60 that provides non-optical based signals for generating non-optical based sensor data is not line-of-sight dependent and two of the LEDs 50a, 50b, 50c are not being measured. Better approximate the position of the LEDs 50a, 50b, 50c at times (because only one LED is measured at a time) or when one or more of the LEDs 50a, 50b, 50c are not visible from the optical sensor 40 during treatment Therefore, it can be incorporated in the navigation system 20.
First, in an initialization step 200, the system 20 measures the positions of the LEDs 50a, 50b, 50c for the tracker 44 in the localizer coordinate system LCLZ and determines initial position data. These measurements are performed by sequentially lighting the LEDs 50a, 50b, and 50c. By this lighting, an optical signal is sent to the optical sensor 40. When the optical signal is received by the optical sensor 40, a corresponding signal is generated by the optical sensor 40 and sent to the camera controller 42. The frequency during lighting of LED50a, 50b, 50c is 100 Hz or more, Preferably it is 300 Hz or more, More preferably, it is 500 Hz or more. In some cases, the frequency during lighting is 1000 Hz, that is, the lighting interval is 1 millisecond.
In some embodiments, the optical sensor 40 can read only one LED at a time. The camera controller 42 is connected to the LED 50a through one or more infrared transceivers or RF transceivers (on the camera unit 36 and tracker 44) as described in US Pat. No. 7,725,162 to Malackowski et al. The lighting of 50b and 50c can be controlled. The contents of this US patent are hereby incorporated by reference. Alternatively, the tracker 44 can be activated locally (such as by a switch on the tracker 44), and when activated, the LEDs 50a, 50b, 50c are lit in sequence without a command from the camera controller 42.
Based on the input from the optical sensor 40, the camera controller 42 generates a raw position signal. This position signal is then sent to the localization engine 100 to determine the position of each of the corresponding three LEDs 50a, 50b, 50c in the localizer coordinate system LCLZ.
In the initialization step 200, in order to establish initial position data, the movement of the tracker 44 must be less than a predetermined threshold. The predetermined threshold value is stored in the navigation computer 26. The initial position data established in step 200 essentially provides a static snapshot of the position of the three LEDs 50a, 50b, 50c at the initial time t0 that is the basis for the remaining steps in the process. . At initialization, the speeds of the LEDs 50a, 50b, 50c are calculated by the localization engine 100 between cycles (ie, each set of three LED measurements) to ensure that these speeds are sufficiently low, ie, not moving substantially. If it is less than the predetermined threshold value shown, this initial position data or static snapshot is established. In some embodiments, the predetermined threshold (also referred to as a static speed limit) is 200 mm / s or less along any axis, preferably 100 mm / s or less, more preferably 10 mm / s or less. If the predetermined threshold is 100 mm / s, the calculated speed must be less than 100 mm / s in establishing a static snapshot.
As shown in FIGS. 4 and 4A, once a static snapshot is obtained, in step 202, the measured positions of LEDs 50a, 50b, 50c are compared to the tracker 44 model. This model is data stored in the navigation computer 26. This model data indicates the position of the LED of the tracker 44 in the tracker coordinate system BTRK1. The system 20 stores the number and position of the LEDs 50 of each tracker 44, 46, 48 in the coordinate system of each tracker. In the case of the trackers 44, 46 and 48, the origin of their coordinate system is set to the center of gravity of all the LED positions of the tracker 44.
The localization engine 100 utilizes a rigid body matching algorithm or a point matching algorithm to measure the measured LEDs 50a, 50b, 50c in the localizer coordinate system LCLZ with the LEDs in the stored model. Match. When the best fit is sought, the localization engine 100 evaluates the deviation of this fit and determines whether the measured LEDs 50a, 50b, 50c are within the stored predetermined tolerance of the model. Judging. This tolerance can be based on the distance between corresponding LEDs so that if the fit results in an excessively large distance, the initialization step must be repeated. In some embodiments, the LED position should not deviate more than 2.0 mm from the model, preferably not more than 0.5 mm, more preferably more than 0.1 mm. It should not deviate significantly.
If the fit is within a predetermined tolerance, a transformation matrix is generated in step 204 that transforms any other unmeasured LED in the model from the bone tracker coordinate system BTRK1 to the localizer coordinate system LCLZ. The This step is utilized when four or more LEDs are used or when virtual LEDs are used, as further described below. In some embodiments, the trackers 44, 46, 48 may have four or more LEDs. When all positions in the localizer coordinate system LCLZ are established, an LED cloud is created. This LED cloud is based on the positions of all LEDs 50a, 50b, 50c in the localizer coordinate system LCLZ on the x-axis, y-axis, and z-axis, and all the LEDs 50a, 50b, 50c on the tracker 44 in the localizer coordinate system LCLZ. Arrangement.
Once the LED cloud is established, the navigation system 20 can continue tracking the tracker 44 during the surgical procedure. As explained above, this involves turning on the next LED in the sequence. As an example, the LED 50a is turned on. Therefore, the LED 50 a sends an optical signal to the optical sensor 40. When these optical signals are received by the optical sensor 40, corresponding signals are generated by the optical sensor 40 and sent to the camera controller 42.
Based on the input from the optical sensor 40, the camera controller 42 generates a raw position signal. This raw position signal is then sent to the localization engine 100, and at time t1, a new position of the LED 50a relative to the x-axis, y-axis, and z-axis of the localizer coordinate system LCLZ is determined. This is shown in step 206 as a new LED measurement.
t0, t1,. . . The designation of time, such as tn, is used as an example showing different times or different time ranges or time periods, and recognizes that the invention is not limited to any particular time or limited time. It should be.
Once the new position of the LED 50a is determined, at step 208, the localization engine 100 can calculate the linear velocity vector of the LED 50a.
The tracker 44 is treated as a rigid body. Therefore, the linear velocity vector of the LED 50a is a vector amount equal to the time rate of change of the linear position. This velocity in the localizer coordinate system LCLZ can be calculated from the previously measured position and time of the LED in the localizer coordinate system LCLZ and the currently measured position and time, even for the acceleration of each LED. . The previously measured position and time of the LED and the current measured position and time define the history of the LED's position. The speed calculation of the LED 50a can take the simplest form as follows.
, And the which is the measured position in the previous LED50a at time t p. And
, And the this is the position that is currently measured in LED50a at time t n. As is well known to those skilled in the art, at least one of the speed and acceleration of each LED can also be obtained by data fitting of the LED position history of that LED.
At time t1, at step 210, the gyroscope sensor 60 also measures the angular velocity of the tracker 44. The gyroscope sensor 60 sends a signal related to this angular velocity to the tracker controller 62.
The tracker controller 62 then sends corresponding signals to the localization engine 100, which then uses the angular velocity vector from these signals.
To be able to calculate In step 210, the gyroscope coordinate system is also converted to the bone tracker coordinate system BTRK1, and the angular velocity vector calculated by the localization engine 100 is calculated.
Is represented in the bone tracker coordinate system BTRK1.
In step 212, the position vector
Relative velocity vector about the origin of the bone tracker coordinate system BTRK1
Is calculated. This position vector
Are also stored in memory within the navigation computer 26 for access by the localization engine 100 for subsequent calculations. This calculation is based on the angular velocity vector derived from the gyroscope signal.
And the relative velocity of the origin of the bone tracker coordinate system BTRK1 by calculating the outer product of the LED 50a and the position vector with respect to the origin.
Next, the localization engine 100 determines the relative velocity vectors for the remaining unmeasured LEDs 50b, 50c (these LEDs are not lit, and therefore their position has not been measured, and thus have not been measured).
Calculate These velocity vectors can be calculated with respect to the origin of the bone tracker coordinate system BTRK1.
Relative velocity vector for each unmeasured LED 50b, 50c at time t1
The calculation performed by the localization engine 100 to determine is the angular velocity vector at time t1
And the position vector
And based on the outer product. These position vectors are taken from the origin of the bone tracker coordinate system BTRK1 toward the unmeasured LEDs 50b and 50c. These position vectors
Are stored in memory within the navigation computer 26 for access by the localization engine 100 for subsequent calculations.
In step 212, these relative velocities calculated in the bone tracker coordinate system BTRK1 are changed to the localizer coordinate system LCLZ using the transformation matrix obtained in step 202. The relative velocity in the localizer coordinate system LCLZ is used for the calculation in step 214.
In step 214, the velocity vector at the origin of the bone tracker coordinate system BTRK1 in the localizer coordinate system LCLZ at time t1.
Is the measured velocity vector of LED 50a at time t1
Is first calculated by the localization engine 100. This velocity vector
Is the velocity vector of LED 50a at time t1
And the relative velocity vector of the origin at time t1 expressed with reference to the position vector of the LED 50a with respect to the origin
Is calculated by adding Therefore, the velocity vector at the origin at time t1 is calculated as follows.
Next, the velocity vectors of the remaining unmeasured LEDs in the localizer coordinate system LCLZ at time t1 are used as the velocity vector of the origin of the bone tracker coordinate system BTRK1 in the localizer coordinate system LCLZ at time t1.
And the respective relative velocity vectors at time t1, expressed relative to those position vectors having the origin of the bone tracker coordinate system BTRK1, can be calculated by the localization engine 100. Each velocity vector at time t1 is calculated as follows.
In step 216, the localization engine 100 determines the movement from time t0 to time t1, ie, the change in position Δx (in Cartesian coordinates) for each unmeasured LED 50b, 50c, and the calculated velocity vector of the LED 50b, 50c. Calculate based on time change. Depending on the embodiment, the time change Δt of measurement of each LED is 2 milliseconds or less, and may be 1 millisecond or less.
These calculated changes in position (x, y, z) can then be added to previously determined positions for each of the LEDs 50b, 50c in the localizer coordinate system LCLZ. Thus, in step 218, the amount of change in position can be added to the previous position of LEDs 50b, 50c at time t0 determined during the static snapshot. This is expressed as follows.
In step 220, these positions calculated for each of the LEDs 50b, 50c at time t1 are combined with the determined position of LED 50a at time t1. Next, the newly determined positions for the LEDs 50a, 50b, 50c are checked against the model of the tracker 44 using a point matching algorithm or a rigid body matching algorithm to obtain the best fit. If this best fit is within the specified tolerance of the system 20, then a new transformation matrix is obtained by the navigation processor 52 to associate the bone tracker coordinate system BTRK1 with the localizer coordinate system LCLZ.
In step 222, using the new transformation matrix, the newly calculated position for the unmeasured LEDs 50b, 50c is adjusted to the model to obtain an adjusted position. The position measured for the LED 50a can also be adjusted by a matching algorithm so that it is also recalculated. These adjustments are considered updates to the LED cloud. In some embodiments, the position measured for LED 50a is fixed to the model position of LED 50a during the matching process.
When the best-fit conversion is completed, the coordinate conversion unit 102 is determined by the measured (and possibly adjusted) position of the LED 50a in the localizer coordinate system LCLZ and the calculated (and adjusted) positions of the LEDs 50b and 50c. Can determine the new position and orientation of the femur F based on the above-described relationship among the femur coordinate system FBONE, the bone tracker coordinate system BTRK1, and the localizer coordinate system LCLZ.
Thereafter, Steps 206 to 222 are repeated at the next time t2, and start from the measurement of the LED 50b in the localizer coordinate system LCLZ. LEDs 50a and 50c are unmeasured LEDs. Each time t1, t2. . . As a result of this loop at tn, the position of each LED 50a, 50b, 50c is measured (one LED is lit at each time) or calculated, and this calculated position is determined by the optical sensor 40 and the gyroscope. A very accurate approximation is made based on measurements by the sensor 60. This loop of steps 206-222 for determining the new position of the LED 50 can be performed by the localization engine 100 at a frequency of at least 100 Hz, more preferably at least 300 Hz, and most preferably at least 500 Hz.
As shown in FIG. 5, the LED cloud may include virtual LEDs. Such a virtual LED is a predetermined point specified on the model, and does not actually correspond to a physical LED in the tracker 44. These points are also located at times t1, t2,. . . , Tn. These virtual LEDs can be calculated in the same way as unmeasured LEDs as in FIG. The only difference is that the virtual LED is never lit or included in a series of optical measurements. This is because a virtual LED does not correspond to any light source and is essentially just a virtual one. Steps 300-322 show the steps used to track the trackers 44, 46, 48 using real and virtual LEDs. Steps 300 to 322 generally correspond to steps 200 to 222 except that virtual LEDs are added. Virtual LEDs are treated in the same way as unmeasured LEDs using the same formulas described above.
One purpose of using virtual LEDs in addition to LEDs 50a, 50b, 50c is, for example, to reduce the effects of errors in the speed calculation described above. These errors have little effect on the calculated position of the LEDs 50a, 50b, 50c, but this error increases as the point of interest is located farther from the LEDs 50a, 50b, 50c. there is a possibility. For example, when tracking a femur F having a tracker 44, the LEDs 50a, 50b, 50c incorporated in the tracker 44 may experience a slight error of about 0.2 millimeters for their calculated position. In contrast, consider the surface of the femur F that may be located more than 10 centimeters away from the LEDs 50a, 50b, 50c. A slight error of 0.2 millimeters in the LEDs 50a, 50b, 50c can result in an error of 0.4 millimeters to 2 millimeters on the surface of the femur F. This error increases as the femur F is located farther away from the LEDs 50a, 50b, 50c. By using virtual LEDs in the steps of FIG. 5, such potential amplification of errors can be reduced as described below.
As shown in FIG. 5A, one virtual LED 50d may be located on the surface of the femur F. The other virtual LEDs 50e, 50f, 50g, 50h, 50i, 50j, 50k are located along the x-axis, y-axis, z-axis, respectively, and both sides of the origin along these axes to obtain 6 virtual LEDs Can be located at random locations in the bone tracker coordinate system BTRK1. These virtual LEDs are shown in FIG. 5A and are included as part of the model of tracker 44 used in steps 302 and 320. In some embodiments, only virtual LEDs 50e-50k are used. In other embodiments, the virtual LED is a location along each of the x-axis, y-axis, and z-axis, but can be positioned at a different distance from the origin of the bone tracker coordinate system BTRK1. In another further embodiment, some or all of the virtual LEDs may be located away from the x-axis, y-axis, z-axis.
At this time, the model includes actual LEDs 50a, 50b, and 50c and virtual LEDs 50d to 50k. Each time t1, t2,. . . , Tn, this extended model is checked in step 320 with the measured and calculated positions for the actual LEDs 50a, 50b, 50c and the positions calculated for the virtual LEDs 50d-50k, and the bone tracker coordinate system BTRK1 is represented in the localizer coordinate system. A transformation matrix associated with LCLZ is obtained. At this time, if the virtual LEDs 50d to 50k included in the model located at positions away from the actual LEDs 50a, 50b, and 50c are used, errors in the rotation matrix can be reduced. In essence, the rigid body matching algorithm or point matching algorithm has additional points that are used for matching, some of these additional points being outside the points that define the actual LEDs 50a, 50b, 50c. Since it is located radially, the collation is rotationally stable.
In another variation of the process of FIG. 5, the location of the virtual LEDs 50e-50k can be dynamically changed in use in response to the movement of the tracker 44. The calculated positions of unmeasured actual LEDs 50b, 50c and virtual LEDs 50e-50k at time t1 become more accurate as the tracker 44 moves slower. Therefore, the locations of the virtual LEDs 50e to 50k along the x-axis, y-axis, and z-axis with respect to the origin of the bone tracker coordinate system BTRK1 can be adjusted based on the speed of the tracker 44. Therefore, the locations of the virtual LEDs 50e to 50k are (s, 0, 0), (−s, 0, 0), (0, s, 0), (0, −s, 0), (0, 0, respectively). s), represented by (0, 0, -s), s increases when the tracker 44 moves at a low speed and decreases to a smaller value when the tracker 44 moves at a higher speed. This can be handled by an empirical formula for s, or s can be adjusted based on an estimate of the velocity error and the calculated position.
Determining the new position of the LED 50 (real and virtual) can be performed at a frequency of at least 100 Hz, more preferably at least 300 Hz, and most preferably at least 500 Hz.
Data from accelerometer 70 can be used in situations where optical measurements of LED 50 are disturbed by line of sight interference. If the LED to be measured is obstructed, the localization engine 100 estimates the position assuming a constant velocity at the origin. However, the constant velocity assumption in this situation may be inaccurate, resulting in errors. The accelerometer 70 essentially monitors whether the constant velocity assumption in that time period is correct. The steps shown in FIGS. 6 and 7 show how to confirm this assumption.
Continuing to use the tracker 44 as an example, steps 400-422 in FIG. 6 generally correspond to steps 300-322 in FIG. However, in step 424, the system 20 determines whether there are fewer than three LEDs measured in the last measurement cycle. Less than 3 measured LEDs means that one or more LEDs could not be measured in this cycle. This may occur due to a line of sight problem or the like. The tracker 44 cycle is the last three measurements attempted. If the LEDs 50a, 50b, 50c are visible and measured during the last three measurements, the system 20 proceeds to step 408 and continues processing as described with respect to FIG.
If the system 20 determines that one or more of the LEDs 50a, 50b, 50c cannot be measured in this cycle, i.e., the measurement has been disturbed, the algorithm still proceeds to step 408. However, if the new LED to be measured in step 406 is not measurable, the system makes some speed assumptions as described below.
In step 406, if an LED, such as LED 50a, is not visible from the optical sensor 40 at the measurement time tn, the previously calculated velocity for the origin of the tracker 44 in the localizer coordinate system LCLZ at the previous time t (n-1). vector
Is assumed to remain constant. Therefore, the velocity vectors of the LEDs 50a, 50b, 50c in the localizer coordinate system LCLZ are the previously calculated velocity vectors in the localizer coordinate system LCLZ.
And the relative velocity vectors of the LEDs 50a, 50b, 50c derived from the newly measured angular velocity vectors from the gyroscope 60. The equations described in steps 316-322 can then be used to determine the new position of the LEDs 50a, 50b, 50c.
First, the LED 50a will be measured in step 406, but if it is obstructed, it is assumed that the origin velocity vector is the same as in the previous calculation. Accordingly, the speed of the new LED is not calculated in step 408.
Step 410 is performed in the same manner as step 310.
Relative velocity vector of LEDs 50a, 50b, 50c calculated in step 412
Is the previous velocity vector in this case
And the newly measured angular velocity vector from the gyroscope 60 in the bone tracker coordinate system BTRK1.
In step 414, the velocity vector in the localizer coordinate system LCLZ is the origin velocity vector.
And the relative velocity vector of the LEDs 50a, 50b, 50c
And can be calculated using
Steps 416 to 422 are performed in the same manner as steps 316 to 322.
In step 424, if the system 20 determines that one or more of the LEDs 50a, 50b, 50c cannot be measured during a cycle, i.e., the measurement is disturbed, the LEDs 50a, 50b, 50c in that cycle. Another algorithm is executed simultaneously in steps 500 to 506 shown in FIG. 7 until a complete measurement cycle has been made, all of which is visible from the optical sensor 40. System 20 is considered to be in a “jamming” state until a complete cycle with all visible measurements is made.
Steps 500-506 are continuously performed while the system 20 is in a disturbed state.
In step 500, the navigation processor 52 starts a clock that tracks how long the system 20 has been disturbed. The time in the disturbing state is hereinafter referred to as t (blocked).
In step 502, the accelerometer 70 measures acceleration along the x-axis, y-axis, and z-axis of the bone tracker coordinate system BTRK1 and tracks errors in the constant velocity assumption. The accelerometer reading is converted from the accelerometer coordinate system to the bone tracker coordinate system BTRK1, similar to the gyroscope reading.
If the accelerometer 70 detects acceleration (s) that exceed a predetermined acceleration tolerance (s), the navigation computer 26 places the system 20 in an error state. These allowable acceleration ranges can be defined differently along each x-axis, y-axis, and z-axis, or can be the same along each axis. If the measured acceleration exceeds an acceptable range, the constant velocity assumption cannot be relied upon and cannot be used for that particular application of surgical navigation. Different tolerances can be used depending on the application. For example, at the time of cutting by a robot, the allowable range can be made very small. On the other hand, in the case of only visual navigation, that is, when feedback is not provided to the cutting control loop, the allowable range can be set larger.
In step 504, the speed error associated with the position of the LED 50 relative to the optical sensor 40 is taken into account and monitored when in a disturbed state. For each of the LEDs 50, the speed error v error multiplied by the disturbed time t blocked condition must be smaller than the position error tolerance γ to prevent the system 20 from going into an error state. Therefore, the following formula must be satisfied.
In this equation, the speed error v error is calculated as follows for each of the LEDs 50a, 50b, and 50c.
Position errors x error (t) and x error (t-1) are predetermined position errors in system 20 based on location relative to optical sensor 40 at times t and t-1. In essence, the potential position error increases as the LEDs 50a, 50b, 50c are located farther away from the optical sensor 40. These position errors are derived experimentally or theoretically and placed in a look-up table or as an equation. An associated position error is then provided at each position of the LEDs 50a, 50b, 50c in Cartesian coordinates (x, y, z).
In step 504, the localization engine 100 accesses this lookup table or calculates this formula to determine the position error for each of the LEDs 50a, 50b, 50c at the current time t and the previous time t-1. . The position error is thus based on the Cartesian position in the localizer coordinate system LCLZ calculated by the system 20 at step 422 for the current time t and the previous time t-1. The time variable Δt represents the time required for subsequent position calculations and therefore represents the difference between t and t−1, which can be, for example, 1 millisecond.
The position error tolerance γ is predetermined by the navigation computer 26 in preparation for access by the localization engine 100. The position error tolerance γ can be expressed in millimeters. The position error tolerance γ can be from 0.001 millimeters to 1 millimeter, and in some embodiments is set to 0.5 millimeters in particular. When the position error tolerance γ is set to 0.5 millimeters, the following equation must be satisfied.
As described above, the longer the disturbing state of the system 20, the greater the effect that the time variable has in this equation, and therefore the allowable speed error is smaller. In some embodiments, this equation is calculated by the localization engine 100 separately at step 504 for each of the LEDs 50a, 50b, 50c. In another embodiment, depending on how closely the LEDs 50a, 50b, 50c are positioned on the tracker 44, only one of the LEDs 50a, 50b, 50c has a speed error to determine suitability. Used in this calculation.
In step 506, if the error (s) exceed the position error tolerance γ, the system 20 is put into an error state. In such a state, for example, any control or movement of the cutting tool or ablation tool is stopped and the function of those tools is stopped.
[IV. Other Embodiments]
In one embodiment, when each of the trackers 44, 46, 48 is being actively tracked, the lighting of the LED is one LED of the tracker 44 is lit, then one LED of the tracker 46 is lit, then , One LED of the tracker 48 is lit, then the second LED of the tracker 44 is lit, then the second LED of the tracker 46 is lit, and so on until all the LEDs are lit. And this sequence is repeated. This lighting sequence can be performed through a command signal sent from the transceiver (not shown) of the camera unit 36 to the transceivers (not shown) of the trackers 44, 46, and 48.
The navigation system 20 is used in a closed loop fashion and can control the surgical procedure performed by the surgical cutting instrument. A tracker 50 is provided on both the instrument 22 and the anatomy being cut so that the navigation system 20 can track the position and orientation of the instrument 22 and the anatomy being cut, such as bone.
In one embodiment, the navigation system is part of a robotic surgical system that treats tissue. In some forms, the robotic surgical system is a robotic surgical cutting system that cuts tissue material from a patient's anatomy, such as bone or soft tissue. This cutting system is used to prepare bones for surgical implants such as hip implants and unicompartmental knee implants, bicompartmental knee implants, or knee implants including total knee implants. be able to. Some of these types of implants are shown in US patent application Ser. No. 13 / 530,927 entitled “Prosthetic Implant and Method of Implantation”. The disclosure of this US patent application is hereby incorporated by reference.
The robotic surgical cutting system includes a manipulator (see, for example, FIG. 1). The manipulator has a plurality of arms and a cutting tool carried by at least one of the plurality of arms. The robot control system controls or restricts the movement of the cutting tool with at least 5 degrees of freedom. An example of such a manipulator and control system is described in US Provisional Patent Application No. 61 / 679,258 entitled “Surgical Manipulator Capable of Controlling a Surgical Instrument in either a Semi-Autonomous Mode or a Manual, Boundary Constrained Mode”. It is also shown in US patent application Ser. No. 13 / 958,834 entitled “Navigation System for use with a Surgical Manipulator Operable in Manual or Semi-Autonomous Mode”. The disclosures of these US provisional patent applications and US patent applications are hereby incorporated by reference.
In this embodiment, the navigation system 20 communicates with a robot control system (which may include a manipulator controller 54). The navigation system 20 exchanges at least one of position data and orientation data with the robot control system. At least one of these position data and orientation data indicates at least one of the position and orientation of the instrument 22 with respect to the anatomical tissue. This communication provides a closed loop control that controls the cutting so that the cutting of the anatomy is performed within a predetermined boundary.
In this embodiment, each time an LED measurement is made, the manipulator movement can be made in conjunction with the LED measurement so that there is a corresponding movement of the instrument 22 by the manipulator 56. However, this is not always the case. For example, there is a delay between the most recent LED measurement and movement by the manipulator 56 such that at least one of position data and orientation data sent from the navigation computer 26 to the manipulator 56 due to control loop operation is unreliable. There is a case. In such cases, the navigation computer 26 can be configured to also transmit kinematic data to the manipulator controller 54. Such kinematic data includes previously determined linear and angular velocities for trackers 44, 46, 48. Since these velocities are already known, the position can be calculated based on the time delay. The manipulator controller 54 can then calculate the position and orientation of the trackers 44, 46, 48 to control the movement of the manipulator 56, and thus the instrument 22 (at least one of the femur F and tibia T). Or the relative position and orientation of the instrument tip).
In this embodiment, the instrument 22 is held by the manipulator or other robot shown in FIG. 1 that provides some form of mechanical constraint on the movement. This constraint limits the movement of the instrument 22 within a predetermined boundary. If the instrument 22 deviates beyond a predetermined boundary, control is sent to the instrument 22 to stop cutting.
When both the instrument 22 and the anatomical tissue to be cut are tracked in real time in these systems, the need to firmly fix the anatomical tissue in place can be eliminated. Since both the instrument 22 and the anatomy are tracked, the control of the instrument 22 can be adjusted based on at least one of the relative position and orientation of the instrument 22 relative to the anatomy. Also, the instrument 22 and anatomical representation on the display can be moved relative to each other, emulating their real-world movement.
In one embodiment, each of the femur F and tibia T has a target volume of tissue material that is removed by the working end of the surgical instrument 22. These target volumes are defined by one or more boundaries. These boundaries define the bone surface that should remain after the procedure. In some embodiments, as disclosed in provisional patent application No. 61 / 679,258 entitled “Surgical Manipulator Capable of Controlling a Surgical Instrument in either a Semi-Autonomous Mode or a Manual, Boundary Constrained Mode” The system 20 tracks and controls the surgical instrument 22 to ensure that the working end, eg, a bar, removes only the target volume of tissue material and does not expand beyond the boundary. The contents of the provisional patent application are incorporated herein by reference.
In the described embodiment, the instrument 22 is controlled by utilizing data generated by the coordinate converter 102 that indicates the position and orientation of the bar or other cutting tool relative to the target volume. By knowing their relative position, the surgical instrument 22 or the manipulator to which it is attached can be controlled so that only the desired tissue material is removed.
In other systems, the instrument 22 is movable with three degrees of freedom relative to the handheld housing and is a cutting tool that is manually positioned by the surgeon's hand without the aid of a cutting jig, guide arm, or other constraint mechanism. Have Such a system is described in US Provisional Patent Application No. 61 / 662,070 entitled “Surgical Instrument Including Housing, a Cutting Accessory that Extends from the Housing and Actuators that Establish the Position of the Cutting Accessory Relative to the Housing”. It is shown. The disclosure of this US provisional patent application is hereby incorporated by reference.
In these embodiments, the system comprises a handheld surgical cutting instrument having a cutting tool. As shown in US Provisional Patent Application No. 61 / 662,070 entitled “Surgical Instrument Including Housing, a Cutting Accessory that Extends from the Housing and Actuators that Establish the Position of the Cutting Accessory Relative to the Housing” The control system controls the movement of the cutting tool with at least 3 degrees of freedom using an internal actuator or motor. The disclosure of the above US provisional patent application is hereby incorporated by reference. The navigation system 20 communicates with the control system. One tracker (such as tracker 48) is attached to the instrument. Other trackers (trackers 44, 46, etc.) are attached to the patient's anatomy.
In this embodiment, the navigation system 20 communicates with the control system of the handheld surgical cutting instrument. The navigation system 20 exchanges at least one of position data and orientation data with the control system. At least one of these position data and orientation data indicates at least one of the position and orientation of the instrument 22 with respect to the anatomical tissue. This communication is anatomical so that the cut is made within a predetermined boundary (the term predetermined boundary is understood to include a predetermined trajectory, volume, line, other shape or geometry, etc.) Provides closed loop control to control the cutting of the target tissue.
The features of the present invention can be used to track sudden or unexpected movement of the localizer coordinate system LCLZ as may occur when the camera unit 36 is struck by a surgical person. An accelerometer (not shown) attached to the camera unit 36 monitors the collision and stops the system 20 when a collision is detected. In this embodiment, the accelerometer communicates with the camera controller 42 and the camera controller 42 responds when the acceleration measured along any of the x-axis, y-axis, or z-axis exceeds a predetermined value. A signal is sent to the navigation computer 26 to disable the system 20 and wait for the camera unit 36 to stabilize before restarting the measurement. In some cases, the initialization steps 200, 300, 400 must be repeated before navigation resumes.
In some embodiments, the virtual LED is positioned at the working tip of the instrument 22. In this embodiment, the virtual LED is located at the work tip location in the model of the instrument tracker 48 so that the work tip location is continuously calculated.
The intended scope of the appended claims is to encompass all modifications and variations that fall within the true spirit and scope of the present invention. Furthermore, although the embodiments described above relate to medical applications, the invention described herein can also be applied to other applications such as industry, aerospace, defense, etc. .
The scope of claims at the beginning of the filing of Japanese Patent Application No. 2015-533296 is as follows.
A tracker attached to an object and comprising three markers and a non-optical sensor, wherein the optical sensor sequentially receives an optical signal from the marker, and the non-optical sensor generates a non-optical signal Is a tracker,
The position of the first marker among the markers at a first time is obtained based on the first optical signal from the first marker,
The positions of the second marker and the third marker of the markers at the first time are determined based on the first optical signal and the non-optical signal from the non-optical sensor,
A computing system for associating the determined position of the first marker, the position of the second marker, and the position of the third marker with the object and tracking the position of the object;
A navigation system that tracks subjects.
The navigation system of claim 1, wherein the non-optical sensor is located at a known location associated with each of the markers.
The navigation system according to claim 1, wherein the marker is a passive reflector.
The navigation system according to claim 1, wherein the marker is an active emitter.
The navigation system according to claim 3, wherein the active emitter is a light emitting diode.
The navigation system according to claim 1, wherein the optical sensor is accommodated in a camera unit, and the camera unit includes a second optical sensor.
The navigation system according to claim 6, wherein the camera unit includes a third optical sensor.
The navigation system according to claim 7, wherein the optical sensor is a one-dimensional charge coupled device.
The navigation system according to claim 1, comprising a second tracker having three markers and a second non-optical sensor.
The navigation system according to claim 9, wherein the second tracker is attached to a bone.
The computing system comprises a processor;
The processor calculates a first velocity of the first marker based on the first optical signal, and based on the first velocity and the non-optical signal at the first time, the second marker and The navigation system according to claim 1, wherein the position of the second marker and the third marker is calculated by calculating the speed of the third marker.
The computing system tracks the position and orientation of the object by associating the determined position of the first marker, the position of the second marker, and the position of the third marker with the object. The navigation system according to claim 1.
13. A probe for selecting a landmark in a patient's anatomy, the probe comprising a plurality of markers that send signals to the optical sensor upon selection of the landmark. Navigation system.
2. The computing system according to claim 1, wherein the computing system initially measures the position of the first marker, the position of the second marker, and the position of the third marker to determine initial position data. Navigation system.
The computing system sequentially turns on the first marker, the second marker, and the third marker and sends an optical signal to the optical sensor, whereby the position of the first marker and the second marker are transmitted. The navigation system according to claim 14, wherein the initial position data is determined by measuring a position of a marker and a position of the third marker.
When determining the initial position data, the computing system calculates a speed of the first marker, a speed of the second marker, and a speed of the third marker, and calculates the calculated speed to a predetermined threshold value. 15. The navigation system according to claim 14, wherein the navigation system is for comparison.
The computing system includes the first marker position, the second marker position, and the third marker position measured in the initial stage, the first marker stored in the computing system, and the third marker position. The navigation system according to claim 14, wherein the navigation system is for comparison with a model of a second marker and the third marker.
18. The navigation of claim 17, wherein the computing system matches the first marker, the second marker, and the third marker with the model and provides what best fits the model. system.
The navigation system of claim 18, wherein the computing system matches one or more virtual markers with the model and provides the best fit for the model.
The navigation system according to claim 17, wherein the computing system generates a transformation matrix from a coordinate system of the tracker to a localizer coordinate system.
The navigation system according to claim 1, wherein the computing system calculates a linear velocity vector of the first marker.
The navigation system according to claim 21, wherein the computing system measures an angular velocity of the tracker at the first time.
The navigation system according to claim 22, wherein the computing system calculates a relative velocity vector of an origin of a tracker coordinate system based on the measured angular velocity.
The navigation system according to claim 23, wherein the computing system calculates a relative velocity vector of the second marker and the third marker based on the measured angular velocity.
The computing system calculates a velocity vector of the origin based on a linear velocity vector calculated for the first marker and a relative velocity vector calculated for the origin of the tracker coordinate system. Item 25. The navigation system according to item 24.
The computing system is configured to generate the second marker and the second marker at the first time based on a velocity vector calculated for the origin and a relative velocity vector calculated for the second marker and the third marker. The navigation system according to claim 25, which calculates a three-marker velocity vector.
The computing system calculates the positions of the second marker and the third marker at the first time based on the velocity vector at the first time calculated for the second marker and the third marker. The navigation system according to claim 26, wherein:
28. The navigation system of claim 27, wherein the computing system calculates a relative velocity vector for one or more virtual markers.
The computing system determines a velocity vector of the one or more virtual markers at the first time based on a velocity vector calculated for the origin and a relative velocity vector calculated for the one or more virtual markers. The navigation system according to claim 28, wherein the navigation system is to be calculated.
The computing system calculates a position of the one or more virtual markers at the first time based on a velocity vector at the first time calculated for the one or more virtual markers. Item 30. The navigation system according to Item 29.
A robot manipulator and a cutting tool;
A robot control system for controlling or constraining the movement of the cutting tool with at least 5 degrees of freedom;
A navigation system in communication with the robot control system and comprising at least one optical sensor;
A tracker attached to the robot manipulator;
A tracker attached to the patient's anatomy and comprising three markers and a non-optical sensor;
The optical sensor receives an optical signal from the marker;
The non-optical sensor generates a non-optical signal;
The navigation system sends position data indicating a position of the anatomical tissue to the robot control system, and the cutting is controlled so that the cutting of the anatomical tissue is performed within a predetermined boundary. For cutting system.
A localizer comprising at least one optical sensor;
A tracker in communication with the optical sensor and comprising three markers and a non-optical sensor;
A computing system for determining the position of each of the three markers in a localizer coordinate system based on an optical signal and a non-optical signal, wherein a matching algorithm is executed to execute one or more of the markers in the localizer coordinate system The position obtained for the marker is collated with the position of one or more of the markers in the tracker model defined with reference to the tracker coordinate system, and the tracker coordinate system is converted to the localizer coordinate system. With a computing system to obtain a transformation matrix for
Navigation system equipped with.
The computing system comprises a processor that matches a position calculated for a virtual point in the localizer coordinate system with a position of the virtual point in the model to obtain the transformation matrix. The navigation system according to 32.
33. The navigation system of claim 32, wherein the computing system comprises a processor that recalculates one or more of the positions in the localizer coordinate system determined for the marker based on the transformation matrix.
At least two optical sensors;
A tracker attached to an object and equipped with three markers and a non-optical sensor;
At least two of the optical sensors receive an optical signal from the marker at an optical detection frequency of at least 100 Hz;
The system for tracking an object, wherein the non-optical sensor generates a non-optical signal at a non-optical detection frequency of at least 100 Hz.
36. The system of claim 35, wherein the optical detection frequency is at least 300 Hz and the non-optical detection frequency is at least 300 Hz.
A method of tracking an object during a surgical procedure using an optical sensor, a tracker attached to an object, comprising three markers and a non-optical sensor, and a computing system comprising:
Sequentially receiving optical signals from the markers;
Generating a non-optical signal;
Determining a position of the first marker at a first time based on a first optical signal from a first marker of the markers;
Obtaining the positions of the second marker and the third marker of the markers at the first time based on the first optical signal and the non-optical signal from the non-optical sensor, An optical sensor that does not receive optical signals from the second marker and the third marker at the first time; and
Associating the determined position of the first marker, the position of the second marker and the position of the third marker with the object, and tracking the position of the object during the surgical procedure;
38. The method of claim 37, comprising: measuring an initial position of the first marker, a position of the second marker, and a position of the third marker to determine initial position data.
The step of measuring the position of the first marker, the position of the second marker, and the position of the third marker and determining the initial position data includes the first marker, the second marker, and the third marker. 40. The method of claim 38, comprising: sequentially turning on and sending an optical signal to the optical sensor.
Calculating the speed of the first marker, the speed of the second marker, and the speed of the third marker in determining the initial position data;
Comparing the calculated speed with a predetermined threshold;
The first marker position, the second marker position, and the third marker position, which are measured in the initial stage, are stored in the computing system, the first marker, the second marker, and the second marker. 40. The method of claim 38, comprising comparing to a model for three markers.
Collating the first marker, the second marker, and the third marker with the stored model;
Providing the best fit for the model;
43. The method of claim 42, comprising matching one or more virtual markers with the stored model and providing a best fit to the model.
39. The method of claim 38, comprising generating a transformation matrix from the tracker coordinate system to a localizer coordinate system.
38. The method of claim 37, comprising calculating a linear velocity vector of the first marker.
46. The method of claim 45, comprising measuring an angular velocity of the tracker at the first time.
47. The method of claim 46, comprising calculating a relative velocity vector at the origin of the tracker coordinate system based on the measured angular velocity.
48. The method of claim 47, comprising calculating a relative velocity vector of the second marker and the third marker based on the measured angular velocity.
49. The method of claim 48, comprising calculating a velocity vector for the origin based on a linear velocity vector calculated for the first marker and a relative velocity vector calculated for the origin of the tracker coordinate system.
Based on the velocity vector calculated for the origin and the relative velocity vector calculated for the second marker and the third marker, the velocity vectors of the second marker and the third marker at the first time are obtained. 50. The method of claim 49, comprising the step of calculating.
Calculating the positions of the second marker and the third marker at the first time based on a velocity vector at the first time calculated for the second marker and the third marker. 50. The method according to 50.
52. The method of claim 51, comprising calculating a relative velocity vector for one or more virtual markers.
Calculating a velocity vector of the one or more virtual markers at the first time based on a velocity vector calculated for the origin and a relative velocity vector calculated for the one or more virtual markers. Item 53. The method according to Item 52.
54. The method of claim 53, comprising calculating a position of the one or more virtual markers at the first time based on a velocity vector at the first time calculated for the one or more virtual markers.
A method of tracking an object during a surgical procedure using an optical sensor, a tracker attached to the object and comprising three markers and a non-optical sensor, and a computing system comprising:
Determining the position of the three markers in the field of view of the optical sensor such that the optical sensor can sequentially receive optical signals from the three markers;
The computing system is operated to determine a position of the first marker at a first time based on a first optical signal from a first marker of the markers, and the first optical signal and the non-optical sensor And determining the positions of the second marker and the third marker of the markers at the first time based on the non-optical signal from the first marker, the determined position of the first marker, the position of the second marker, and the Associating a position of a third marker with the object and tracking the position of the object during the surgical procedure, wherein the optical sensor at the first time and the second marker and A step that does not receive an optical signal from the third marker; and
A tracker attached to an object and comprising three markers and a non-optical sensor, wherein the plurality of optical sensors sequentially receive optical signals from the marker, and the non-optical sensors generate non-optical signals Tracker
A computing system that associates the determined position of the first marker, the position of the second marker, and the position of the third marker with the object and tracks the position of the object;
The computing system initially measures the position of the first marker, the position of the second marker, and the position of the third marker, and determines the position of the first marker, the second marker, and the third marker. Determine the initial position data ,
The computing system includes a processor;
Calculating a linear velocity vector of the first marker at the first time based on the first optical signal;
Measuring an angular velocity vector of the tracker at the first time based on a non-optical signal from the non-optical sensor;
Using the position of the first marker and the measured angular velocity of the tracker to calculate a relative velocity vector of the origin in the tracker coordinate system of the tracker at the first time;
Using the measured angular velocity of the tracker and initial position data of the second marker and the third marker, including initial positions of the second marker and the third marker in the tracker coordinate system, Calculating a relative velocity vector of the second marker and the third marker at a first time;
Using the calculated linear velocity vector of the first marker and the calculated relative velocity vector of the origin of the tracker coordinate system, calculating the velocity vector of the origin of the tracker coordinate system at the first time;
Using the calculated velocity vector of the origin of the tracker coordinate system and the calculated relative velocity vectors of the second marker and the third marker, the second marker and the third marker at the first time Calculate the velocity vector of
Using the calculated velocity vectors of the second marker and the third marker at the first time, the positions of the second marker and the third marker at the first time are calculated.
Thus, a navigation system for tracking an object , which calculates the positions of the second marker and the third marker at the first time .
The navigation system according to claim 1, wherein the marker is an active emitter that sequentially emits optical signals.
The navigation system according to claim 1, wherein the plurality of optical sensors are accommodated in a camera unit.
The computing system sequentially turns on the first marker, the second marker, and the third marker and sends an optical signal to the plurality of optical sensors, so that the position of the first marker The navigation system according to claim 1, wherein the initial position data is determined by measuring a position of a second marker and a position of the third marker.
When determining the initial position data, the computing system calculates a speed of the first marker, a speed of the second marker, and a speed of the third marker, and calculates the calculated speed to a predetermined threshold value. The navigation system according to claim 1, wherein the navigation system is for comparison.
The computing system includes the first marker position, the second marker position, and the third marker position measured in the initial stage, the first marker stored in the computing system, and the third marker position. The navigation system according to claim 1, wherein the navigation system is for comparison with a model of a second marker and the third marker.
8. The navigation of claim 7 , wherein the computing system matches the first marker, the second marker, and the third marker with the model and provides what best fits the model. system.
The navigation system of claim 8 , wherein the computing system matches one or more virtual markers with the model and provides the best fit to the model.
The navigation system according to claim 7 , wherein the computing system generates a transformation matrix from the tracker coordinate system to a localizer coordinate system.
The navigation system according to claim 1 , wherein the computing system calculates a relative velocity vector for one or more virtual markers.
The computing system determines a velocity vector of the one or more virtual markers at the first time based on a velocity vector calculated for the origin and a relative velocity vector calculated for the one or more virtual markers. The navigation system according to claim 11 , which is to be calculated.
The computing system calculates a position of the one or more virtual markers at the first time based on a velocity vector at the first time calculated for the one or more virtual markers. Item 15. The navigation system according to Item 12 .
A method of tracking an object using a plurality of optical sensors, non-optical sensors, and a computing system comprising :
Measuring initial position data of the first marker, the second marker, and the third marker to determine initial position data of the first marker, the second marker, and the third marker ; ,
The plurality of optical sensors sequentially receiving optical signals from the first marker, the second marker, and the third marker;
The non-optical sensor generating a non-optical signal;
The computing system determining a position of the first marker at a first time based on a first optical signal from the first marker;
The computing system determining a position of the second marker and a third marker at the first time based on the first optical signal and a non-optical signal from the non-optical sensor;
The computing system associates the determined first marker position, second marker position, and third marker position with the object to determine the position and orientation of the object during a surgical procedure. look including a step of tracking,
The computing system determining the positions of the second marker and the third marker at the first time based on the first optical signal and the non-optical signal from the non-optical sensor,
Using the position of the first marker and the measured angular velocity of the tracker to calculate a relative velocity vector of an origin in the tracker coordinate system of the tracker at the first time;
Using the calculated linear velocity vector of the first marker and the calculated relative velocity vector of the origin of the tracker coordinate system to calculate the velocity vector of the origin of the tracker coordinate system at the first time When,
Using the calculated velocity vector of the origin of the tracker coordinate system and the calculated relative velocity vectors of the second marker and the third marker, the second marker and the third marker at the first time Calculating a velocity vector of
Calculating the positions of the second marker and the third marker at the first time using the calculated velocity vectors of the second marker and the third marker at the first time;
A method comprising .
JP2015533296A 2012-09-26 2013-09-25 Navigation system with optical and non-optical sensors Active JP6370789B2 (en)
US201261705804P true 2012-09-26 2012-09-26
US61/705,804 2012-09-26
US14/035,207 US9008757B2 (en) 2012-09-26 2013-09-24 Navigation system including optical and non-optical sensors
US14/035,207 2013-09-24
PCT/US2013/061642 WO2014052428A1 (en) 2012-09-26 2013-09-25 Navigation system including optical and non-optical sensors
JP2015534480A JP2015534480A (en) 2015-12-03
JP2015534480A5 JP2015534480A5 (en) 2016-10-27
JP6370789B2 true JP6370789B2 (en) 2018-08-08
JP2015533296A Active JP6370789B2 (en) 2012-09-26 2013-09-25 Navigation system with optical and non-optical sensors
JP2018096415A Pending JP2018198931A (en) 2012-09-26 2018-05-18 Navigation system including optical and non-optical sensors
JP2018096414A Pending JP2018183597A (en) 2012-09-26 2018-05-18 Navigation system including optical and non-optical sensors
JP (3) JP6370789B2 (en)
KR (2) KR20190045412A (en)
CN (2) CN109171964A (en)
AU (3) AU2013323646B2 (en)
US10441294B2 (en) 2013-06-11 2019-10-15 Depuy Ireland Unlimited Company System for the treatment of a planned volume of a body part
US10390737B2 (en) 2013-09-30 2019-08-27 Stryker Corporation System and method of controlling a robotic system for manipulating anatomy of a patient during a surgical procedure
JP6205387B2 (en) * 2014-06-04 2017-09-27 アニマ株式会社 Method and apparatus for acquiring position information of virtual marker, and operation measurement method
JP6481029B2 (en) 2014-10-31 2019-03-13 メドトロニック・アドヴァンスド・エナジー・エルエルシー Power monitoring circuit and method for reducing leakage current in an RF generator
CA2968917C (en) 2014-11-25 2019-02-05 Synaptive Medical (Barbados) Inc. Sensor based tracking tool for medical components
DE102015201460A1 (en) * 2015-01-28 2016-07-28 Siemens Healthcare Gmbh Position determination of a medical instrument
CN107205786A (en) 2015-02-25 2017-09-26 马科外科公司 For reducing navigation system and method that tracking is interrupted in surgical procedures
US10470724B2 (en) 2015-04-13 2019-11-12 Precisionrad Llc Laser and accelerometer guided medical device
US20170333137A1 (en) 2016-05-23 2017-11-23 Mako Surgical Corp. Systems And Methods For Identifying And Tracking Physical Objects During A Robotic Surgical Procedure
US10318024B2 (en) * 2016-10-14 2019-06-11 Orthosoft, Inc. Mechanical optical pointer
AU2017345734A1 (en) 2016-10-21 2019-05-09 Mako Surgical Corp. Systems and tools for use with surgical robotic manipulators
EP3541270A1 (en) * 2016-11-18 2019-09-25 Stryker Corp. Method and apparatus for treating a joint, including the treatment of cam-type femoroacetabular impingement in a hip joint and pincer-type femoroacetabular impingement in a hip joint
WO2018112025A1 (en) 2016-12-16 2018-06-21 Mako Surgical Corp. Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site
EP3554774A1 (en) 2016-12-16 2019-10-23 Mako Surgical Corp. Techniques for detecting errors or loss of accuracy in a surgical robotic system
US20180333207A1 (en) 2017-04-14 2018-11-22 Stryker Corporation Surgical systems and methods for facilitating ad-hoc intraoperative planning of surgical procedures
US20180325608A1 (en) 2017-05-10 2018-11-15 Mako Surgical Corp. Robotic Spine Surgery System And Methods
US20180353253A1 (en) 2017-06-09 2018-12-13 Mako Surgical Corp. Robotic Surgical System And Method For Producing Reactive Forces To Implement Virtual Boundaries
CN107149722A (en) * 2017-06-20 2017-09-12 深圳市瀚翔生物医疗电子股份有限公司 A kind of transcranial magnetic stimulation treatment equipment
US20190142525A1 (en) 2017-11-15 2019-05-16 Stryker Corporation High Bandwidth And Low Latency Hybrid Communication Techniques For A Navigation System
WO2019147964A1 (en) 2018-01-26 2019-08-01 Mako Surgical Corp. End effectors and methods for driving tools guided by surgical robotic systems
WO2019147948A1 (en) 2018-01-26 2019-08-01 Mako Surgical Corp. End effectors, systems, and methods for impacting prosthetics guided by surgical robots
US20190254756A1 (en) 2018-02-19 2019-08-22 Mako Surgical Corp. Surgical Systems And Methods For Identifying Tools Guided By Surgical Robots
EP3581121A1 (en) 2018-06-15 2019-12-18 MAKO Surgical Corp. Techniques for patient-specific milling path generation
CN109758234A (en) * 2019-02-15 2019-05-17 哈尔滨工业大学 For the mobile laparoscope automatic control system of Minimally Invasive Surgery and its control method
JP4612194B2 (en) 1998-12-23 2011-01-12 イメージ・ガイディッド・テクノロジーズ・インコーポレイテッド Hybrid 3D probe tracked by multiple sensors
DE50010673D1 (en) 1999-04-19 2005-08-11 Leica Geosystems Ag Indirect position determination with the help of a tracker
SE515374C2 (en) 1999-10-29 2001-07-23 Abb Flexible Automation As Method and apparatus for determining an object's coordinates and orientation in the reference coordinate system
ITMI20011635A1 (en) 2001-07-27 2003-01-27 G D S Giorgi Dynamic Stereotax Device and microsurgical procedure Aided
JP2005515910A (en) 2002-01-31 2005-06-02 ブレインテック カナダ インコーポレイテッドＢｒａｉｎｔｅｃｈ Ｃａｎａｄａ，Ｉｎｃ． Method and apparatus for single camera 3D vision guide robotics
DE10217726A1 (en) 2002-04-17 2003-11-27 Heidenhain Gmbh Dr Johannes Optical position measuring device
JP2004061459A (en) 2002-07-31 2004-02-26 Canon Inc Position detector, lens equipped with this, and method for position detection
DE10251600A1 (en) 2002-11-06 2004-05-27 Kuka Roboter Gmbh Method and device for controlling movements in handling devices
DE102004005380A1 (en) 2004-02-03 2005-09-01 Isra Vision Systems Ag Method for determining the position of an object in space
DE102004057933A1 (en) 2004-12-01 2006-06-08 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. A method and apparatus for navigating and positioning an object relative to a patient
WO2007014470A2 (en) 2005-08-01 2007-02-08 Resonant Medical Inc. System and method for detecting drifts in calibrated tracking systems
FR2902871B1 (en) 2006-06-23 2008-08-29 Thales Sa Inertial measurement unit with reinforced acceleration
DE102006034270A1 (en) 2006-07-18 2008-01-24 C. & E. Fein Gmbh Location system for locating the position of a tool
DE502006004198D1 (en) 2006-10-17 2009-08-20 Brainlab Ag Marker navigation system for detecting and displaying the location of marker devices
DE502006003472D1 (en) 2006-10-20 2009-05-28 Brainlab Ag Marker navigation device, in particular for medical purposes
US8315690B2 (en) 2007-10-02 2012-11-20 General Electric Company Dynamic reference method and system for interventional procedures
AU2008329463A1 (en) 2007-11-30 2009-06-04 Orthosoft Inc. Optical tracking CAS system
DE102007059599B4 (en) 2007-12-11 2017-06-22 Siemens Healthcare Gmbh Device for a medical intervention and method of operation for a device for a medical intervention
JP2010145274A (en) 2008-12-19 2010-07-01 Panasonic Corp Inertial sensor
JP2010216880A (en) 2009-03-13 2010-09-30 Omron Corp Displacement sensor
KR101903307B1 (en) * 2009-03-26 2018-10-01 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 System for providing visual guidance for steering a tip of an endoscopic device towards one or more landmarks and assisting an operator in endoscopic navigation
FR2944203A1 (en) 2009-04-08 2010-10-15 Gen Electric System and method for determining the position of a medical instrument
JP4957753B2 (en) 2009-06-15 2012-06-20 セイコーエプソン株式会社 Robot, transfer device, and control method using inertial sensor
CN102460205A (en) 2009-06-23 2012-05-16 皇家飞利浦电子股份有限公司 Position determining system
EP2448512A1 (en) 2009-06-29 2012-05-09 Koninklijke Philips Electronics N.V. Method and apparatus for tracking in a medical procedure
WO2011001300A1 (en) 2009-06-29 2011-01-06 Koninklijke Philips Electronics, N.V. Method and system for position determination
US8615127B2 (en) 2010-01-15 2013-12-24 Vanderbilt University System and method for point-based rigid registration with anisotropic weighting
EP2525731A1 (en) 2010-01-20 2012-11-28 Creative Team Instruments Ltd. Orientation dector for use with a hand-held surgical or dental tool
CN102892352A (en) * 2010-04-22 2013-01-23 蓝带技术有限责任公司 Navigated freehand surgical tool and kit
2013-09-24 US US14/035,207 patent/US9008757B2/en active Active
2013-09-25 KR KR1020197011736A patent/KR20190045412A/en active Application Filing
2013-09-25 EP EP13776882.6A patent/EP2900164A1/en active Pending
2013-09-25 CN CN201811105300.0A patent/CN109171964A/en active Search and Examination
2013-09-25 KR KR1020157005182A patent/KR101974102B1/en active IP Right Grant
2013-09-25 JP JP2015533296A patent/JP6370789B2/en active Active
2013-09-25 WO PCT/US2013/061642 patent/WO2014052428A1/en active Application Filing
2013-09-25 AU AU2013323646A patent/AU2013323646B2/en active Active
2013-09-25 CA CA2883508A patent/CA2883508A1/en active Pending
2013-09-25 CN CN201380050199.2A patent/CN104684502B/en active IP Right Grant
2015-03-02 US US14/635,402 patent/US9271804B2/en active Active
2016-01-13 US US14/994,236 patent/US9687307B2/en active Active
2017-05-19 US US15/599,935 patent/US20170252111A1/en active Pending
2017-11-20 AU AU2017264974A patent/AU2017264974B2/en active Active
2018-05-18 JP JP2018096415A patent/JP2018198931A/en active Pending
2018-05-18 JP JP2018096414A patent/JP2018183597A/en active Pending
2019-02-04 AU AU2019200725A patent/AU2019200725A1/en active Pending
CN104684502A (en) 2015-06-03
KR20150064015A (en) 2015-06-10
US20150164609A1 (en) 2015-06-18
AU2017264974B2 (en) 2019-02-21
US9687307B2 (en) 2017-06-27
US20160120610A1 (en) 2016-05-05
JP2015534480A (en) 2015-12-03
AU2013323646A1 (en) 2015-03-12
JP2018183597A (en) 2018-11-22
AU2017264974A1 (en) 2017-12-07
KR101974102B1 (en) 2019-04-30
US9271804B2 (en) 2016-03-01
JP2018198931A (en) 2018-12-20
CA2883508A1 (en) 2014-04-03
KR20190045412A (en) 2019-05-02
US20170252111A1 (en) 2017-09-07
CN104684502B (en) 2018-10-19
CN109171964A (en) 2019-01-11
US9008757B2 (en) 2015-04-14
WO2014052428A1 (en) 2014-04-03
AU2019200725A1 (en) 2019-03-21
US20140088410A1 (en) 2014-03-27
AU2013323646B2 (en) 2017-09-14
EP2900164A1 (en) 2015-08-05
CA2654261C (en) 2017-05-16 Method and apparatus for controlling a haptic device
EP2448514B1 (en) 2015-06-24 Adjustable guide in computer assisted orthopaedic surgery
Ang et al. 2001 Design and implementation of active error canceling in hand-held microsurgical instrument
Taylor et al. 2008 Medical robotics and computer-integrated interventional medicine
2018-01-19 A02 Decision of refusal
2018-05-29 A911 Transfer of reconsideration by examiner before appeal (zenchi)
Ref document number: 6370789