Source: http://www.google.com/patents/US8081810?dq=6,712,702
Timestamp: 2017-05-26 11:37:58
Document Index: 21630716

Matched Legal Cases: ['Application No. 200780034771', 'Application No. 200880012795', 'Application No. 08730689', 'Application No. 07842741', 'Application No. 08743996', 'Application No. 08730689', 'Application No. 08743996', 'Application No. 07842741', 'Application No. 07842741']

Patent US8081810 - Recognizing a real world fiducial in image data of a patient - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsA storage medium contains a program which instructs a computer to recognize a predetermined shape of each of at least one portion of a medical assembly as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received by the digital computer. The...http://www.google.com/patents/US8081810?utm_source=gb-gplus-sharePatent US8081810 - Recognizing a real world fiducial in image data of a patientAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS8081810 B2Publication typeGrantApplication numberUS 11/726,653Publication dateDec 20, 2011Filing dateMar 22, 2007Priority dateMar 22, 2007Fee statusPaidAlso published asEP2131736A1, EP2131736A4, US20080232656, WO2008118684A1Publication number11726653, 726653, US 8081810 B2, US 8081810B2, US-B2-8081810, US8081810 B2, US8081810B2InventorsJames W. VoegeleOriginal AssigneeEthicon Endo-Surgery, Inc.Export CitationBiBTeX, EndNote, RefManPatent Citations (81), Non-Patent Citations (48), Classifications (12), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetRecognizing a real world fiducial in image data of a patient
US 8081810 B2Abstract
A storage medium contains a program which instructs a computer to recognize a predetermined shape of each of at least one portion of a medical assembly as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received by the digital computer. The at-least-one portion has another function apart from functioning as a real-world fiducial. A medical apparatus includes a medical assembly and a storage medium. The medical assembly includes a component having at-least-one portion each with a predetermined shape. The storage medium contains a program which instructs a computer to recognize the predetermined shape of each of the at-least-one portion as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received by the digital computer. The component has another function apart from functioning as a real-world fiducial.
1. A non-transitory storage medium containing a program readable by a digital computer which instructs the digital computer to recognize a predetermined shape of each of at least one portion of a medical assembly as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received as an input by the digital computer, wherein the at-least-one portion has another function apart from functioning as a real-world fiducial, wherein the medical assembly includes a position sensor adapted to provide position data and wherein each of the at-least-one portion is located at a fixed, predetermined position with respect to the position sensor such that the real-world fiducial is fixed in position relative to the position sensor, wherein the medical assembly includes an insertion sleeve insertable into the patient through which a surgical device is inserted into the patient for a medical treatment of the patient and wherein the at-least-one portion is at-least-one portion of the insertion sleeve.
2. The storage medium of claim 1, wherein the at-least-one portion is adapted to have a fixed position relative to the patient during the medical treatment of the patient.
3. The storage medium of claim 2, wherein the program instructs the digital computer to calculate a position of the position sensor using at least position data obtained from the position sensor and indexed to a reference coordinate system, to create an image representation using at least the image data obtained from the patient and indexed to the reference coordinate system using at least the recognized predetermined shape, the predetermined position, and the indexed position of the position sensor, and to display an image of the image representation.
4. The storage medium of claim 1, wherein the at-least-one portion includes a plurality of portions each having a same shape.
5. The storage medium of claim 1, wherein the at-least-one portion includes a plurality of portions each having a different shape.
6. The storage medium of claim 1, wherein the at-least-one portion is chosen from the group consisting of an external rib of the insertion sleeve and a distal hole of a distal end of the insertion sleeve and the at-least-one portion is recognized by the digital computer based upon the predetermined shape.
7. The storage medium of claim 6, wherein the medical assembly includes the surgical device insertable into the patient through the insertion sleeve and wherein the surgical device is a medical treatment device.
8. The storage medium of claim 7, wherein the surgical device is an ablation probe.
9. Medical apparatus comprising a medical assembly and a storage medium, wherein the medical assembly includes a component having at-least-one portion each with a predetermined shape, wherein the storage medium contains a program readable by a digital computer which instructs the digital computer to recognize the predetermined shape of each of the at-least-one portion as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received as an input by the digital computer, and wherein the at-least-one portion has another function apart from functioning as a real-world fiducial, wherein the medical assembly includes a position sensor adapted to provide position data and wherein each at-least-one portion is located at a fixed, predetermined position with respect to the position sensor such that the real-world fiducial is fixed relative to the position sensor and wherein the medical assembly includes an insertion sleeve insertable into the patient through which a surgical device is inserted into the patient for a medical treatment of the patient and wherein the at-least-one portion is at-least-one portion of the insertion sleeve.
10. The medical apparatus of claim 9, wherein the at-least-one portion is adapted to have a fixed position relative to the patient during the medical treatment of the patient.
11. The medical apparatus of claim 10, wherein the program instructs the digital computer to calculate a position of the position sensor using at least position data obtained from the position sensor and indexed to a reference coordinate system, to create an image representation using at least the image data obtained from the patient and indexed to the reference coordinate system using at least the recognized predetermined shape, the predetermined position, and the indexed position of the position sensor, and to display an image of the image representation.
12. The medical apparatus of claim 9, wherein the at-least-one portion includes a plurality of portions each having a same shape.
13. The medical apparatus of claim 9, wherein the at-least-one portion includes a plurality of portions each having a different shape.
14. The medical apparatus of claim 9, wherein the at-least-one portion is chosen from the group consisting of an external rib of the insertion sleeve, a distal hole of a distal end of the insertion sleeve, a side hole created in the insertion sleeve, and a raised or recessed symbol created on the insertion sleeve and the at-least-one portion is recognized by the digital computer based upon the predetermined shape.
15. The medical apparatus of claim 14, wherein the medical assembly includes a surgical device insertable into the patient through the insertion sleeve and wherein the surgical device is a medical treatment device.
16. The medical apparatus of claim 15, wherein the surgical device is an ablation probe. Description
The present invention is related generally to medical images, and more particularly to a storage medium containing a computer program and to medical apparatus including a medical assembly and a storage medium containing a computer program all relating to recognizing a real world fiducial in image data of a patient.
Imagers are known for obtaining image data of a patient and for displaying images of the image data on a display monitor. Such images include, without limitation, ultrasound images, X-ray images, computerized tomography (CT) images, positive electron emission (PET) images, magnetic resonance (MRI) images, fluoroscope images, etc. Where needed, it is known to register these images with a real world object by placing a marker on the skin of the patient, wherein the marker has a predetermined shape, and wherein the marker is recognizable in the image data using pattern recognition software (e.g., a conventional segmentation subroutine).
Position sensors are known which are placed on medical instruments which are inserted into a patient allowing the position of the medical instrument to be tracked inside the patient. Such position sensors are part of known position sensing systems such as an AC-based system available from Biosense-Webster or a DC-based system available from Ascension Technology Corporation.
Still, scientists and engineers continue to seek improvements in recognizing a real world fiducial in image data of a patient.
A first expression of an embodiment of the invention is for a storage medium containing a program readable by a digital computer which instructs the digital computer to recognize a predetermined shape of each of at least one portion of a medical assembly as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received as an input by the digital computer. The at-least-one portion has another function apart from functioning as a real-world fiducial.
A second expression of an embodiment of the invention is for medical apparatus including a medical assembly and a storage medium. The medical assembly includes a component having at-least-one portion each with a predetermined shape. The storage medium contains a program readable by a digital computer which instructs the digital computer to recognize the predetermined shape of each of the at-least-one portion as a real-world fiducial in image data of a patient when the image data includes the predetermined shape and is received as an input by the digital computer. The component has another function apart from functioning as a real-world fiducial.
Several benefits and advantages are obtained from one or more expressions of the embodiment of the invention. In one example of registering an image of a patient with a real world object, the need for a separate marker having no function apart from being a real-world fiducial is eliminated. In the same or a different example, the portion of the medical assembly serving as a real-world fiducial is insertable (i.e., capable of being inserted) into the patient, instead of being conventionally placed on the skin of the patient, allowing for less image data to be generated, for some medical procedures, in order for at least some image data to contain the real-world fiducial.
FIG. 1 is a schematic view of an embodiment of the invention showing a digital computer and an example of a medical assembly, wherein the digital computer includes a storage medium, wherein the medical assembly example includes a component and an ablation probe, and wherein the component functions as an insertion sleeve and also functions as at least one real-world fiducial in image data of the patient; and
FIG. 2 is a schematic view of a display monitor upon which the digital computer displays an image of the image data.
Before explaining the embodiment of the present invention in detail, it should be noted that the present invention is not limited in its application or use to the details of construction and arrangement of parts and steps illustrated in the accompanying drawings and description. The illustrative embodiment of the invention may be implemented or incorporated in other embodiments, methods, variations and modifications, and may be practiced or carried out in various ways. Furthermore, unless otherwise indicated, the terms and expressions employed herein have been chosen for the purpose of describing the illustrative embodiment of the present invention for the convenience of the reader and are not for the purpose of limiting the invention.
It is further understood that any one or more of the following-described implementations, examples etc. can be combined with any one or more of the other following-described implementations, examples etc.
An embodiment of the invention is shown in FIGS. 1-2. A first expression of the embodiment of FIGS. 1-2 is for a storage medium 10 containing a program readable by a digital computer 12 which instructs the digital computer 12 to recognize a predetermined shape of each of at least one portion 14, 16, 18, 20 and 22 of a medical assembly 24 as a real-world fiducial in image data 26 of a patient 28 when the image data 26 includes the predetermined shape and is received as an input by the digital computer 12. The at-least-one portion 14, 16, 18, 20 and 22 has another function apart from functioning as a real-world fiducial. It is noted that the words “at least one portion” includes “the entirety”, and that the term “assembly” includes, without limitation, “component”. In one example, the program includes a conventional segmentation subroutine to identify the predetermined shape.
Examples of storage media include, without limitation, temporary computer memory and permanent computer memory such as RAM, hard drives, CD's, etc. Examples of image data 26 include, without limitation, ultrasound image data, X-ray image data, computerized tomography (CT) image data, positive electron emission (PET) image data, magnetic resonance (MRI) image data, and fluoroscope image data. An example of a computer program which creates a manipulative 3D display image from 2D CT-scans and MRI-scans is Mimics available from Materialise of Ann Arbor, Mich. It is noted that the image data 26 may be pre-acquired image data or real-time image data. In one arrangement, the predetermined shape is a shape recognizable as a “manufactured” shape as opposed to biological shapes occurring in image data of a patient.
In one implementation of the first expression of the embodiment of FIGS. 1-2, the medical assembly 24 includes a (wired or wireless) position sensor 30 adapted to provide position data, and each at-least-one portion 14, 16, 18, 20 and 22 is located at a predetermined position with respect to the position sensor 30. In one variation, the at-least-one portion 14, 16, 18, 20 and 22 is adapted to have a fixed position relative to the patient 28 during a medical treatment of the patient 28. In one modification, the program instructs the digital computer 12 to perform steps a) through c). Step a) includes calculating a position of the position sensor using at least position data obtained from the position sensor and indexed to a reference coordinate system. Step b) includes creating an image representation using at least the image data obtained from the patient and indexed to the reference coordinate system using at least the recognized predetermined shape, the predetermined position, and the indexed position of the position sensor. Step c) includes displaying an image of the image representation.
In one realization of the first expression of the embodiment of FIGS. 1-2, the position data and/or the image data 26 are already indexed to the reference coordinate system when received by the computer 12. In a different realization, the position data and/or the image data 26 are not yet indexed to the reference coordinate system when received by the computer 12, and such indexing is performed by the computer 12.
Examples of position sensors 30 adapted to provide position data include, without limitation, the position sensors of the AC-based position sensing system available from Biosense-Webster and the DC-based position sensing system available from Ascension Technology Corporation. It is noted that, as used in describing the system embodiment of FIGS. 1-2, the term “position” includes up to six degrees of freedom so that calculating position includes calculating a two dimensional or three-dimensional translation and two or three degrees of orientation of the sensor 30 with respect to a reference coordinate system. A description of the operation of an embodiment of a position sensor 30 adapted to provide position data is found in US Patent Application Publication 2006/0089624.
In one illustration of the first expression of the system embodiment of FIGS. 1-2, the sensor 30 is considered to be a position sensor of a Biosense Webster positioning sensing system and a transmitter, not shown, of such system is used by the digital computer 12 for a reference coordinate system for position data from the position sensor 30. Thus, the digital computer 12 can index the position data of the sensor 30 to a reference coordinate system. The position of the at-least-one portion 14, 16, 18, 20 and 22 is predetermined with respect to the position sensor 30. Thus the position of the at-least-one portion 14, 16, 18, 20 and 22 is related to the reference coordinate system. Since the image data 26 is related to the predetermined shape of each of the at-least-one portion 14, 16, 18, 20 and 22, a subroutine can be written by those of ordinary skill in the art, without undue experimentation, which instructs the digital computer 12 to create the image representation of the image data 26 indexed to the reference coordinate system.
In one application of the first expression of the embodiment of FIGS. 1-2, the at-least-one portion 14, 16, 18, 20 and 22 includes a plurality of portions 14, 16 and 18 each having a same shape. In the same or a different application, the at-least-one portion 14, 16, 18, 20 and 22 includes a plurality of portions 14, 20 and 22 each having a different shape.
In one enablement of the first expression of the embodiment of FIGS. 1-2, the medical assembly 24 includes an insertion sleeve 34 insertable into the patient 28, and the at-least-one portion 14, 16, 18, 20 and 22 is at-least-one portion (such as a patient-insertable portion) of the insertion sleeve 34. In one illustration, the at-least-one portion 14, 16, 18, 20 and 22 is chosen from the group consisting of an external rib 14, 16 and 18 of the insertion sleeve 34 and a distal hole 22 of a distal end 36 of the insertion sleeve 34. In one variation, the medical treatment assembly includes a surgical device 38 insertable into the patient 28 through the insertion sleeve 34. It is noted that the term “device” includes, without limitation, “component”. In one modification, the surgical device 36 is an ablation probe. In a different example, not shown, the component is a holder for a medical diagnostic and/or medical treatment device.
In this enablement, the position sensor 30 is the only sensor of the medical assembly 24 which is attached to the insertion sleeve 34 and adapted to provide position data. In one variation, the position sensor 30 is attached to a patient-non-insertable portion of the insertion sleeve 34. It is noted that the position sensor 30 may be temporarily attached or permanently attached to the insertion sleeve 34, wherein “temporarily attached” means the position sensor may be detached from the insertion sleeve without damage to the position sensor and/or the insertion sleeve and wherein “permanently attached” means the position sensor may not be detached from the insertion sleeve without damage to the position sensor and/or the insertion sleeve. In a different variation, not shown, the position sensor is attached to a patient-insertable portion of the insertion sleeve 34. In a further variation, not shown, the position sensor is attached to orthopaedic hardware of the patient 28.
A first method of the invention is a method for visualizing a patient 28 and comprises steps a) through e). Step a) includes obtaining a medical assembly 24 having at least one portion 14, 16, 18, 20 and 22 each with a predetermined shape adapted for recognition as a real-world fiducial in image data 26 of the patient 28, wherein the at-least-one portion 14, 16, 18, 20 and 22 has another function apart from functioning as a real-world fiducial. Step b) includes disposing the medical assembly 24 with the at-least-one portion 14, 16, 18, 20 and 22 on or in the patient 28. Step c) includes obtaining the image data 26 of the patient 28. Step d) includes recognizing the at-least-one portion 14, 16, 18, 20 and 22 in the image data 26. Step e) includes displaying an image 31 of the image data 26 which includes the at-least-one portion 14, 16, 18, 20 and 22.
A second expression of an embodiment of the invention is for medical apparatus 40 including a medical assembly 24 and a storage medium 10. The medical assembly 24 includes a component (e.g., insertion sleeve 34) having at-least-one portion 14, 16, 18, 20 and 22 each with a predetermined shape. The storage medium 10 contains a program readable by a digital computer 12 which instructs the digital computer 12 to recognize the predetermined shape of each of the at-least-one portion 14, 16, 18, 20 and 22 as a real-world fiducial in image data 26 of a patient 28 when the image data 26 includes the predetermined shape and is received as an input by the digital computer 12. The component (e.g., insertion sleeve 34) has another function apart from functioning as a real-world fiducial.
It is noted that the implementations, examples, etc. of the first expression of the embodiment of FIGS. 1-2 are equally applicable to the second expression of the embodiment of FIGS. 1-2. In a further illustration of the second expression of the embodiment of FIGS. 1-2, the group from which the at-least-one portion 14, 16, 18, 20 and 22 is chosen also consists of a side hole 20 created in the insertion sleeve 34 and a raised or recessed symbol 21 created or disposed on the insertion sleeve 34. It is noted that symbols includes letters and numbers as well as non-alphanumeric symbols such as a five-pointed star, etc. The symbols are distinguishable in the image 31 due to a different mass density relative to their surroundings.
A second method of the invention is a method for visualizing a patient 28 and comprises steps a) through e). Step a) includes obtaining a medical assembly 24 including a component (e.g., insertion sleeve 34) having at least one portion 14, 16, 18, 20 and 22 each with a predetermined shape adapted for recognition as a real-world fiducial in image data 26 of the patient 28, wherein the component (e.g., insertion sleeve 34) has another function apart from functioning as a real-world fiducial. Step b) includes disposing the medical assembly 24 with the at-least-one portion 14, 16, 18, 20 and 22 of the component (e.g., insertion sleeve 34) on or in the patient 28. Step c) includes obtaining the image data 26 of the patient 28. Step d) includes recognizing the at-least-one portion 14, 16, 18, 20 and 22 in the image data 26. Step e) includes displaying an image 31 of the image data 26 which includes the at-least-one portion 14, 16, 18, 20 and 22.
In one variation of either or both of the methods, the medical assembly 24 includes a position sensor 30 and each at-least-one portion 14, 16, 18, 20 and 22 is located at a predetermined position with respect to the position sensor 30. In one modification, the at-least-one portion 14, 16, 18, 20 and 22 is adapted to have a fixed position relative to the patient during a medical treatment of the patient 28. In one example, there is also included, between steps d) and e) the step of indexing the image data 26 to a reference coordinate system using a position sensor 30 and in a manner as previously discussed.
In a first extension of either or both of the expressions of the embodiment of FIGS. 1-2, there is also included a display monitor 42 upon which the image 31 is displayed. Examples of a display monitor 42 include, without limitation, a computer monitor, a goggle display screen, and a room wall upon which projected images are displayed.
In an employment of either or both of the expressions of the embodiment of FIGS. 1-2, the image 31 is a three-dimensional manipulative image, and there is also included a computer input device 44 operatively connected to the digital computer 12 to allow a user to manipulate the three-dimensional-manipulative image on the display monitor 42. Examples of input devices 44 include, without limitation, a keyboard and a mouse. In a different employment, the image is a two-dimensional non-manipulative image.
While the present invention has been illustrated by expressions of an embodiment and enablements, applications, etc. thereof, it is not the intention of the applicant to restrict or limit the spirit and scope of the appended claims to such detail. Numerous other variations, changes, and substitutions will occur to those skilled in the art without departing from the scope of the invention. It will be understood that the foregoing description is provided by way of example, and that other modifications may occur to those skilled in the art without departing from the scope and spirit of the appended Claims.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5391199Jul 20, 1993Feb 21, 1995Biosense, Inc.Apparatus and method for treating cardiac arrhythmiasUS5398691Sep 3, 1993Mar 21, 1995University Of WashingtonMethod and apparatus for three-dimensional translumenal ultrasonic imagingUS5497934Oct 7, 1993Mar 12, 1996United States Surgical CorporationSurgical apparatus with indicatorUS5575288Jun 7, 1995Nov 19, 1996Acuson CorporationCompact rotationally steerable ultrasound transducerUS5636255 *Mar 5, 1996Jun 3, 1997Queen's University At KingstonMethod and apparatus for CT image registrationUS5728044Mar 10, 1995Mar 17, 1998Shan; YansongSensor device for spacial imaging of endoscopesUS5729129Jun 7, 1995Mar 17, 1998Biosense, Inc.Magnetic location system with feedback adjustment of magnetic field generatorUS5771896Aug 30, 1996Jun 30, 1998Acuson CorporationCompact rotationally steerable ultrasound transducerUS5772594 *Oct 16, 1996Jun 30, 1998Barrick; Earl F.Fluoroscopic image guided orthopaedic surgery system with intraoperative registrationUS5836869Nov 1, 1995Nov 17, 1998Olympus Optical Co., Ltd.Image tracking endoscope systemUS5868673Mar 11, 1997Feb 9, 1999Sonometrics CorporationSystem for carrying out surgery, biopsy and ablation of a tumor or other physical anomalyUS6016439 *Oct 9, 1997Jan 18, 2000Biosense, Inc.Method and apparatus for synthetic viewpoint imagingUS6092526Jun 19, 1997Jul 25, 2000Scimed Life Systems, Inc.Percutaneous chamber-to-artery bypassUS6167292Oct 9, 1998Dec 26, 2000Integrated Surgical Systems SaRegistering method and apparatus for robotic surgery, and a registering device constituting an application thereofUS6252599May 16, 1998Jun 26, 2001Ge Yokogawa Medical Systems, LimitedImage display method and image display apparatusUS6321106Apr 3, 2000Nov 20, 2001Jerome LemelsonSystem and method for treating select tissue in a living beingUS6381485 *Oct 28, 1999Apr 30, 2002Surgical Navigation Technologies, Inc.Registration of human anatomy integrated for electromagnetic localizationUS6428547Nov 15, 2000Aug 6, 2002Brainlab AgDetection of the shape of treatment devicesUS6456735Jul 3, 1999Sep 24, 2002Ge Yokogawa Medical Systems, LimitedImage display method and apparatusUS6491702May 29, 2001Dec 10, 2002Sofamor Danek Holdings, Inc.Apparatus and method for photogrammetric surgical localizationUS6546279 *Oct 12, 2001Apr 8, 2003University Of FloridaComputer controlled guidance of a biopsy needleUS6556695 *Sep 16, 1999Apr 29, 2003Mayo Foundation For Medical Education And ResearchMethod for producing high resolution real-time images, of structure and function during medical proceduresUS6615063Nov 27, 2000Sep 2, 2003The General Hospital CorporationFluorescence-mediated molecular tomographyUS6690964Jul 3, 2001Feb 10, 2004Siemens AktiengesellschaftMethod and device for visualization of positions and orientation of intracorporeally guided instruments during a surgical interventionUS6773402Feb 19, 2002Aug 10, 2004Biosense, Inc.Location sensing with real-time ultrasound imagingUS7366562Oct 17, 2003Apr 29, 2008Medtronic Navigation, Inc.Method and apparatus for surgical navigationUS7697972Jul 14, 2003Apr 13, 2010Medtronic Navigation, Inc.Navigation system for cardiac therapiesUS7764985 *Jul 23, 2004Jul 27, 2010Smith & Nephew, Inc.Surgical navigation system component fault interfaces and related processesUS7840256 *Dec 12, 2005Nov 23, 2010Biomet Manufacturing CorporationImage guided tracking array and methodUS20010029333Feb 28, 2001Oct 11, 2001The Board Of Trustees Of The Leland Stanford Junior UniversityMethod and apparatus for volumetric image navigationUS20010044578 *Jan 22, 1998Nov 22, 2001Shlomo Ben-HaimX-ray guided surgical location system with extended mapping volumeUS20020007108Jun 5, 2001Jan 17, 2002Chen David T.Anatomical visualization systemUS20020087101 *Jan 3, 2001Jul 4, 2002Barrick Earl FrederickSystem and method for automatic shape registration and instrument trackingUS20020156363Mar 21, 2002Oct 24, 2002Hunter Mark W.Registration of human anatomy integrated for electromagnetic localizationUS20030065294Sep 28, 2001Apr 3, 2003Pickup Ray L.Cutaneous administration systemUS20030139668Dec 9, 2002Jul 24, 2003Shlomo Ben-HaimMethod for alignment of bone using position sensorsUS20030160721Mar 27, 2003Aug 28, 2003Pinhas GilboaIntrabody navigation system for medical applicationsUS20040101822Nov 26, 2002May 27, 2004Ulrich WiesnerFluorescent silica-based nanoparticlesUS20040105979Aug 14, 2003Jun 3, 2004Encap Technologies, Inc.Microencapsulated and nanoencapsulated particles, moisture barrier resins, and processes for manufacturing sameUS20040167391 *Oct 17, 2003Aug 26, 2004Solar Matthew S.Fiducial marker devices, tools, and methodsUS20050020878Jul 31, 2003Jan 27, 2005Junichi OhnishiEndoscopeUS20050020918Sep 16, 2003Jan 27, 2005Wilk Ultrasound Of Canada, Inc.Ultrasonic medical device and associated methodUS20050033164Jul 12, 2002Feb 10, 2005Takeshi YatsuoEndoscopic image pickup method and magnetic resonance imaging device using the sameUS20050080333Aug 12, 2004Apr 14, 2005Piron Cameron AnthonyHybrid imaging method to monitor medical device delivery and patient support for use in the methodUS20050085793Aug 30, 2004Apr 21, 2005Glossop Neil D.Device and method for registering a position sensor in an anatomical bodyUS20050152836May 21, 2004Jul 14, 2005Euan AshleyDiagnostic markers and pharmacological targets in heart failure and related reagents and methods of use thereofUS20050182295Dec 10, 2004Aug 18, 2005University Of WashingtonCatheterscope 3D guidance and interface systemUS20050196028Mar 8, 2005Sep 8, 2005Siemens AktiengesellschaftMethod of registering a sequence of 2D image data with 3D image dataUS20050203420Dec 8, 2004Sep 15, 2005Martin KleenMethod for merging medical imagesUS20060052701Aug 18, 2005Mar 9, 2006University Of WashingtonTreatment of unwanted tissue by the selective destruction of vasculature providing nutrients to the tissueUS20060058644 *Sep 10, 2004Mar 16, 2006Harald HoppeSystem, device, and method for AD HOC tracking of an objectUS20060064006Sep 23, 2005Mar 23, 2006Mediguide Ltd.Method and system for determining a three dimensional representation of a tubular organUS20060089624Oct 22, 2004Apr 27, 2006Voegele James WSystem and method for planning treatment of tissueUS20060089625Oct 22, 2004Apr 27, 2006Voegele James WSystem and method for treatment of tissue using the tissue as a fiducialUS20060089626Oct 22, 2004Apr 27, 2006Vlegele James WSurgical device guide for use with an imaging systemUS20060142657Feb 21, 2006Jun 29, 2006Mako Surgical CorporationHaptic guidance system and methodUS20060149134Jan 27, 2006Jul 6, 2006University Of WashingtonCatheterscope 3D guidance and interface systemUS20060173299Dec 14, 2004Aug 3, 2006Scimed Life Systems, Inc.Systems and methods for improved three-dimensional imaging of a body lumenUS20060183246Nov 26, 2003Aug 17, 2006Ulrich WiesnerFluorescent silica-based nanoparticlesUS20060239544Mar 16, 2006Oct 26, 2006Yankelevitz David FMethod for expanding the domain of imaging software in a diagnostic work-upUS20060245971May 2, 2005Nov 2, 2006Burns Andrew APhotoluminescent silica-based sensors and methods of useUS20060271056May 10, 2006Nov 30, 2006Smith & Nephew, Inc.System and method for modular navigated osteotomeUS20070147705Dec 4, 2006Jun 28, 2007Medispectra, Inc.Methods and systems for correcting image misalignmentUS20070173689Mar 9, 2007Jul 26, 2007Takashi OzakiObject observation system and method of controlling object observation systemUS20070191707 *Sep 15, 2005Aug 16, 2007Denittis Albert SDevice for locating the cervix and uterusUS20070270685May 18, 2007Nov 22, 2007Mako Surgical Corp.Method and apparatus for controlling a haptic deviceUS20080086051Sep 20, 2006Apr 10, 2008Ethicon Endo-Surgery, Inc.System, storage medium for a computer program, and method for displaying medical imagesUS20080118103Nov 20, 2006May 22, 2008General Electric CompanySystem and method of navigating a medical instrumentUS20080221434Mar 9, 2007Sep 11, 2008Voegele James WDisplaying an internal image of a body lumen of a patientUS20080234544Mar 20, 2007Sep 25, 2008Ethicon Endo-Sugery, Inc.Displaying images interior and exterior to a body lumen of a patientUS20080234566Mar 21, 2007Sep 25, 2008Ethicon Endo-Surgery, Inc.Recognizing a real world fiducial in a patient image dataUS20080234720 *Oct 29, 2007Sep 25, 2008Acclarent, Inc.Devices, Systems and Methods for Treating Disorders of the Ear, Nose and ThroatUS20080298655 *Jun 26, 2008Dec 4, 2008Edwards Jerome RMethods, apparatuses, and systems useful in conducting image guided interventionsUS20080319307Jun 19, 2007Dec 25, 2008Ethicon Endo-Surgery, Inc.Method for medical imaging using fluorescent nanoparticlesUS20090054761Aug 22, 2007Feb 26, 2009Ethicon Endo-Surgery, Inc.Medical system, method, and storage medium concerning a natural orifice transluminal medical procedureUS20090161927Feb 17, 2007Jun 25, 2009National University Corporation Nagoya UniversityMedical Image Observation Assisting SystemDE102005022901A1May 18, 2005Nov 23, 2006Siemens AgInstrumentation section orientation procedure takes two dimensional image of object area and recognises marking patternEP0920838A2Dec 8, 1998Jun 9, 1999The Cleveland Clinic FoundationFiducial cupEP1410758A1Jul 12, 2002Apr 21, 2004Hitachi Medical CorporationEndoscopic image pickup method and magnetic resonance imaging device using the sameEP1652470A1Aug 5, 2005May 3, 2006Hitachi, Ltd.Optical measuring instrument for living bodyFR2779339A1 Title not available* Cited by examinerNon-Patent CitationsReference1CN, Notification of First Office Action, Chinese Application No. 200780034771.0 (Aug. 11, 2010).2CN, Notification of First Office Action, Chinese Application No. 200880012795.0 (Oct. 20, 2010).3EP, Decision to Grant, European Application No. 08730689.0 (Apr. 21, 2011).4EP, Office Action, European Application No. 07842741.6 (Oct. 12, 2010).5EP, Search Report, European Application No. 08743996.4 (Apr. 8, 2011).6EP, Supplementary European Search Report, European Application No. 08730689.0; 6 pages (Apr. 28, 2010).7EP, Supplementary European Search Report, European Application No. 08743996.4 (Apr. 8, 2011).8Hybrid Silica Technologies, Inc.-01. Hybrid Silica Technologies, Inc. (HST) Founded to Commercialize CU Dots Fluorescent Nanoparticles, 2004, by the Office of the Vice Provost for Research, Cornell University, 2 pages, Webpage.9Hybrid Silica Technologies, Inc.—01. Hybrid Silica Technologies, Inc. (HST) Founded to Commercialize CU Dots Fluorescent Nanoparticles, 2004, by the Office of the Vice Provost for Research, Cornell University, 2 pages, Webpage.10International Search Report, International Application No. PCT/US2007/078832 (2 pages) (mailed Apr. 10, 2008; published Jul. 3, 2008).11International Search Report, International Application No. PCT/US2008/054933 (3 pages) (mailed Aug. 20, 2008; published Nov. 27, 2008).12Invitrogen-Qdot In Vivo Imaging, 2006 Introgen Corporation, 5 pages, webpage.13Invitrogen—Qdot In Vivo Imaging, 2006 Introgen Corporation, 5 pages, webpage.14Kodak-Kodak X-Sight Imaging Agent for In Vivo Applications, 2007, 3 pages, Webpage.15Kodak—Kodak X-Sight Imaging Agent for In Vivo Applications, 2007, 3 pages, Webpage.16PCT, International Preliminary Report on Patentability, International Application No. PCT/US2007/078832 (Mar. 24, 2009).17PCT, International Preliminary Report on Patentability, International Application No. PCT/US2007/078832; 6 pages (Mar. 24, 2009).18PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/054933 (Sep. 8, 2009).19PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/054933; 6 pages (Sep. 8, 2009).20PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/056043 (Sep. 15, 2009).21PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/056043; 5 pages (Sep. 15, 2009).22PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/057322 (Sep. 22, 2009).23PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/057322; 5 pages (Sep. 22, 2009).24PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/057323 (Sep. 22, 2009).25PCT, International Preliminary Report on Patentability, International Application No. PCT/US2008/057323; 5 pages (Sep. 22, 2009).26PCT, International Search Report, PCT/US08/56043 (Aug. 26, 2008).27PCT, International Search Report, PCT/US08/57322 (Aug. 18, 2008).28PCT, International Search Report, PCT/US08/57323 (Aug. 7, 2008).29Supplementary Partial European Search Report, European Application No. 07842741.6 (8 pages) (Aug. 6, 2009).30Supplementary Partial European Search Report, European Patent Application No. 07842741 (8 pages) (Aug. 6, 2009).31U.S. Appl. No. 11/524,216, filed Apr. 2008, Voegele, James W.32US, Advisory Action, U.S. Appl. No. 11/524,216; 3 pages (Apr. 15, 2009).33US, Advisory Action, U.S. Appl. No. 11/524,216; 3 pages (May 11, 2010).34US, Office Action, U.S. Appl. No. 11/524,216; 16 pages (Mar. 3, 2010).35US, Office Action, U.S. Appl. No. 11/524,216; 19 pages (Jun. 23, 2009).36US, Office Action, U.S. Appl. No. 11/524,216; 20 pages (Jan. 22, 2009).37US, Office Action, U.S. Appl. No. 11/524,216; 21 pages (Aug. 19, 2008).38US, Office Action, U.S. Appl. No. 11/716,465; 11 pages (Mar. 16, 2010).39US, Office Action, U.S. Appl. No. 11/716,465; 15 pages (Jun. 24, 2009).40US, Office Action, U.S. Appl. No. 11/725,834 (Aug. 1, 2011).41US, Office Action, U.S. Appl. No. 11/725,834 (Mar. 22, 2011).42US, Office Action, U.S. Appl. No. 11/726,257; 16 pages (Mar. 2, 2010).43US, Office Action, U.S. Appl. No. 11/726,257; 17 pages (Aug. 6, 2009).44US, Office Action, U.S. Appl. No. 11/820,354 (Jun. 29, 2011).45US, Office Action, U.S. Appl. No. 11/894,841 (Feb. 25, 2011).46US, Office Action, U.S. Appl. No. 11/894,841 (Nov. 3, 2010).47Viergever, M.A. et al., "Integration of functional and anatomical brain images," Biophy. Chem., vol. 68, pp. 207-219 (1997).48Website document of Mimics Software from Materialise (8 pages), Jun. 2007.Classifications U.S. Classification382/131International ClassificationG06K9/00Cooperative ClassificationA61B5/064, G06T7/73, G06T2207/10072, A61B6/12, G06T2207/10116, A61B5/06, G06T2207/30004, G06T2207/30244European ClassificationG06T7/00P1, A61B5/06Legal EventsDateCodeEventDescriptionMar 22, 2007ASAssignmentOwner name: ETHICON ENDO-SURGERY, INC., OHIOFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VOEGELE, JAMES W.;REEL/FRAME:019153/0382Effective date: 20070320Jun 3, 2015FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services