Patent Description:
In tissue ablation, an ablation probe is inserted into a subject to locally ablate tissue. Various types probes exist for ablating tissue. For example, heat, cold, radio frequency power, and lasers can all be used to ablate tissue.

United States patent application publication <CIT> discloses a system for surgical procedure assistance. In one example, a first image of a patient captured prior to a surgical procedure is received. A treatment plan is generated based on the first image. The treatment plan includes information related to one or more surgical instruments. A second image of the patient captured after the surgical procedure has been initiated is received. The treatment plan is dynamically adjusted based on a pose of any of the one or more surgical instruments identified from the second image. A third image of the patient captured after a lesion is treated by at least one of the surgical instruments based on the adjusted treatment plan is received. Whether a further treatment to the lesion is needed is determined based on the third image. Upon determining a further treatment is needed, an updated treatment plan is dynamically generated based on the third image.

The invention provides for a medical instrument, a computer program, and a method in the independent claims. Embodiments are given in the dependent claims.

A difficult part of accurately performing tissue ablation is accurately planning the ablations. Embodiments may provide for a system which aids in the planning of ablations. An anatomical segmentation and a target zone segmentation are received and then used to render several three-dimensional models on a planning graphical user interface. A first three-dimensional model shows the anatomical segmentation and the target zone segmentation. A second three-dimensional model shows a remaining portion of the target zone segmentation. An ablation zone selector on the planning graphical user interface enables the selection of an ablation zone. The system then updates the remaining portion (the second three-dimensional model) by removing the ablation zone from the remaining portion. This process may be repeated to plan the entire ablation.

In one aspect the invention provides for a medical instrument that comprises a user interface. The user interface comprises a display. The medical instrument further comprises a memory storing machine-executable instructions. The medical instrument further comprises a computational system that is configured for controlling the medical instrument. The medical instrument may take different forms in different examples. In some examples the medical instrument is a workstation or computing system. In other examples the medical instrument may include other components such as an ablation system.

Execution of the machine-executable instructions causes the computational system to receive an anatomical segmentation identifying a location of an anatomical structure. The anatomical segmentation could be in the form of a segmentation of a medical image. In other examples the anatomical segmentation is simply identification of a region of the anatomical structure independent of a medical image. Execution of the machine-executable instructions further causes the computational system to receive a target zone segmentation identifying a location of a volume at least partially within the anatomical segmentation. This volume may also be referred to as the target zone.

Execution of the machine-executable instructions further causes the processor to display a planning graphical user interface using the display. The planning graphical user interface comprises a first panel configured for rendering a cross-sectional view of the anatomical segmentation and the target zone segmentation. The planning graphical user interface further comprises a second panel configured for displaying a rendering of a first three-dimensional model of the anatomical segmentation and the target zone segmentation.

The rendering of the first three-dimensional model may for example be a two-dimensional rendering of the three-dimensional model. In other examples a three-dimensional rendering may be used. The planning graphical user interface further comprises a third panel configured for rendering a second three-dimensional model of a remaining portion of the target zone segmentation. The planning graphical user interface further comprises an ablation selector configured for providing an ablation zone descriptive of a volume at least partially within the remaining portion.

Execution of the machine-executable instructions further causes the computational system to repeatedly receive the ablation zone from the ablation selector. Execution of the machine-executable instructions further causes the computational system to repeatedly update the remaining portion by removing the ablation zone from the remaining portion. This embodiment may be beneficial because it may aid in the planning of an ablation. The display of the remaining portion may aid in the selection of the proper ablation zone.

In another embodiment the ablation selector is configured to receive a selection of a volume within the remaining portion. Execution of the machine-executable instructions further causes the processor to generate the ablation zone in response to receiving the selection of a volume from the ablation selector. For example, the user interface may display the possible volumes which could be ablated.

In another embodiment the ablation selector is configured for receiving a selection of a trajectory that intersects the remaining portion. Execution of the machine-executable instructions further causes the processor to generate the ablation zone in response to receiving the selection of the trajectory from the ablation selector. A particular ablation system may have a guide or set insertion points where a probe may be inserted. The user interface may for example display the possible trajectories which a physician or other operator can choose from and can then plan the ablation and see the projected results.

In another embodiment the memory further comprises an automated planning module configured for outputting the ablation zone in response to inputting the remaining portion. The ablation selector is configured to receive an automated planning request. Execution of the machine-executable instructions further causes the processor to generate the ablation zone by inputting the remaining portion into the automated planning module in response to receiving the automated planning request. The automated planning module may for example be implemented in different ways. In one example a neural network could be used to choose the ablation zone in response to the existing remaining portion. In other examples the automated planning module may use a search algorithm that looks at all of the possible choices and then chooses an ablation zone which matches predetermined criteria. For example, the ablation zone may be chosen such that the maximum amount of tissue is ablated.

In another embodiment execution of the machine-executable instructions further causes the processor to generate insertion instructions for inserting the ablation probe in response to receiving the ablation zone from the ablation selector. The medical instrument may for example be useful in planning an ablation operation. During or after the planning has taken place the insertion instructions may be provided for use by the physician or medical technician.

In another embodiment the medical instrument comprises an ablation probe system comprising an ablation probe. The medical instrument further comprises an ablation probe tracking system registered to the anatomical segmentation. The ablation probe tracking system may for example be implemented in a variety of different ways. There may for example be a radio-frequency tag or other transmitter on the ablation probe which enables tracking. In other cases, the ablation probe tracking system may track the probe at least partially using an input medical image such as from a CT system or a magnetic resonance imaging system.

Execution of the machine-executable instructions further causes the computational system to receive probe tracking data from the ablation probe. Execution of the machine-executable instructions further causes the computational system to update the remaining portion using the probe tracking data. When the ablation probe is actually inserted into a subject the actual area which the ablation probe reaches may be different than what is intended. In this embodiment the remaining portion is updated so that it matches the actual position of the ablation probe.

In another embodiment the ablation probe is a radio-frequency ablation probe.

In another embodiment the ablation probe is a microwave ablation probe.

In another embodiment the ablation probe is a high-intensity focused ultrasound ablation probe.

In another embodiment the ablation probe is a focal or focused laser ablation probe.

In another embodiment the ablation probe is an irreversible electroporation probe.

In another embodiment the ablation probe is a cryo-ablation probe.

In another embodiment the medical instrument further comprises a guidance medical imaging system. Execution of the machine-executable instructions further causes the computational system to control the guidance medical imaging system to acquire real-time guidance medical imaging data during acquisition of tracking data from the ablation probe. Execution of the machine-executable instructions further causes the computational system to display the real-time guidance medical imaging data on the user interface in real time. The real-time guidance medical image data may for example be used to track and locate the position of the probe exactly and also update the remaining portion.

In another embodiment the guidance medical imaging system is a computed tomography system.

In another embodiment the guidance medical imaging system is an ultrasound imaging system.

In another embodiment the guidance medical imaging system is a magnetic resonance imaging system.

In another embodiment the guidance medical imaging system is an X-ray fluoroscope.

In another embodiment execution of the machine-executable instructions further causes the computational system to receive a planning magnetic resonance image descriptive of a region of interest of a subject. Anatomical segmentation identifies a location of an anatomical structure within the planning magnetic resonance image. The first panel is further configured for rendering a cross-sectional view of the planning magnetic resonance image.

In another embodiment the memory further stores an automated segmentation algorithm configured for generating the anatomical segmentation and/or the target zone segmentation in response to inputting the planning magnetic resonance image. Execution of the machine-executable instructions further causes the processor to generate the anatomical segmentation and/or the target zone segmentation by inputting the planning magnetic resonance image into the automated segmentation algorithm.

The automated segmentation algorithm may be implemented in a variety of ways. In one example the automated segmentation algorithm is implemented as a neural network. In other examples the automated segmentation algorithm may perform the segmentation by using an anatomical atlas. In another example the automated segmentation algorithm uses a deformable shape model to perform the segmentation.

In another embodiment the medical instrument further comprises a planning magnetic resonance image system configured for acquiring planning k-space data of the subject. The label planning on the planning magnetic resonance image is intended to indicate a particular magnetic resonance imaging system. Likewise, the term planning k-space data is intended to indicate specific k-space data and the word planning is used as a label. The memory further comprises planning pulse sequence commands configured for controlling the magnetic resonance imaging system to acquire the planning k-space data.

Execution of the machine-executable instructions further causes the computational system to control the planning magnetic resonance imaging system with the planning pulse sequence commands to acquire the planning k-space data. Execution of the machine-executable instructions further causes the computational system to reconstruct the planning magnetic resonance image from the planning k-space data.

In another embodiment the display is a three-dimensional display. This for example may be a display that is provided by goggles or other virtual reality or augmented reality system. Execution of the machine-executable instructions further causes the processor to render the first three-dimensional model and the second three-dimensional model three-dimensionally using the three-dimensional display.

In another aspect the invention provides for a computer program that comprises machine-executable instructions for execution by a computational system controlling a medical instrument. The medical instrument comprises a user interface comprising a display. Execution of the machine-executable instructions causes the computational system to receive an anatomical segmentation identifying a location of an anatomical structure. Execution of the machine-executable instructions further causes the computational system to receive a target zone segmentation identifying a location of a volume at least partially within the anatomical segmentation. Execution of the machine-executable instructions further causes the computational system to display a planning graphical user interface using the display.

The planning graphical user interface comprises a first panel configured for rendering a cross-sectional view of the anatomical segmentation and the target zone segmentation. The planning graphical user interface further comprises a second panel configured for displaying a rendering of the first three-dimensional model of the anatomical segmentation and the target zone segmentation. The planning graphical user interface further comprises a third panel configured for rendering a second three-dimensional model of the remaining portion of the target zone segmentation. The planning graphical user interface further comprises an ablation selector configured for providing an ablation zone descriptive of a volume at least partially within the remaining portion.

Execution of the machine-executable instructions further causes the computational system to repeatedly receive the ablation zone from the ablation selector. Execution of the machine-executable instructions further causes the computational system to repeatedly update the remaining portion by removing the ablation zone from the remaining portion.

In another aspect the invention provides for a method of operating a medical instrument according to claim <NUM>.

The medical instrument comprises a user interface. The user interface comprises a display. The method comprises receiving an anatomical segmentation identifying a location of an anatomical structure. The method further comprises receiving a target zone segmentation identifying a location of a volume at least partially within the anatomical segmentation. The method further comprises displaying a planning graphical user interface using the display. The planning graphical user interface comprises a first panel configured for rendering a cross-sectional view of the anatomical segmentation and the target zone segmentation.

The planning graphical user interface further comprises a second panel configured for displaying a rendering of a first three-dimensional model of the anatomical segmentation and the target zone segmentation. The planning graphical user interface further comprises a third panel configured for rendering a second three-dimensional model of a remaining portion of the target zone segmentation. The planning graphical user interface further comprises an ablation selector configured for providing an ablation zone descriptive of a volume at least partially within the remaining portion. The method further comprises repeatedly receiving the ablation zone from the ablation selector. The method further comprises repeatedly updating the remaining portion by removing the ablation zone from the remaining portion.

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as an apparatus, method according to claim <NUM> or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit," "module" or "system. " Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer executable code embodied thereon.

A 'computer-readable storage medium' as used herein encompasses any tangible storage medium which may store instructions which are executable by a processor or computational system of a computing device. The computer-readable storage medium may be referred to as a computer-readable non-transitory storage medium. The computer-readable storage medium may also be referred to as a tangible computer readable medium. In some embodiments, a computer-readable storage medium may also be able to store data which is able to be accessed by the computational system of the computing device. Examples of computer-readable storage media include, but are not limited to: a floppy disk, a magnetic hard disk drive, a solid state hard disk, flash memory, a USB thumb drive, Random Access Memory (RAM), Read Only Memory (ROM), an optical disk, a magneto-optical disk, and the register file of the computational system. Examples of optical disks include Compact Disks (CD) and Digital Versatile Disks (DVD), for example CD-ROM, CD-RW, CD-R, DVD-ROM, DVD-RW, or DVD-R disks. The term computer readable-storage medium also refers to various types of recording media capable of being accessed by the computer device via a network or communication link. For example, data may be retrieved over a modem, over the internet, or over a local area network. Computer executable code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire line, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

'Computer memory' or 'memory' is an example of a computer-readable storage medium. Computer memory is any memory which is directly accessible to a computational system. 'Computer storage' or 'storage' is a further example of a computer-readable storage medium. Computer storage is any non-volatile computer-readable storage medium. In some embodiments computer storage may also be computer memory or vice versa.

A 'computational system' as used herein encompasses an electronic component which is able to execute a program or machine executable instruction or computer executable code. References to the computational system comprising the example of "a computational system" should be interpreted as possibly comprising more than one computational system or processing core. The computational system may for instance be a multi-core processor. A computational system may also refer to a collection of computational systems within a single computer system or distributed amongst multiple computer systems. The term computational system should also be interpreted to possibly refer to a collection or network of computing devices each comprising a processor or computational systems. The machine executable code or instructions may be executed by multiple computational systems or processors that may be within the same computing device or which may even be distributed across multiple computing devices.

Machine executable instructions or computer executable code may comprise instructions or a program which causes a processor or other computational system to perform an aspect of the present invention. Computer executable code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages and compiled into machine executable instructions. In some instances, the computer executable code may be in the form of a high-level language or in a pre-compiled form and be used in conjunction with an interpreter which generates the machine executable instructions on the fly. In other instances, the machine executable instructions or computer executable code may be in the form of programming for programmable logic gate arrays.

Aspects of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It is understood that each block or a portion of the blocks of the flowchart, illustrations, and/or block diagrams, can be implemented by computer program instructions in form of computer executable code when applicable. It is further under stood that, when not mutually exclusive, combinations of blocks in different flowcharts, illustrations, and/or block diagrams may be combined. These computer program instructions may be provided to a computational system of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the computational system of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.

These machine executable instructions or computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The machine executable instructions or computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. A 'user interface' as used herein is an interface which allows a user or operator to interact with a computer or computer system. A 'user interface' may also be referred to as a 'human interface device. " A user interface may provide information or data to the operator and/or receive information or data from the operator. A user interface may enable input from an operator to be received by the computer and may provide output to the user from the computer. In other words, the user interface may allow an operator to control or manipulate a computer and the interface may allow the computer indicate the effects of the operator's control or manipulation. The display of data or information on a display or a graphical user interface is an example of providing information to an operator. The receiving of data through a keyboard, mouse, trackball, touchpad, pointing stick, graphics tablet, joystick, gamepad, webcam, headset, pedals, wired glove, remote control, and accelerometer are all examples of user interface components which enable the receiving of information or data from an operator. A 'hardware interface' as used herein encompasses an interface which enables the computational system of a computer system to interact with and/or control an external computing device and/or apparatus. A hardware interface may allow a computational system to send control signals or instructions to an external computing device and/or apparatus. A hardware interface may also enable a computational system to exchange data with an external computing device and/or apparatus. Examples of a hardware interface include, but are not limited to: a universal serial bus, IEEE <NUM> port, parallel port, IEEE <NUM> port, serial port, RS-<NUM> port, IEEE-<NUM> port, Bluetooth connection, Wireless local area network connection, TCP/IP connection, Ethernet connection, control voltage interface, MIDI interface, analog input interface, and digital input interface.

A 'display' or 'display device' as used herein encompasses an output device or a user interface adapted for displaying images or data. A display may output visual, audio, and or tactile data. Examples of a display include, but are not limited to: a computer monitor, a television screen, a touch screen, tactile electronic display, Braille screen,
Cathode ray tube (CRT), Storage tube, Bi-stable display, Electronic paper, Vector display, Flat panel display, Vacuum fluorescent display (VF), Light-emitting diode (LED) displays, Electroluminescent display (ELD), Plasma display panels (PDP), Liquid crystal display (LCD), Organic light-emitting diode displays (OLED), a projector, and Head-mounted display.

K-space data is defined herein as being the recorded measurements of radio frequency signals emitted by atomic spins using the antenna of a Magnetic resonance apparatus during a magnetic resonance imaging scan. Magnetic resonance data is an example of tomographic medical image data.

A Magnetic Resonance Imaging (MRI) image, MR image, or magnetic resonance imaging data is defined herein as being the reconstructed two- or three-dimensional visualization of anatomic data comprised within the magnetic resonance imaging data. This visualization can be performed using a computer.

<FIG> illustrates an example of a medical instrument <NUM>. The medical instrument <NUM> is shown as comprising in this particular example a computer <NUM>. The computer <NUM> is shown as comprising an optional hardware interface <NUM>. The hardware interface <NUM> may for example be used to control other components of the medical instrument <NUM> if they are present. The medical instrument <NUM> is further shown as comprising a computational system <NUM>. The computational system <NUM> is intended to represent one or more computational systems or devices such as processors of other computers. The computational system <NUM> may be distributed also in multiple locations. The medical instrument <NUM> is further shown as comprising a user interface <NUM>. The user interface comprises a planning graphical user interface <NUM>. The medical instrument <NUM> is further shown as comprising a memory <NUM>. The memory <NUM> represents any memory that is accessible to the computational system <NUM>.

The medical instrument <NUM> illustrated in <FIG> may be a component or part of a variety of different types of systems. In one example the medical instrument <NUM> is a workstation or a computing device which is used for planning. In another example the medical instrument <NUM> may be integrated with an ablation probe or ablation probe system. In another example the medical instrument <NUM> may be integrated with a magnetic resonance imaging or other medical imaging system.

The memory <NUM> is further shown as comprising an optional automated planning module <NUM>. The automated planning module may be configured for outputting a selected ablation zone in response to inputting the remaining portion. The memory <NUM> is further shown as comprising insertion instructions <NUM> which may be presented on an optional display for insertion instructions <NUM>. For example, the insertion instructions <NUM> may comprise instructions on where and how far to insert an ablation probe.

The planning graphical user interface <NUM> is shown as comprising a first panel <NUM>, a second panel <NUM>, and a third panel <NUM>. The first panel is configured for rendering a cross-sectional view of the anatomical segmentation <NUM> and a cross-sectional view of the target zone segmentation <NUM>. The first panel <NUM> may also be configured for displaying a cross-sectional of a medical image such as a magnetic resonance image with these two cross-sectional views of the segmentations <NUM>, <NUM>.

The second panel <NUM> is configured for displaying a rendering of a first three-dimensional model <NUM>. The first three-dimensional model <NUM> is a three-dimensional model of the anatomical segmentation <NUM> and the target zone segmentation <NUM>. The second panel <NUM> may be useful because it may display the three-dimensional models of the segmentations <NUM> and <NUM> without any other medical imaging data and also in the three-dimensional means.

The third panel <NUM> displays a second three-dimensional model <NUM> that shows a remaining portion of the target zone segmentation <NUM>. Shown within the panel <NUM> are a number of ablation zone selectors <NUM> that are volumes. These correspond to volumes that the operator can select to further ablate the target zone <NUM>. After an ablation zone selector <NUM> has been removed a variety of actions may take place. For example, this area may be removed from the target zone segmentation <NUM> to show a smaller volume or region that still needs to be ablated. It may also cause the insertion instructions <NUM> to be generated. In some examples this medical instrument <NUM> may be used purely for planning purposes. For example, the insertion instructions <NUM> could be followed at a later time. In other examples the medical instrument <NUM> could be integrated with an ablation probe and/or medical imaging system for tracking and real-time updating of the remaining portion <NUM>.

Also shown on the planning graphical user interface <NUM> is an optional automated planning request control <NUM>. For example, when this button <NUM> is activated by the operator the automated planning module <NUM> may for example choose one of the ablation zone selectors <NUM> automatically.

<FIG> illustrates a further example of a medical instrument <NUM>. The medical instrument <NUM> in <FIG> is similar to the medical instrument <NUM> in <FIG> except in this example instead of the ablation zone selector selecting volumes the ablation zone selector instead selects trajectories <NUM>'. These for example may be a choice of different insertion points for an ablation probe. Once a trajectory <NUM>' is selected the ablation zone that will be ablated may be determined and this may be removed or subtracted from the remaining portion <NUM>.

<FIG> shows a flowchart which illustrates a method of operating the medical instrument <NUM> of <FIG> or <NUM> of <FIG>. First in step <NUM> the anatomical segmentation <NUM> identifying a location of an anatomical structure is received. Next in step <NUM> the target zone segmentation <NUM> is received and this identifies the location of a volume at least partially within the anatomical segmentation. Next in step <NUM> the planning graphical user interface <NUM> is displayed. The planning graphical user interface <NUM> comprises a first panel <NUM> that is configured for rendering a cross-sectional view of the anatomical segmentation <NUM> and a cross-sectional view of the target zone segmentation <NUM>. The planning graphical user interface <NUM> further comprises a second panel <NUM> that is configured for displaying a rendering of a first three-dimensional model <NUM> of the anatomical segmentation <NUM> and the target zone segmentation <NUM>.

The planning graphical user interface <NUM> further comprises a third panel <NUM> which is configured for rendering a second three-dimensional model <NUM> of a remaining portion of the target zone segmentation. The planning graphical user interface further comprises an ablation selector <NUM>, <NUM>' configured for providing an ablation zone descriptive of a volume at least partially within the remaining portion. The method then proceeds to step <NUM>. In step <NUM> the ablation zone is received from the ablation zone selector <NUM>, <NUM>'. Then in step <NUM> the remaining portion <NUM> is updated by removing the ablation zone from the remaining portion. This causes the remaining portion to become smaller. The method then proceeds to decision box <NUM>. In this step it asks are the iterations finished. If the answer is no then the method returns back to step <NUM> and another ablation zone is selected. If the answer is yes then the method proceeds to step <NUM> and the method illustrated in <FIG> ends.

<FIG> shows a further example of a medical instrument <NUM>. The medical instrument <NUM> in <FIG> is similar to the medical instruments <NUM> and <NUM> depicted in <FIG> and <FIG>. The medical instrument <NUM> additionally comprises a guidance medical image system <NUM> and an ablation probe tracking system <NUM>. There is also an ablation probe system <NUM> displayed. The guidance medical image system <NUM> may represent any number of different modalities of medical imaging that may be used for tracking the insertion of the ablation probe <NUM>. The guidance medical imaging system <NUM> has an imaging zone <NUM> from which guidance medical image data <NUM> can be acquired. A subject <NUM> is shown as on a subject support <NUM> and is supported such that the anatomical structure <NUM> and the target zone <NUM> are within the imaging zone <NUM>.

The planning graphical user interface <NUM> is further shown as having a real-time rendering <NUM> of the guidance medical image data <NUM> acquired by the guidance medical imaging system <NUM>. It clearly displays the position of the ablation probe <NUM>. The medical instrument <NUM> is also shown as comprising an ablation probe tracking system <NUM>. This may for example comprise electronics which are able to localize the position and orientation of the ablation probe <NUM> so that is can be better determined what region of the subject <NUM> is actually ablated by the probe <NUM>. This can be used to update or correct the remaining portion <NUM>.

<FIG> illustrates a further example of a medical instrument <NUM>. The medical instrument <NUM> in <FIG> is similar to the medical instruments <NUM> and <NUM> except that the medical instrument <NUM> further comprises a planning magnetic resonance imaging system <NUM>. The planning magnetic resonance imaging system <NUM> is a magnetic resonance imaging system. The term planning in the planning magnetic resonance imaging system is simply a label. Likewise, the planning label is used for pulse sequence commands, k-space data and images from this planning magnetic resonance imaging system <NUM>. The features of <FIG> may be freely combined with the features of <FIG>. In some instances, the planning magnetic resonance imaging system <NUM> may be identical with the guidance medical imaging system <NUM>.

The planning magnetic resonance imaging system <NUM> comprises a magnet <NUM>. The magnet <NUM> is a superconducting cylindrical type magnet with a bore <NUM> through it. The use of different types of magnets is also possible; for instance it is also possible to use both a split cylindrical magnet and a so called open magnet. A split cylindrical magnet is similar to a standard cylindrical magnet, except that the cryostat has been split into two sections to allow access to the iso-plane of the magnet, such magnets may for instance be used in conjunction with charged particle beam therapy. An open magnet has two magnet sections, one above the other with a space in-between that is large enough to receive a subject: the arrangement of the two sections area similar to that of a Helmholtz coil. Open magnets are popular, because the subject is less confined. Inside the cryostat of the cylindrical magnet there is a collection of superconducting coils.

Within the bore <NUM> of the cylindrical magnet <NUM> there is an imaging zone <NUM> where the magnetic field is strong and uniform enough to perform magnetic resonance imaging. A region of interest <NUM> is shown within the imaging zone <NUM>. The k-space data that is acquired typically acquried for the region of interest. The subject <NUM> is shown as being supported by a subject support <NUM> such that at least a portion of the subject <NUM> is within the imaging zone <NUM> and the region of interest <NUM>. The anatomical structure <NUM> and the target zone <NUM> are within the field of view <NUM> which is also inside of the imaging zone <NUM>.

Within the bore <NUM> of the magnet there is also a set of magnetic field gradient coils <NUM> which is used for acquisition of preliminary magnetic resonance data to spatially encode magnetic spins within the imaging zone <NUM> of the magnet <NUM>. The magnetic field gradient coils <NUM> connected to a magnetic field gradient coil power supply <NUM>. The magnetic field gradient coils <NUM> are intended to be representative. Typically magnetic field gradient coils <NUM> comprise three separate sets of coils for spatially encoding in three orthogonal spatial directions. A magnetic field gradient power supply supplies current to the magnetic field gradient coils. The current supplied to the magnetic field gradient coils <NUM> is controlled as a function of time and may be ramped or pulsed.

Adjacent to the imaging zone <NUM> is a radio-frequency coil <NUM> for manipulating the orientations of magnetic spins within the imaging zone <NUM> and for receiving radio transmissions from spins also within the imaging zone <NUM>. The radio frequency antenna may comprise multiple coil elements. The radio frequency antenna may also be referred to as a channel or antenna. The radio-frequency coil <NUM> is connected to a radio frequency transceiver <NUM>. The radio-frequency coil <NUM> and radio frequency transceiver <NUM> may be replaced by separate transmit and receive coils and a separate transmitter and receiver. It is understood that the radio-frequency coil <NUM> and the radio frequency transceiver <NUM> are representative. The radio-frequency coil <NUM> is intended to also represent a dedicated transmit antenna and a dedicated receive antenna. Likewise the transceiver <NUM> may also represent a separate transmitter and receivers. The radio-frequency coil <NUM> may also have multiple receive/transmit elements and the radio frequency transceiver <NUM> may have multiple receive/transmit channels. For example if a parallel imaging technique such as SENSE is performed, the radio-frequency could <NUM> will have multiple coil elements.

The transceiver <NUM> and the gradient controller <NUM> are shown as being connected to the hardware interface <NUM> of a computer system <NUM>.

The memory <NUM> is further shown as comprising planning pulse sequence commands <NUM>. The planning pulse sequence commands <NUM> are pulse sequence commands. The planning pulse sequence commands <NUM> are data or commands which may be converted into commands that control the planning magnetic resonance imaging system <NUM> to acquire the planning k-space data <NUM>. The planning k-space data <NUM> is k-space data. The memory <NUM> is further shown as comprising a planning magnetic resonance image <NUM>. The planning magnetic resonance image was reconstructed from the planning k-space data <NUM> and may be segmented. The memory <NUM> is further shown as comprising an automated segmentation algorithm <NUM> that is able to automatically generate the anatomical segmentation <NUM> and/or the target zone segmentation <NUM> using the planning magnetic resonance image <NUM> as input. In some cases, these segmentations may also be provided manually using the planning graphical user interface <NUM>.

In thermal tumor ablation procedures (and may other types of ablations), it is beneficial to fully cover the tumor to eradicate the disease, without ablating surrounding critical structures. For this purpose, it is possible to create a plan upfront, yet real-time feedback mechanisms while placing the ablation applicators and performing the ablation are missing.

Examples may provide a feedback mechanism to help clinicians in assessing coverage of the tumor, and especially in identifying areas that are not treated within the tumor. The system includes visualization of the untreated area in 2D and 3D including associated interaction mechanisms.

Examples may be particularly relevant to the field of thermal ablation in general, and specifically addresses the need to support identification of areas that are not treated. Although the disclosure below is also relevant to many other types of ablation.

Percutaneous thermal ablation is an interventional cancer treatment option that has seen significant increase in adoption in the past decade, and is predicted to continue to grow at a CAGR of <NUM>-<NUM>% through <NUM>. Thermal ablation can be delivered using various ablation modalities, including radiofrequency (RF), microwave (MW), high-intensity focused ultrasound (HIFU), focal laser ablation (FLA), irreversible electroporation (IRE), cryo-ablation, etc..

In clinical practice, these ablation procedures consist of placing one or more ablation applicators (ablation probe <NUM>) inside or near the target region (target zone <NUM>) with the help of image guidance. Typically, physicians place these needle-like applicators while inspecting real-time ultrasound or interventional radiology images (CT/MR), based on information provided from the manufacturer, results in clinical trials and personal experience. The use of more advanced ablation therapy planning systems (ATPS) to plan the ablation and guide needle placement, akin to the radiation therapy planning systems (RTPS) used in brachytherapy procedures, is not wide spread due to their limited availability.

In current ablation procedures, quality assurance is limited. Most procedures are performed without a plan, and if a plan is defined, it is visualized by displaying the covered/treated area, without direct feedback on the presence of small untreated areas ("gaps") between individual ablations inside the target.

Examples may provide for an ablation therapy guidance system, capable displaying the untreated area within the target (the remaining portion <NUM>). This display (planning graphical user interface <NUM>) is interactive, 3D rendering that allows the user to determine where to place additional applicators to cover the untreated areas.

Given discrete binary representations of a lesion L (target zone <NUM>) to be treated and the ablation zone Z (<NUM>), the untreated area U (the remaining portion <NUM>) can be computed by the following equation: <MAT>.

For the purpose of visualization, the binary region U may need to be converted in a mesh or contour structure. For this purpose, the calculation may include marching squares or marching cubes as a post-processing step.

The untreated area may be visualized in 2D, e.g. on top of multi-planar reformat (MPR) visualizations of 3D image volume covering the area to be treated, or on top of live US images that are registered to the applicator plan through real-time tracking.

<FIG> and <FIG> below provide example of 2D untreated area visualizations. <FIG> shows an example of a planning magnetic resonance image <NUM>. There is visible an anatomical segmentation <NUM> with a target zone segmentation <NUM> and an ablation zone <NUM>.

<FIG> shows the same segmentations <NUM>, <NUM> and the location of the ablation zone <NUM> in an ultrasound image <NUM>. The location of a suggested position for the ablation probe <NUM> is also displayed.

The untreated area (the remaining portion <NUM>) may be visualized in 3D, e.g.by shaded surface in combination with other anatomical parts to reveal the relative location of the untreated area with respect to surrounding tissue.

<FIG> and <FIG> show two views of the third panel <NUM>. In <FIG> the remaining portion <NUM> is the entire target zone segmentation <NUM>. An ablation zone <NUM> has been selected. After this is selected the volume of the ablation zone is removed from the remaining portion <NUM>. <FIG> shows the remaining portion <NUM> after the ablation zone <NUM> has been removed.

In transperineal prostate procedures, the visualization may include a visualization of the transperineal grid template (a needle guidance device) through which applicators are being inserted. This enables the users to decide on the correct approach to cover the untreated area.

<FIG> shows an alternative means of visualization. Illustrated in <FIG> is a rendering of a transperineal grid template that lays a matrix of circles labeled A-M and <NUM>-<NUM>. These represent different locations where an ablation probe may be inserted. Underneath this grid <NUM> the ablation zone <NUM> is illustrated as well as the remaining portion <NUM>. Superimposing <NUM> in <NUM> on the grid <NUM> may help an operator visualize the proper location to insert an ablation probe.

When including more regions for healthy tissue and organs at risk, these 3D surface renderings may possibly be generated with the help of advanced techniques, such as glass rendering.

When the untreated area is visualized in 3D renderings, alongside MPR visualizations of a 3D image volume of the area to be treated, the system may incorporate a navigation aid that positions the MPR viewers based on a clicked untreated area as visualized in a 3D rendering.

In some examples, when the untreated area is visualized, the user may be able to plan an ablation within the untreated area:.

The visualization of the untreated areas plays an important role during two decision moments in an ablation procedure that is guided aby an ATPS.

The first moment is the review and approval of the plan that is to be implanted by the user. Before starting to do so, the user can inspect his plan to assess whether there are no remaining uncovered areas in the target lesion.

The second moment is after placement of the applicators, where small deviations from the plan are inevitable. Such deviations may introduce small untreated areas in between the applicators, which can now easily be visualized. If there are gaps, the user can decide to plan further ablations, to place an applicator in the untreated area, or to accept the gap as is.

Examples may possibly provide for medical instruments with one or more of the following features:
A medical instrument cable of computing and displaying the untreated area within a target for an ablation treatment.

A medical instrument capable of visualizing the untreated area relative to needle guidance device.

A medical instrument capable of calculating a new ablation plan that will cover the untreated area.

A medical instrument in which the display of the untreated area is achieved using 2D rendering techniques.

A medical instrument in which the display of the untreated area is achieved using 3D rendering techniques.

Claim 1:
A medical instrument (<NUM>, <NUM>, <NUM>, <NUM>) comprising:
- a user interface (<NUM>) comprising a display;
- a memory (<NUM>) storing machine executable instructions (<NUM>);
- a computational system (<NUM>) configured for controlling the medical instrument, wherein execution of the machine executable instructions causes the computational system to:
- receive (<NUM>) an anatomical segmentation (<NUM>) identifying a location of an anatomical structure (<NUM>);
- receive (<NUM>) a target zone segmentation (<NUM>) identifying a location of a volume (<NUM>) at least partially within the anatomical segmentation; and
- display (<NUM>) a planning graphical user interface (<NUM>) using the display; wherein the planning graphical user interface comprises a first panel (<NUM>) configured for rendering a cross sectional view of the anatomical segmentation (<NUM>) and the target zone segmentation (<NUM>); wherein the planning graphical user interface further comprises a second panel (<NUM>) configured for displaying a rendering of a first three-dimensional model (<NUM>) of the anatomical segmentation and the target zone segmentation;
wherein the planning graphical user interface further comprises a third panel (<NUM>) configured for rendering a second three-dimensional model (<NUM>) of a remaining portion of the target zone segmentation; wherein the planning graphical user interface further comprises an ablation selector (<NUM>, <NUM>', <NUM>) configured to provide a user-selectable ablation zone, descriptive of a volume at least partially within the remaining portion that the user can select to ablate the target zone segmentation;
wherein execution of the machine executable instructions further causes the computational system to iteratively :
- receive (<NUM>) an ablation zone from the ablation selector (<NUM>, <NUM>', <NUM>); and
- update (<NUM>) the remaining portion by removing the ablation zone from the remaining portion, until the corresponding iterations are finished.