Patent ID: 12260570

DETAILED DESCRIPTION

FIG.1shows a schematic representation of an embodiment of a method for providing PROV-RD result image data. In a first act, pre-acquired first image data D1 of a subject including an examination region may be received REC-D1. Further, the first image data D1 may map the examination region. In a further act, a model dataset MD may be generated GEN-MD based on the first image data D1. In a further act, pre-acquired second image data D2 of the subject may be received REC-D2. Further, the model dataset MD and the second image data D2 may map at least a common part of the examination region at a second level of detail. In a further act, the model dataset MD and the second image data D2 may be pre-aligned PREG-MD-D2 at a first level of detail below the second level of detail based on first features of a first class of features of the examination region that are mapped at the first level of detail in the model dataset MD and the second image data D2. Alternatively or in addition, the model dataset MD and the second image data D2 may be pre-aligned PREG-MD-D2 at the first level of detail based on an acquisition geometry of the second image data D2 with respect to the subject (e.g., the examination region). In a further act, the model dataset MD and the second image data D2 may be registered REG-MD-D2 at the second level of detail based on second features of a second class of features of the examination region that are mapped at the second level of detail in the model dataset MD and the second image data D2. In one embodiment, the second class of features may be mappable at the second level of detail or above. In a further act, the registered second image data D2-REG and/or the registered model dataset MD-REG may be provided PROV-RD as the result image data.

In one embodiment, the second class of features may be unique above the first level of detail. Further, the pre-alignment PREG-MD-D2 of the model dataset MD and the second image data D2 may provide a pre-alignment of the second features of the second class of features at the first level of detail for the registering REG-MD-D2 of the model dataset MD and the second image data D2 at the second level of detail. The second features may act as unambiguous fingerprints (e.g., identifiers) between respective mappings in the model dataset MD and the second image data D2 at the second level of detail. A spatial circumference of the uniqueness of the second class of features may depend on a level of accuracy of the pre-alignment PREG-MD-D2 between the model dataset MD and the second image data D2 (e.g., the first level of detail). For example, if the pre-alignment PREG-MD-D2 is spatially accurate by 2 cm, the second class of features is to be unique within a spatial circumference (e.g., a search space, of 2 cm). Alternatively, multiple non-unique features of the second class of features may be combined based on combinatoric methods to achieve uniqueness within the spatial circumference. The spatial circumference of the uniqueness of the second class of features may be determined by matching each feature of the second class of features to all other features of the second class of features in the examination region and measuring a spatial distance between the matching features. Alternatively, the spatial circumference of the uniqueness of the second class of features may be determined by statistical analysis of its complexity. Further, the spatial circumference of the uniqueness of the second class of features may become larger with a more complex geometry and/or pattern of the features of the second class of features.

Further, the providing PROV-RD of the result image data may include mixing and/or overlaying and/or superimposing the registered second image data D2-REG with the model dataset MD. Alternatively, the providing PROV-RD of the result image data may include mixing and/or overlaying and/or superimposing the registered model dataset MD-REG with the second image data D2.

FIG.2shows a schematic representation of a further embodiment of a method for providing PROV-RD result image data. A geometric and/or anatomical model MER and/or initial image data DP of the examination region may be received REC-MER, REC-DP. Further, the generating GEN-MD of the model dataset MD may include registering the first image data D1 to the geometric and/or anatomical model MER and/or the initial image data DP based on further features of the first class of features that are mapped in the first image data D1 and represented in the geometric and/or anatomical model MER and/or the initial image data DP at the first level of detail.

FIG.3shows a schematic representation of a further embodiment of a method for providing PROV-RD result image data. The first image data D1 may include a number of first mappings D1.M1 to D1.Mn of the examination region. Further, the generating GEN-MD of the model dataset MD may include reconstructing the model dataset MD from the first mappings D1.M1 to D1.Mn.

In one embodiment, the first mappings D1.M1 to D1.Mn may map a number of at least partially different sections of the examination region of the subject. Further, the registering REG-MD-D2 of the model dataset MD and the second image data D2 may include identifying at least one of the first mappings in the model dataset MD based on the pre-alignment PREG-MD-D2 of the model dataset MD and the second image data D2. The at least one first mapping corresponds with the mapping of the common part of the examination region in the second image data D2.

FIG.4shows a schematic representation of a further embodiment of a method for providing PROV-RD result image data. The first mappings D1.M1 to D1.Mn each map the common part of the examination region with at least partially different acquisition geometries in 2D. In addition, the generating GEN-MD of the model dataset MD may include reconstructing RECO-D1-F the mapping of at least part of the first features and/or second features in the model dataset MD from at least two of the first mappings D1.M1 to D1.Mn.

In addition, the second image data D2 may include a number of second 2D mappings D2.M1 to D2.Mk of the common part of the examination region with at least partially different acquisition geometries. Further, the mapping of at least part of the first features and/or second features in the second image data D2 may be reconstructed RECO-D2-F from at least two of the second 2D mappings D2.M1 to D2.Mk.

FIG.5shows a schematic representation of a further embodiment of a method for providing PROV-RD result image data. The examination region may include an anatomical object. Further, the common part of the examination region may include a first part of the anatomical object. Hence, the first D1 and the second image data D2 may each map the first part of the anatomical object D1.AO1 and D2.AO1. Further, the second image data D2 may map a second part of the anatomical object D2.AO2. The second part D2.AO2 is not mapped in the model dataset MD. For example, the second part of the anatomical object D2.AO2 is not comprised by the common part of the examination region. In one embodiment, the registering REG-MD-D2 of the model dataset MD and the second image data D2 may include determining DET-DF1 a first deformation rule for the mapping of the first part of the anatomical object in the second image data D2.AO1 based on the second features. Further, the registering REG-MD-D2 of the model dataset and the second image data D2 may include determining DET-DF2 a second deformation rule for the mapping of the second part of the anatomical object in the second image data D2.AO2 by extrapolating the first deformation rule. Further, the registering REG-MD-D2 of the model dataset and the second image data D2 may include applying the first deformation rule and the second deformation rule to the second image data D2.

FIG.6shows a schematic representation of an embodiment of a provision unit PRVS. The provision unit PRVS may include a calculation unit CU, a memory unit MU, and/or an interface IF. Further, the provision unit PRVS may be configured to execute an embodiment of the method for providing PROV-RD result image data according to the present embodiments. The calculation unit CU, the memory unit MU, and/or the interface IF are configured to execute the respective acts. For example, the interface IF may be configured to receive the first image data and the second image data REC-D1 and REC-D2. Further, the interface IF may be configured to provide PROV-RD the result image data. Further, the calculation CU and/or the memory unit MU may be configured to generate GEN-MD the model dataset MD, to pre-align PREG-MD-D2 and to register REG-MD-D2 the model dataset MD and the second image data D2.

FIG.7shows a schematic representation of an embodiment of a system, where the system includes a provision unit PRVS according to the present embodiments, a first medical imaging device, a second medical imaging device, and a display unit41. The first medical imaging device and the second medical imaging device may be different imaging modalities. For example, the first medical imaging device may be embodied as a medical C-arm X-ray system37that may be configured to acquire the first image data D1 of the subject31including the examination region ER. Further, the second medical imaging device may be embodied as a medical ultrasound device IU1 that is configured to acquire the second image data D2 of the subject31. The first image data D1 and the second image data D2 may map at least the common part of the examination region ER at the second level of detail.

The medical C-arm X-ray system37may include an X-ray detector34and an X-ray source33that may be mounted to a C-arm38of the C-arm X-ray system37such that the X-ray detector34and the X-ray source33are movable (e.g., rotatable) around at least one axis. In addition, the medical C-arm X-ray system37may include a motion unit39(e.g., including at least a wheel and/or rail and/or robotic system) that permits a spatial motion of the medical C-arm X-ray system37. For the acquisition of the first image data D1 of the subject31(e.g., including at least one projection image of the of the subject31), the provision unit PRVS may send a signal24to the X-ray source33. Consequently, the X-ray source33may emit an X-ray bundle (e.g., a cone-beam and/or a fan-beam and/or a parallel-beam). When the X-ray bundle impinges on a surface of the X-ray detector34after an interaction between the X-ray bundle and the region under examination RE of the subject31, the X-ray detector34may send a signal21to the provision unit PRVS that is dependent on the detected X-rays. Based on the signal21, the provision unit PRVS may be configured to receive first image data D1.

The medical ultrasound device UI1 may include at least one ultrasound transducer. For example, the medical ultrasound device UI1 may include multiple ultrasound transducers that may be spatially arranged in a loop (e.g., an ellipse or circle), a row, an array and/or a matrix. The at least one ultrasound transducer may be configured to emit a field of ultrasound into the subject31(e.g., the examination region ER) by a coupling medium (e.g., a gel). Further, the at least one ultrasound transducer may be configured to detect a reflected and/or transmitted portion of the ultrasound field after an interaction between the ultrasound field and the subject31(e.g., the examination region ER). In one embodiment, the medical ultrasound device UI1 may be configured to provide a signal36depending on the received portion of the ultrasound field. Based on the signal36, the provision unit PRVS may be configured to receive second image data D2.

The provision unit PRVS may be configured to generate the model dataset MD based on the first image data D1. Further, the provision unit PRVS may be configured to pre-align PREG-MD-D2 the model dataset MD and the second image data D2 at a first level of detail below the second level of detail based on first features of the first class of features of the examination region ER that are mapped at the first level of detail in the model dataset MD and the second image data D2. Alternatively or in addition, the provision unit PRVS may be configured to pre-align PREG-MD-D2 the model dataset MD and the second image data D2 at the first level of detail based on an acquisition geometry of the second image data D2 with respect to the subject31(e.g., the examination region ER). In addition, the provision unit PRVS may be configured to register REG-MD-D2 the model dataset MD and the second image data D2 at the second level of detail based on second features of a second class of features of the examination region ER that are mapped at the second level of detail in the model dataset MD and the second image data D2. In one embodiment, the second class of features is mappable at the second level of detail or above. Further, the provision unit PRVS may be configured to provide PROV-RD the registered second image data D2-REG and/or the registered model dataset MD-REG as result image data. For example, the provision unit PRVS may be configured to provide PROV-RD the registered second image data D2-REG and/or the registered model dataset MD-REG as result image data to the display unit41via a signal25.

The display unit41may include a display and/or monitor that is configured to display the graphical representation of the result image data. The system may further include an input unit42(e.g., a keyboard). The input unit42may be integrated into the display unit41(e.g., as a capacitive and/or resistive touch display). The input unit42may be configured to capture a user input (e.g., from a medical staff). Further, the provision unit PRVS may be configured to receive the user input from the input unit42via a signal26. The provision unit PRVS may be configured to control the acquisition of the first image data D1 and the further image data D2 by the medical C-arm X-ray system37based on the user input (e.g., based on the signal26).

FIG.8shows a schematic representation of a further embodiment of a system. The first medical imaging device may be an extracorporeal imaging modality. Like illustrated inFIG.7, the first medical imaging device may be embodied as the medical C-arm X-ray system37that may be configured to acquire the first image data D1 from outside the subject. Further, the second medical imaging device IU2 may be embodied as an endoluminal imaging modality (e.g., a diagnostic and/or surgical instrument, such as an endoscope and/or laparoscope and/or bronchoscope and/or catheter) that is configured to be at least partially inserted into the subject31(e.g., a cavity and/or hollow organ of the subject31). The second medical imaging device IU2 may be configured to acquire the second image data D2 from within the subject31(e.g., from within the examination region ER and/or adjacent to the examination region ER). The second imaging device IU2 may be configured to provide the second image data D2 to the provision unit PRVS via the signal36.

Although the present invention has been described in detail with reference to embodiments, the present invention is not limited by the disclosed examples from which the skilled person is able to derive other variations without departing from the scope of the invention. In addition, the utilization of indefinite articles such as “a” and/or “an” does not exclude multiples of the respective features. Further, terms such as “unit” and “element” do not exclude that the respective components may include multiple interacting sub-components, where the sub-components may further be spatially distributed.

The elements and features recited in the appended claims may be combined in different ways to produce new claims that likewise fall within the scope of the present invention. Thus, whereas the dependent claims appended below depend from only a single independent or dependent claim, it is to be understood that these dependent claims may, alternatively, be made to depend in the alternative from any preceding or following claim, whether independent or dependent. Such new combinations are to be understood as forming a part of the present specification.

While the present invention has been described above by reference to various embodiments, it should be understood that many changes and modifications can be made to the described embodiments. It is therefore intended that the foregoing description be regarded as illustrative rather than limiting, and that it be understood that all equivalents and/or combinations of embodiments are intended to be included in this description.