Source: https://patents.google.com/patent/EP3013241A1/en
Timestamp: 2020-01-26 00:41:57
Document Index: 752100193

Matched Legal Cases: ['art 100', 'art 100', 'art 100', 'art 100', 'art 100', 'art 100', 'art 100']

EP3013241A1 - Method and system for multi-modal tissue classification - Google Patents
Method and system for multi-modal tissue classification
EP3013241A1
EP3013241A1 EP14738901.9A EP14738901A EP3013241A1 EP 3013241 A1 EP3013241 A1 EP 3013241A1 EP 14738901 A EP14738901 A EP 14738901A EP 3013241 A1 EP3013241 A1 EP 3013241A1
EP14738901.9A
EP3013241B1 (en
Amir Mohammad TAHMASEBI MARAGHOOSH
2013-06-26 Priority to US201361839424P priority Critical
2014-06-19 Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
2014-06-19 Priority to PCT/IB2014/062422 priority patent/WO2014207627A1/en
2016-05-04 Publication of EP3013241A1 publication Critical patent/EP3013241A1/en
2020-01-01 Publication of EP3013241B1 publication Critical patent/EP3013241B1/en
210000001519 tissues Anatomy 0 abstract claims description title 227
206010060862 Prostate cancer Diseases 0 description 11
102100011339 KLK3 Human genes 0 description 3
A method for multi-modal tissue classification of an anatomical tissue involves a generation of a tissue classification volume (40) of the anatomical tissue derived from a spatial registration and an image extraction of one or more MRI features of the anatomical tissue and one or more ultrasound image features of the anatomical tissue. The method further involves a classification of each voxel of the tissue classification volume (40) as one of a plurality of tissue types including a healthy tissue voxel and an unhealthy tissue voxel.
FOR MULTI-MODAL TISSUE CLASSIFICATION
The present invention generally relates to an imaging of anatomical tissues. The present invention specifically relates to a utilization of multiple imaging modalities for screening, detecting and treating unhealthy (e.g., cancerous) anatomical tissues.
Prostate cancer is one of the most common organ malignancies among
American men. Historically, a "gold standard" for prostate cancer diagnosis is a histopathologic analysis of biopsy tissue samples whereby elevated prostate specific antigen ("PSA") levels and results of digital rectal exam ("DRE") tests are considered as the screening. However, a PSA test yields low specificity and sensitivity, and detection by palpation through DRE is limited to relatively large and superficial lesions.
In ultrasound ("US") imaging, tissue classification based on acoustic parameters
(e.g., attenuation and backscattered coefficients) extracted from radio frequency ("RF") echo signals has been studied since the early 1970s. More particularly, texture features extracted from B-mode US images and spectral features extracted from calibrated average spectrum of RF echo signals have been used along with numerous
classification approaches for tissue typing as healthy or cancerous. However, while US imaging provides high temporal resolution imaging of the anatomical tissue of interest, accuracy of ultrasound-based cancer detection techniques has proven to be limited due to poor signal-to-noise ratio and low spatial resolution.
More particularly, transrectal ultrasound ("TRUS") is sometimes used as an alternative step in the screening process for prostate cancer. However, approximately 40% of the peripheral zone hypoechoic lesions have proven to be malignant.
Therefore, a clinical value of TRUS is limited to a biopsy guidance tool.
Recently, there has been significant interest in using magnetic resonance imaging ("MRI") for diagnosis of prostate cancer due to its high anatomical resolution. However, a diagnostic value of anatomical T2 -weighted ("T2W") MRI in
distinguishing prostate cancer from benign prostate lesions is limited. For example, it has been shown that the accuracy, sensitivity and positive predictive values of prostate cancer detection using MRI for tumor foci greater than 1.0 cm in diameter are 79.8%, 85.3%), and 92.6%>, respectively. Moreover, the accuracy, sensitivity and positive predictive values of prostate cancer detection using MRI decreases to 24.2%, 26.2%, and 75.9%), respectively, for tumor foci smaller than 1.0 cm.
However, a combination of anatomic, biologic, metabolic and functional dynamic information offered by multi-parametric MRI has been shown to improve prostate cancer detection accuracy. A few of the common functional MR imaging techniques that have been utilized for prostate cancer detection are dynamic contrast enhanced MR imaging ("DCE"), proton MR spectroscopic imaging ("MRSI"), and diffusion-weighted MR imaging ("DWI"). More particularly, DCE visualizes tissue vascularity, MRSI provides metabolic information and DWI shows the Brownian motion of extracellular water molecules.
Importantly, a standard of care in prostate cancer therapy is moving from a 'whole gland' approach (e.g., radical prostatectomy, whole gland radiation and brachytherapy) to more focused and localized treatment paradigms designed to only treat specific cancerous regions within the prostate. A step in this direction is the ability to accurately identify these localized cancerous regions. However, in spite of the improved capabilities of multi-parametric MRI, it is still inherently difficult for observers to accurately identify cancerous regions in a consistent manner.
Furthermore, in ultrasound images, the B-mode US image processing pipeline suppresses potential tissue signatures that may assist in differentiating cancerous tissue from normal tissue.
In general, the present invention recognizes that an automated decision support system or computer-aided diagnosis that includes different algorithms to perform image registration, image segmentation, image feature extraction, image delineation and tissue classification on multi-modality images may provide a systematic and objective approach to fuse information from different types of images. Specifically, the present invention is premised on combining tissue information extracted from spatially registered MRI images (e.g., T1W, T2W, a DWI, a DCE and MRSI) and US images (e.g., a B-mode image and a RF echo image) in order to form a vector of unique image features for each voxel of the registered images. Such a multi-modal (US-RF-MRI) vector of features combines the advantages of the multi-modalities to achieve higher accuracy, sensitivity and specificity in detecting prostate cancer.
One form of the present invention is a system for multi-modal tissue classification of an anatomical tissue that employs one or more MRI systems, one or more ultrasound systems and a workstation. In operation, the MRI system(s) generate one or more MRI features of the anatomical tissue and the ultrasound system(s) generate one or more ultrasound image features of the anatomical tissue. The workstation generates a tissue classification volume of the anatomical tissue derived from a spatial registration and an image extraction of the MRI feature(s) and the ultrasound image feature(s) of the anatomical tissue. The workstation further classifies each voxel of the tissue classification volume as one of a plurality of tissue types including a healthy tissue voxel and an unhealthy tissue voxel.
A second form of the present invention is a workstation for multi-modal tissue classification of an anatomical tissue employing an image registrator, a feature extractor and a tissue classifier. In operation, the image registrator and the feature extract generate a tissue classification volume of the anatomical tissue derived from a spatial registration and an image extraction of one or more MRI features of the anatomical tissue and one or more ultrasound image features of the anatomical tissue. The tissue classifier classifies each voxel of the tissue classification volume as one of a plurality of tissue types including a healthy tissue voxel and an unhealthy tissue voxel.
A third form of the present invention is a method for multi-modal tissue classification of an anatomical tissue involving a generation of a tissue classification volume of the anatomical tissue derived from a spatial registration and an image extraction of one or more MRI features of the anatomical tissue and one or more ultrasound image features of the anatomical tissue. The method further involves a classification of each voxel of the tissue classification volume as one of a plurality of tissue types including a healthy tissue voxel and an unhealthy tissue voxel.
FIG. 1 illustrates multi-modal tissue classification in accordance with the present invention.
FIG. 2 illustrates an exemplary embodiment of a multi-modal tissue
classification workstation in accordance with the present invention.
FIG. 3 illustrates a flowchart representative of an exemplary embodiment of a multi-modal tissue classification method in accordance with the present invention.
FIG. 4 illustrates a first exemplary implementation of the flowchart illustrated in FIG. 3 by the system illustrated in FIG. 2.
FIG. 5 illustrates a second exemplary implementation of the flowchart illustrated in FIG. 3 by the system illustrated in FIG. 2.
Referring to FIG. 1, a MRI system 20 employs a scanner 21 and a workstation 22 to generate a MRI image of an anatomical tissue of a patient, such as, for example, a MRI image 23 of anatomical tissue of a prostate 11 of a patient 10 as shown. In practice, the present invention utilizes one or more MRI systems 20 of various types to acquire MRI features of the anatomical tissue. Examples of types of MRI systems and associated MRI features of an anatomical tissue include, but are not limited to, a T2W MRI system illustrating normalized intensity-value and/or texture based features of the anatomical tissue, a DWI-MRI system illustrating apparent diffusion coefficient ("ADC") of water in the anatomical tissue, a DCE-MRI system illustrating
pharmacokinetic parameters of the anatomical tissue, and MRSI system illustrating metabolic information of the anatomical tissue.
An ultrasound system 30 employs a probe 31 and a workstation 32 to generate an ultrasound image of an anatomical tissue of a patient, such as, for example, a US image 33 of the anatomical tissue of prostate 11 of patient 10 as shown. In practice, the present invention utilizes one or more ultrasound systems 30 of various types to acquire US image features of the anatomical tissue. Examples of types of ultrasound imaging systems 30 and associated US image features of the anatomical tissue include, but are not limited to, a B-mode US imaging system illustrating texture based features of the anatomical tissue and US RF echo imaging system illustrating spectral features of the anatomical tissue. The present invention performs various known techniques including, but not limited to, image segmentation, image registration, image feature extraction, image delineation and tissue classification, on MRI images and ultrasound images of the anatomical tissue to provide a systematic and objective approach to fuse feature information from the MRI images and the ultrasound images. Specifically, the present invention is premised on combining image features extracted from spatially registered MRI images (e.g., T2W-MRI, DWI-MRI, DCE-MRI and MRSI) and ultrasound images (e.g., a B-mode image and a RF echo image) in order to form a vector of image features for each voxel of a tissue classification volume, such as, for example, tissue
classification volume 40a and tissue classification volume 40b as shown in FIG. 1.
In practice, each voxel of a tissue classification volume is classified between a healthy tissue voxel and an unhealthy tissue voxel (e.g., cancerous) based on the image feature vector of the voxel derived from the extracted image features of the spatially registered MRI images and ultrasound images. The quantity and linearity of classifications is not limited by the present invention.
For example, each voxel of tissue classification volume 40a is classified as a being a healthy tissue voxel or an unhealthy tissue voxel (e.g., cancerous) based on the image feature vector of the voxel derived from the extracted image features of the spatially registered MRI images and ultrasound images. As shown in FIG. 1, the healthy tissue voxels are the white voxels and the unhealthy tissue voxels are the black voxels.
By further example, each voxel of tissue classification volume 40b is classified as being either a healthy tissue voxel, an unhealthy tissue voxel (e.g., cancerous) or a borderline unhealthy tissue voxel based on the image feature vector of the voxel derived from the extracted image features of the spatially registered MRI images and ultrasound images. As shown in FIG. 1, the healthy tissue voxels are the white voxels, the unhealthy tissue voxels are the black voxels and the borderline unhealthy tissue voxels are the gray voxels.
Another example, not shown in FIG. 1, is the utilization of a grayscale of voxels ranging from white healthy tissue voxels through multiple gray voxels indicating various probabilities of unhealthiness of corresponding tissue to black unhealthy tissue voxels (e.g., cancerous). To facilitate an understanding of the present invention, exemplary embodiments of the present invention will now be described herein as directed to a generation of tissue classification volumes of anatomical tissue of a prostate. For purposes of the present invention, the terms "image segmentation", "image (spatial) registration", "image delineation", "image feature extraction", "tissue classification" and
"dimensionality reduction" as well as related terms are to be broadly interpreted as known in the art of the present invention. Also, in practice, the present invention applies to any anatomical region (e.g., head, thorax, pelvis, etc.) and to anatomical tissue of any anatomical structure (e.g., organs).
Referring to FIG. 2, an exemplary workstation 50 employs modules 51-53 for implementing a flowchart 100 (FIG. 3) representative of a multi-modal tissue classification method of the present invention.
In operation, workstation 50 provides a multi-modal data input channel (not shown) for receiving one or more MRI images 70 and one or more US images 80.
Second, image registrator 51 employs technique(s) for spatial registration(s) of the voxels of MRI image(s) 70 and ultrasound image(s) 80.
Third, feature extractor 52 employs technique(s) for extracting image features from the voxels of MRI image(s) 70 and ultrasound image(s) 80.
In practice, as will be further described herein, image registrator 51 and feature extractor 52 operate in tandem to extract image features from the spatially registered voxels of MRI image(s) 70 and ultrasound image(s) 80 for purposes of generating a tissue classification volume having a voxel correspondence with the spatially registered MRI image(s) 70 and ultrasound image(s) 80 and for generating a concatenated n- dimensional image feature vector for each voxel of the tissue classification volume with n equaling a total number of image features.
Fourth, tissue classifier 53 employs technique(s) for classifying, unsupervised or supervised, a tissue type of each voxel of the tissue classification volume as indicated by the image feature vector of each voxel.
Finally, a user interface (not shown) of workstation 50 provides for the display of the tissue classification volume on a voxel-by-voxel basis including zoom and pan capabilities, such as, for example, the display of tissue classification volume 40a as shown in FIG. 2. In practice, workstation 50 may provide tools for modules 51-53 including, but not limited, to an image segmentation tool to segment voxels of the anatomical tissue from MRI images 70 and US images 80 and an image delineation tool to delineate voxels of MRI images 70 and US images 80 suspicious of being unhealthy (e.g., cancerous).
Also in practice, workstation 50 may be structurally configured in any manner suitable for implementing a multi-modal tissue classification method of the present invention, particularly flowchart 100. In one embodiment, workstation 50 is structurally configured with hardware/circuitry (e.g., processor(s), memory, etc.) for executing modules 51-53 programmed and installed as software/firmware within workstation 50.
Additionally, in practice, workstation 50 may be a stand-alone workstation providing tissue classification volume(s) to an image diagnostic system 90 (e.g., a MRI system or an ultrasound system) for incorporation into a diagnostic procedure as needed and/or an interventional guidance system 91 (e.g., an electromagnetic tracking system, optical tracking system or image tracking system) for incorporation into an
interventional procedure as needed. Alternatively, workstation 50 may be incorporated within image diagnostic system 90 or incorporated within interventional guidance system 91.
Exemplary executions of flowchart 100 (FIG. 3) by workstation 50 as shown in
FIGS. 4 and 5 will now be described herein in the context of MRI images 70 consisting of a T2W image 71, a DWI image 72, a DCE image 73 and a MRSI image 74, and US images 80 consisting of a B-mode image 81 and a RF echo image 82. From the description, those having ordinary skill in the art will appreciate alternative systems and devices for implementing multi-modal tissue classification methods of the present invention.
Referring to FIG. 3, a stage S101 of flowchart 100 encompasses image registrator 51 performing an intra-modal spatial registration and/or a multi-modal spatial registration for purposes of generating a tissue classification volume having voxel correspondence with the spatially registered images. For example, as shown in FIGS. 4 and 5, image registrator 51 first performs an intra-modal spatial registration of MRI images 70 and then performs a multi-modal spatial registration of MRI images 70 and US images 80 for purposes of generating a tissue classification volume having voxel correspondence with the spatially registered MIR images 70 and US images 80. An image segmentation tool (not shown) may be utilized by image registrator 51 prior to or after the spatial registration(s) to segment voxels of the anatomical tissue (e.g., a prostrate) from MRI images 70 and US images 80.
The resulting spatial registration of MRI images 70 and US images 80 are communicated to feature extractor 52 whereby a stage SI 02 of flowchart 100 encompasses feature extractor 52 extracting and concatenating image features from each voxel of the spatial registered MRI image(s) 70 and US image(s) 80 to generate a n-dimensional image feature vector for each voxel of the tissue classification volume.
For example, as shown in FIG. 4, a feature extractor 52a extracts normalized intensity-value and/or texture based features of the anatomical tissue from T2W image 71, an apparent diffusion coefficient ("ADC") of water of the anatomical tissue from DWI image 72, pharmacokinetic parameters of the anatomical tissue from DCE image 73, metabolic information of the anatomical tissue from MRS image 74, texture based image features of the anatomical tissue from B-mode image 81 and spectral image features of the anatomical tissue from RF image 82. From the spatially registered extractions, feature extractor 52a generates a vector 40a of six (6) dimensional image features for each voxel of the tissue classification volume.
If not utilized by image registrator 51, the image segmentation tool (not shown) may be utilized by feature extractor 52a prior to or after the generation of an image feature vector 40a for each voxel.
By further example, as shown in FIG. 5, a feature extractor 52b utilizes a MRI image delineator 54 to delineate voxels of MRI images 70 representative of unhealthy (e.g., cancerous) portions of the anatomical tissue and generates a weight Wi of a distance from a boundary of the anatomical structure for each voxel from spatially registered MRI images 70. Feature extractor 52b then extracts texture based image features of the anatomical tissue from B-mode image 81 and spectral image features of the anatomical tissue from RF image 82. From the spatially registered extractions, feature extractor 52b generates a weighted vector 40b of two (2) dimensional image features for each voxel of the tissue classification volume. If not utilized by image registrator 51, the image segmentation tool (not shown) may be utilized by feature extractor 52b prior to or after the generation of an image feature vector 40b for each voxel.
Upon completion of stage SI 02, the resulting image feature vector for each voxel (e.g., image feature vectors 40a or image feature vectors 40b) of the tissue classification volume is communicated to a tissue classifier 53 whereby a stage SI 03 of flowchart 100 encompasses tissue classifier 53 classifying, unsupervised or supervised, a tissue type of each voxel for the tissue classification volume (e.g., tissue classification volume 40a and tissue classification volume 40b) as indicated by the image feature vector of each voxel.
For example, all of the image features of the image feature vector of a particular voxel may indicate the associated anatomical tissue is healthy (i.e., normal cells or void of any cellular irregularities). Conversely, one or more of the image features of the image feature vector of a particular voxel may indicate the associated anatomical tissue may be or is unhealthy to some degree (i.e., abnormal cells or inclusive of any cellular irregularity).
Referring to FIG. 2, upon completion of flowchart 100, the tissue classification volume may be displayed by workstation 50, image diagnostic system 90 and/or interventional guidance system 91. Additionally, an overlay or fusion of the tissue classification volume may be displayed on/within an image of the anatomical tissue generated by image diagnostic system 90 and/or interventional guidance system 91.
Referring to FIGS. 1-5, those having ordinary skill in the art will appreciate numerous benefits of the present invention including, but not limited to, an
improvement in a sensitivity and specificity of cancer detection for any anatomical tissue (e.g., a prostate). As such, the present invention is applicable in all diagnostic and therapeutic scenarios that would benefit from the ability to localize a location and size of tumors within a gland/section of tissue.
Those having ordinary skill in the art will further appreciate the implementation of the present invention with alternative imaging modalities (e.g., computed
tomography and SPECT, PET, etc.).
1. A system for multi-modal tissue classification of an anatomical tissue, the system comprising:
at least one MRI system (20) structurally configured to generate at least one MRI feature of the anatomical tissue;
at least one ultrasound system (30) structurally configured to generate at least one ultrasound image feature of the anatomical tissue; and
a workstation (60) structurally configured to generate a tissue classification volume (40) of the anatomical tissue derived from a spatial registration and an image extraction of the at least one MRI feature and the at least one ultrasound image feature of the anatomical tissue,
wherein the workstation (60) is further structurally operable to classify each voxel of the tissue classification volume as one of a plurality tissue types including at least a healthy tissue voxel and an unhealthy tissue voxel.
2. The system of claim 1, wherein a generation of the tissue classification volume (40) includes:
the workstation (60) spatially registering and image extracting the at least one MRI feature and the at least one ultrasound image feature of the anatomical tissue; and the workstation (60) generating an image feature vector (41) for each voxel, each image feature vector (41) including a concatenation of a spatially registered and image extracted at least one MRI feature and at least one ultrasound image feature of the anatomical tissue associated with a corresponding voxel.
3. The system of claim 2, wherein a classification of each voxel of the tissue classification volume (40) as one of the tissue types is derived from the concatenation of image features of the anatomical tissue included within a corresponding image feature vector (41).
4. The system of claim 1, wherein a generation of the tissue classification volume (40) includes: the workstation (60) image extracting at least two ultrasound image features of the anatomical tissue; and
the workstation (60) generating an image feature vector (41) for each voxel, each image feature vector (41) including a concatenation of the image extracted at least two ultrasound image features of the anatomical tissue associated with a corresponding voxel.
5. The system of claim 4, wherein the generation of the tissue classification volume (40) further includes:
the workstation spatially registering the at least one MRI feature and the at least two ultrasound image features;
the workstation (60) generating a weighted factor for each voxel, each weighted factor being derived from a delineation of each spatially registered at least one MRI feature of the anatomical tissue representative of an unhealthy portion of the anatomical tissue; and
the workstation (60) applying each weighted factor to a corresponding image feature vector (41).
6. The system of claim 5, wherein a classification of each voxel of the tissue classification volume (40) as one of the tissue types is derived from the concatenation of image features of the anatomical tissue within a corresponding image feature vector (41).
7. The system of claim 1, wherein the plurality of tissue types further includes a borderline unhealthy tissue voxel.
8. The system of claim 1, wherein the plurality of tissue types further includes a plurality of probable unhealthy tissue voxels ranging between the healthy tissue voxel and the unhealthy tissue voxel.
9. The system of claim 1, further comprising: an image diagnostic system (90) structurally configured for incorporating the tissue classification volume (40) into a diagnostic procedure.
an interventional guidance system (91) structurally configured for incorporating the tissue classification volume (40) into an interventional procedure.
11. A workstation (60) for multi-modal tissue classification of an anatomical tissue, the workstation (60) comprising:
an image registrator (51) and a feature extractor (52) structurally configured to generate a tissue classification volume (40) of the anatomical tissue derived from a spatial registration and an image extraction of at least one MRI feature of the anatomical tissue and at least one ultrasound image feature of the anatomical tissue; and
a tissue classifier (53) structurally configured to classify each voxel of the tissue classification volume (40) as one of a tissue type including at least a healthy tissue voxel and an unhealthy tissue voxel.
12. The workstation (60) of claim 11, a generation of the tissue classification volume (40) includes:
the image register (51) spatially registering the at least one MRI feature and the at least one ultrasound image feature of the anatomical tissue;
the feature extractor (52) extracting the spatially registered at least one MRI feature and at least one ultrasound image feature of the anatomical tissue; and
the feature generator (52) generating an image feature vector (41) for each voxel, each image feature vector (41) including a concatenation of the spatially registered and image extracted at least one MRI feature and at least one ultrasound image feature of the anatomical tissue associated with a corresponding voxel.
13. The system of claim 12, wherein a classification of each voxel of the tissue classification volume (40) as one of the tissue types is derived from the concatenation of image features of the anatomical tissue included within a corresponding image feature vector (41).
14. The workstation (60) of claim 11, wherein a generation of the tissue classification volume (40) includes:
the image register (51) spatially registering the at least one MRI feature and at least two ultrasound image features of the anatomical tissue;
the feature extractor (52) image extracting the at least two ultrasound image features of the anatomical tissue;
the feature extractor (52) generating an image feature vector (41) for each voxel, each image feature vector (41) including a concatenation of the image extracted at least two ultrasound image features of the anatomical tissue associated with a corresponding voxel;
the feature extractor (52) generating a weighted factor for each voxel, each weighted factor being derived from a delineation of each spatially registered at least one MRI feature of the anatomical tissue representative of a suspicious unhealthy portion of the anatomical tissue; and
the feature extractor (52) applying each weighted factor to each image feature vector (41) of the corresponding voxel.
15. The workstation (60) of claim 14, wherein a classification of each voxel of the tissue classification volume (40) as one of the tissue types is derived from the concatenation of image features of the anatomical tissue included within a
corresponding image feature vector (41).
16. A method for multi-modal tissue classification of an anatomical tissue, the method comprising:
generating a a tissue classification volume (40) of the anatomical tissue derived from a spatial registration and an image extraction of at least one MRI feature and at least one ultrasound image feature of the anatomical tissue; and classifying each voxel of the tissue classification volume (40) as one of a plurality of tissue types including at least a healthy tissue voxel and an unhealthy tissue voxel.
17. The method of claim 16, wherein the generation of the tissue classification volume (40):
spatially registering and image extracting the at least one MRI feature and the at least one ultrasound image feature of the anatomical tissue; and
generating an image feature vector (41) for each voxel, each image feature vector (41) including a concatenation of the spatially registered and image extracted at least one MRI feature and at least one ultrasound image feature of the anatomical tissue associated with a corresponding voxel.
18. The method of claim 17, wherein a classification of each voxel of the tissue classification volume (40) as one of the tissue types is derived from the concatenation of image features of the anatomical tissue included within a corresponding image feature vector (41).
19 The method of claim 16, wherein the generation of the tissue classification volume (40) includes:
spatially registering the at least one MRI feature and the at least one ultrasound image feature of the anatomical tissue;
image extracting the at least one ultrasound image feature of the anatomical tissue;
generating an image feature vector (41) for each voxel, each image feature vector (41) including a concatenation of the image extracted at least one ultrasound image feature of the anatomical tissue associated with a corresponding voxel;
generating a weighted factor for each voxel, each weighted factor being derived from a delineation of each spatially registered at least one MRI feature of the anatomical tissue representative of a suspicious unhealthy portion of the anatomical tissue; and applying each weighted factor to each image feature vector (41) of the corresponding voxel.
20. The method of claim 19, wherein a classification of each voxel of the tissue classification volume (40) as one of the tissue types is derived from the concatenation of image features of the anatomical tissue included within a corresponding image feature vector (41).
EP14738901.9A 2013-06-26 2014-06-19 System for multi-modal tissue classification Active EP3013241B1 (en)
US201361839424P true 2013-06-26 2013-06-26
PCT/IB2014/062422 WO2014207627A1 (en) 2013-06-26 2014-06-19 Method and system for multi-modal tissue classification
EP3013241A1 true EP3013241A1 (en) 2016-05-04
EP3013241B1 EP3013241B1 (en) 2020-01-01
ID=51177105
EP14738901.9A Active EP3013241B1 (en) 2013-06-26 2014-06-19 System for multi-modal tissue classification
US (1) US20160098621A1 (en)
EP (1) EP3013241B1 (en)
JP (1) JP6445548B2 (en)
CN (1) CN105338905B (en)
WO (1) WO2014207627A1 (en)
CN107810537A (en) 2015-06-12 2018-03-16 皇家飞利浦有限公司 System and method for identifying cancerous issue
JP2007524461A (en) * 2003-06-25 2007-08-30 シーメンス メディカル ソリューションズ ユーエスエー インコーポレイテッドＳｉｅｍｅｎｓ Ｍｅｄｉｃａｌ Ｓｏｌｕｔｉｏｎｓ ＵＳＡ，Ｉｎｃ． Mammography automatic diagnosis and decision support system and method
US7636420B2 (en) * 2005-05-26 2009-12-22 Koninklijke Philips Electronics N.V. Radio-therapeutic treatment planning incorporating functional imaging information
JP5429517B2 (en) * 2008-09-03 2014-02-26 国立大学法人金沢大学 Diagnosis support system, method and computer program
CN103200876B (en) * 2010-11-11 2015-09-09 奥林巴斯医疗株式会社 The method of operating of ultrasound observation apparatus, ultrasound observation apparatus
DE102011085894B4 (en) * 2011-11-08 2014-03-27 Siemens Aktiengesellschaft Method and electronic computing device for imaging and imaging system
2014-06-19 EP EP14738901.9A patent/EP3013241B1/en active Active
2014-06-19 US US14/891,768 patent/US20160098621A1/en active Pending
2014-06-19 JP JP2016522913A patent/JP6445548B2/en active Active
2014-06-19 WO PCT/IB2014/062422 patent/WO2014207627A1/en active Application Filing
2014-06-19 CN CN201480036465.0A patent/CN105338905B/en active IP Right Grant
See references of WO2014207627A1 *
WO2014207627A1 (en) 2014-12-31
EP3013241B1 (en) 2020-01-01
US20160098621A1 (en) 2016-04-07
JP2016523165A (en) 2016-08-08
CN105338905B (en) 2019-10-18
CN105338905A (en) 2016-02-17
JP6445548B2 (en) 2018-12-26
Kurhanewicz et al. 2008 Multiparametric magnetic resonance imaging in prostate cancer: present and future
Dighe et al. 2008 Differential diagnosis of thyroid nodules with US elastography using carotid artery pulsation
Zhi et al. 2007 Comparison of ultrasound elastography, mammography, and sonography in the diagnosis of solid breast lesions
Giannarini et al. 2012 Potential and limitations of diffusion-weighted magnetic resonance imaging in kidney, prostate, and bladder cancer including pelvic lymph node staging: a critical analysis of the literature
Lemaitre et al. 2009 Dynamic contrast-enhanced MRI of anterior prostate cancer: morphometric assessment and correlation with radical prostatectomy findings
Wefer et al. 2000 Sextant localization of prostate cancer: comparison of sextant biopsy, magnetic resonance imaging and magnetic resonance spectroscopic imaging with step section histology
Kim et al. 2010 High-b-value diffusion-weighted imaging at 3 T to detect prostate cancer: comparisons between b values of 1,000 and 2,000 s/mm2
Futterer et al. 2006 Prostate cancer localization with dynamic contrast-enhanced MR imaging and proton MR spectroscopic imaging
Partridge et al. 2010 Differential diagnosis of mammographically and clinically occult breast lesions on diffusion‐weighted MRI
Verma et al. 2012 Overview of dynamic contrast-enhanced MRI in prostate cancer diagnosis and management
Van Cauter et al. 2012 Gliomas: diffusion kurtosis MR imaging in grading
Morgan et al. 2007 Evaluation of the potential of diffusion-weighted imaging in prostate cancer detection
Rosenkrantz et al. 2013 Prostate cancer localization using multiparametric MR imaging: comparison of Prostate Imaging Reporting and Data System (PI-RADS) and Likert scales
Fütterer et al. 2006 Prostate cancer: local staging at 3-T endorectal MR imaging—early experience
Pickles et al. 2006 Diffusion‐weighted imaging of normal and malignant prostate tissue at 3.0 T
Heijmink et al. 2007 Prostate cancer: body-array versus endorectal coil MR imaging at 3 T—comparison of image quality, localization, and staging performance
Koh et al. 2008 Detection of colorectal hepatic metastases using MnDPDP MR imaging and diffusion-weighted imaging (DWI) alone and in combination
Riches et al. 2009 MRI in the detection of prostate cancer: combined apparent diffusion coefficient, metabolite ratio, and vascular parameters
Ipc: G06T 7/00 20170101ALI20190701BHEP
Ipc: G06T 7/40 20170101ALI20190701BHEP
Ipc: A61B 8/08 20060101AFI20190701BHEP
Ipc: A61B 5/055 20060101ALI20190701BHEP