METHOD AND APPARATUS FOR NON-INVASIVE QUANTIFICATION OF METABOLITES IN THE BODY BASED ON ARTIFICIAL NEURAL NETWORKS

A method of quantifying, by a quantification apparatus, metabolites in a body includes: predicting aleotoric uncertainty information and a sample spectrum from a pre-processed input spectrum using an artificial neural network, wherein the sample spectrum has a form in which signal quality is improved compared to the pre-processed input spectrum; generating a predictive mean spectrum by calculating an average of the sample spectrum; calculating an epistemic uncertainty spectrum of the sample spectrum based on a variance of the sample spectrum; calculating an aleatoric uncertainty spectrum of the sample spectrum based on an average of the aleatoric uncertainty information; and calculating a two-standard deviation spectrum (2SD spectrum) of the sample spectrum based on the epistemic uncertainty spectrum and the aleatoric uncertainty spectrum.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and the benefit of Korean Patent Application No. 10-2022-0037208, filed on Mar. 25, 2022, the disclosure of which is incorporated herein by reference in its entirety.

BACKGROUND

1. Field of the Invention

The present disclosure relates to a method and apparatus for non-invasively quantifying metabolites in the body using an artificial neural network technology.

2. Discussion of Related Art

In general, magnetic resonance spectroscopy (MRS) is used for non-invasive quantification of metabolites in the body. MRS data is a resonance signal of a one-dimensional data type that may be acquired from a magnetic resonance imaging (MRI) system for the whole body. In the MRS data, resonance signals of various metabolites including water may appear by overlapping at positions in a specific anatomical region.

However, the quality of the resonance signal significantly degrades compared to magnetic resonance image data due to the patient's motion, hardware performance, and the characteristics of scan parameters. Since the metabolites in the body contain various types of pathophysiological information of patients and have the potential to be used for medical diagnosis, it is very important to separate and quantify the resonance signals of metabolites in MRS data without information distortion.

SUMMARY OF THE INVENTION

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the following detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to assist in determining the scope of the claimed subject matter.

The present disclosure is directed to providing a method and apparatus for non-invasive quantification of metabolites in the body capable of improving the accuracy of metabolites quantification and the uncertainty information of metabolites quantification compared to the conventional method by constructing a Bayesian convolutional neural network (BCNN)-based variational inference network optimized for a magnetic resonance spectroscopy (MRS) data format and developing a pre-processing algorithm and post-processing algorithm of the network.

The technical problems to be solved by the present disclosure are not limited to the above-mentioned technical problems. That is, other technical problems that are not mentioned may be obviously understood by those skilled in the art to which the present disclosure pertains from the following detailed description.

According to an aspect of the present disclosure, there is provided a method for non-invasive quantification of metabolites in a body including predicting aleotoric uncertainty information and a sample spectrum from a pre-processed input spectrum using an artificial neural network, wherein the sample spectrum has a form in which signal quality is improved compared to the pre-processed input spectrum, generating a predictive mean spectrum by calculating an average of the sample spectrum, calculating an epistemic uncertainty spectrum of the sample spectrum based on a variance of the sample spectrum, calculating an aleatoric uncertainty spectrum of the sample spectrum based on an average of the aleatoric uncertainty information, and calculating a two-standard deviation spectrum (2SD spectrum) of the sample spectrum based on the epistemic uncertainty spectrum and the aleatoric uncertainty spectrum.

The artificial neural network may include a Bayesian convolutional neural network (BCNN).

When compared to the pre-processed input spectrum, in the sample spectrum, signal-to-noise ratio (SNR), linewidth, and phase/frequency may be adjusted, and an MM signal may be added.

The predicting may include predicting T sample spectra and T pieces of aleatoric uncertainty information per the pre-processed input spectrum through T-time Monte Carlo dropout sampling (MCDO sampling), the sample spectrum may correspond to a metabolite-only output spectrum, and the aleatoric uncertainty information may correspond to a noise variance spectrum.

The predictive mean spectrum may be generated based on an average value of the sample spectra for each data point.

The calculating of the 2SD spectrum may include calculating a total uncertainty spectrum by summing the epistemic uncertainty spectrum and the aleatoric uncertainty spectrum, calculating a standard deviation spectrum (SD-spectrum) from a ½ power of the total uncertainty spectrum, and calculating the 2SD spectrum by multiplying the SD spectrum by 2.

The method may further include performing baseline correction on the predictive mean spectrum and the 2SD spectrum, calculating a metabolite content value by performing linear regression on the corrected predictive mean spectrum, calculating a metabolite standard deviation value by performing linear regression on the corrected 2SD spectrum, and normalizing the metabolite content value and the metabolite standard deviation value.

The method may further include converting the normalized metabolite content value and the normalized metabolite standard deviation value into a vector form and transmitting the converted vector to an output unit.

The normalizing may be based on (1) a relative content of the metabolite to water or (2) a relative content of the metabolite to a reference metabolite.

The relative content of the metabolite to the water may be based on Equation 1.

where Concmetadenotes a content of a target metabolite (mmol/L), the Smetadenotes a signal area of the target metabolite, the Swaterdenotes a signal area of the water, the CorrTiss denotes a ratio of water in a biological tissue from which a MRS signal is obtained, the Nspinswaterdenotes the number of spins of water participating in generating a resonance signal, and the Nspinsmetadenotes the number of spins of the target metabolite participating in generating the resonance signal.

The method may further include forming a reconstructed signal by calculating a difference between the normalized metabolite content value and the predictive mean spectrum, forming a reconstructed signal by calculating a difference between the normalized metabolite standard deviation value and the 2SD spectrum, and checking accuracy of the normalization based on a result of comparing the reconstructed signals.

The method may further include transmitting the predictive mean spectrum and the 2SD spectrum to an output unit.

According to another aspect of the present disclosure, there is provided an apparatus for non-invasive quantification of metabolites in a body, which includes: one or more processors; and one or more memories configured to store instructions that, when executed by the one or more processors, cause the one or more processors to perform a calculation, in which the calculation performed by the one or more processors may include a calculation of pre-processing encrypted MRS data to provide an input spectrum; a calculation of predicting aleatoric uncertainty information and a sample spectrum from the pre-processed input spectrum using an artificial neural network, a calculation of calculating a predictive mean spectrum of the predicted sample spectrum and a 2SD spectrum of the predicted sample spectrum based on the predicted sample spectrum and the predicted aleatoric uncertainty information, a calculation of calculating a metabolite content value by performing linear regression on the predictive mean spectrum, a calculation of calculating a metabolite standard deviation value by performing linear regression on the 2SD spectrum, and a calculation of normalizing each of the metabolite content value and the metabolite standard deviation value.

The accompanying drawings, which are included as part of the detailed description to assist understanding of the present disclosure, illustrate embodiments of the present disclosure and explain the technical features of the present disclosure together with the detailed description.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Hereafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and the same or similar components are given the same reference numerals regardless of the numbers of figures and are not repeatedly described. In addition, the terms “module” and “unit” for components used in the following description are used only to easily make the disclosure. Therefore, these terms do not have meanings or roles that distinguish from each other in themselves. Further, when it is determined that a detailed description for the known art related to the present disclosure may obscure the gist of the present disclosure, the detailed description will be omitted. Further, it should be understood that the accompanying drawings are provided only in order to allow exemplary embodiments of the present disclosure to be easily understood, and the spirit of the present disclosure is not limited by the accompanying drawings, but includes all the modifications, equivalents, and substitutions included in the spirit and the scope of the present disclosure.

Terms including ordinal numbers such as “first,” “second,” etc., may be used to describe various components, but the components are not to be construed as being limited to the terms. The terms are used only to distinguish one component from another component.

It is to be understood that when a first element is referred to as being “connected to” or “coupled to” a second element, it may be connected directly to or coupled directly to the second element or be connected to or coupled to the second element with a third element interposed therebetween. On the other hand, it should be understood that when a first element is referred to as being “connected directly to” or “coupled directly to” a second element, it may be connected to or coupled to the second element without a third element interposed therebetween.

Singular forms are intended to include plural forms unless the context clearly indicates otherwise.

It will be further understood that terms “include” or “have” used in the present specification specify the presence of features, numerals, steps, operations, components, parts mentioned in the present specification, or combinations thereof, but do not preclude the presence or addition of one or more other features, numerals, steps, operations, components, parts, or combinations thereof.

FIG.1is a block diagram for describing an electronic device according to the present disclosure.

An electronic device100may include a wireless communication unit110, an input unit120, a sensing unit140, an output unit150, an interface unit160, a memory170, a control unit180, a power supply unit190, and the like. The components illustrated inFIG.1are not essential to implementing the electronic device100, so the electronic devices described herein may have more or fewer components than those listed above.

More specifically, the wireless communication unit110of the components may include one or more modules which enable wireless communication between the electronic device100and a wireless communication system, between the electronic device100and other electronic devices100, or the electronic device100and an external server. In addition, the wireless communication unit110may include one or more modules which connect the electronic device100to one or more networks.

The wireless communication unit110may include at least one of a broadcast receiving module111, a mobile communication module112, a wireless Internet module113, a near field communication module114, and a location information module115.

The input unit120may include a camera121or an image input unit for inputting an image signal, a microphone122or an audio input unit for inputting a sound signal, and a user input unit123for receiving information from a user. Examples of the user input unit123may include a touch key, a push key (mechanical key), and the like. Voice data or image data collected by the input unit120may be analyzed and processed as a control command of the user.

The sensing unit140may include one or more sensors for sensing at least one of information in the electronic device100, information on an environment surrounding the electronic device100, and user information. For example, the sensing unit140may include at least one of a proximity sensor141, an illumination sensor142, a touch sensor, an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an red-green-blue (RGB) sensor, an infrared sensor (IR sensor), a fingerprint sensor, an ultrasonic sensor, an optical sensor, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, a radiation detection sensor, a thermal detection sensor, a gas detection sensor, etc.), and a chemical sensor (e.g., an electronic nose sensor, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the electronic device100may use a combination of information sensed by at least two or more of these sensors.

The output unit150is for generating an output related to a sight, hearing, or tactile sense. The output unit150may include at least one of a display unit151, a sound output unit152, a haptic module153, and an optical output unit154. The display unit151forms a layer structure with or is integrally formed with the touch sensor, thereby implementing a touch screen. The touch screen may function as the user input unit123which provides an input interface between the electronic device100and the user, and may provide an output interface between the electronic device100and the user.

The interface unit160serves as a path of various types of external devices connected to the electronic device100. The interface unit160may include at least one of a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connection of devices including an identity module, an audio input/output (I/O) port, a video I/O port, and an earphone port. In the electronic device100, an appropriate control related to the connected external device may be performed in response to the connection of the external device to the interface unit160.

In addition, the memory170stores data supporting various functions of the electronic device100. The memory170may store a plurality of application programs or applications that are driven by the electronic device100, and data and instructions for operating the electronic device100. At least some of these application programs may be downloaded from the external server via the wireless communication. In addition, at least some of these application programs may exist in the electronic device100at the time of shipment for basic functions (for example, an incoming and outgoing call function, and a message reception and transmission function) of the electronic device100. Meanwhile, the application program may be stored in the memory170, installed on the electronic device100, and driven by the control unit180to perform the operation or function of the electronic device.

In addition to the operation related to the application program, the control unit180typically controls the overall operation of the electronic device100. The control unit180may provide or process appropriate information or a function to a user by processing signals, data, information, and the like, which are input or output through the above-described components, or by driving an application program stored in the memory170.

In addition, the control unit180may control at least some of the components described with reference toFIG.1to drive the application program stored in the memory170. In addition, the control unit180may operate a combination of at least two or more of the components included in the electronic device100to drive the application program.

The power supply unit190receives power from an external power source and/or an internal power source under the control of the control unit180and supply the received power to each component included in the electronic device100. The power supply unit190includes a battery which may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other in order to implement an operation, a control, or a control method of the electronic device100according to various embodiments described below. In addition, the operation, control, or control method of the electronic device100may be implemented on the electronic device100by driving at least one application program stored in the memory170.

In this specification, the electronic device100may include an apparatus for quantifying metabolites in the body (hereinafter referred to as “quantification apparatus”).

FIG.2is a block diagram of an artificial intelligence (AI) device according to an embodiment of the present disclosure.

The AI device20may include an electronic device including an AI module capable of performing AI processing, a server including the AI module, or the like. In addition, the AI device20may be included as at least a part of the electronic device100illustrated inFIG.1and may be provided to perform at least a part of the AI processing together.

Specifically, as illustrated inFIG.2, the AI device20may include an AI processor21, a memory25, and/or a communication unit27.

The AI device20is a computing device capable of learning neural networks, and may be implemented as various electronic devices such as a server, a desktop PC, a notebook PC, and a tablet PC.

The AI processor21may learn an artificial neural network using a program stored in the memory25. In particular, the AI processor21may receive a one-dimensional MRS spectrum, predict a spectrum having improved signal quality compared to the received spectrum, and output the predicted spectrum. Here, examples of methods for improving signal quality may include denoising, frequency/phase-adjustment, and line-narrowing.

In addition, the AI processor21may form an artificial neural network mounted in a prediction unit to be described below.

Meanwhile, the AI processor21performing the functions as described above may be a general purpose processor (for example, central processing unit (CPU)), or may be an AI dedicated processor (for example, graphics processing unit (GPU)) for artificial intelligence learning.

The memory25may store various programs and data required for an operation of the AI device20. The memory25may be implemented by a non-volatile memory, a volatile memory, a flash memory, a hard disc drive (HDD), a solid-state drive (SSD), or the like. The memory25is accessed by the AI processor21, and readout/recording/correction/deletion/update, and the like of data in the memory25may be performed by the AI processor21. In addition, the memory25may store a neural network model (e.g., a deep learning model) generated through a learning algorithm for data classification/recognition according to an embodiment of the present disclosure.

Meanwhile, the AI processor21may include a data learning unit which learns a neural network for data classification/recognition. For example, the data learning unit may acquire learning data to be used for learning, and apply the acquired learning data to the deep learning model, thereby training the deep learning model.

The communication unit27may transmit the AI processing result by the AI processor21to an external electronic device.

Here, the external electronic device may include other terminals and/or servers.

Meanwhile, the AI device20illustrated inFIG.2has been described functionally divided into the AI processor21, the memory25, the communication unit27, and the like. However, the above-described components are integrated into one module, which may be referred to as an AI module or AI model.

FIG.3Aillustrates a pipeline of a quantification apparatus applicable to the present disclosure.

Referring toFIG.3A, a quantification apparatus300may include an input unit330, a control unit180, and an output unit340, and the control unit180of the quantification apparatus300may include a prediction unit310and a post-processing unit320.

In general, quantification of metabolites in MRS data was processed by a digital signal processing method based on a nonlinear-least-squares (NLLS) method, which causes problems with incomplete quantification results according to initial parameter conditions and algorithms.

As an uncertainty confidence index for the quantification results, a Cramer-Rao lower bound (CRLB) was used. Specifically, the related art empirically sets a CRLB criterion (20%, 30%, or 50%), and then determines that quantification results indicating a CRLB value higher than the criterion are “unreliable quantification results,” and as a result, the “unreliable quantification results” are excluded without being used for research/diagnostic purposes.

However, since the statistical meaning of the CRLB is precision not accuracy, it has been reported that there is a risk of medical statistical bias when data screening is performed for the purpose of determining whether to use the quantification results based on the upper limit.

Therefore, the development of a metabolite quantification method, performance improvement, and a more accurate quantification result confidence index is very important to use MRS data for medical diagnosis purposes. In the present disclosure, the quantification apparatus300may provide improved metabolites quantification accuracy and uncertainty information. To this end, the prediction unit310may include an artificial neural network. The artificial neural network may be a Bayesian convolutional neural network (BCNN).FIG.3Billustrates a simplified design of the BCNN and a workflow for training of the corresponding artificial neural network to estimate a metabolite content and associated uncertainty.

Referring toFIG.3B, the input of the artificial neural network is a simulated human brain spectrum at 3.0 T. It is typically degraded due to a low signal-to-noise ratio (SNR), line-broading, an MM signal, an unknown baseline, and phase/frequency shift. A ground truth target spectrum is a metabolite-only spectrum prior to adjusting a SNR, a linewidth, and a phase/frequency, and adding the MM signal. The output of the artificial neural network includes the metabolite-only spectrum and a noise variance spectrum. With T-time Monte Carlo dropout sampling, a total of T outputs per input spectrum is obtained (T=50). An average (predictive mean spectrum) of the metabolite-only output spectra is designated as a BCNN-predicted spectrum. The variance of the metabolite-only output spectra is designated as an epistemic (model) uncertainty spectrum. An average of the noise variance spectra is designated as an aleatoric (data) uncertainty spectrum. A two-standard deviation spectrum (2SD spectrum) is defined as a 2×standard deviation spectrum. A standard deviation spectrum (SD-spectrum) is acquired from (total uncertainty spectrum)1/2. The total uncertainty spectrum is a sum of the aleatoric uncertainty spectrum and the epistemic uncertainty spectrum. Multiple regression is performed on both the BCNN-predicted spectrum and the 2SD spectrum using a metabolite basis set to estimate an individual metabolite content and associated uncertainty, respectively. The uncertainty is estimated from the 2SD spectrum. When the 2SD spectrum is given in an absolute mode, in this case, the metabolite basis set is also used as the absolute mode. Finally, the BCNN-predicted metabolite content is represented as “metabolite content (% uncertainty).” Here, the “% uncertainty” may be obtained by converting the estimated uncertainty into a percentage of each metabolite content.

Referring back toFIG.3A, the prediction unit310may receive the one-dimensional MRS spectrum from the input unit330to predict a spectrum with improved signal quality of the corresponding spectrum, and may transmit first data, which is the predicted spectrum, to the output unit340and output the first data. The first data may correspond to the metabolite-only output spectra in the description referring toFIG.3B.

In addition, the prediction unit310may transmit second data, which is a variance spectrum of an output spectrum predicted based on unsupervised learning, to the output unit340and output the first data and second data together. The second data may correspond to the noise variance spectra in the description referring toFIG.3B.

The post-processing unit320may perform one-dimensional signal processing on each of the first data and the second data from the prediction unit310, and then calculate third data, which is the metabolite content, and fourth data, which is a percentage standard deviation value of the metabolite.

The output unit340may receive the third data, the fourth data, and spectra (e.g., first data, second data, and pre-processed data of the input unit330, etc.) of an intermediate stage that may be generated in the above-described pipeline and display the received third data, fourth data, and spectra on a user's screen.

FIG.4is an exemplary diagram of an operation of an input unit to which the present disclosure may be applied.

Referring toFIG.4, the input unit330may process input data and transmit the processed input data to the prediction unit310or the output unit340.

The input unit330receives encrypted MRS data (S410).

Then, the input unit330determines whether a header of the encrypted MRS data can be recognized (S420).

As a result of the determination, when the header cannot be recognized (N, S420), a user may directly input MRS data information (S430).

As a result of the determination, when the header can be recognized (Y, S420), the input unit330may acquire a manufacturer and encryption information of the MRS data from the header.

Thereafter, the input unit330decrypts the MRS data based on the encryption information (S440).

The input unit330performs a fast Fourier transform (FFT) on the decrypted data and acquires a real value (S450).

The input unit330normalizes data of the real value (S460). Examples of the normalization methods may include zero to one, zero centered, interquartile range (IQR), and the like.

The input unit330indexes the normalized data and cuts the data so that the normalized data is to be input to the prediction unit310(S470).

The cut data, that is, the pre-processed data, may be transmitted to the prediction unit310, vectorized in the prediction unit310, and then displayed in the form of a spectrum picture in the output unit340.

FIG.5is an exemplary diagram of an operation of a prediction unit to which the present disclosure may be applied.

Referring toFIG.5, the prediction unit310receives the pre-processed data from the input unit330(S510).

The prediction unit310predicts a sample spectrum and aleatoric uncertainty information of the sample spectrum based on the pre-processed data (S520). For example, the prediction unit310may predict the sample spectrum and the aleatoric uncertainty information using an artificial neural network. In more detail, the artificial neural network loaded in the prediction unit310represents a variational inference network structure based on Bayesian approximation with Monte-Carlo dropout. The artificial neural network may predict and output, based on the unsupervised learning, aleatoric uncertainty information of each sample predicted through supervised learning. Here, the “sample spectrum” and the “aleatoric uncertainty information” may correspond to the “metabolite-only output spectra” and the “noise variance spectra” in the description referring toFIG.3B, respectively. Such an artificial neural network may be pre-trained using a loss function considering heteroscedasticity. Big data may be used for pre-training.

As an example, the prediction unit310may predict the aleatoric uncertainty information by repeating as many times as the number of samples according to the number N of samples included in the pre-processed data. As another example, the number of times of repeated predictions may be empirically set by a user.

For example, when the prediction is performed N times, the prediction unit310may generate N sample spectra corresponding to the input spectrum and N aleatoric uncertainty spectra (noise variance spectra) corresponding to each sample spectrum.

As described above, when the sample spectrum and the aleatoric uncertainty information (noise variance spectrum) are predicted from the pre-processed data, the prediction unit310temporarily stores each of the predicted sample spectrum and the predicted aleatoric uncertainty information (S530and S540). The sample spectrum stored in operation S530may represent a form in which signal quality is improved compared to the spectrum of the input pre-processing data. Here, the form of the improved signal quality may mean a form in which one or more of denoising, frequency/phase-adjustment, and line-narrowing has been performed.

After operation S530, the prediction unit310calculates an average of the sample spectra (S550).

After operation S530, the prediction unit310calculates a variance of the sample spectra (S560). For example, the prediction unit310may derive the epistemic uncertainty spectrum through a variance calculation for the sample spectra and store the derived epistemic uncertainty spectrum.

In more detail, the prediction unit310may calculate the variance of the sample spectra using the artificial neural network and derive the epistemic uncertainty spectrum from a result of the calculation.

Meanwhile, after operation S540, the prediction unit310calculates the average of the aleatoric uncertainty information (noise variance spectra) for each sample spectrum (S570). For example, the prediction unit310may derive the aleatoric uncertainty spectrum through the average calculation of the aleatoric uncertainty information (noise variance spectra) for the sample spectra and store the derived aleatoric uncertainty spectrum.

In more detail, the prediction unit310may also predict the noise variance spectrum for the corresponding sample spectrum based on the unsupervised learning of the artificial neural network along with the sample spectrum. Accordingly, the corresponding noise variance spectrum may also be formed as many as the number of samples.

For example, when 50 sample spectra are generated, the same number of 50 noise variance spectra may also be generated, and the prediction unit310may calculate the average of the 50 noise variance spectra to derive the aleatoric uncertainty spectrum.

Here, the average of the sample spectra predicted by the artificial neural network may be used to quantify metabolites. The variance of the sample spectra predicted by the artificial neural network may be used as the epistemic uncertainty spectrum. The average of the variance spectra predicted by the artificial neural network may be used as the aleatoric uncertainty spectrum. The total uncertainty spectrum, which is the sum of the aleatoric uncertainty spectrum and the epistemic uncertainty spectrum, may be used for the 2SD spectrum. The 2SD spectrum may be used to estimate the uncertainty of the metabolite content by multiple regression in combination with the metabolite basis set in the absolute mode. That is, the 2SD spectrum may be used for the quantification standard deviation of the metabolite.

Meanwhile, after operation S550, the prediction unit310derives the predictive mean spectrum based on the average of the calculated sample spectra (S580).

For example, the prediction unit310may calculate the average of N sample spectra to calculate the mean spectrum. In more detail, when 50 sample spectra each having 1024 data points are generated, the prediction unit310may calculate the average of the 50 sample spectra for each data point to derive the predictive mean spectrum.

Meanwhile, after operation S570, the prediction unit310derives and stores the 2SD spectrum based on the epistemic uncertainty spectrum and the aleatoric uncertainty spectrum (S590).

For example, in the 2SD spectrum, “SD spectrum” is acquired from (total uncertainty spectrum)1/2. The total uncertainty spectrum may be defined as “aleatoric uncertainty spectrum+epistemic uncertainty spectrum.” The aleatoric uncertainty may be classified into homoscedastic aleatoric uncertainty and heteroscedastic aleatoric uncertainty.

FIG.6is an exemplary diagram of an operation of a post-processing unit to which the present disclosure may be applied.

Referring toFIG.6, the post-processing unit320receives the predictive mean spectrum from the prediction unit310(S610). In addition, the post-processing unit320receives the 2SD spectrum from the prediction unit310(S620). InFIG.6, “input 1” and “input 2” mean the predictive mean spectrum and the 2SD spectrum, respectively.

The post-processing unit320performs baseline correction on each of the predictive mean spectrum and the 2SD spectrum (S630). For example, the post-processing unit320may correct all regions without a resonance spectrum to zero through the baseline correction.

The post-processing unit320performs linear regression on the baseline-corrected data using the metabolite basis set (S640).

For example, unlike in vivo MRS spectra in which signal quality is low and individual metabolite spectra are overlapped, the metabolite basis set includes a set of high-quality reference MRS spectra for each metabolite.

In addition, each metabolite spectrum constituting the metabolite basis set needs to be acquired under exactly the same conditions as the MRS scan parameters (e.g., repetition time (TR), echo time (TE), localization pulse sequence, etc.) when acquiring the in vivo MRS spectrum.

For example, the metabolite basis set, which may be used when quantifying17metabolites of the in vivo MRS spectrum having 1024 data points, may be constituted in a matrix form of 17×1024, and may be configured as a set of spectra in independent vector form for each metabolite.

Here, as a method of acquiring each metabolite spectrum constituting the metabolite basis set, the following may be exemplified.1) Quantum mechanical calculation using a density matrix. That is, an approximated simulation method; Under specific MRS scan parameters (TR, TE, localization pulse sequence), a response shown by quantum mechanical properties (Number of spin, Chemical shift, J-coupling) in a magnetic field environment due to a molecular structure of each metabolite.2) A method of acquiring data by preparing each metabolite sample as a high-concentration aqueous solution, putting the high-concentration aqueous solution in a spherical glass ball, etc., and performing the MRS scan with the same protocol as the targeted in vivo MRS spectrum.

The post-processing unit320calculates a metabolite content value from the predictive mean spectrum through the linear regression and temporarily stores the calculated metabolite content value (S612).

The post-processing unit320calculates a metabolite standard deviation value from the 2SD spectrum through linear regression and temporarily stores the calculated metabolite standard deviation value (S622).

For example, singular value decomposition (SVD) through a Moore-Penrose pseudo inverse matrix may be performed in the linear regression.

The post-processing unit320normalizes each of the metabolite content value and the metabolite standard deviation value through a normalization function, and temporarily stores each of the normalized metabolite content value and the normalized metabolite standard deviation value (S614and S624).

For example, the normalization process may be calculated according to Equation 1. Specifically, considering a relative content of metabolite to water or a relative content to a reference metabolite (e.g., Creatine+Phosphocreatine), the relative content of metabolite to water may be calculated according to Equation 1 below.

In Equation 1, the Concmetadenotes a content of a target metabolite (mmol/L). The Smetaand the Swaterdenote a signal area of the metabolite and a signal area of the water, respectively. The CorrTiss denotes a ratio of water in a biological tissue from which the MRS signal is obtained. The Nspinswaterdenotes the number of spins of water participating in generating a resonance signal, and the Nspinsmetadenotes the number of spins of the target metabolite participating in generating the resonance signal. Equation 1 may be modified by adding a correction term considering a T1 relaxation time and a T2 relaxation time of water, and the T1 relaxation time and T2 relaxation time of the metabolite. The post-processing unit320may convert each of the normalized metabolite content value and the normalized metabolite standard deviation value into a vector form and transmit the converted normalized metabolite content value and normalized metabolite standard deviation value to the output unit340.

In addition, the post-processing unit320may take scalar products of resonance signals of metabolites in the metabolite basis set corresponding to the metabolite content values and metabolite content values, sum all the scalar products to form a reconstructed signal, and obtain a signal representing a difference between an input value (input 1) and the reconstructed signal (S613).

In addition, the post-processing unit320may take scalar products of resonance signals of metabolites in the metabolite basis set corresponding to the normalized metabolite standard deviation values and the normalized metabolite standard deviation values, sum all the scalar products to form a reconstructed signal, and obtain a signal representing a difference between an input value (input 2) and the reconstructed signal (S623). For example, the metabolite basis set used in such a deviation-related calculation may have a form converted into an absolute value form.

The reconstructed signal may be used to check whether the normalized metabolite content value and the normalized metabolite standard deviation value have actually been calculated correctly.

For example, by using the MRS spectrum having 1024 data points, both the predicted mean spectrum and the 2SD spectrum may each represent 1024 data points.

In this case, the linear regression (pinv) process based on the Moore-Penrose pseudo inverse matrix for 17 kinds of “metabolite content calculations” having 1024 data points includes “metabolite content calculation process and metabolite standard deviation calculation process,” and the calculation equation for each process is as follows. In the calculation equation below, pinv means a pseudo-inverse matrix, and abs means an absolute value.

Meanwhile, the reconstruction includes a reconstructed spectrum calculation process for the predictive mean spectrum and a reconstructed spectrum calculation process for a 2×standard deviation spectrum, and the calculation equation for each process is as follows. In the calculation equation below, sum means the summation, and abs means the absolute value.

Reconstructed spectrum of predictive mean spectrum [1024]=sum (metabolite content×(metabolite basis set))

Reconstructed spectrum of 2SD spectrum [1024]=sum(metabolite standard deviation×(abs(metabolite basis set)))

The post-processing unit320may check a difference between the reconstructed spectra and each reference spectrum. Based on the check result, it may be checked whether the prediction unit310normally operates.

FIG.7is exemplary diagram of normal operation verification to which the present disclosure may be applied.

FIG.7(A)illustrates, in order from the top, a target in vivo brain MRS spectrum (in vivo), a predictive mean spectrum (Pred.), a reconstructed predictive mean spectrum (Recon.), and a difference (Pred.−Recon.) between the predictive mean spectrum and the reconstructed predictive mean spectrum.FIG.7(B)illustrates, in order from the top, a 2×standard deviation spectrum (2SD), a reconstructed 2×standard deviation spectrum (Recon2SD), and a difference (2SD−Recon2SD) between a 2×standard deviation spectrum (2SD) and a reconstructed 2×standard deviation spectrum (Recon2SD).

Referring back toFIG.6, the post-processing unit320may convert the spectra acquired in operations S613and S623, into a vector matrix, and then transmit the converted vector matrix to the data output unit included in the output unit340.

The output unit340may receive and output the following data.From the input unit330, pre-processed MRS dataFrom the prediction unit310, predictive mean spectrum and 2SD spectrum (2SD spectrum)From the post-processing unit320, normalized metabolite content value (metabolite normalization value), normalized metabolite standard deviation value (metabolite standard deviation normalization value), difference spectrum between normalized metabolite content value and predictive mean spectrum (S610), and difference spectrum between normalized metabolite standard deviation and SD spectrum (S620).

The output unit340may display each input as a result on the user's screen.

For example, a series of quantification processes may be arranged and displayed in order, from the MRS data acquired from a patient and pre-processed to the quantification result spectrum (artificial neural network prediction spectrum and reconstructed spectrum), and in addition to this, quantification content for each metabolite and confidence index information may be displayed together.

In addition, the interface of the output unit340may be configured as a user-responsive type capable of displaying individual quantification results of each metabolites desired by the user. The interface may also include an option to output the quantification results to the outside of the device in the form of a spreadsheet or image.

FIG.8is a flowchart illustrating an embodiment of an operation of a quantification apparatus to which the present disclosure may be applied.

Referring toFIG.8, the quantification apparatus300may include the input unit330, the prediction unit310, the post-processing unit320, and the output unit340described above.

The quantification apparatus300receives encrypted MR spectroscopy (MRS) data through the input unit330, pre-processes the received encrypted MRS data, and transmits the pre-processed data to the prediction unit310(S8010). For example, the pre-processing may include a decrypting operation, an operation of acquiring a real value through fast Fourier transform, an operation of normalizing a real value, an indexing operation, and an operation of cutting data to be input to the prediction unit310.

The quantification apparatus300predicts the sample spectrum and aleatoric uncertainty information (noise dispersion spectrum) of the MRS data based on the pre-processed data through the artificial neural network included in the prediction unit310(S8020). For example, the artificial neural network may be the Bayesian convolutional Neural Network (BCNN), and the prediction unit310may predict the aleatoric uncertainty information (noise dispersion spectrum) through the artificial neural network. When the number of samples included in the pre-processed data is plural, the prediction unit310may repeatedly predict the aleatoric uncertainty information (noise dispersion spectrum) according to the number of samples.

In addition, the sample spectra may have the form in which signal quality is improved compared to the spectrum of the pre-processed data.

The quantification apparatus300calculates the average of the sample spectra to generate the predictive mean spectrum (S8030). For example, the predictive mean spectrum may be generated based on an average value of sample spectra for each data point.

The quantification apparatus300calculates the epistemic uncertainty spectrum of sample spectra (S8040). For example, the prediction unit310may calculate the epistemic uncertainty spectrum through the variance calculation for the sample spectra.

The quantification apparatus300calculates the aleatoric uncertainty spectrum of sample spectra (S8050). For example, the prediction unit310may calculate the aleatoric uncertainty spectrum of the sample spectra through the average of the aleatoric uncertainty information.

The quantification apparatus300calculates the 2SD spectrum of the sample spectra based on the epistemic uncertainty spectrum and the aleatoric uncertainty spectrum (S8060).

The quantification apparatus300transmits the predictive mean spectrum and the 2SD spectrum to the post-processing unit320and the output unit340. For example, the post-processing unit320may determine whether the quantification of quantification apparatus300is normally operating.

As a result, the present specification relates to the method of quantifying metabolites in the body through MRS data, and can provide metabolites-based medical information with significantly improved quantification accuracy compared to the existing technologies.

In addition, the reliability information of the quantification results shows significantly improved performance compared to the existing methods, enabling screening for uncertain quantification results, and can quantity metabolites at a much faster speed than the existing methods, and as a result, can be used for precise quantification of metabolites and for diagnosis assistance immediately after MRS scan.

The present specification described above can be embodied as a computer readable code on a medium in which a program is recorded. A computer readable medium may include all kinds of recording devices in which data that may be read by a computer system are stored. An example of the computer readable medium may include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a read only memory (ROM), a random access memory (RAM), a compact disk read only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage, and the like, and also include a medium implemented in a form of a carrier wave (for example, transmission through the Internet). Therefore, the above-described detailed description is to be interpreted as being illustrative rather than being restrictive in all aspects. The scope of the present specification is to be determined by reasonable interpretation of the claims, and all modifications within an equivalent range of the present specification fall in the scope of the present specification.

According to an embodiment of the present disclosure, it is possible to improve the accuracy of quantification of metabolites and the uncertainty information of quantification of metabolites by constructing a Bayesian convolutional neural network (BCNN)-based variational inference network optimized for an MRS data format and developing a pre-processing algorithm and post-processing algorithm of the network.

Effects which can be achieved by the present disclosure are not limited to the above-described effects. That is, other effects that are not described may be obviously understood by those skilled in the art to which the present disclosure pertains from the above detailed description.

In addition, although the services and embodiments have been mainly described hereinabove, this is only an example and does not limit the present specification. Those skilled in the art to which the present specification pertains may understand that several modifications and applications that are not described in the present specification may be made without departing from the spirit of the present disclosure. For example, each component described in detail in an exemplary embodiment of the present invention may be modified. In addition, differences associated with these modifications and applications are to be interpreted as being included in the scope of the present specification as defined by the following claims.