# Reference-Driven Undersampled MR Image Reconstruction Using Wavelet Sparsity-Constrained Deep Image Prior

Authors: Di Zhao; Yanhu Huang; Feng Zhao; Binyi Qin; Jincun Zheng
Journal: Computational and Mathematical Methods in Medicine
 (2021)

---

## Abstract

Deep learning has shown potential in significantly improving performance for undersampled magnetic resonance (MR) image reconstruction. However, one challenge for the application of deep learning to clinical scenarios is the requirement of large, high-quality patient-based datasets for network training. In this paper, we propose a novel deep learning-based method for undersampled MR image reconstruction that does not require pre-training procedure and pre-training datasets. The proposed reference-driven method using wavelet sparsity-constrained deep image prior (RWS-DIP) is based on the DIP framework and thereby reduces the dependence on datasets. Moreover, RWS-DIP explores and introduces structure and sparsity priors into network learning to improve the efficiency of learning. By employing a high-resolution reference image as the network input, RWS-DIP incorporates structural information into network. RWS-DIP also uses the wavelet sparsity to further enrich the implicit regularization of traditional DIP by formulating the training of network parameters as a constrained optimization problem, which is solved using the alternating direction method of multipliers (ADMM) algorithm. Experiments onin vivo MR scans have demonstrated that the RWS-DIP method can reconstruct MR images more accurately and preserve features and textures from undersampled k-space measurements.


---

## Body

## 1. Introduction

Magnetic resonance imaging (MRI) is a noninvasive imaging technology that can provide structural, functional, and anatomical information for clinical diagnosis. However, its slow imaging speed may result in motion artifacts and image quality degradation, as well as lead to patient discomfort. To accelerate MRI scans, researchers are seeking methods to increase imaging speed by reducing the amount of acquiredk-space data without degrading the image reconstruction quality.Accelerated MR image reconstruction from undersampledk-space measurements is, in essence, a highly underdetermined inverse problem. Reconstruction methods based on signal processing have evolved rapidly over the past decades and can now explore and utilize the prior information about the desired MR image to achieve the reconstruction by using regularization methods under the premise of ensuring the uniqueness and stability of the solution. Sparsity is a commonly used prior information with the emerging popularity of Compressed Sensing (CS) theory [1–3], including fixed sparse transform (e.g., wavelet or/and gradient) [4–6] and more flexible adaptive sparse representation (e.g., data-driven tight frame [7] and dictionary learning [8–10]). High-resolution reference images obtained in advance in practical application scenarios can also provide prior information. They can provide structural similarity for the target MR images and obtain more sparse difference images [11–13]. In addition, the structured priors, such as image support information [14–16] and structural sparsity (e.g., group sparsity, block sparsity, and tree sparsity) [15, 17, 18], can be introduced into a reconstruction model based on the union-of-subspace sampling theory [19], which has been verified to be efficient in improving reconstruction accuracy.In recent years, deep learning has received a great deal of attention in the field of medical imaging, especially for segmentation, denoising, classification, and acceleration of MRI tasks [20]. MRI approaches based on deep learning can be either data-driven or model-driven [21, 22]. Data-driven approaches are aimed at learning the mapping from undersampled k-space/images to fully sampled k-space/images [23–28]. Model-driven approaches start from MR image reconstruction models and import the procedure of iterative reconstruction algorithms into networks [29–32]. To ensure the quality of reconstruction performance, both approaches require pre-training processes with the aid of large, high-quality patient-based datasets. However, this is a challenge in clinical applications because it is difficult to obtain sufficient amounts of patient-based MR datasets due to patient privacy concerns.Recently, Ulyanov et al. proposed a Deep Image Prior (DIP) framework [33], which demonstrates that convolutional neural networks (CNNs) have the inherent ability to regularize various ill-posed inverse problems without pretraining [34]. DIP can achieve satisfactory results by applying untrained networks with random noise as the network input. DIP has been used for denoising, inpainting, super-resolution reconstruction [35–38], CS recovery [39], and medical imaging, such as PET image reconstruction [34], CT reconstruction [40], and dynamic MRI [41].In this paper, we propose a novel deep learning-based Reference-driven method using Wavelet Sparsity-constrained DIP (RWS-DIP) for CS-based undersampled MR image reconstruction, which can achieve improved performance without any pre-training procedures. Our proposed RWS-DIP method incorporates structure and sparsity priors into a DIP framework and utilizes the priors to further improve the efficiency of learning. It not only builds a bridge between the constrained reconstruction method and deep learning, but also largely reduces the dependence on patient-based datasets and contributes to the expansion of clinical applications. Experimental results have shown that the proposed RWS-DIP method can obtain more accurate reconstruction than traditional DIP, particularly in preserving image textures and features. The main contributions of this paper can be summarized as follows:(1)
The proposed RWS-DIP method utilizes both structure and sparsity priors of MR images. The former is introduced by using a high-resolution reference image obtained in advance as the input of CNN, whose structure is similar to target MR images and thereby incorporates structural information into network. The latter is used by regularizing thel1 norm of coefficients in a wavelet domain to further enrich the implicit regularization of traditional DIP, which is enforced by the fixed network structure. These priors improve the efficiency and effectiveness of deep learning and contribute to the improvement in reconstruction performance(2)
The proposed RWS-DIP is a novel deep learning-based MR image reconstruction method inspired by traditional DIP and does not require any pre-training. This advantage renders the training datasets unnecessary, which has significance in clinical applicationsThe remainder of this paper is organized as follows. Section2 presents details on the proposed RWS-DIP method, as well as a review of traditional DIP. Section 3 includes experimental results from in vivo MR scans and also includes details about data acquisition, undersampled schemes, and the experimental setup. Section 4 provides a summary of the paper’s main points and its results.


## 2. Methodology

### 2.1. Traditional DIP for Undersampled MR Image Reconstruction

Applying traditional DIP to undersampled MR image reconstruction, the object function is(1)θ^=argminθy−Fufθ∣z22,where y∈ℂM×1 is the undersampled k-space measurements of the desired MR image It∈ℂN×N, Fu denotes an undersampled Fourier transform operator, and ∙2 is the l2 norm. fθ∣z is an untrained deep CNN parameterized by θ, with the random noise z as input.The desired MR image can then be reconstructed by(2)I^t=fθ^∣z.The training of the network parametersθ is performed by solving the optimization problem in Equation (1) iteratively, which is guided by the attempt to best match the network output to the measurements in k-space. In DIP, no pre-training procedure is needed and the network training, or optimizing of network parameters, begins with an untrained CNN initialized randomly.


### 2.2. Proposed Method

Figure1 depicts an overview of our proposed RWS-DIP method, in which the procedure of the target MR image reconstruction can be achieved in three steps: network training, MR image reconstruction, and data correction. In the first step, we do not need high-quality MR datasets and pre-training. The network parameters of the untrained CNN are optimized by solving the proposed constrained object function iteratively, which not only restricts the data consistency and explores wavelet sparsity but also introduces structural prior by using a similar reference image as the input of CNN. Next, the trained network outputs the reconstructed MR image. In the third step, the data correction process uses the prior measurements in k-space to further improve the reconstruction accuracy. A further explanation will be provided in the following sections.Figure 1
Overview of the proposed RWS-DIP method: (a) overall process for ADMM-based reconstruction; (b) network architecture [33] used in the proposed method.


#### 2.2.1. Network Training with a Reference and Wavelet Sparsity-Constrained DIP

Leveraging the concept of the traditional DIP framework, our proposed RWS-DIP method uses a high-resolution reference MR image and the wavelet sparsity to provide prior information for the target MR image reconstruction. Therefore, the objective function for network parameter optimization is as follows:(3)θ^=argminθy−Fufθ∣Ir22+λΨfθ∣Ir1,where Ir∈ℂN×N denote a high-resolution reference MR image acquired in advance with similar anatomical structure to the target image It∈ℂN×N, Ψ is the wavelet transform operator, and ∙1 is the l1 norm. The regularization parameter λ>0.Our proposed objective function in Equation (3) consists of the data fidelity term and the l1 regularization term. It is aimed at finding the optimal network parameters that ensure the sparsity of the target MR image in wavelet domain on the premise of maintaining data consistency.The data fidelity term restricts the data consistency between the network output andk-space measurements. We use the known reference MR image Ir as the network input, instead of random noise in traditional DIP. This strategy is capable of exploring and introducing the structural prior of the target MR image into the network for learning because of the high structural similarity between the reference and target images. The l1 regularization constrains the sparsity of the target MR image in a wavelet domain, which merges more prior information for efficient training of network parameters.Letα=Ψfθ∣Ir, Equation (3) becomes
(4)θ^=argminy−Fufθ∣Ir22+λα1s.t.α=Ψfθ∣Ir.The constrained optimization problem in Equation (4) can be transformed into a penalty using the augmented Lagrangian:
(5)argminθ,αy−Fufθ∣Ir22+λα1+ρ2α−Ψfθ∣Ir−μ22.In the expression above,μ stands for the Lagrange multiplier vector and ρ is a penalty parameter.To solve the problem in Equation (5), we use the alternating direction method of multipliers (ADMM) algorithm [42] to update the three unknowns θ, α, and μ iteratively:
(6)θ^k=argminθy−Fufθ∣Ir22+ρ2αk−1−Ψfθ∣Ir−μk−122,(7)αk=argminαλα1+ρ2α−Ψfθ^k∣Ir−μk−122,(8)μk=μk−1+αk−Ψfθ^k∣Ir.(1)
For the subproblem in Equation (6), this optimization is close in spirit to that performed in traditional DIP. However, we further modify the optimization by a proximity regularization that forces Ψfθ∣Ir to be close to αk−1−μk−1, which helps to provide additional stabilization and robustness(2)
For the subproblem in Equation (7), the solution can be written as
(9)αk=SλρΨfθ^k∣Ir+μk−1,where Sλ/ρ is the soft thresholding operator defined as [42]
(10)Sκb=b−κ,b>κ,0,b≤κ,b+κ,b<−κ


#### 2.2.2. MR Image Reconstruction

After the iterative update procedure of network parameters, we obtain the trained CNN parameterized byθ^MaxIt(let MaxIt denote the maximum iteration number of ADMM; then, θ^MaxIt is the parameter of the final trained network). The output of the trained CNN is the reconstructed MR image, which can be presented as
(11)I^rec=fθ^MaxIt∣Ir.


#### 2.2.3. Data Correction

Performing data correction operatorCor· to CNN output I^rec in the last step below, we obtain corrected k-space data ycor as follows:
(12)ycor=CorI^rec=FI^recU¯⋃y,where F denotes Fourier transform and y is the priori acquired measurements of the target MR image, which are sampled at the spatial locations corresponding to the undersampled mask U in k-space. Let U¯ denote the complementary set of U. This data correction strategy, defined in Equation (12), reserves all the priori acquired measurements to enforce the k-space data consistency, so that the reconstruction error will focus only on the missing k-space data. The final reconstructed target MR image can then be achieved by performing an inverse Fourier transform on ycor(13)I^t=F−1ycor.The algorithm flowchart of our proposed RWS-DIP method is presented in Algorithm1.Algorithm 1: Algorithm for the proposed RWS-DIP method.
Input:MaxIt - the iteration number for ADMM;SubIt - the iteration number for the update of network parameters;ρ - the ADMM penalty parameter;λ - the regularization parameter;Ir - the reference MR image;Ψ - the wavelet transform operator;y - k-space measurement;Output: The reconstructed target MR image, I^t;1:Initialization:μ0=0, α0=ΨFu−1y and set θ0 randomly;2:k=1: MaxItdo3:Updateθ^k: Solve Eq.(6) using Adam and back-propagation for SubIt iterations;4:Updateαk: Apply Eq.(9) to obtain the solution of subproblem in Eq.(7);5:Updateμk: μk=μk−1+αk−Ψfθ^k∣Ir.6:end for7:Reconstruction: CNN output I^rec=fθ^MaxIt∣Ir;8:Data correction: ycor=CorI^rec=FI^recU¯∪y;9:I^t=F−1ycor;


### 2.3. Network Architecture

The CNN architecture employed in the proposed RWS-DIP method is summarized in Figure1(b), which is the same as that used in [33]. It is an encoder-decoder (“hourglass”) architecture with skip connection. The encoding path (left side) and decoding path (right side) are linked by the skip connections, marked by yellow arrows, to integrate features from different resolutions. The network consists of repetitive applications of the convolutional (Conv) layer, batch normalization (BN) layer, and leaky rectified linear unit (LeakyReLU) layer, downsampling with stride and upsampling with bilinear interpolation. The maximal depth of the network is L. ndi, nui, and nsi denote the number of filters at the ith depth for downsampling, upsampling, and skip connections, respectively. kdi, kui, and ksi correspond to the respective kernel sizes.


## 2.1. Traditional DIP for Undersampled MR Image Reconstruction

Applying traditional DIP to undersampled MR image reconstruction, the object function is(1)θ^=argminθy−Fufθ∣z22,where y∈ℂM×1 is the undersampled k-space measurements of the desired MR image It∈ℂN×N, Fu denotes an undersampled Fourier transform operator, and ∙2 is the l2 norm. fθ∣z is an untrained deep CNN parameterized by θ, with the random noise z as input.The desired MR image can then be reconstructed by(2)I^t=fθ^∣z.The training of the network parametersθ is performed by solving the optimization problem in Equation (1) iteratively, which is guided by the attempt to best match the network output to the measurements in k-space. In DIP, no pre-training procedure is needed and the network training, or optimizing of network parameters, begins with an untrained CNN initialized randomly.


## 2.2. Proposed Method

Figure1 depicts an overview of our proposed RWS-DIP method, in which the procedure of the target MR image reconstruction can be achieved in three steps: network training, MR image reconstruction, and data correction. In the first step, we do not need high-quality MR datasets and pre-training. The network parameters of the untrained CNN are optimized by solving the proposed constrained object function iteratively, which not only restricts the data consistency and explores wavelet sparsity but also introduces structural prior by using a similar reference image as the input of CNN. Next, the trained network outputs the reconstructed MR image. In the third step, the data correction process uses the prior measurements in k-space to further improve the reconstruction accuracy. A further explanation will be provided in the following sections.Figure 1
Overview of the proposed RWS-DIP method: (a) overall process for ADMM-based reconstruction; (b) network architecture [33] used in the proposed method.


### 2.2.1. Network Training with a Reference and Wavelet Sparsity-Constrained DIP

Leveraging the concept of the traditional DIP framework, our proposed RWS-DIP method uses a high-resolution reference MR image and the wavelet sparsity to provide prior information for the target MR image reconstruction. Therefore, the objective function for network parameter optimization is as follows:(3)θ^=argminθy−Fufθ∣Ir22+λΨfθ∣Ir1,where Ir∈ℂN×N denote a high-resolution reference MR image acquired in advance with similar anatomical structure to the target image It∈ℂN×N, Ψ is the wavelet transform operator, and ∙1 is the l1 norm. The regularization parameter λ>0.Our proposed objective function in Equation (3) consists of the data fidelity term and the l1 regularization term. It is aimed at finding the optimal network parameters that ensure the sparsity of the target MR image in wavelet domain on the premise of maintaining data consistency.The data fidelity term restricts the data consistency between the network output andk-space measurements. We use the known reference MR image Ir as the network input, instead of random noise in traditional DIP. This strategy is capable of exploring and introducing the structural prior of the target MR image into the network for learning because of the high structural similarity between the reference and target images. The l1 regularization constrains the sparsity of the target MR image in a wavelet domain, which merges more prior information for efficient training of network parameters.Letα=Ψfθ∣Ir, Equation (3) becomes
(4)θ^=argminy−Fufθ∣Ir22+λα1s.t.α=Ψfθ∣Ir.The constrained optimization problem in Equation (4) can be transformed into a penalty using the augmented Lagrangian:
(5)argminθ,αy−Fufθ∣Ir22+λα1+ρ2α−Ψfθ∣Ir−μ22.In the expression above,μ stands for the Lagrange multiplier vector and ρ is a penalty parameter.To solve the problem in Equation (5), we use the alternating direction method of multipliers (ADMM) algorithm [42] to update the three unknowns θ, α, and μ iteratively:
(6)θ^k=argminθy−Fufθ∣Ir22+ρ2αk−1−Ψfθ∣Ir−μk−122,(7)αk=argminαλα1+ρ2α−Ψfθ^k∣Ir−μk−122,(8)μk=μk−1+αk−Ψfθ^k∣Ir.(1)
For the subproblem in Equation (6), this optimization is close in spirit to that performed in traditional DIP. However, we further modify the optimization by a proximity regularization that forces Ψfθ∣Ir to be close to αk−1−μk−1, which helps to provide additional stabilization and robustness(2)
For the subproblem in Equation (7), the solution can be written as
(9)αk=SλρΨfθ^k∣Ir+μk−1,where Sλ/ρ is the soft thresholding operator defined as [42]
(10)Sκb=b−κ,b>κ,0,b≤κ,b+κ,b<−κ


### 2.2.2. MR Image Reconstruction

After the iterative update procedure of network parameters, we obtain the trained CNN parameterized byθ^MaxIt(let MaxIt denote the maximum iteration number of ADMM; then, θ^MaxIt is the parameter of the final trained network). The output of the trained CNN is the reconstructed MR image, which can be presented as
(11)I^rec=fθ^MaxIt∣Ir.


### 2.2.3. Data Correction

Performing data correction operatorCor· to CNN output I^rec in the last step below, we obtain corrected k-space data ycor as follows:
(12)ycor=CorI^rec=FI^recU¯⋃y,where F denotes Fourier transform and y is the priori acquired measurements of the target MR image, which are sampled at the spatial locations corresponding to the undersampled mask U in k-space. Let U¯ denote the complementary set of U. This data correction strategy, defined in Equation (12), reserves all the priori acquired measurements to enforce the k-space data consistency, so that the reconstruction error will focus only on the missing k-space data. The final reconstructed target MR image can then be achieved by performing an inverse Fourier transform on ycor(13)I^t=F−1ycor.The algorithm flowchart of our proposed RWS-DIP method is presented in Algorithm1.Algorithm 1: Algorithm for the proposed RWS-DIP method.
Input:MaxIt - the iteration number for ADMM;SubIt - the iteration number for the update of network parameters;ρ - the ADMM penalty parameter;λ - the regularization parameter;Ir - the reference MR image;Ψ - the wavelet transform operator;y - k-space measurement;Output: The reconstructed target MR image, I^t;1:Initialization:μ0=0, α0=ΨFu−1y and set θ0 randomly;2:k=1: MaxItdo3:Updateθ^k: Solve Eq.(6) using Adam and back-propagation for SubIt iterations;4:Updateαk: Apply Eq.(9) to obtain the solution of subproblem in Eq.(7);5:Updateμk: μk=μk−1+αk−Ψfθ^k∣Ir.6:end for7:Reconstruction: CNN output I^rec=fθ^MaxIt∣Ir;8:Data correction: ycor=CorI^rec=FI^recU¯∪y;9:I^t=F−1ycor;


## 2.2.1. Network Training with a Reference and Wavelet Sparsity-Constrained DIP

Leveraging the concept of the traditional DIP framework, our proposed RWS-DIP method uses a high-resolution reference MR image and the wavelet sparsity to provide prior information for the target MR image reconstruction. Therefore, the objective function for network parameter optimization is as follows:(3)θ^=argminθy−Fufθ∣Ir22+λΨfθ∣Ir1,where Ir∈ℂN×N denote a high-resolution reference MR image acquired in advance with similar anatomical structure to the target image It∈ℂN×N, Ψ is the wavelet transform operator, and ∙1 is the l1 norm. The regularization parameter λ>0.Our proposed objective function in Equation (3) consists of the data fidelity term and the l1 regularization term. It is aimed at finding the optimal network parameters that ensure the sparsity of the target MR image in wavelet domain on the premise of maintaining data consistency.The data fidelity term restricts the data consistency between the network output andk-space measurements. We use the known reference MR image Ir as the network input, instead of random noise in traditional DIP. This strategy is capable of exploring and introducing the structural prior of the target MR image into the network for learning because of the high structural similarity between the reference and target images. The l1 regularization constrains the sparsity of the target MR image in a wavelet domain, which merges more prior information for efficient training of network parameters.Letα=Ψfθ∣Ir, Equation (3) becomes
(4)θ^=argminy−Fufθ∣Ir22+λα1s.t.α=Ψfθ∣Ir.The constrained optimization problem in Equation (4) can be transformed into a penalty using the augmented Lagrangian:
(5)argminθ,αy−Fufθ∣Ir22+λα1+ρ2α−Ψfθ∣Ir−μ22.In the expression above,μ stands for the Lagrange multiplier vector and ρ is a penalty parameter.To solve the problem in Equation (5), we use the alternating direction method of multipliers (ADMM) algorithm [42] to update the three unknowns θ, α, and μ iteratively:
(6)θ^k=argminθy−Fufθ∣Ir22+ρ2αk−1−Ψfθ∣Ir−μk−122,(7)αk=argminαλα1+ρ2α−Ψfθ^k∣Ir−μk−122,(8)μk=μk−1+αk−Ψfθ^k∣Ir.(1)
For the subproblem in Equation (6), this optimization is close in spirit to that performed in traditional DIP. However, we further modify the optimization by a proximity regularization that forces Ψfθ∣Ir to be close to αk−1−μk−1, which helps to provide additional stabilization and robustness(2)
For the subproblem in Equation (7), the solution can be written as
(9)αk=SλρΨfθ^k∣Ir+μk−1,where Sλ/ρ is the soft thresholding operator defined as [42]
(10)Sκb=b−κ,b>κ,0,b≤κ,b+κ,b<−κ


## 2.2.2. MR Image Reconstruction

After the iterative update procedure of network parameters, we obtain the trained CNN parameterized byθ^MaxIt(let MaxIt denote the maximum iteration number of ADMM; then, θ^MaxIt is the parameter of the final trained network). The output of the trained CNN is the reconstructed MR image, which can be presented as
(11)I^rec=fθ^MaxIt∣Ir.


## 2.2.3. Data Correction

Performing data correction operatorCor· to CNN output I^rec in the last step below, we obtain corrected k-space data ycor as follows:
(12)ycor=CorI^rec=FI^recU¯⋃y,where F denotes Fourier transform and y is the priori acquired measurements of the target MR image, which are sampled at the spatial locations corresponding to the undersampled mask U in k-space. Let U¯ denote the complementary set of U. This data correction strategy, defined in Equation (12), reserves all the priori acquired measurements to enforce the k-space data consistency, so that the reconstruction error will focus only on the missing k-space data. The final reconstructed target MR image can then be achieved by performing an inverse Fourier transform on ycor(13)I^t=F−1ycor.The algorithm flowchart of our proposed RWS-DIP method is presented in Algorithm1.Algorithm 1: Algorithm for the proposed RWS-DIP method.
Input:MaxIt - the iteration number for ADMM;SubIt - the iteration number for the update of network parameters;ρ - the ADMM penalty parameter;λ - the regularization parameter;Ir - the reference MR image;Ψ - the wavelet transform operator;y - k-space measurement;Output: The reconstructed target MR image, I^t;1:Initialization:μ0=0, α0=ΨFu−1y and set θ0 randomly;2:k=1: MaxItdo3:Updateθ^k: Solve Eq.(6) using Adam and back-propagation for SubIt iterations;4:Updateαk: Apply Eq.(9) to obtain the solution of subproblem in Eq.(7);5:Updateμk: μk=μk−1+αk−Ψfθ^k∣Ir.6:end for7:Reconstruction: CNN output I^rec=fθ^MaxIt∣Ir;8:Data correction: ycor=CorI^rec=FI^recU¯∪y;9:I^t=F−1ycor;


## 2.3. Network Architecture

The CNN architecture employed in the proposed RWS-DIP method is summarized in Figure1(b), which is the same as that used in [33]. It is an encoder-decoder (“hourglass”) architecture with skip connection. The encoding path (left side) and decoding path (right side) are linked by the skip connections, marked by yellow arrows, to integrate features from different resolutions. The network consists of repetitive applications of the convolutional (Conv) layer, batch normalization (BN) layer, and leaky rectified linear unit (LeakyReLU) layer, downsampling with stride and upsampling with bilinear interpolation. The maximal depth of the network is L. ndi, nui, and nsi denote the number of filters at the ith depth for downsampling, upsampling, and skip connections, respectively. kdi, kui, and ksi correspond to the respective kernel sizes.


## 3. Experimental Results

### 3.1. Experimental Setup

Experiments were conducted to evaluate the performance of our proposed RWS-DIP method. The comparisons with the proposed RWS-DIP method included zero-filling and traditional DIP [33]. To ensure a fair comparison, the zero-filling reconstructions and corresponding k-space measurements were used as inputs for all the methods, and the same network architectures was employed for our RWS-DIP method and traditional DIP.We quantified the reconstruction quality using the metrics of relative error (RelErr), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM) [43]:
(14)RelErr=x^−x2x2,(15)PSNR=10lgNNMAXx2∑i=1N∑j=1Nx^i,j−xi,j,(16)SSIM=2μxμx^+c12σxx^+c2μx2+μx^2+c1σx2+σx^2+c2.In the descriptions in Equations (14)–(16), the reconstructed MR image x^ and the ground truth x are the same size of N×N, and MAXx denotes the largest value in x. Moreover, for the SSIM shown in Equation (16), μx, μx^, σx, and σx^ represent the means and standard deviations of x and x^, respectively, and σxx^ denotes the crosscovariance between x and x^, and constants c1=0.01 and c2=0.03.


#### 3.1.1. Data Acquisition

To demonstrate the performance of our RWS-DIP method, simulations were conducted on three groups ofinvivo MR images. To simulate the data acquisition, we undersampled the 2D discrete Fourier transform of the MR images from invivo MR scans, which were acquired from a 3T Siemens MRI scanner. The imaging parameters of the first group of scanned data (Brain A) were GR sequence, flipangle=70°, TR=250 ms, TE=2.5 ms, fieldofviewFOV=220mm×220mm, and slicethickness=5.0 mm. The reference and target images in Brain A were of size 512×512, as shown in Figures 2(a) and 2(b). The imaging parameters of the second and third groups of scanned data (Brain B and Brain C) were as follows: SE sequence, flip angle=120°, TR=4000 ms, TE=91 ms, FOV=176mm×176mm, and slicethickness=5.0 mm. The MR images in Brain B and Brain C were of size 256×256 and are shown in Figures 2(c)–2(f), respectively.Figure 2
MR images used in the experiments: Brain A: the reference image (a) and target image (b); Brain B: the reference image (c) and target image (d); Brain C: the reference image (e) and target image (f).


#### 3.1.2. Training Setting

We used the same CNN architecture as the traditional DIP in [33], which is shown in detail in Figure 1(b). The parameters used in the experiments, including network hyperparameters, iteration number (MaxIt and SubIt), wavelet (wavelet function and decomposition level), ADMM penalty parameter ρ, and regularization parameter λ, are shown in Table 1.Table 1
Parameter settings for experiments.
ParameterImagesBrain ABrain BBrain CNetwork hyperparametersLearning rate0.010.010.01L666nd[16, 32, 64, 64, 128, 128][32, 32, 64, 128, 128, 128][32, 32, 64, 128, 128, 128]nu[16, 32, 64, 64, 128, 128][32, 32, 64, 128, 128, 128][32, 32, 64, 128, 128, 128]ns[16,16,16,16,16,16][16,16,16,16,16,16][16,16,16,16,16,16]kd[3,3,3,3,3,3][3,3,3,3,3,3][3,3,3,3,3,3]ku[3,3,3,3,3,3][3,3,3,3,3,3][3,3,3,3,3,3]ks[1,1,1,1,1,1][1,1,1,1,1,1][1,1,1,1,1,1]Iteration numberMaxIt505050SubIt100100100Wavelet parametersWavelet functionHaarHaarHaarDecomposition level866ρ0.070.050.05λ0.00010.00010.0001The models were implemented on the Ubuntu 16.04 LTS (64 bit) operating system, running on an Intel Core i9-7920X 2.9 GHz CPU and Nvidia GeForce GTX 1080Ti GPU with 11 GB RAM in the PyTorch open framework with CUDA and CUDNN support.


#### 3.1.3. Undersampled Schemes

To compare the influence of different undersampling masks to the performance of the proposed RWS-DIP method, our experiments employed three types of undersampling masks: Cartesian, variable density, and radial. Figure3 depicts these three undersampling masks.Figure 3
Undersampling masks used in the experiments: (a) Cartesian mask with a sampling rate of 20%; (b) radial mask with a sampling rate of 20%; (c) variable density mask with sampling rate of 15%.
(a)(b)(c)


### 3.2. Results

#### 3.2.1. Reconstruction Performance Comparison

(1) Reconstruction under Different Sampling Rates. We demonstrated the effectiveness of our RWS-DIP method at different sampling rates under Cartesian mask. Table 2 shows the quantitative performance of the proposed RWS-DIP method, traditional DIP and zero-filling reconstructions in RelErr, and PSNR and SSIM indexes at 10%, 20%, 30%, and 40% sampling rates. Taking into account the randomness involved in the training procedure (random initialization of network parameters in the proposed method; both random initializations of the network input and network parameters for traditional DIP), all the quantitative results were achieved by averaging the indices after being run 10 times. It can be seen that the proposed method has the lowest RelErr and the highest PSNR and SSIM values for all three groups of MR data, which means that our proposed RWS-DIP method can obtain more accurate reconstruction.Table 2
RelErr, PSNR, and SSIM values of reconstruction by different methods under Cartesian undersampled mask.
ImagesMethods10%20%RelErr (%)PSNR (dB)SSIMRelErr (%)PSNR (dB)SSIMBrain AZero-filling21.6321.68570.710115.2624.71740.7695DIP16.4924.14750.82635.4533.68520.9617RWS-DIP6.9231.58380.94863.2138.27380.9836Brain BZero-filling35.2620.29260.639118.7425.78490.7608DIP33.0820.84660.721211.3130.19830.9361RWS-DIP15.9627.18100.90007.5933.63470.9694Brain CZero-filling32.5321.32400.660015.9927.49150.7860DIP30.7821.81260.735311.7430.18150.9297RWS-DIP18.0926.42930.87448.4133.07890.9635ImagesMethods30%40%RelErr (%)PSNR (dB)SSIMRelErr (%)PSNR (dB)SSIMBrain AZero-filling5.3933.74390.84304.0236.30000.8590DIP2.8239.47890.98622.5440.48710.9876RWS-DIP2.0142.32010.99171.6743.98220.9942Brain BZero-filling16.8026.73020.76998.8932.26540.8302DIP8.3832.79540.95936.3435.25490.9733RWS-DIP5.7336.07310.97954.3538.47730.9864Brain CZero-filling11.0330.71960.83467.9433.57190.8597DIP7.2134.41980.96986.3135.58480.9747RWS-DIP5.7336.40880.98084.8837.80790.9845Figures4–6 show the reconstructed MR images using the proposed RWS-DIP method and the compared methods under Cartesian undersampled mask with 20% and 30% sampling rates. It is obvious that our RWS-DIP method has the best performance in preserving more image textures and features, especially from the zoom-in images. The corresponding error images further show that the reconstruction of our RWS-DIP method has the smallest differences and is closest to the target MR image.Figure 4
Comparison of reconstructions of the target MR image in Brain A using Cartesian undersampled mask with 20% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 5
Comparison of reconstructions of the target MR image in Brain B using Cartesian undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 6
Comparison of reconstructions of the target MR image in Brain C using Cartesian undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)(2) Reconstruction with Different Undersampled Masks. The reconstruction results were compared under radial and variable density undersampled masks. The quantitative results tabulated in Table 3 clearly indicate that the proposed RWS-DIP method obtains more accurate reconstruction than with the radial and variable density undersampled masks. Comparisons of the reconstructed MR images are shown in Figures 7 and 8. The corresponding error images and zoom-in images demonstrate that our RWS-DIP method outperforms the compared methods with less structural loss and can preserve more details than the radial and variable density undersampled masks.Table 3
RelErr, PSNR, and SSIM values of reconstruction by different methods under radial undersampled mask and variable density undersampled mask.
ImagesMask (undersampled rate)MethodsRelErr (%)PSNR (dB)SSIMBrain ARadial (10%)Zero-filling10.1528.25880.7601DIP6.2533.66690.9408RWS-DIP3.5237.46350.9780Variable density (20%)Zero-filling7.9330.39490.8483DIP3.3538.00610.9798RWS-DIP2.5740.20620.9859Brain BRadial (20%)Zero-filling15.3527.51730.7928DIP8.2032.96910.9610RWS-DIP5.7636.03100.9786Variable density (30%)Zero-filling16.9926.63740.7596DIP6.3835.14790.9708RWS-DIP4.7537.70080.9827Brain CRadial (20%)Zero-filling12.8029.42500.8256DIP8.0433.47710.9623RWS-DIP6.0235.97620.9775Variable density (30%)Zero-filling14.3428.43450.8038DIP7.0334.65780.9692RWS-DIP5.1837.28970.9811Figure 7
Comparison of reconstructions of the target MR image in Brain B using the radial undersampled mask with 20% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 8
Comparison of reconstructions of the target MR image in Brain C using the variable density undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)


#### 3.2.2. Convergence Analysis

Convergence is an important quality in applications of MRI methods based on deep learning. Therefore, we detected the convergence of the proposed RWS-DIP method use error curves drawn by conducting experiments on Brain A and Brain B under Cartesian undersampled mask. Figure9 depicts the relative errors of reconstruction at every ADMM iteration. It can be observed that, as the number of iterations increases, the relative errors gradually converge to a low value at different sampling rates. Although there are slight fluctuations in the iteration procedure, the overall trend maintains convergence.Figure 9
RelErr curves of the proposed RWS-DIP method under Cartesian undersampled mask.


#### 3.2.3. Parameter Evaluation

We evaluated the sensitivity of the proposed RWS-DIP method to parameter settings. The main parameters evaluated were the ADMM penalty parameterρ and the regularization parameter λ. We performed experiments on the Brain C dataset under Cartesian undersampled mask and varied one parameter at a time while keeping the rest as fixed values, as shown in Table 1.Figures10 and 11 show the plots of PSNR values as a function of the ADMM penalty parameter ρ and the regularization parameter λ. As can be seen from the curves, the optimal numerical settings for ρ and λ (ρ=0.05 and λ=0.0001) in the proposed RWS-DIP method under different sampling rates are identical, which means that the RWS-DIP method has robustness in the setting of parameters. In fact, although the reconstructions have lower PSNR values than other numerical settings for parameters ρ and λ, the difference is not significant, and the reconstruction performance is acceptable.Figure 10
PSNR values vs. regularization parameterλ for the reconstruction under Cartesian undersampled mask with different sampling rates.Figure 11
PSNR values vs. ADMM penalty parameterρ for the reconstruction under Cartesian undersampled mask with different sampling rates.


## 3.1. Experimental Setup

Experiments were conducted to evaluate the performance of our proposed RWS-DIP method. The comparisons with the proposed RWS-DIP method included zero-filling and traditional DIP [33]. To ensure a fair comparison, the zero-filling reconstructions and corresponding k-space measurements were used as inputs for all the methods, and the same network architectures was employed for our RWS-DIP method and traditional DIP.We quantified the reconstruction quality using the metrics of relative error (RelErr), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM) [43]:
(14)RelErr=x^−x2x2,(15)PSNR=10lgNNMAXx2∑i=1N∑j=1Nx^i,j−xi,j,(16)SSIM=2μxμx^+c12σxx^+c2μx2+μx^2+c1σx2+σx^2+c2.In the descriptions in Equations (14)–(16), the reconstructed MR image x^ and the ground truth x are the same size of N×N, and MAXx denotes the largest value in x. Moreover, for the SSIM shown in Equation (16), μx, μx^, σx, and σx^ represent the means and standard deviations of x and x^, respectively, and σxx^ denotes the crosscovariance between x and x^, and constants c1=0.01 and c2=0.03.


### 3.1.1. Data Acquisition

To demonstrate the performance of our RWS-DIP method, simulations were conducted on three groups ofinvivo MR images. To simulate the data acquisition, we undersampled the 2D discrete Fourier transform of the MR images from invivo MR scans, which were acquired from a 3T Siemens MRI scanner. The imaging parameters of the first group of scanned data (Brain A) were GR sequence, flipangle=70°, TR=250 ms, TE=2.5 ms, fieldofviewFOV=220mm×220mm, and slicethickness=5.0 mm. The reference and target images in Brain A were of size 512×512, as shown in Figures 2(a) and 2(b). The imaging parameters of the second and third groups of scanned data (Brain B and Brain C) were as follows: SE sequence, flip angle=120°, TR=4000 ms, TE=91 ms, FOV=176mm×176mm, and slicethickness=5.0 mm. The MR images in Brain B and Brain C were of size 256×256 and are shown in Figures 2(c)–2(f), respectively.Figure 2
MR images used in the experiments: Brain A: the reference image (a) and target image (b); Brain B: the reference image (c) and target image (d); Brain C: the reference image (e) and target image (f).


### 3.1.2. Training Setting

We used the same CNN architecture as the traditional DIP in [33], which is shown in detail in Figure 1(b). The parameters used in the experiments, including network hyperparameters, iteration number (MaxIt and SubIt), wavelet (wavelet function and decomposition level), ADMM penalty parameter ρ, and regularization parameter λ, are shown in Table 1.Table 1
Parameter settings for experiments.
ParameterImagesBrain ABrain BBrain CNetwork hyperparametersLearning rate0.010.010.01L666nd[16, 32, 64, 64, 128, 128][32, 32, 64, 128, 128, 128][32, 32, 64, 128, 128, 128]nu[16, 32, 64, 64, 128, 128][32, 32, 64, 128, 128, 128][32, 32, 64, 128, 128, 128]ns[16,16,16,16,16,16][16,16,16,16,16,16][16,16,16,16,16,16]kd[3,3,3,3,3,3][3,3,3,3,3,3][3,3,3,3,3,3]ku[3,3,3,3,3,3][3,3,3,3,3,3][3,3,3,3,3,3]ks[1,1,1,1,1,1][1,1,1,1,1,1][1,1,1,1,1,1]Iteration numberMaxIt505050SubIt100100100Wavelet parametersWavelet functionHaarHaarHaarDecomposition level866ρ0.070.050.05λ0.00010.00010.0001The models were implemented on the Ubuntu 16.04 LTS (64 bit) operating system, running on an Intel Core i9-7920X 2.9 GHz CPU and Nvidia GeForce GTX 1080Ti GPU with 11 GB RAM in the PyTorch open framework with CUDA and CUDNN support.


### 3.1.3. Undersampled Schemes

To compare the influence of different undersampling masks to the performance of the proposed RWS-DIP method, our experiments employed three types of undersampling masks: Cartesian, variable density, and radial. Figure3 depicts these three undersampling masks.Figure 3
Undersampling masks used in the experiments: (a) Cartesian mask with a sampling rate of 20%; (b) radial mask with a sampling rate of 20%; (c) variable density mask with sampling rate of 15%.
(a)(b)(c)


## 3.1.1. Data Acquisition

To demonstrate the performance of our RWS-DIP method, simulations were conducted on three groups ofinvivo MR images. To simulate the data acquisition, we undersampled the 2D discrete Fourier transform of the MR images from invivo MR scans, which were acquired from a 3T Siemens MRI scanner. The imaging parameters of the first group of scanned data (Brain A) were GR sequence, flipangle=70°, TR=250 ms, TE=2.5 ms, fieldofviewFOV=220mm×220mm, and slicethickness=5.0 mm. The reference and target images in Brain A were of size 512×512, as shown in Figures 2(a) and 2(b). The imaging parameters of the second and third groups of scanned data (Brain B and Brain C) were as follows: SE sequence, flip angle=120°, TR=4000 ms, TE=91 ms, FOV=176mm×176mm, and slicethickness=5.0 mm. The MR images in Brain B and Brain C were of size 256×256 and are shown in Figures 2(c)–2(f), respectively.Figure 2
MR images used in the experiments: Brain A: the reference image (a) and target image (b); Brain B: the reference image (c) and target image (d); Brain C: the reference image (e) and target image (f).


## 3.1.2. Training Setting

We used the same CNN architecture as the traditional DIP in [33], which is shown in detail in Figure 1(b). The parameters used in the experiments, including network hyperparameters, iteration number (MaxIt and SubIt), wavelet (wavelet function and decomposition level), ADMM penalty parameter ρ, and regularization parameter λ, are shown in Table 1.Table 1
Parameter settings for experiments.
ParameterImagesBrain ABrain BBrain CNetwork hyperparametersLearning rate0.010.010.01L666nd[16, 32, 64, 64, 128, 128][32, 32, 64, 128, 128, 128][32, 32, 64, 128, 128, 128]nu[16, 32, 64, 64, 128, 128][32, 32, 64, 128, 128, 128][32, 32, 64, 128, 128, 128]ns[16,16,16,16,16,16][16,16,16,16,16,16][16,16,16,16,16,16]kd[3,3,3,3,3,3][3,3,3,3,3,3][3,3,3,3,3,3]ku[3,3,3,3,3,3][3,3,3,3,3,3][3,3,3,3,3,3]ks[1,1,1,1,1,1][1,1,1,1,1,1][1,1,1,1,1,1]Iteration numberMaxIt505050SubIt100100100Wavelet parametersWavelet functionHaarHaarHaarDecomposition level866ρ0.070.050.05λ0.00010.00010.0001The models were implemented on the Ubuntu 16.04 LTS (64 bit) operating system, running on an Intel Core i9-7920X 2.9 GHz CPU and Nvidia GeForce GTX 1080Ti GPU with 11 GB RAM in the PyTorch open framework with CUDA and CUDNN support.


## 3.1.3. Undersampled Schemes

To compare the influence of different undersampling masks to the performance of the proposed RWS-DIP method, our experiments employed three types of undersampling masks: Cartesian, variable density, and radial. Figure3 depicts these three undersampling masks.Figure 3
Undersampling masks used in the experiments: (a) Cartesian mask with a sampling rate of 20%; (b) radial mask with a sampling rate of 20%; (c) variable density mask with sampling rate of 15%.
(a)(b)(c)


## 3.2. Results

### 3.2.1. Reconstruction Performance Comparison

(1) Reconstruction under Different Sampling Rates. We demonstrated the effectiveness of our RWS-DIP method at different sampling rates under Cartesian mask. Table 2 shows the quantitative performance of the proposed RWS-DIP method, traditional DIP and zero-filling reconstructions in RelErr, and PSNR and SSIM indexes at 10%, 20%, 30%, and 40% sampling rates. Taking into account the randomness involved in the training procedure (random initialization of network parameters in the proposed method; both random initializations of the network input and network parameters for traditional DIP), all the quantitative results were achieved by averaging the indices after being run 10 times. It can be seen that the proposed method has the lowest RelErr and the highest PSNR and SSIM values for all three groups of MR data, which means that our proposed RWS-DIP method can obtain more accurate reconstruction.Table 2
RelErr, PSNR, and SSIM values of reconstruction by different methods under Cartesian undersampled mask.
ImagesMethods10%20%RelErr (%)PSNR (dB)SSIMRelErr (%)PSNR (dB)SSIMBrain AZero-filling21.6321.68570.710115.2624.71740.7695DIP16.4924.14750.82635.4533.68520.9617RWS-DIP6.9231.58380.94863.2138.27380.9836Brain BZero-filling35.2620.29260.639118.7425.78490.7608DIP33.0820.84660.721211.3130.19830.9361RWS-DIP15.9627.18100.90007.5933.63470.9694Brain CZero-filling32.5321.32400.660015.9927.49150.7860DIP30.7821.81260.735311.7430.18150.9297RWS-DIP18.0926.42930.87448.4133.07890.9635ImagesMethods30%40%RelErr (%)PSNR (dB)SSIMRelErr (%)PSNR (dB)SSIMBrain AZero-filling5.3933.74390.84304.0236.30000.8590DIP2.8239.47890.98622.5440.48710.9876RWS-DIP2.0142.32010.99171.6743.98220.9942Brain BZero-filling16.8026.73020.76998.8932.26540.8302DIP8.3832.79540.95936.3435.25490.9733RWS-DIP5.7336.07310.97954.3538.47730.9864Brain CZero-filling11.0330.71960.83467.9433.57190.8597DIP7.2134.41980.96986.3135.58480.9747RWS-DIP5.7336.40880.98084.8837.80790.9845Figures4–6 show the reconstructed MR images using the proposed RWS-DIP method and the compared methods under Cartesian undersampled mask with 20% and 30% sampling rates. It is obvious that our RWS-DIP method has the best performance in preserving more image textures and features, especially from the zoom-in images. The corresponding error images further show that the reconstruction of our RWS-DIP method has the smallest differences and is closest to the target MR image.Figure 4
Comparison of reconstructions of the target MR image in Brain A using Cartesian undersampled mask with 20% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 5
Comparison of reconstructions of the target MR image in Brain B using Cartesian undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 6
Comparison of reconstructions of the target MR image in Brain C using Cartesian undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)(2) Reconstruction with Different Undersampled Masks. The reconstruction results were compared under radial and variable density undersampled masks. The quantitative results tabulated in Table 3 clearly indicate that the proposed RWS-DIP method obtains more accurate reconstruction than with the radial and variable density undersampled masks. Comparisons of the reconstructed MR images are shown in Figures 7 and 8. The corresponding error images and zoom-in images demonstrate that our RWS-DIP method outperforms the compared methods with less structural loss and can preserve more details than the radial and variable density undersampled masks.Table 3
RelErr, PSNR, and SSIM values of reconstruction by different methods under radial undersampled mask and variable density undersampled mask.
ImagesMask (undersampled rate)MethodsRelErr (%)PSNR (dB)SSIMBrain ARadial (10%)Zero-filling10.1528.25880.7601DIP6.2533.66690.9408RWS-DIP3.5237.46350.9780Variable density (20%)Zero-filling7.9330.39490.8483DIP3.3538.00610.9798RWS-DIP2.5740.20620.9859Brain BRadial (20%)Zero-filling15.3527.51730.7928DIP8.2032.96910.9610RWS-DIP5.7636.03100.9786Variable density (30%)Zero-filling16.9926.63740.7596DIP6.3835.14790.9708RWS-DIP4.7537.70080.9827Brain CRadial (20%)Zero-filling12.8029.42500.8256DIP8.0433.47710.9623RWS-DIP6.0235.97620.9775Variable density (30%)Zero-filling14.3428.43450.8038DIP7.0334.65780.9692RWS-DIP5.1837.28970.9811Figure 7
Comparison of reconstructions of the target MR image in Brain B using the radial undersampled mask with 20% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 8
Comparison of reconstructions of the target MR image in Brain C using the variable density undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)


### 3.2.2. Convergence Analysis

Convergence is an important quality in applications of MRI methods based on deep learning. Therefore, we detected the convergence of the proposed RWS-DIP method use error curves drawn by conducting experiments on Brain A and Brain B under Cartesian undersampled mask. Figure9 depicts the relative errors of reconstruction at every ADMM iteration. It can be observed that, as the number of iterations increases, the relative errors gradually converge to a low value at different sampling rates. Although there are slight fluctuations in the iteration procedure, the overall trend maintains convergence.Figure 9
RelErr curves of the proposed RWS-DIP method under Cartesian undersampled mask.


### 3.2.3. Parameter Evaluation

We evaluated the sensitivity of the proposed RWS-DIP method to parameter settings. The main parameters evaluated were the ADMM penalty parameterρ and the regularization parameter λ. We performed experiments on the Brain C dataset under Cartesian undersampled mask and varied one parameter at a time while keeping the rest as fixed values, as shown in Table 1.Figures10 and 11 show the plots of PSNR values as a function of the ADMM penalty parameter ρ and the regularization parameter λ. As can be seen from the curves, the optimal numerical settings for ρ and λ (ρ=0.05 and λ=0.0001) in the proposed RWS-DIP method under different sampling rates are identical, which means that the RWS-DIP method has robustness in the setting of parameters. In fact, although the reconstructions have lower PSNR values than other numerical settings for parameters ρ and λ, the difference is not significant, and the reconstruction performance is acceptable.Figure 10
PSNR values vs. regularization parameterλ for the reconstruction under Cartesian undersampled mask with different sampling rates.Figure 11
PSNR values vs. ADMM penalty parameterρ for the reconstruction under Cartesian undersampled mask with different sampling rates.


## 3.2.1. Reconstruction Performance Comparison

(1) Reconstruction under Different Sampling Rates. We demonstrated the effectiveness of our RWS-DIP method at different sampling rates under Cartesian mask. Table 2 shows the quantitative performance of the proposed RWS-DIP method, traditional DIP and zero-filling reconstructions in RelErr, and PSNR and SSIM indexes at 10%, 20%, 30%, and 40% sampling rates. Taking into account the randomness involved in the training procedure (random initialization of network parameters in the proposed method; both random initializations of the network input and network parameters for traditional DIP), all the quantitative results were achieved by averaging the indices after being run 10 times. It can be seen that the proposed method has the lowest RelErr and the highest PSNR and SSIM values for all three groups of MR data, which means that our proposed RWS-DIP method can obtain more accurate reconstruction.Table 2
RelErr, PSNR, and SSIM values of reconstruction by different methods under Cartesian undersampled mask.
ImagesMethods10%20%RelErr (%)PSNR (dB)SSIMRelErr (%)PSNR (dB)SSIMBrain AZero-filling21.6321.68570.710115.2624.71740.7695DIP16.4924.14750.82635.4533.68520.9617RWS-DIP6.9231.58380.94863.2138.27380.9836Brain BZero-filling35.2620.29260.639118.7425.78490.7608DIP33.0820.84660.721211.3130.19830.9361RWS-DIP15.9627.18100.90007.5933.63470.9694Brain CZero-filling32.5321.32400.660015.9927.49150.7860DIP30.7821.81260.735311.7430.18150.9297RWS-DIP18.0926.42930.87448.4133.07890.9635ImagesMethods30%40%RelErr (%)PSNR (dB)SSIMRelErr (%)PSNR (dB)SSIMBrain AZero-filling5.3933.74390.84304.0236.30000.8590DIP2.8239.47890.98622.5440.48710.9876RWS-DIP2.0142.32010.99171.6743.98220.9942Brain BZero-filling16.8026.73020.76998.8932.26540.8302DIP8.3832.79540.95936.3435.25490.9733RWS-DIP5.7336.07310.97954.3538.47730.9864Brain CZero-filling11.0330.71960.83467.9433.57190.8597DIP7.2134.41980.96986.3135.58480.9747RWS-DIP5.7336.40880.98084.8837.80790.9845Figures4–6 show the reconstructed MR images using the proposed RWS-DIP method and the compared methods under Cartesian undersampled mask with 20% and 30% sampling rates. It is obvious that our RWS-DIP method has the best performance in preserving more image textures and features, especially from the zoom-in images. The corresponding error images further show that the reconstruction of our RWS-DIP method has the smallest differences and is closest to the target MR image.Figure 4
Comparison of reconstructions of the target MR image in Brain A using Cartesian undersampled mask with 20% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 5
Comparison of reconstructions of the target MR image in Brain B using Cartesian undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 6
Comparison of reconstructions of the target MR image in Brain C using Cartesian undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)(2) Reconstruction with Different Undersampled Masks. The reconstruction results were compared under radial and variable density undersampled masks. The quantitative results tabulated in Table 3 clearly indicate that the proposed RWS-DIP method obtains more accurate reconstruction than with the radial and variable density undersampled masks. Comparisons of the reconstructed MR images are shown in Figures 7 and 8. The corresponding error images and zoom-in images demonstrate that our RWS-DIP method outperforms the compared methods with less structural loss and can preserve more details than the radial and variable density undersampled masks.Table 3
RelErr, PSNR, and SSIM values of reconstruction by different methods under radial undersampled mask and variable density undersampled mask.
ImagesMask (undersampled rate)MethodsRelErr (%)PSNR (dB)SSIMBrain ARadial (10%)Zero-filling10.1528.25880.7601DIP6.2533.66690.9408RWS-DIP3.5237.46350.9780Variable density (20%)Zero-filling7.9330.39490.8483DIP3.3538.00610.9798RWS-DIP2.5740.20620.9859Brain BRadial (20%)Zero-filling15.3527.51730.7928DIP8.2032.96910.9610RWS-DIP5.7636.03100.9786Variable density (30%)Zero-filling16.9926.63740.7596DIP6.3835.14790.9708RWS-DIP4.7537.70080.9827Brain CRadial (20%)Zero-filling12.8029.42500.8256DIP8.0433.47710.9623RWS-DIP6.0235.97620.9775Variable density (30%)Zero-filling14.3428.43450.8038DIP7.0334.65780.9692RWS-DIP5.1837.28970.9811Figure 7
Comparison of reconstructions of the target MR image in Brain B using the radial undersampled mask with 20% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)Figure 8
Comparison of reconstructions of the target MR image in Brain C using the variable density undersampled mask with 30% sampling rate: (a) the target image and reconstruction results, (b) the corresponding error images, and (c) the corresponding zoom-in images.
(a)(b)(c)


## 3.2.2. Convergence Analysis

Convergence is an important quality in applications of MRI methods based on deep learning. Therefore, we detected the convergence of the proposed RWS-DIP method use error curves drawn by conducting experiments on Brain A and Brain B under Cartesian undersampled mask. Figure9 depicts the relative errors of reconstruction at every ADMM iteration. It can be observed that, as the number of iterations increases, the relative errors gradually converge to a low value at different sampling rates. Although there are slight fluctuations in the iteration procedure, the overall trend maintains convergence.Figure 9
RelErr curves of the proposed RWS-DIP method under Cartesian undersampled mask.


## 3.2.3. Parameter Evaluation

We evaluated the sensitivity of the proposed RWS-DIP method to parameter settings. The main parameters evaluated were the ADMM penalty parameterρ and the regularization parameter λ. We performed experiments on the Brain C dataset under Cartesian undersampled mask and varied one parameter at a time while keeping the rest as fixed values, as shown in Table 1.Figures10 and 11 show the plots of PSNR values as a function of the ADMM penalty parameter ρ and the regularization parameter λ. As can be seen from the curves, the optimal numerical settings for ρ and λ (ρ=0.05 and λ=0.0001) in the proposed RWS-DIP method under different sampling rates are identical, which means that the RWS-DIP method has robustness in the setting of parameters. In fact, although the reconstructions have lower PSNR values than other numerical settings for parameters ρ and λ, the difference is not significant, and the reconstruction performance is acceptable.Figure 10
PSNR values vs. regularization parameterλ for the reconstruction under Cartesian undersampled mask with different sampling rates.Figure 11
PSNR values vs. ADMM penalty parameterρ for the reconstruction under Cartesian undersampled mask with different sampling rates.


## 4. Conclusions

In this paper, we propose a novel reference-driven undersampled MR image reconstruction method using wavelet sparsity-constrained deep image prior. Our RWS-DIP method, which is based on the DIP framework, requires neither a pre-training procedure nor patient-based datasets, which is of great significance for clinical applications. The RWS-DIP method uses both structure and sparsity priors to improve the efficiency of the learning. The structural prior is introduced by employing a reference image as the network input, and the sparsity prior is explored by regularizing thel1 norm of wavelet coefficients. Experimental results on invivo MR scans show that the RWS-DIP method can achieve improved reconstruction performance and outperforms traditional DIP in preserving texture details and removing artifacts.Two extensions can be made in order to improve the proposed scheme: (1) mining and incorporating more effective prior information may lead to a further boost in performance, particularly in regard to strengthening the use of structural prior information, and (2) further research is needed for the regularization effect introduced into DIP, which will guide the design of complementary regularizations, so as to achieve a stronger effect and better performance.



---

*Source: 8865582-2021-01-22.xml*