Pixel Co-Occurence Based Loss Metrics for Super Resolution Texture Recovery
Authors: Ying Da Wang
Pawel Swietojanski
Ryan T Armstrong
Peyman Mostaghimi
Venue:  (2020)
Keywords: Super Resolution Generative Adversarial Networks
Perceptual Loss Functions

Abstract: Single Image Super Resolution (SISR) has significantly improved with Convolutional Neural Networks (CNNs) and Generative Adversarial Networks (GANs), often achieving order of magnitude better pixelwise accuracies (distortions) and state-of-the-art perceptual accuracy. Due to the stochastic nature of GAN reconstruction and the ill-posed nature of the problem, perceptual accuracy tends to correlate inversely with pixelwise accuracy which is especially detrimental to SISR, where preservation of original content is an objective. GAN stochastics can be guided by intermediate loss functions such as the VGG featurewise loss, but these features are typically derived from biased pre-trained networks. Similarly, measurements of perceptual quality such as the human Mean Opinion Score (MOS) and no-reference measures have issues with pre-trained bias. The spatial relationships between pixel values can be measured without bias using the Grey Level Co-occurence Matrix (GLCM), which was found to match the cardinality and comparative value of the MOS while reducing subjectivity and automating the analytical process. In this work, the GLCM is also directly used as a loss function to guide the generation of perceptually accurate images based on spatial collocation of pixel values. We compare GLCM based loss against scenarios where (1) no intermediate guiding loss function, and (2) the VGG feature function are used. Experimental validation is carried on X-ray images of rock samples, characterised by significant number of high frequency texture features. We find GLCM-based loss to result in images with higher pixelwise accuracy and better perceptual scores.

Under review as a conference paper at ICLR 2020
PIXEL CO-OCCURENCE BASED Loss METRICS FOR SUPER RESOLUTION TEXTURE RECOVERY
Anonymous authors Paper under double-bling review
ABSTRACT
Single Image Super Resolution (SISR) has significantly improved with Convolu- tional Neural Networks (CNNs) and Generative Adversarial Networks (GANs), often achieving order of magnitude better pixelwise accuracies (distortions) and state-of- ti--the-art perceptual accuracy. Due to the stochastic nature of GAN recon- struction and the ill- ill-posed nature of the problem, perceptual accuracy tends to correlate inversely with pixelwise accuracy which is especially detrimental SISR, where preservation of original content is an objective. GAN stochastics can be guided by intermediate loss functions such as the VGG featurewise loss, but these features are typically derived from biased pre-trained networks. Simi- larly, measurements of perceptual quality such as the human Mean Opinion Score (MOS) and no-refe no-reference measures have issues with pre-trained bias. The spatial relationships between pixel values can be measured without bias using the Grey Level Co-occurence Matrix (GLCM), which was found to match the cardinality and comparative value of the MOS while reducing subjectivity and automating the analytical process. In this work, the GLCM is also directly used as loss function to guide the generation of perceptually accurate images based on spatial collocation of pixel values. We compare GLCM based loss against scenarios where (1) no intermediate guiding loss function, and (2) the VGG feature function are used. Experimental validation carried on X-ray images of rock samples, characterised by significant number of high frequency texture features. We find GLCM-baase loss to result in images with higher pixelwise accuracy and better perceptual scores.
INTRODUCTION
A super resolution (SR) image is generated from single low resolution image (LR) (with without variable blur and noise) such that the result closely matches the true high resolution counterpart (whether it exists or not) (Park et al. 2003). There thus exists a vast number of possible solutions (Dong et al. 2014) for any given LR image, and by an extension, there are many techniques to recover SR details with varying degrees of accuracy. These methods range from the simple and blurry interpolation methods (bicubic, linear, etc.) that cannot recover contextual features to more complex model-based methods that utilise prior knowledge of certain domain characteristics to generate sharper details (Dai et al. 2009 Jian Sun et al. 2008 Yan et al., 2015). The contextual dependence of SR images addressed with Example-based approaches including Markov Random Field (MRF) (Freeman et al. 2002), Neighbour Embedding (Hong Chang et al., 2004), Sparse Coding (Yang et al. 2010) and Random Forest methods (Schulter et al.
2015). These can be generalised (Dong et al.
2014) into Super Resolution Convolutional Neural
Networks (SRCNN) for photographic images
(Dong et al. 2014, Wang et al. 2016 [imm et al.,
2017, Yu et al. 2018 Kim et al.) 2015 Ledig
et al.; 2017 7) medical images (Umehara et al. [0188]
You et al. 2018 and digital rock images (Wang
ct al. 20 2018 2019a). The original SRCNN network utilised as a backbone 3-5 convolutional
layers (Dong et al. 2014) that sharpened a bicubically upsampled image. More recent models contain
dedicated upsampling layers (Dong et al. 20166] Shi et al. 2016 Odena et al., 2016). skip connections
to improve gradient scaling (Kim et al. 2015 Ledig et al. (017). ), removal of batch normalisation
(Lim et al. 2017). and use of the sharper LI loss function YYu et al, 2018 Zhu et al.] (017). These
changes have all contributed gradually improving the pixelwise accuracy of the super resolution

---

Under review as a conference paper at ICLR 2020
methods. Despite the high pixelwise accuracy achieved by SRCNN networks ! the resulting super resolved images are often perceptually unsatisfying, and easily identifiable by a human observer as "blurry". It is due to the SRCNN can recover accurately features spanning several pixels such as larger scale edges, texture and high frequency features are lost as the network attempts to maximise the pixelwise accuracy over wide range of possible HR counterparts. The local minima problem thus manifests itself clearly in the ill-posed problem of Super Resolution.
Perceptual results can be improved by training the network with a hybrid loss function that combines a pixelwise loss (Ll or L2) with a feature-wise loss that is the L2 loss of features extracted from some intermediate convolutional layer of a pre-trained model (Johnson et al. 2016). The most effective method of perceptual texture generation thus far has been the use of Generative Adversarial Networks (GANs) (Goodfellow et al. 2014), with SRGAN generated images from low resolution photographs score highly on human surveys of image quality (Ledig et al.) 2017 Dosovitskiy & Brox (2166) as they can recover high frequency textures that are perceived as realistic, both for photographic features (Ledig et al. 2017) and textural quality in X-ray images (You et al. 2018). However, SRGAN generated images are stochastic in the way that high frequency features are regenerated, with a tendency to cause pixel mismatch, which is especially exacerbated by the use of the VGG feature loss (You et al. 2018 Ledig et al. 2017; Sajjadi et al.) 2017) that further tends to result in further distortion, leading higher pixelwise loss. For natural images this loss in pixelwise accuracy may be secondary, but plays an important role in applications where texture carries actual information, such as in X-ray images. This trade-off between the pixelwise accuracy (distortion) and the perceptual accuracy (Sajjadi et al. 2017 Mechrez et al. 2018 Vasu et al., 2018), is a consistently emergent limitation in SRGAN performance, whereby a high pixelwise accuracy causes over-smoothing while high perceptual accuracy causes pixel mismatch and distortion in some features. While both pixelwise accuracy and perceptual accuracy are important, SISR aims to preserve as much content/characteristies from the original image, while GAN essentially "makes up" content that is perceptually satisfying at the expense of pixelwise measures.
While pixel-wise distortions can be quantitatively measured, in order to evaluate perceptual per- formance one typically requires human subjective evaluations of Mcan Opinion Scores (MOS), or by leveraging the proxy score produced by "pre-trained" models (which could introduce their own biases) (Ma et al. 2016 Salimans et al. 2016). SRGANs typically obtain superior scores in terms of subjective metrics Ledig et al. 2017: Zhu et al. 2017 Vasu et al. 2018), however, an objective study of the differences in the high frequency SR textures compared to the original HR images has not yet been carried. This is especially of interest in imaging areas requiring expert judgements, such as in radiographic images. These are most often benchmarked with a combination of pixelwise metrics and opinion score surveys despite the smaller sample sizes and logistical challenge.
The overall aim of this study is the introduction of Grey Level Co-occurence Matrix (GLCM) method (Haralick et al. 1973) both an auxiliary loss function, and as an addition to the PSNR metric for evaluating perceptual and textural accuracy of super resolution techniques (GLCM better correlates with the subjective scores of human evaluations). GLCM has been sucessfully used in the characterisation of texture in medical images (Makaju et 2018 Madero Orozco et al. 2015 Sivaramakrishna et al. 2002 Pratiwi et al. [2015] Liao et al. al. | Yang et al.) 2012) and CT rock images (Singh et al. [211 Becker Becker et al. 201 6 Jardine et al. (218)). In essence, the GLCMM transforms an image into a representation of the spatial relationship between the grey colours present in the image. The GLCM is not pixelwise measurement, and so be used to evaluate texture recovery that may not be a pixelwise match. The GLCM is particularly well suited for automatic perceptual/textuall in-domain comparisons, as it does not require timecconsuiing expert MOS evaluations, and does not pose inherent dita-bias when scoring with auxiliary models.
We the DeepRock-SHP (Wang al., 2019a) dataset to train and validate the results of SRGAN model, which in this study is a modified Enhanced Deep Super Resolution (EDSR) network (Lim ct al., 2017) coupled GAN discriminator (EDSRGAN). The resulting performance in generating SR images is quantitatively analysed, both based on the traditional pixelwise approach, as well as using the GLCM spatial texture accuracy method introduced in this work. GLCM texture analyses of the SRGAN and SRCNN results indicate quantitatively that SRGAN produces images with a GLCM error that are an order of magnitude lower (more texturally similar) than SRCNN images, that tend to
'Henceforth, unless stated otherwise, all generative convolutional networks (and the corresponding generated images) will be referred to as "SRCNN"
2

---

Under review as a conference paper at ICLR 2020
have a higher PSNR, but also a higher GLCM enror and lower MOS scores. Overall, the use of the GLCM offers fast and more agnostic evaluation metric when compared to carrying MOS evaluations, and is easier to reproduce and analyse due to its algorithmic data-driven nature. The GLCM can be also used as an auxiliary loss function to guide the generation of spatially accurate texture, resulting in further reductions in the texture error while also improving the pixelwise accuracy.
2
METHODS
2.1
GREY LEVEL CO-OCCURRENCE MATRIX FOR TEXTURE ANALYSIS
The Grey Level Co-occurrence Matrix characterises the texture of an image by caleulating the number of pairs of pixels that could be spatially related within some pre-defined regions of interest. For given image with grey levels, an N by N co-occurrence matrix P is constructed, in which the (i,5) position denotes the number of times a grey level is spatially related to a corresponding grey level j. An example of spatial relationship setting in an image of size (Nz. N2y could be all locations of y) and (z + 1, y) (i.e. their horizontal adjacency). In this case, the value at location (i,j) in P is the sum of all occurrences where grey level i and grey level j occur horizontally adjacent to each other within the image. Since the GLCM does not compare spatially matching pixel values but instead compares the spatial distribution of pixel values, it is good measure of texture similarity to complement the exxel-b-pixe- similarity PSNR metric.
In general, multiple GLCMs with an encompassing set of spatial relationships are constructed to fully characterise the texture of an image. Aside from the default (z. y) to (x + 1. y) relationship. the offset value can be generalised to an omnidirectional pixel distance d E Z such that the spatial relationships are (ar, 3) to (ar + dz, y + dyy). Some of the the GLCMs used in this study are calculated in 8 directions with a 45 degree offset, to a distance of up to 10 pixels with a 4-bit precision (16 grey
levels after quantisation). This results in a 8x 1x10x6xx16 GLCM tensor P, or 80 16x16 GLCMS, one for each spatial relationship setting. This raw transformation can then be analysed for variety of statistical measures, or a pixelwise comparison can be carried on GLCMs for different images to comparatively quantify texture similarity. If generated SR image is texturally similar to the original HR image, then it can be expected that the corresponding GL.CMs are closer to each other w.r. I.1 or 1.2 distances. The L1-GL L1-GLCM error is computed as:
Eis PSRS - -PHR
GLCM Loss
(1)
Enj'j 2j
2.2 SUPER RESOLUTION GENERATIVE ADVERSARIAL NETWORK AND LOSS FUNCTIONS
The architecture used in this study is the EDSRGAN network (Wang et al. 2019a), which is based on the Enhanced Deep Super Resolution (EDSR) (Lim et al. 2017) and the SR- SR-Resnet (Ledig et al. 2017) networks. The model uses Parametric Rectified Linear Units (PReLU) as activation functions, and batch normalisation layers are removed as this was found detrimental to SR convergence (Lim let al. 2017: Yu al.) 2018). The Generator G is depicted in Figure D The LI pixelwise loss was used as it offered better SRCNN convergence and less severe smearing compared to the 1.2 loss (Zhu et al. 2017) by reducing the penalty for high frequency noise and texture.
G' is trained for 100,000 iterations on cropped mini-batches of 16x 192x 192 with a learning rate of le-4 using the Adam optimiser (Kingma & Ba 2014). The generator G is capable of boosting image resolution and sharpening medium to large scale features (Wang et al. a). SRGAN is finetuned to regenerate high frequency textures and features smaller than 3-5 pixels. The GAN couples G with discriminator D depicted in Figure by the adversarial loss ADV Lose Joint training continues for additional 150,000 iterations.
On top of Lingu and ADV Loss losses, the total generator loss also includes VGG-19 perceptual objective (Ledig et al. 2017), and the proposed GLCM (cf. equation T. and is defined as follows:
GLoss Irponn +VGG119.0. + BADV Loss + GGLC Loss
3

---

Under review as a conference paper at ICLR 2020
SubPool Convolation F3el
Connotaiional Lagee
Resioual Block
PRCLU
Connection
Figure I: Architecture of the generator network. As in EDSR network but with PReLU activations all layers, including subpixel convolations during upscaling.
Speud
Figure Architecture of the Discriminator network.
where a, B, and y are scaling terms set to le-5, 1e-3, and le-4, respectively to keep their magnitudes in the ballpark of the L1 loss.
RESULTS AND DISCUSSION
This section shows the results and analyses of the EDSRGAN network performance, when trained with GLCM metric. The first set experiments illustrate GLCM performance as metric to quantify texture accuracy of the network in its standard configuration with the VGG19 loss function. Then setup gets extended to using GLCM as an auxiliary loss function as shown in equation 2
3.1 GREY LEVEL CO-OCCURENCE MATRIX AS A METRIC
The pixelwise accuracy of the SRCNN and SRGAN is calculated by comparing the PSNR of the Bicubic (BC), SR, and SRGAN images against the ground truth HR images. The PSNR results are reported on held-out set of 800 500x500 test images of sandstone, carbonate, and coal in Table T In terms of pixelwise accuracy, SRGAN images are less accurate compared to SR images. This is expected for perceptual losses, as they sample one of many plausible SR solutions, of which HR only one instance.
Table I: PSNR results for the DeepRock-SA dataset (Higher is better)
Sandstone
Carbonate
Coal
PSNR (dB)
Mean
Var
Mean
Var
Mean
Var
Bicubic
25.8822
0.6802
22.9768
1.9896
39,8738
10.3738
SRCNN
28.5986
6.9992
24.3879
1.7475
42.6653
3.7016
SRGAN
26.2118
8.3945
21.8533
1.3415
40.6061
4.4339
Sample visualisations of the resulting validation images are shown in Figure 3 The HR image (top row) and LR image (first column), and the corresponding interpolation (BC), SRCNN and SRGAN methods (3rd - 5th column, respectively). A trend of gradually improved visual sharpness and texture quality from BC to SR and SR to SRGAN images can be observed. This is particularly clear for carbonate images that contain highly heterogeneous features such as oolitic vugs and high frequency texture associated with microporosity. This visual trend is expected from SRGAN type networks, but is entirely lost when looking at the PSNR results in Table In other words, the pixel mismatch caused by stochastic GAN generation is unaccounted for, causing the drop in the pixelwise accuracy of SRGAN images. Thus, the spatial relationship of
variants obtained with bicubic
4

---

Under review as a conference paper at ICLR 2020
Eavoralares Carbonate
Fractured Cool
Banthalmer Sand
100
10
252
250
350
100
299
100
191
50
50
50
50
mostin cal 1
12 22
200
200
50
50
230
200
203
200
50
100
Figure 3: Sample images from the validation set using EDSRGAN network. Based the 1.R image, bicubic SR, SRCNN and SRGAN images generated. Results show improvement feature recovery in SRCNN images, and texture recovery in SRGAN images that look perceptually identical the images.
5

---

Under review as a conference paper at ICLR 2020
pixels is analysed instead of the pixelwise relationship. To do this, GLCMs calculated for HR, SR, SRGAN, and BC images and compared to each other. As an initial reference, the 8-way 4-bit GLCM over offset of 10 pixels (see Section 2.1) is used. The LI error between the GLCMs is calculated as a measure of textural similarity and plotted for the validation images, presented in Figure 4 sorted in ascending order of L.1 GLCM error.
Sandstone
Corbonate
1.5
1.2
00
04
200 433
850
203
Figure 4: Plots of the LI GLCM error for sandstone, carbonate, and coal images in the validation and testing sets of the DeepRock-SR dataset. 800 images for each rock type are sorted in axcending order of SRGAN error for visual clarity. can be seen that SRGAN results show a clear comparative improvement in spatial texture similarity.
There is clear delineation between the BC, SR, and SRGAN images in terms of their LI-GLCM егтor, with SRGAN images offering best results in terms of their GLCM defined spatial relationships. The filtered Gildehauser sandstone images can be seen as the red data points close to the blue SRGAN line in the sandstone graph, and show lower overall error compared to the other raw sandstone images. Another sample of interest is the Wilcox Tight Gas Sandstone, seen as the outlying cloud of points that results in high comparative GLCM errors in Bicubic and SRCNN methods due to the increase in intragranular texture compared to conventional sandstones. Carbonate images show similar improvements in texture similarity. Coal images possess sparse distribution of fracture features within an otherwise fairly smooth sub resolution micro-fracturr that results in low proportion of regions with high texture variation. Thus the SRCNN and bicubic methods show a lesser degree of texture loss compared to SRGAN. While SRCNN possesses a greater pixel-by-pixe accuracy, the texture error analysis in this section shows that SRGAN is superior in recovering the spatial relationship between pixel values. Since this 8-way 4-bit 1 10px offset choice of GLCM is arbitrary, whether this delineation of texture accuracy is preserved when using different GLCM parameters is shown in Figure 5
Changing the bit depth results in quantisation of the spatial grey values, and causes loss of information which can smear away certain details. Changing the offset length affects the weighting and importance assigned to the spatial relationship of pixels close (i.e. 5px) and far (i.e 20px) neighbourhoods. We find that, when plotting the median L1-GLCM error for each rock type over different bit depths and offset lengths, the relationship between order of texture accuracy as compared to the HR ground truth image is preserved without exception. This lends credence to the general use of the LI-GLCM as a measurement of perceptual error in textured images.
3.2 GREY LEVEL CO-OCCURENCE MATRIX AS A LOss FUNCTION
Since the GLCM metric clearly quantifies and delineates texture accuracy, it can be directly used as a loss function to replace the VGG loss function that is canonically used in the SRGAN network. In this case, the GLCM is calculated with floating point precision maintain differentiaaiiity. and to preserve computational speed during training, the GLCM is calculated with an offset of 2px in directions. This 8- 8-way, float32-bit GLCM with offset of 2px replaces the VGG function during training, and the resulting pixelwise and texturewise accuracy is compared against SRGAN-MSE (trained with no intermediate loss function), as well as SRGAN-VGG. Furthermore, the 8-way, 4-bit GLCM metric used in the previous section shows that the overall texture accuracy is also improved compared to SRGAN-VGG, as shown in Figure 6 The overall pixelwise and texturewise accuracy of SRGAN-GLCM, GLCM is superior to versions with MSE-only and VGG as loss functions. This shows an ability to directly use the GLCM as an unbiased loss function is a further benefit aside from its potential use as quality metric for texture recovery.

---

Under review as a conference paper at ICLR 2020
Sandstone
101
460
101
030 enee
109
Bi Deegth
Deeth
6C Depoth
Figure 5: Different bit depths and offset lengths for the LI GLCM for sandstone, carbonate, and coal images retain the same cardinal relationship in terms of spatial texture reconstruction accuracy
Validation Images
OCo
10-3
ERGAN-GLCM
SRGAN-MS MSEE
SRGAN-VGG
L1 GLCM error
10
0
100
200
300
400
500
600
700
800
Figure 6: Comparison of texture accuracy as measured by the LI-GLCM. for cases of SRGAN trained with MSE-only, VGG, and GLCM functions. The GLCM loss function produces the lowest overall texture error.

---

Under review as a conference paper at ICLR 2020
The resulting trained networks produce mean pixelwise and texturewise error as shown in Table 2 indicating that SRGAN-GLCH, provides the most accurate overall result. The SRGAN-MSE results obtained without any intermediate loss function that would guide the generation of SR images, while the SRGAN-VGG results make use of the VGG loss function. Note, in our case auxiliary VGG model was trained detect coloured photographic features rather than greyscale X-ray textures. Thus the degree of pixelwise distortion is highest for SRGAN-VGG, SRGAN-MSE results are characterised by the highest texturewise error, since the GAN guided generation of perceptually accurate features is entirely stochastic and unguided. These limitations of SRGAN-MSE and ERGAN-VGE are less severe in the SRGAN ORGAN-GLCM, which does not cause extra distortion of the pixelwise configuration (resulting in higher PSNR). At the same time, SRGAN-GLCM also improves the spatial accuracy of pixel values, thus improving also texture accuracy.
Table 2: Pixelwise (Higher is better) and lexturewise (Lower is better) results for the DeepRock-SE dataset, comparing SRGAN network performance as trained using only the MSE, MSE+ and MSL+GLCM. Average values on validation dataset, the pixelwise mismatch is highest for VGG loss, while lowest for GLCM loss. Texturewise, the GLCM is superior followed by VGG and MSE metries.
Validation Images
Mean PSNR (dB)
Mean LI-GLCM
SRGAN-MSE
29.3787
4.465e-4
SRGAN-
29.3344
3.651e-4
SRGAN-GLCM
29.3815
3.124e-4
4 CONCLUSIONS
The issue with understanding and quantifying the accuracy of perceptual texture regeneration is addressed in an unbiased and automated approach that uses the GLCM as an accuracy metric as well as loss function. Texture analysis using GL.CMs (of varying bit depths and offsets) shows superior texture similarity of SRGAN images compared to normal SRCNN and other interpolation methods. Similarly, using the GLCM as a loss function reduces distortions caused by the VGG loss function, which improves the pixelwise accuracy and reduces texturewise errors. GLCM, used either as metric and/or loss function, applied in this work to digital rock images, is likely to also perform well for other types of highly textured greyscale images such medical images (where the concept of the GLCM originated from).
While the GLCM has been shown to well with SRGAN networks to obtain higher pixelwise and texturewise accuracies on X-ray images, its performance both as the perceptual metric and loss function remains to be explored for natural photographic images. One would reasonably expect, that the GLCM would confer some (as yet untested) benefit for any vision generation tasks where high quality high frequency textures are present. Furthermore, the GLCM is traditionally used for greyscale images, so its use in colour images would require some modifications, such as separate GLCM per colour channel. We leave this as future work.
REFERENCES
Megan Becker, MA Jardine, Jodie Miller, and M Harris. X-ray computed tomography geometal- lurgical tool for 3d textural analysis of drill core? 06 2016.
Martin J. Blunt, Branko Bijeljic, Hu Dong, Oussama Gharbi, Stefan Iglauer, Peyman Mostaghimi, Adriana Paluszny, and Christopher Pentland. Pore-scale imaging and modelling. Advances in Water Resources, 51:197 216, 2013. ISSN 0309-1708. doi: https///doi.rr//000010/// advwatres 2012. 03 003. URL http:/ / /wwww scwencedi www.eencedeeet...ommeo com http://cacncceacllee////// 35th Year Anniversary Issue.
pii/s03091700 70800205222228
Tom Bultreys, Luc Van Hoorebeke, and Veerle Cnudde. Multi-scale, micro-computed tomography- based pore network models to simulate drainage in heterogeneous rocks. Advances in
Water Resources, 78:36 49, 2015. ISSN 0309-1708. doi: https///bo..rr//100016///
advwatree.20115.02.00 URL http: http://ww..ceenccrreee.ttttt http://dweetttcooocccc////eeraaa S11/803391170815500000
8

---

Under review as a conference paper at ICLR 2020
T. Chung, Y.D. Wang, Mostaghimi P., and Armstrong RT. Approximating permeability of micro-ct images using elliptic flow equations. SPE Journal, 2018.
S. Dai, M. Han, W. Xu, Y. Wu, Y. Gong, and A. K. Katsaggelos. Softcuts: soft edge smoothness prior for color image super-resolttion. IEEE Transactions Image Processing, 18(5):969 981, May 2009. ISSN 1057-7149. doi: 10.1 19/10099P.009..200 2010088..
Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. Image Super-Resolution Using Deep Convolutional Networks, volume 38. 2014. doi: 10.1 10.100//PAMM2205522492222
the Chao Dong, Chen Change Loy, and Xiaoou Tang. oucceaattiggngguuuuupuoooooooaao ral network. CoRR, abs/1608.003661 2016. Ttt.A//...///aa......////////2/0
neu-
Alexey Dosovitskiy and Thomas Brox. Generating images with perceptual similarity metrics based on deep networks. CoRR, abs/ Abs/1600.00264,, 2016. URL http:://axx...zo////aappp 02644
W. T. Freeman, T. R. Jones, and E. C. Pasztor. Example-based super-resolution. IEEE Computer Graphics and Applications, 22(2):56-65, March 2002. ISSN 0272-1716. doi: 10. 2.11109/3.9887444
Ian J. Goodfellow, Jean Pouget-Abadie, Mchdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative Adversarial Networks. arXiv e-prints, art. arXiv:1406.2661 Jun 2014.
Wen Hao Chen, Yang, Tiqiao Xiao, Sheridan Mayo, Yu Dan Wang. and Haipeng Wang. A synchrotron- local computed tomography combined with data-constrained modelling ap- proach for quantitative analysis of anthracite coal microstructure. Journal of synchrotron radiation, 21:586-93, 05 2014. doi: 10.1 1000100/11000 11.107/566005775100077999
R. M. Haralick, K. Shanmugam, and Dinstein. Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics, SMC-3(6)610-621, Nov 1973. ISSN 0018-9472. doi: 10.1 1999/SSMC.1933330000
RD Hazlett. Simulation of capillar-dominatte displacements microtomographic images of reservoir rocks, pp. 21-35. Springer, 1995.
Hong Chang, Dit-Ya Yan Yeung, and Yimin Xiong, Super-resolution through neighbor embedding. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Puttern Recognition, 2004. CVPR 2004., volume 1, pp. I-I, June 2004. doi: 10.1 10.1109/CVPR.2004, 1315043,
M.A. Jardine, J.A. Miller, and M. Becker. Coupled x-ray computed tomography and grey level co-occurrence matrices as a method for quantification of mineralogy and texture in 3d. Com- puters & Geosciences, 111:105 117, 2018. ISSN 0098-3004. doi: https://doi.or/10..001
2ccgee..217..11.00 URL http: http:://wwwr www. www.eiiiiiniiieeee rect cote
com htt.s//c////eee//aaiiciooooo
211/80098300417333
Jian Sun, Zongben Xu, and Heung-Yeung Shum. Image super-resolution using gradient profile prior. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, June 2008. doi: 10.1 10..1099//P.2200 4587659.
Justin Johnson, Alexandre Alahi, and Fei-Fei Li. Perceptual losses for real-time style transfer and super-resolution. CoRR, abs/1603.08115, 2016. httl:tttpp//xx..ooott
603
08 08155
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee. Accurate Image Super-Resolution Using Very Deep Convolutional Networks. 2015.
Diederik Kingma and Jimmy Ba. Adam: A Method for Stochastic Optimization. 2014.
Paulina Krakowska, Marek Dohnalik, Jadwiga Jarzyna, and Kamila Wawrzyniak-Grn Computed x-ray microtomography as the useful tool in petrophysics: A case study of tight carbonates
modryn formation from poland. Journal of Natural Gas Science and Engineering, 31:67-75. 2016. ISSN 1875-5100, doi: https://doi.org/1000 httg://000.11..oooeeeo.11.000000 sci sciencedi rect com/ sci http:///s..eeeeaaaaaa///a/////// S111111877775110000012017
2016.0.....000000.00 URL http:http: /www

---

Under review as a conference paper at ICLR 2020
Christian Ledig, Lucas Theis, Ferenc Huszar, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz. Zehan Wang, and Wenzhe Shi. Photo- Realistic Single Image Super-Resolution Using Generative Adversarial Network. 2017. doi: 10.1 00.1109/VVP..001..19
Zhengji Li, Qizhi Teng, Xiaohai He, Guihua Yue, and Zhengyong Wang. Sparse representation- based volumetric super-resolution algorithm for 3d images of reservoir rocks. Journal of Applied Geophysics. 144:69-77. 2017. ISSN 0926-9851. doi: https///ooi.or//1000
URL http:// wwwp://wwwwwc.oo www.sceeieedrer..ccc com htt.:///oeccccc/aaric......
pi 051/509266951113300
Yin- Yin Liao, Po-Hsiang Tsui, Chia-Hui Li, King-Jen Chang, Wen-Hung Kuo, Chien-Cheng Chang, and Khang Yeh. Classification of scattering media within benign and malignant breast tumors based on ultrasound
setrre-fattre--baseee and makagami-parameter images. Medical Physics, doi: 10. 10.1118/1.3566064 URL (tLLhtts::/ /ttp//aaa...////////////../aa. onlinelibrary
38(4):2198-2200) 2011.
wi wiley. ctw.:cccm/cco doi/ abs /10 110 11 111111111111111 /1..//1111111 3566064
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. Enhanced Deep Residual Networks for Single Image Super- Super-Resolutton. 2017. doi: 10. 109/CVPR..207..551
W Brent Lindquist, Sang-Moon Lee, David A Coker, Keith W Jones, and Per Spanne. Medial axis analysis of void structure in three-dimensional tomographic images of porous media. Journal of Geophysical Research: Solid Earth, 101(B4):8297-8311 -3100, 1996. ISSN 2156-2202.
Chao Ma, Chih- Yuan Yang, Xiaokang Yang. and Ming-Hsuan Yang. Learning a no-reference quality metric for single-image super-resolution. CoRR, abs/1612.05890, 2016. URL http:
//arxiv.org/eat abs/ 111..11111111 05890
Hiram Madero Orozco, Osslan Osiris Vergara Villegas, Vianey Guadalupe Cruz Sánchez, Humberto de Jesús Ochoa Domínguez, and Manuel de Jesús Nandayapa Alfaro. Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. BioMedical Engineering OnLine, 14(1):9, Feb 2015. ISSN 1475-925X. doi: 10. 10.1186612933--0550000333
URL https: htt///oioogg////// 10. 11 86
015 5003-0000
Suren Makaju, P.W.C. Prasad, Abeer Alsadoon, A.K. Singh, and A. Elchouemi. Lung cancer detection using ct scan images. Procedia Computer Science, 125:107 - 114, 2018. ISSN 1877- 0509. doi: http:://do..rr//1000 [com/ sc wwwssecceeerriieeeeeee http:///oo/oooorrrrr///////////1
2017. (RLhttp:: www. sci sciencedirect The 6th International Conference
on Smart Computing and Communications.
John Mathieson, J.R. Mayo, C.A. Staples, and N L Müller. Chronic diffuse infiltrative lung disease: Comparison of diagnostic accuracy of ct and chest radiography. Radiology, 171:111-6, 05 1989. doi: 10. 14/rrddooooyyy. 171.1.2922811.
Roey Mechrez, Itamar Talmi, Firas Shama, and Lihi Zelnik-Manor. Learning to maintain natural im- age statistics. CoRR, abs/180 0111803.000 04666, 2018. URL http:://aaxxxx..oot/aa///111 04626
Peyman Mostaghimi, Martin J Blunt, and Branko Bijeljic. Computations of absolute permeability micro-et images. Mathematical Geosciences, 45(1):103-123 2013. ISSN 1874-8961.
Augustus Odena, Vincent Dumoulin, and Chris Olah. Deconvolution and checkerboard arti- facts. Distill, 2016. doi: 00223915dissiil.0000.. URL lttt:://cistill.puu pub//1111
S. C. Park, M. K. Park, and M. G. Kang. Super-resolution image reconstruction: technical overview. IEEE Signal Processing Magazine, 20(3):21-36, May 2003. ISSN 1053-5888. doi: 10.1 10.1109//SP.2003.. 220.0......000...22.7.. 1202077.
Mellisa Pratiwi, Alexander, Jeklin Harefa, and Sakka Nanda. Mammograms classification using gray- level co-occurrence matrix and radial basis function neural network. Procedia Computer Science, 59:83 91, 2015. ISSN 1877-0509. doi: sccleecc/arriceeep//////70001010 // w/www. wwwesceeiiiceieeecoocoooco rect. com/ swtpsccccccceeeeeceeeeeeeeecccee ternational Conference Computer Science and Computational InaartaaioonalIneeleleeeeee (ICCSCI 2015).
URhhttp! http:
In-
10

---

Under review as a conference paper at ICLR 2020
M. S. M. Sajjadi, B. Schölkopf, and M. Hirsch. Enhancenet: Single image super-resolution through automated texture synthesis. In 2017 IEEE International Conference on Computer Vision (ICCV), pp. 4501-4510 Oct 2017. doi: 10.110///CCV.221..488.
Tim Salimans, lan J. Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. Improved techniques for training gans. CoRR, abs/1606.0344 2016. URL http::/arxiv
1606. 03498
Steffen Schlüter, Adrian Sheppard, Kendra Brown, and Dorthe Wildenschild. Image processing of multiphase images obtained via x-ray microtomography: a review. Water Resources Research, 50 (4):3615-3639, 2014.
Steffen Schlüter, Adrian Sheppard, Kendra Brown, and Dorthe Wildenschild. Image processing of multiphase images obtained via x-ray microtomography: A review. Water Resources Re- search, 50(4))6615 2014. doi: 1o::100.0002/22144R0
URL httpp::/aggpubs:
on ine wwweelibrrrr.wleec.... wi www.llyyyyoomaeamm dwi/ http://wwwwwlacc.o////////a/aa//
S. Schulter, C. Leistner, and H. Bischof. Fast and accurate image upscaling with super-resolution forests. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp- 3791-3799, June 2015. doi: 10.1109/VVP.22155.229999
Wenzhe Shi, Jose Caballero, Ferenc Huszár, Johannes Totz, Andrew P. Aitken, Rob Bishop, Daniel Rueckert, and Zehan Wang. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. CoRR, abs/1609.05158, 2016. URL http://arxiv
axg/abs/1605 05158
Ankita Singh, Ryan T. Armstrong, Klaus Regenauer-Lieh, and Peyman Mostaghimi. Rock characteri- zation using gray-level co-occurrence matrix: An objective perspective of digital rock statistics.
Water Resources Research, 55(3):1912-1927, 2019. doi: 10. 20.10299/2088WR023344 URL https
7/ //agupubs.
Radhika Sivaramakrishna, Kimerly A. Powell, Michael Lieber, William A. Chilcote, and Raj Shekhar. Texture analysis of lesions in breast ultrasound images. Computerized Medi- cal Imaging and Graphics, 26(5):303 - 307, 2002. ISSN 0895-6111. doi: huts://doi.org
0010016/00899-111100000000222120 URL http:/ http://wwwwwccccc www.scciencd.... rect. wtt.:/ccc..si.iieee
article/s11/00855110000222
Kensuke Umehara, Junko Ota, and Takayuki Ishida. Application of Super-Resolation Convolutional Neural Network for Enhancing Image Resolution in Chest CT, volume 31. 2018. doi: 10. 1001 s10278-017-0033-..
Subeesh Vasu, Thekke Madam Nimisha, and Rajagopalan Ambasamudram Narayanan. Analyz- ing perception-distortioo tradeoff using enhanced perceptual super-resolution network, CORR, abs/1811.000: 2018. URL httptt
org/ abs/ 18 1811 00344
Yifan Wang, Lijun Wang, Hongyu Wang, and Peihua Li. End-to-end image super-resolution via deep and shallow convolutional networks. CoRR, abs/1607 (00/1607707680, 2016. UtLhttp: httth:t/p//ax/
htre/bbs/10000 0t1///11770060000
Ying Da Wang, Ryan Armstrong, and Peyman Mostaghimi. Boosting resolution and recovering texture of micro-ct images with deep learning, 2019a.
Ying Da Wang. Ryan T. Armstrong, and Peyman Mostaghimi. Enhancing resolution of digital rock images with super resolution convolutional neural networks. Journal of Petroleum Sci- ence and Engineering. 182:106261, 2019b. ISSN 0920-4105. doi: https://doi. wrt.:/o..or/10000001. 1016/ 2ttttol.2019,00226.. URL http:// /tw::///wwww.o// www.sceeeiiieeee rect. com/ httm///iinnce//riclleee. p11/809204105193665
Ying Da Wang, Traiwit Chung. Ryan T. Armstrong, James McClure, Thomas Ramstad, and Peyman Mostaghimi. Accelcrated computation of relative permeability by coupled morphological multiphase flow simulation, 2019c.
11

---

Under review as a conference paper at ICLR 2020
Ying Da Wang, Traiwit Chung, Ryan T. Armstrong, James E. McClure, and Peyman Mostaghimi. Computations of permeability of large rock images by dual grid domain decomposition. Ad- vances in Water Resources, 126:1-14, 2019d. ISSN 0309-1708. doi: https///bo..rr//10001166/
allwatres.2019.0000 002. URL http:tttpp/... /ttp://wwwwwomm sci enced rect. ctt.:ttt.ooooccccec//eeetiiieeee
p1 p11/503091 708 8307498
Yukai Wang. Qizhi Teng, Xiaohai He, Junxi Feng, and Tingrong Zhang. Ct-image super resolution using 3d convolutional neural network. CoRR, abs/1806. 09074, 2018. URL
09074
Dorthe Wildenschild and Adrian P Sheppard. X-ray imaging and analysis techniques for quantifying pore-scale structure and processes subsurface porous medium systems. Advances Water Resources, 51:217-246, 2013. ISSN 0309-1708.
Q. Yan, Xu, X. Yang, and T. Q. Nguyen. Single image superresolution based on gradient profile sharpness. IEEE Transactions on Image Processing, 24(10):3187-3202 Oct 2015. ISSN 1057- 7149. doi: 10.1 109/TTP.2015.2414877
Jianchao Yang, John Wright, Thomas S. Huang, and Lei Yu. Image super-resolution via sparse representation. Image Processing, IEEE Transactions on, 19:2861 2873, 12 2010. doi: 10.1 TIP.2010.2050625.
Xiaofeng Yang, Srini Tridandapani. Jonathan J. Beitler, David S. Yu, Emi J. Yoshida, Walter J. Curran, and Tian Liu. Ultrasound glem texture analysis of radiation-nnduced parotid-gland injury in head-and-neck cancer radiotherapy: An in vivo study of late toxicity. Medical Physics, 39()): 5732-5739, 2012. URL https: /atas://aappo /aapm. onl inel www.onniiiiirrrry...emmo wwwey. com/ cwm/doim abs/10 #118/1.47475
Jun-Jun Ych, Solomon Chih-Cheng Chen, Wen-Bao Teng, Chun-Hsiung Chou,
Shih-Peng Hsich, Tsung-Lung Lee, and Ming-Ting Wu. Identifying the most infectious lesions in pulmonary tuberculosis by high-resolution multi-detector computed tomography. European radiology. 20: 2135-45, 09 2010. doi: 10. 10.1007/s00330-000 1796-199-5.
Chenyu You, Guang Li, Yi Zhang, Xiaoliu Zhang, Hongming Shan, Shenghong Ju, Zhen Zhao, Zhuiyang Zhang, Wenxiang Cong, Michael W. Vannier, Punam K. Saha, and Ge Wang. CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN- CIRCLE). arXiv e-prints, art. arXiv: 1 180.888....0 04256, Aug 2018.
Jiahui Yu, Yuchen Fan, Jianchao Yang, Ning Xu, Zhaowen Wang, Xinchao Wang, and Thomas Huang. Wide activation for efficient and accurate image super-resolution. CoRR, abs/ 0tts/1808.000 008.888811 2018.
URL http: org www.sass...... 08718
Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A. Efros. Unpaired image-to-image translation using cycle-consistent adversarial networks. CoRR, abs/1703. 2017. URL http://
arxiv.
APPENDIX
5.1 TEXTURED X-RAY IMAGE DATASET
X-ray Computed Tomography (CT) images that detail the finer features within the internal structure of porous media are important in characterisation of the physical properties in material analysis (Schlüter et al. 2014), as well improving medical diagnostic accuracy and radiomic analysis (Park et al.] 2003] Yeh et al. [2100] Mathieson et al. 1989). One of the recent application is in earth science and engineering for determination rock properties. Rock images, also known as digital rock, at higher energies and micrometre resolution (μCT) assist in determination of petrophysical and flow properties of rocks (Wang et al. 2019d Chung et al. 2018 Wang et al., 2019c Mostaghimi et al. 2013 Krakowska et al. 2016 Blunt al. (2013) 33
destructive manner (Lindquist et al. 1996. Hazlett 1995] Wildenschild & Sheppard 2013) Schlüter et al. 2014). A high resolution rock image
that resolves pore space features while spanning wide FOV represent bulk properties (Li et al.
12

---

Under review as a conference paper at ICLR 2020
2017) can be challenging to obtain in such cases, but can be generated by super resolution methods Wang et al. 2019b a).
The DeepRock-SR dataset comprises of 12,000 500x500 high resolution unsegmented slices of various digital rocks of sandstone, carbonate, and coal (4,000 images respectively), with image resolution ranging from 2.7 to 25 jam, outlined in previous studies (Wang al. 2019a). The dataset contains a wide range of rock types, imaged under various conditions. Resolved sandstone grains and under-resolved clay minerals, complex under-resolved carbonate microporosity (Bultreys et al.) 2013), and coal fracture networks (Hao Chen et al. 2014) are all encompassed as features within the dataset.
Bentheimer Sandstoone
Beroa Sandstore
Leopard Sandstone
Olldchouser Sandstone
Wikos Fight Sandstone
100
302
100
100
100
230
200
300
Estalllades Carbanate
Savonnteres Carbonate
Massangis Carbonate
Naturalty Fractured Coal
200
202
200
200
200
300
300
380
400
480
Figure 7: Sample slices of images from DeepRock-SP
Res
Raal Tabel
Disrininnttee
High
L: Loss
ADV Loss
Loss
VGG Loss
Figure 8: Overall architecture of the EDSRGAN network
13

---

Under review as a conference paper at ICLR 2020
300
350
200
200
200
343
100
150
100
150
153
200
200
200
212
100
150
100
150
100
150
150
150
352
200
200
200
202
100
150
200
150
200
Figure 9: Difference maps of the sample images from Figure revealing obvious improvement in the pixelwise accuracy of SRGAN images despite there being high perceptual fidelity the SRGAN images
14


Reviews:
[{"review_id": "SJlcwtH2tB", "reviewer": "AnonReviewer1", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "The paper considers the problem of generating a high-resolution image from a low-resolution one. The paper introduces the Grey Level Co-occurrence Matrix Method (GLCM) for evaluating the performance of super-resolution techniques and as an auxiliary loss function for training neural networks to perform well for super-resolution. The GLCM was originally introduced in a 1973 paper and has been used in a few papers in the computer vision community. The paper trains and validates a super-resolution GAN (SRGAN)  and a super-resolution CNN (SRCNN) on the DeepRock-SR dataset. Specifically, for the SRGAN, the paper uses the EDSRGAN network trained on loss function particular to the paper: The loss function consists of the addition of the L1 pixel-wise loss plus the VGG19 perceptual objective plus the proposed GLCM loss.\nThe paper finds that SRCNN outperforms SRGAN in terms of the PSNR metric, but SRGAN performs better in terms of the spatial texture similarity.  \nNext, the paper shows that when trained with the mean L1-GMCM loss function, SRGAN performs best.\n\nIn summary, the paper proposes to use the GMCM loss for training and evaluation of the super-resolution methods. However, this metric is well known in the computer-vision community along with many others. Also, the idea to use this metric in training is only evaluated for one network (albeit a very sensible one) and only for one dataset (the DeepRock one). Since the novelty provided by the paper is small, I cannot recommend the acceptance of the paper.", "extra_scores": {"experience_assessment": "I have read many papers in this area.", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper at least twice and used my best judgement in assessing the paper."}, "extra_text": {}}, {"review_id": "Hyl0aS9aYr", "reviewer": "AnonReviewer3", "summary": "", "questions": "", "limitations": "", "rating": 3, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper adopts a loss metric called Grey Level Co-occurence Matrix (GLCM) as a new measurement of perceptual quality for single image super-resolution. The GLCM is particularly well suited for automatic perceptual/textural in-domain comparisons, which does not require time-consuming expert MOS evaluations. Experimental validation is carried on X-ray images of rock samples and promising results are achieved.\n\nMy main concerns are as follows:\n- Novelty is quite limited. First, as the main contribution of this work, GLCM is proposed from Haralick et al.(1973), which is not novel. Second, the network structure used in this work is also based on SRGAN/EDSRGAN, which is also not novel.\n\n- Experiments are not convincing. In super-resolution task, the differences in Tab. 2 are quite minor, which can also be regarded as the same or may be caused by randomness. Moreover, the authors should conduct experiments on generic image SR to demonstrate the effectiveness of GLCM. Further, more qualitative visualizations are also needed to demonstrate the effectiveness of GLCM.\n\n- Page 5 only contains 1 figure, leaving a lot of  space that is not fully used. Besides, Fig. 3 cannot reflect the advantage of GLCM, since SRGAN is much larger and also better than SRCNN.", "extra_scores": {"experience_assessment": "I have published in this field for several years.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper at least twice and used my best judgement in assessing the paper.", "review_assessment:_checking_correctness_of_experiments": "I carefully checked the experiments.", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A"}, "extra_text": {}}, {"review_id": "HygS97ittS", "reviewer": "AnonReviewer2", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper addresses the super-resolution problem. The key is to use pixel co-occurrence-based loss metric. The idea is very straightforward. But the description could be clearer. For example, what is the spatial size of P (\\bar P)? How does it influence the optimization?\n\nEquation (2): There are four loss functions on the right hand. How are the loss defined?\n\nHow is the GAN used?\n\nIn experiments, there is no evidence showing the benefit from the pixel Co-occurrence\n\nThere is a lack of much details. Given the current presentation, I cannot judge if the quality reaches the ICLR bar. ", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper at least twice and used my best judgement in assessing the paper."}, "extra_text": {}}]

Author rebuttal:

Meta-review: This paper proposes to use the grey level co-occurrence matrix method (GLCM) for both the performance evaluation metric and an auxiliary loss function for single image super resolution. Experiments are conducted on X-ray images of rock samples. Three reviewers provide comments. Two reviewers rated reject while one rated weak reject. The major concerns include the lack of clear and detailed description, low novelty, limited experiment on only one database, unconvincing improvement over the prior work, etc. The authors agree that the limited experiment on one database does not demonstrate the generalization capability of the proposed method. The AC agrees with the reviewers’ comments, and recommend rejection.
Decision: Reject