Leveraging deep learning for comprehensive classification of renal diseases: A transfer learning approach

Authors: Agniva Banerjee
Primary area: transfer learning, meta learning, and lifelong learning
Keywords: cnn, kidney, image classification, deep learning, transfer learning

Abstract:
The nightmare of cancer as a leading cause of premature deaths worldwide is becoming real and turns out to be one of the major problems of humanity nowadays. Cancer diagnostics at the early stage is Critical to cancer recovery and survival. In this context, renal diseases, including kidney cysts, stones, and tumors, pose significant global health challenges, affecting approximately 12\% of the population and contributing to chronic kidney disease (CKD). Notably, renal cancer ranks as the tenth most prevalent cancer type, accounting for 2.7\% of all cancer cases. This work presents a deep learning (DL) framework utilizing transfer learning (TL) for the early detection of renal diseases and categorizing the conditions into four binary classifications: Cyst\_vs\_Normal, Cyst\_vs\_Stone, Cyst\_vs\_Tumor, and Stone\_vs\_Tumor, allowing for a more specific understanding of each stage. By analyzing CT scans and microscopic histopathology images, the framework employs convolutional neural networks (CNNs) with pre-trained models to facilitate automatic and precise classification of renal conditions. Specifically, two CNN models ResNet-50 and EfficientNetV2 are implemented, providing a comprehensive analysis of each stage of the DL architecture. Comparative evaluations of training outcomes across various datasets revealed that EfficientNetV2 performed marginally better than ResNet-50, achieving an impressive testing accuracy of up to 100\% for all cases. These results underscore the effectiveness of the DL-based system and highlight its potential for widespread clinical application in renal disease diagnosis.

Decision: reject
Reviewer scores: 3, 3, 1, 1

Reviews and discussion:
<thread>
creation date:
1730105392001

thread_type:
official_review

<thread_object>
creator: reviewer_cner

<content>
summary:
The author evaluates two CNNs on the task of renal disease classification. Two models are evaluated on one dataset.

strengths:
The paper presents the applied problem well.

weaknesses:
I am not sure what to think about this paper, because it has virtually no novelty and doesn't really seem like a research paper. There are no methodological contributions, and while the application may be interesting in its field, the experiment and the results are not extensive enough nor evaluated properly.

My major concerns with the paper have been stated already, but if a paper does not have a methodological contribution, I would expect it to have a scientific contribution somehow (in the application, for instance). Here, two existing neural networks are applied to an open dataset, and the highest mean performing model is dubbed the winner. All steps of the ML pipeline would have to be improved, basically. E.g., proper hyper-parameter search would be needed, more methods would have to be evaluated on more datasets, and confidence intervals, standard errors, or tests would have to be performed to say anything. But even with proper evaluation, this paper does not seem like a fit for ICLR, and should then rather be sent to a journal for renal disease studies.

questions:
I think this paper has too many problems for it to be meaningful to give detailed feedback.
</content>
</thread_object>

</thread>
<thread>
creation date:
1730308448973

thread_type:
official_review

<thread_object>
creator: reviewer_ruvd

<content>
summary:
The author borrow on-shelf convolution neural network (ResNet50 and EfficientNet) to test on a kidney dataset (CT scan) and report the result by accuracy, precision, and recall.

strengths:
I understand that making the following judgment on a paper requires caution, which I will clarify later: there is no strength in this paper

weaknesses:
I find that this paper seems to have been generated by a scientific LLM agent. There are many inconsistencies in citations and formatting that appear to be hallucinations.


Here are just few examples that can be easily spot and verified:

Introduction section

- (In paper) Kidney cancer is a growing public health concern, affecting over 10% of the global population, and
projected to rise from the tenth leading cause of death in 2024  (Can, accessed 20th Sep, 2023) 
- (My verification) There is no mention of a '10% global population' or a 'projection to rise from the tenth leading cause' in the provided link. Additionally, the citation format does not appear to be human-written.
----

-  (In paper) Kidney cysts are fluid-filled sacs, while nephrolithiasis affects approximately 17% of the global population (Alelign & Petros, 2018).
- (My verification) Not 17%, it is 12% in the provided link
----
- (In paper) Computed tomography (CT) scans are particularly effective for kidney examinations, offering 3D (dimensional), cross-sectional images ideal for identifying abnormalities like cysts, stones, and tumors (Schmidt, 2012)."
- (My verification): The cited article does not provide this information or endorsement


Related work section

- (In paper) "CNN is a prominent DL algorithm for classifying grid-patterned datasets like images (Tan & Le,2020). "
- (My verification): Directly citing EfficientNet here feels out of place. In the community, it is more common to reference foundational papers like AlexNet, VGG, or those that pioneered CNN applications in the early stages of deep learning. Also, the phrase 'grid-patterned dataset' does not sound natural.
-----
- (In paper)Page 2 line 101-107: The statement "I.....  I..... I.....": 
- This resembles Claude Sonnet’s writing style when it assists in designing code or formulating ideas.


In 3.2 INITIALIZATION OF WEIGHTS
- (In paper) TL (Zhuang et al., 2020) is a powerful technique that significantly enhances training efficiency, especially when data is limited. It involves taking a pre-trained model, often trained on a large dataset like ImageNet, and fine-tuning it for a different but related task
- It’s quite odd to attribute transfer learning, a general machine learning technique, to a recent work from 2020. People in the community were familiar with this approach well before 2020, which makes it seem like an LLM hallucination.

In 3.3 TRAINING RESULT AND DL MODELS
- (In paper)  Two modern CNN architectures ResNet-50 and EfficientNetV2 are used, and both models were trained and evaluated using TensorFlow (Tan & Le, 2021; He et al., 2016; Khan et al., 2020)
- (My verification): This citation seems random; the correct citation for TensorFlow is: Abadi et al., 'TensorFlow: A System for Large-Scale Machine Learning.' Even if this citation were meant to credit EfficientNet or ResNet-50, the final reference to Khan et al., 2020 is irrelevant.
-----
- (In paper) Each of these blocks incorporates a skip connection, in addition to convolutional layers and batch normalization (Ioffe & Szegedy, 2015; Chen et al., 2020)
- (My verification): Ioffe & Szegedy, 2015 for  batch normalization is correct, but the later citation is SimCLR which is completely irrelevant

Hallucination aside, let me summarize the weakness of experiment design
- Reporting 100% accuracy without detailed analysis is suspicious, as this would imply a complete solution to the task—something that is extremely rare in the machine learning community. Even the latest models struggle to achieve 100% accuracy on datasets like CIFAR-10
https://paperswithcode.com/sota/image-classification-on-cifar-10
- It is unclear why the authors transformed a multi-class classification dataset into binary classes (e.g., cyst vs. normal, tumor vs. normal). There appears to be no benefit in deploying multiple binary classification models over the original multi-class approach
- Similar work was conducted in 2023, where ResNet50, EANet, and a proposed approach were compared on the same Kaggle dataset, rendering this paper's contributions negligible.
https://ieeexplore.ieee.org/document/10074314

questions:
To authors:
Do you really come up with the idea, experiment design and writing by yourself?
</content>
</thread_object>

</thread>
<thread>
creation date:
1730693974643

thread_type:
official_review

<thread_object>
creator: reviewer_asfv

<content>
summary:
The authors used two advanced computer models called ResNet-50 and EfficientNetV2, which were already trained on large image databases, to analyze CT scans of kidneys. These models were tested on four different tasks: comparing healthy kidneys to those with cysts, cysts to stones, cysts to tumors, and stones to tumors. Both models performed very well, but EfficientNetV2 was slightly better, achieving perfect accuracy in almost all cases. The models were trained using special techniques to make them learn better and faster. The study found that these tools could be really useful in medical settings to help diagnose kidney diseases quickly and accurately. However, the authors note that future research should use larger and more diverse datasets, combine different types of medical images, and test the models in real-world hospital settings to make sure they work well for different patients.

strengths:
The study utilized multiple dataset.

weaknesses:
The novelty of this work is limited. Transfer learning is already studied in medical image analysis for long years. There is no novel method or contribution in this work. The evaluation of this work is insufficient. Comprehensive evaluation is required. The figures quality needs improve.

questions:
1. which layers' weights are initialized using Xavier initialization and He initialization?
2. Why select ResNet50 and EfficientNetV2?
</content>
</thread_object>

</thread>
<thread>
creation date:
1730711287886

thread_type:
official_review

<thread_object>
creator: reviewer_xqb6

<content>
summary:
In this study, the authors developed a deep learning (DL) framework that utilizes transfer learning (TL) for the early detection of renal diseases and the classification of conditions through the analysis of CT scans and microscopic histopathology images. The proposed framework employs convolutional neural networks (CNNs) with pre-trained models to enable automatic and accurate classification of renal conditions.

strengths:
The paper is well-organized and clearly written.

The proposed method is technically sound.

The collected dataset for developing and evaluating the proposed method is relatively large-scale.

weaknesses:
The novelty of this work is limited from a methodological perspective.

The interpretation of deep learning models is crucial in clinical practice; however, the authors have rarely presented such results.

Additionally, there is a lack of comprehensive comparisons with other studies.

questions:
Please refer to the weaknesses section.

Furthermore, it is important to address why the model was developed for four binary classifications instead of a multi-class, multi-label task.

In addition to accuracy, precision, and recall, other metrics such as ROC AUC should also be reported. The authors should clarify how the cut-off point for these metrics was determined.
</content>
</thread_object>

</thread>


Metareview:
metareview:
This work presents a deep learning framework with transfer learning for the early detection of renal diseases, which outputs four binary classifications: Cyst_vs_Normal, Cyst_vs_Stone, Cyst_vs_Tumor, and Stone_vs_Tumor for a more specific understanding of each stage. By analyzing CT scans and microscopic histopathology images, this work devises convolutional neural networks (CNNs) with pre-trained models to facilitate automatic and precise classification of renal conditions.