pwc-archive/papers-with-abstracts huggingface dataset:
Feature Compression for Cloud-Edge Multimodal 3D Object Detection
Authors: Chongzhen Tian, Zhengxin Li, Hui Yuan, Raouf Hamzaoui, Liquan Shen, Sam Kwong
Date: 2024-09-06 00:00:00
Tasks: 3D Object Detection, 3D Object Reconstruction, Feature Compression, object-detection, Object Detection, Object Reconstruction

Machine vision systems, which can efficiently manage extensive visual perception tasks, are becoming increasingly popular in industrial production and daily life. Due to the challenge of simultaneously obtaining accurate depth and texture information with a single sensor, multimodal data captured by cameras and LiDAR is commonly used to enhance performance. Additionally, cloud-edge cooperation has emerged as a novel computing approach to improve user experience and ensure data security in machine vision systems. This paper proposes a pioneering solution to address the feature compression problem in multimodal 3D object detection. Given a sparse tensor-based object detection network at the edge device, we introduce two modes to accommodate different application requirements: Transmission-Friendly Feature Compression (T-FFC) and Accuracy-Friendly Feature Compression (A-FFC). In T-FFC mode, only the output of the last layer of the network's backbone is transmitted from the edge device. The received feature is processed at the cloud device through a channel expansion module and two spatial upsampling modules to generate multi-scale features. In A-FFC mode, we expand upon the T-FFC mode by transmitting two additional types of features. These added features enable the cloud device to generate more accurate multi-scale features. Experimental results on the KITTI dataset using the VirConv-L detection network showed that T-FFC was able to compress the features by a factor of 6061 with less than a 3% reduction in detection performance. On the other hand, A-FFC compressed the features by a factor of about 901 with almost no degradation in detection performance. We also designed optional residual extraction and 3D object reconstruction modules to facilitate the reconstruction of detected objects. The reconstructed objects effectively reflected details of the original objects.
Convolutional Transformer-Based Image Compression
Authors: Bouzid Arezki, Fangchen Feng, Anissa Mokraoui
Date: 2024-09-06 00:00:00
Tasks: Image Compression

In this paper, we present a novel transformer-based architecture for end-to-end image compression. Our architecture incorporates blocks that effectively capture local dependencies between tokens, eliminating the need for positional encoding by integrating convolutional operations within the multi-head attention mechanism. We demonstrate through experiments that our proposed framework surpasses state-of-the-art CNN-based architectures in terms of the trade-off between bit-rate and distortion and achieves comparable results to transformer-based methods while maintaining lower computational complexity.
Memory-Optimized Once-For-All Network
Authors: Maxime Girard, Victor Quétu, Samuel Tardieu, Van-Tam Nguyen, Enzo Tartaglione
Date: 2024-09-05 00:00:00
Tasks: All, Diversity

Deploying Deep Neural Networks (DNNs) on different hardware platforms is challenging due to varying resource constraints. Besides handcrafted approaches aiming at making deep models hardware-friendly, Neural Architectures Search is rising as a toolbox to craft more efficient DNNs without sacrificing performance. Among these, the Once-For-All (OFA) approach offers a solution by allowing the sampling of well-performing sub-networks from a single supernet -- this leads to evident advantages in terms of computation. However, OFA does not fully utilize the potential memory capacity of the target device, focusing instead on limiting maximum memory usage per layer. This leaves room for an unexploited potential in terms of model generalizability. In this paper, we introduce a Memory-Optimized OFA (MOOFA) supernet, designed to enhance DNN deployment on resource-limited devices by maximizing memory usage (and for instance, features diversity) across different configurations. Tested on ImageNet, our MOOFA supernet demonstrates improvements in memory exploitation and model accuracy compared to the original OFA supernet. Our code is available at https://github.com/MaximeGirard/memory-optimized-once-for-all.
Efficient Image Compression Using Advanced State Space Models
Authors: Bouzid Arezki, Anissa Mokraoui, Fangchen Feng
Date: 2024-09-04 00:00:00
Tasks: Computational Efficiency, Image Compression, Knowledge Distillation, State Space Models

Transformers have led to learning-based image compression methods that outperform traditional approaches. However, these methods often suffer from high complexity, limiting their practical application. To address this, various strategies such as knowledge distillation and lightweight architectures have been explored, aiming to enhance efficiency without significantly sacrificing performance. This paper proposes a State Space Model-based Image Compression (SSMIC) architecture. This novel architecture balances performance and computational efficiency, making it suitable for real-world applications. Experimental evaluations confirm the effectiveness of our model in achieving a superior BD-rate while significantly reducing computational complexity and latency compared to competitive learning-based image compression methods.
End-to-end Multi-source Visual Prompt Tuning for Survival Analysis in Whole Slide Images
Authors: Zhongwei Qiu, Hanqing Chao, wenbin liu, Yixuan Shen, Le Lu, Ke Yan, Dakai Jin, Yun Bian, Hui Jiang
Date: 2024-09-05 00:00:00
Tasks: Decoder, Survival Analysis, Survival Prediction, Visual Prompt Tuning, whole slide images

Survival analysis using pathology images poses a considerable challenge, as it requires the localization of relevant information from the multitude of tiles within whole slide images (WSIs). Current methods typically resort to a two-stage approach, where a pre-trained network extracts features from tiles, which are then used by survival models. This process, however, does not optimize the survival models in an end-to-end manner, and the pre-extracted features may not be ideally suited for survival prediction. To address this limitation, we present a novel end-to-end Visual Prompt Tuning framework for survival analysis, named VPTSurv. VPTSurv refines feature embeddings through an efficient encoder-decoder framework. The encoder remains fixed while the framework introduces tunable visual prompts and adaptors, thus permitting end-to-end training specifically for survival prediction by optimizing only the lightweight adaptors and the decoder. Moreover, the versatile VPTSurv framework accommodates multi-source information as prompts, thereby enriching the survival model. VPTSurv achieves substantial increases of 8.7% and 12.5% in the C-index on two immunohistochemical pathology image datasets. These significant improvements highlight the transformative potential of the end-to-end VPT framework over traditional two-stage methods.
Enhancing digital core image resolution using optimal upscaling algorithm: with application to paired SEM images
Authors: Shaohua You, Shuqi Sun, Zhengting Yan, Qinzhuo Liao, Huiying Tang, Lianhe Sun, Gensheng Li
Date: 2024-09-05 00:00:00
Tasks: Image Generation, Super-Resolution

The porous media community extensively utilizes digital rock images for core analysis. High-resolution digital rock images that possess sufficient quality are essential but often challenging to acquire. Super-resolution (SR) approaches enhance the resolution of digital rock images and provide improved visualization of fine features and structures, aiding in the analysis and interpretation of rock properties, such as pore connectivity and mineral distribution. However, there is a current shortage of real paired microscopic images for super-resolution training. In this study, we used two types of Scanning Electron Microscopes (SEM) to obtain the images of shale samples in five regions, with 1X, 2X, 4X, 8X and 16X magnifications. We used these real scanned paired images as a reference to select the optimal method of image generation and validated it using Enhanced Deep Super Resolution (EDSR) and Very Deep Super Resolution (VDSR) methods. Our experiments show that the bilinear algorithm is more suitable than the commonly used bicubic method, for establishing low-resolution datasets in the SR approaches, which is partially attributed to the mechanism of Scanning Electron Microscopes (SEM).
Experimental Framework for Generating Reliable Ground Truth for Laryngeal Spatial Segmentation Tasks
Authors: Hamzeh Ghasemzadeh, David S. Ford, Maria E. Powell, Dimitar D. Deliyski
Date: 2024-09-04 00:00:00
Tasks: Segmentation

Objective: The validity of objective measures derived from high-speed videoendoscopy (HSV) depends, among other factors, on the validity of spatial segmentation. Evaluation of the validity of spatial segmentation requires the existence of reliable ground truths. This study presents a framework for creating reliable ground truth with sub-pixel resolution and then evaluates its performance. Method: The proposed framework is a three-stage process. First, three laryngeal imaging experts performed the spatial segmentation task. Second, regions with high discrepancies between experts were determined and then overlaid onto the segmentation outcomes of each expert. The marked HSV frames from each expert were randomly assigned to the two remaining experts, and they were tasked to make proper adjustments and modifications to the initial segmentation within disparity regions. Third, the outcomes of this reconciliation phase were analyzed again and regions with continued high discrepancies were identified and adjusted based on the consensus among the three experts. This three-stage framework was tested using a custom graphical user interface that allowed precise piece-wise linear segmentation of the vocal fold edges. Inter-rate reliability of segmentation was evaluated using 12 HSV recordings. 10% of the frames from each HSV file were randomly selected to assess the intra-rater reliability. Result and conclusion: The reliability of spatial segmentation progressively improved as it went through the three stages of the framework. The proposed framework generated highly reliable and valid ground truths for evaluating the validity of automated spatial segmentation methods.
Groupwise Image Registration with Edge-Based Loss for Low-SNR Cardiac MRI
Authors: Xuan Lei, Philip Schniter, Chong Chen, Rizwan Ahmad
Date: 2024-09-04 00:00:00
Tasks: Edge Detection, Image Registration, MORPH

Purpose: To perform image registration and averaging of multiple free-breathing single-shot cardiac images, where the individual images may have a low signal-to-noise ratio (SNR). Methods: To address low SNR encountered in single-shot imaging, especially at low field strengths, we propose a fast deep learning (DL)-based image registration method, called Averaging Morph with Edge Detection (AiM-ED). AiM-ED jointly registers multiple noisy source images to a noisy target image and utilizes a noise-robust pre-trained edge detector to define the training loss. We validate AiM-ED using synthetic late gadolinium enhanced (LGE) images from the MR extended cardiac-torso (MRXCAT) phantom and free-breathing single-shot LGE images from healthy subjects (24 slices) and patients (5 slices) under various levels of added noise. Additionally, we demonstrate the clinical feasibility of AiM-ED by applying it to data from patients (6 slices) scanned on a 0.55T scanner. Results: Compared to a traditional energy-minimization-based image registration method and DL-based VoxelMorph, images registered using AiM-ED exhibit higher values of recovery SNR and three perceptual image quality metrics. An ablation study shows the benefit of both jointly processing multiple source images and using an edge map in AiM-ED. Conclusion: For single-shot LGE imaging, AiM-ED outperforms existing image registration methods in terms of image quality. With fast inference, minimal training data requirements, and robust performance at various noise levels, AiM-ED has the potential to benefit single-shot CMR applications.
Enhancing Alzheimer's Disease Prediction: A Novel Approach to Leveraging GAN-Augmented Data for Improved CNN Model Accuracy
Authors: Akshay Sunkara, Rajiv Morthala, Anav Jain, Srinjoy Ghose, Santosh Morthala
Date: 2024-09-03 00:00:00
Tasks: Disease Prediction

Alzheimer's Disease (AD) is a neurodegenerative disease affecting millions of individuals across the globe. As the prevalence of this disease continues to rise, early diagnosis is crucial to improve clinical outcomes. Neural networks, specifically Convolutional Neural Networks (CNNs), are promising tools for diagnosing individuals with Alzheimer's. However, neural networks such as ANNs and CNNs typically yield lower validation accuracies when fed lower quantities of data. Hence, Generative Adversarial Networks (GANs) can be utilized to synthesize data to augment these existing MRI datasets, potentially yielding higher validation accuracies. In this study, we use this principle while examining a novel application of the SSMI metric in selecting high-quality synthetic data generated by our GAN to compare its accuracies with shuffled data generated by our GAN. We observed that incorporating GANs with an SSMI metric returned the highest accuracies when compared to a traditional dataset.
Compressed learning based onboard semantic compression for remote sensing platforms
Authors: Protim Bhattacharjee, Peter Jung
Date: 2024-09-03 00:00:00
Tasks: Earth Observation, image-classification, Image Classification, Image Compression, Semantic Communication, Semantic Compression

Earth observation (EO) plays a crucial role in creating and sustaining a resilient and prosperous society that has far reaching consequences for all life and the planet itself. Remote sensing platforms like satellites, airborne platforms, and more recently dones and UAVs are used for EO. They collect large amounts of data and this needs to be downlinked to Earth for further processing and analysis. Bottleneck for such high throughput acquisition is the downlink bandwidth. Data-centric solutions to image compression is required to address this deluge. In this work, semantic compression is studied through a compressed learning framework that utilizes only fast and sparse matrix-vector multiplication to encode the data. Camera noise and a communication channel are the considered sources of distortion. The complete semantic communication pipeline then consists of a learned low-complexity compression matrix that acts on the noisy camera output to generate onboard a vector of observations that is downlinked through a communication channel, processed through an unrolled network and then fed to a deep learning model performing the necessary downstream tasks; image classification is studied. Distortions are compensated by unrolling layers of NA-ALISTA with a wavelet sparsity prior. Decoding is thus a plug-n-play approach designed according to the camera/environment information and downstream task. The deep learning model for the downstream task is jointly fine-tuned with the compression matrix and the unrolled network through the loss function in an end-to-end fashion. It is shown that addition of a recovery loss along with the task dependent losses improves the downstream performance in noisy settings at low compression ratios.
AutoEncoder Convolutional Neural Network for Pneumonia Detection
Authors: Michael Nosa-Omoruyi, Linda U. Oghenekaro
Date: 2024-09-02 00:00:00
Tasks: Anomaly Detection, Diagnostic, Pneumonia Detection

This study presents an innovative approach utilising Autoencoder Convolutional Neural Networks (AECNNs) for pneumonia detection in paediatric chest x-rays. The research addresses the complexity of pneumonia, considering diverse causative agents, including bacteria, viruses, and aspiration. Autoencoder Convolutional Neural Networks are employed to enhance anomaly detection by revealing hidden patterns in the data. The evaluation process involves meticulous analysis of the histogram reconstruction error, leading to the establishment of a threshold for anomaly identification. The results demonstrate distinct differences in error magnitudes during testing and training periods, with a threshold providing a tangible criterion for anomaly detection. The study contributes valuable insights into the discriminative capability of Autoencoder Convolutional Neural Networks, with a threshold of 0.0127, in detecting pneumonia in paediatric chest x-rays, emphasising their potential for improving diagnostic precision.
Accelerating block-level rate control for learned image compression
Authors: Muchen Dong, Ming Lu, Zhan Ma
Date: 2024-09-02 00:00:00
Tasks: Image Compression

Despite the unprecedented compression efficiency achieved by deep learned image compression (LIC), existing methods usually approximate the desired bitrate by adjusting a single quality factor for a given input image, which may compromise the rate control results. Considering the Rate-Distortion (R - D) characteristics of different spatial content, this work introduces the block-level rate control based on a novel D - {\lambda} model specific for LIC. Furthermore, we try to exploit the inter-block correlations and propose a block-wise R - D prediction algorithm which greatly speeds up block-level rate control while still guaranteeing high accuracy. Experimental results show that the proposed rate control achieves up to 100 times, speed-up with more than 98% accuracy. Our approach provides an optimal bit allocation for each block and therefore improves the overall compression performance, which offers great potential for block-level LIC.
An Optimized Binning and Probabilistic Slice Sharing Algorithm for Motion Correction in Abdominal DW-MRI
Authors: Michelle Su, Cemre Ariyurek, Serge Vasylechko, Onur Afacan, Sila Kurugol
Date: 2024-09-01 00:00:00

Diffusion-weighted magnetic resonance imaging (DW-MRI) is a powerful, non-invasive tool for detecting and characterizing abdominal lesions to facilitate early diagnosis, but respiratory motion during a scan reduces image quality and accuracy of quantitative biomarkers. Respiratory binning, which groups image slices into motion phase bins based on a navigator signal, can help mitigate motion artifacts. However, in DW-MRI, the standard binning technique often generates volumes with missing slices along the superior-inferior axis. Thus, longer scans are required to obtain volumes without gaps. In this study, we proposed a new binning technique to minimize missing slices without increasing scan time. We first designed an algorithm using dynamic programming and prefix sum approaches to optimize the initial binning of MR images. Then, we developed a probabilistic refinement phase, selecting some slices to belong in two neighboring bins to further reduce missing slices. We tested our two-phase technique on free-breathing abdominal DW-MRI scans from eight subjects, including one with tumors. The proposed technique significantly reduced missing slices compared to standard binning (p<1.0*10-15), yielding an average reduction of 81.74+/-7.58%. Our technique also reduced motion artifacts, improving the conspicuity of malignant lesions. Apparent Diffusion Coefficient (ADC) maps generated from free-breathing scans corrected using the proposed technique had lower intra-subject variability compared to ADC maps from uncorrected free-breathing and shallow-breathing scans (p<0.001). Additionally, ADC maps from shallow-breathing scans were more consistent with corrected free-breathing maps rather than uncorrected free-breathing maps (p<0.01). The proposed technique corrects for motion while simultaneously reducing missing slices, allowing for shorter acquisition times compared to standard binning.
Statistical Distance-Guided Unsupervised Domain Adaptation for Automated Multi-Class Cardiovascular Magnetic Resonance Image Quality Assessment
Authors: Shahabedin Nabavi, Kian Anvari Hamedani, Mohsen Ebrahimi Moghaddam, Ahmad Ali Abin, Alejandro F. Frangi
Date: 2024-08-31 00:00:00
Tasks: Domain Adaptation, Image Quality Assessment, Unsupervised Domain Adaptation

This study proposes an attention-based statistical distance-guided unsupervised domain adaptation model for multi-class cardiovascular magnetic resonance (CMR) image quality assessment. The proposed model consists of a feature extractor, a label predictor and a statistical distance estimator. An annotated dataset as the source set and an unlabeled dataset as the target set with different statistical distributions are considered inputs. The statistical distance estimator approximates the Wasserstein distance between the extracted feature vectors from the source and target data in a mini-batch. The label predictor predicts data labels of source data and uses a combinational loss function for training, which includes cross entropy and centre loss functions plus the estimated value of the distance estimator. Four datasets, including imaging and k-space data, were used to evaluate the proposed model in identifying four common CMR imaging artefacts: respiratory and cardiac motions, Gibbs ringing and Aliasing. The results of the extensive experiments showed that the proposed model, both in image and k-space analysis, has an acceptable performance in covering the domain shift between the source and target sets. The model explainability evaluations and the ablation studies confirmed the proper functioning and effectiveness of all the model's modules. The proposed model outperformed the previous studies regarding performance and the number of examined artefacts. The proposed model can be used for CMR post-imaging quality control or in large-scale cohort studies for image and k-space quality assessment due to the appropriate performance in domain shift coverage without a tedious data-labelling process.
MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detection
Authors: Zeyu Zhang, Nengmin Yi, Shengbo Tan, Ying Cai, Yi Yang, Lei Xu, Qingtai Li, Zhang Yi, Daji Ergu, Yang Zhao
Date: 2024-08-30 00:00:00
Tasks: Knowledge Distillation, Model Compression

Cervical disc herniation (CDH) is a prevalent musculoskeletal disorder that significantly impacts health and requires labor-intensive analysis from experts. Despite advancements in automated detection of medical imaging, two significant challenges hinder the real-world application of these methods. First, the computational complexity and resource demands present a significant gap for real-time application. Second, noise in MRI reduces the effectiveness of existing methods by distorting feature extraction. To address these challenges, we propose three key contributions: Firstly, we introduced MedDet, which leverages the multi-teacher single-student knowledge distillation for model compression and efficiency, meanwhile integrating generative adversarial training to enhance performance. Additionally, we customize the second-order nmODE to improve the model's resistance to noise in MRI. Lastly, we conducted comprehensive experiments on the CDH-1848 dataset, achieving up to a 5% improvement in mAP compared to previous methods. Our approach also delivers over 5 times faster inference speed, with approximately 67.8% reduction in parameters and 36.9% reduction in FLOPs compared to the teacher model. These advancements significantly enhance the performance and efficiency of automated CDH detection, demonstrating promising potential for future application in clinical practice. See project website https://steve-zeyu-zhang.github.io/MedDet