pwc-archive/papers-with-abstracts huggingface dataset:
Towards Practical Real-Time Neural Video Compression
Authors: Zhaoyang Jia, Bin Li, Jiahao Li, Wenxuan Xie, Linfeng Qi, Houqiang Li, Yan Lu
Date: 2025-02-28 00:00:00
Proceeding: CVPR 2025 1
Tasks: Video Compression

We introduce a practical real-time neural video codec (NVC) designed to deliver high compression ratio, low latency and broad versatility. In practice, the coding speed of NVCs depends on 1) computational costs, and 2) non-computational operational costs, such as memory I/O and the number of function calls. While most efficient NVCs prioritize reducing computational cost, we identify operational cost as the primary bottleneck to achieving higher coding speed. Leveraging this insight, we introduce a set of efficiency-driven design improvements focused on minimizing operational costs. Specifically, we employ implicit temporal modeling to eliminate complex explicit motion modules, and use single low-resolution latent representations rather than progressive downsampling. These innovations significantly accelerate NVC without sacrificing compression quality. Additionally, we implement model integerization for consistent cross-device coding and a module-bank-based rate control scheme to improve practical adaptability. Experiments show our proposed DCVC-RT achieves an impressive average encoding/decoding speed at 125.2/112.8 fps (frames per second) for 1080p video, while saving an average of 21% in bitrate compared to H.266/VTM. The code is available at https://github.com/microsoft/DCVC.
SemiSAM+: Rethinking Semi-Supervised Medical Image Segmentation in the Era of Foundation Models
Authors: Yichi Zhang, Bohao Lv, Le Xue, Wenbo Zhang, Yuchen Liu, Yu Fu, Yuan Cheng, Yuan Qi
Date: 2025-02-28 00:00:00
Tasks: Image Segmentation, Medical Image Segmentation, Segmentation, Semantic Segmentation, Semi-supervised Medical Image Segmentation, Universal Segmentation

Deep learning-based medical image segmentation typically requires large amount of labeled data for training, making it less applicable in clinical settings due to high annotation cost. Semi-supervised learning (SSL) has emerged as an appealing strategy due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods. Beyond existing model-centric advancements of SSL by designing novel regularization strategies, we anticipate a paradigmatic shift due to the emergence of promptable segmentation foundation models with universal segmentation capabilities using positional prompts represented by Segment Anything Model (SAM). In this paper, we present SemiSAM+, a foundation model-driven SSL framework to efficiently learn from limited labeled data for medical image segmentation. SemiSAM+ consists of one or multiple promptable foundation models as generalist models, and a trainable task-specific segmentation model as specialist model. For a given new segmentation task, the training is based on the specialist-generalist collaborative learning procedure, where the trainable specialist model delivers positional prompts to interact with the frozen generalist models to acquire pseudo-labels, and then the generalist model output provides the specialist model with informative and efficient supervision which benefits the automatic segmentation and prompt generation in turn. Extensive experiments on two public datasets and one in-house clinical dataset demonstrate that SemiSAM+ achieves significant performance improvement, especially under extremely limited annotation scenarios, and shows strong efficiency as a plug-and-play strategy that can be easily adapted to different specialist and generalist models.
OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing
Authors: Xiang Xiang, Zhuo Xu, Yao Deng, Qinhao Zhou, Yifan Liang, Ke Chen, Qingfang Zheng, YaoWei Wang, Xilin Chen, Wen Gao
Date: 2025-02-28 00:00:00

In open-world remote sensing, deployed models must continuously adapt to a steady influx of new data, which often exhibits various shifts compared to what the model encountered during the training phase. To effectively handle the new data, models are required to detect semantic shifts, adapt to covariate shifts, and continuously update themselves. These challenges give rise to a variety of open-world tasks. However, existing open-world remote sensing studies typically train and test within a single dataset to simulate open-world conditions. Currently, there is a lack of large-scale benchmarks capable of evaluating multiple open-world tasks. In this paper, we introduce OpenEarthSensing, a large-scale fine-grained benchmark for open-world remote sensing. OpenEarthSensing includes 189 scene and objects categories, covering the vast majority of potential semantic shifts that may occur in the real world. Additionally, OpenEarthSensing encompasses five data domains with significant covariate shifts, including two RGB satellite domians, one RGB aerial domian, one MS RGB domian, and one infrared domian. The various domains provide a more comprehensive testbed for evaluating the generalization performance of open-world models. We conduct the baseline evaluation of current mainstream open-world tasks and methods on OpenEarthSensing, demonstrating that it serves as a challenging benchmark for open-world remote sensing.
Style Content Decomposition-based Data Augmentation for Domain Generalizable Medical Image Segmentation
Authors: Zhiqiang Shen, Peng Cao, Jinzhu Yang, Osmar R. Zaiane, Zhaolin Chen
Date: 2025-02-28 00:00:00
Tasks: Data Augmentation, Image Segmentation, Medical Image Segmentation, Segmentation, Semantic Segmentation

Due to the domain shifts between training and testing medical images, learned segmentation models often experience significant performance degradation during deployment. In this paper, we first decompose an image into its style code and content map and reveal that domain shifts in medical images involve: \textbf{style shifts} (\emph{i.e.}, differences in image appearance) and \textbf{content shifts} (\emph{i.e.}, variations in anatomical structures), the latter of which has been largely overlooked. To this end, we propose \textbf{StyCona}, a \textbf{sty}le \textbf{con}tent decomposition-based data \textbf{a}ugmentation method that innovatively augments both image style and content within the rank-one space, for domain generalizable medical image segmentation. StyCona is a simple yet effective plug-and-play module that substantially improves model generalization without requiring additional training parameters or modifications to the segmentation model architecture. Experiments on cross-sequence, cross-center, and cross-modality medical image segmentation settings with increasingly severe domain shifts, demonstrate the effectiveness of StyCona and its superiority over state-of-the-arts. The code is available at https://github.com/Senyh/StyCona.
An Integrated Deep Learning Framework Leveraging NASNet and Vision Transformer with MixProcessing for Accurate and Precise Diagnosis of Lung Diseases
Authors: Sajjad Saleem, Muhammad Imran Sharif
Date: 2025-02-27 00:00:00
Tasks: Diagnostic, Medical Image Analysis, Specificity

The lungs are the essential organs of respiration, and this system is significant in the carbon dioxide and exchange between oxygen that occurs in human life. However, several lung diseases, which include pneumonia, tuberculosis, COVID-19, and lung cancer, are serious healthiness challenges and demand early and precise diagnostics. The methodological study has proposed a new deep learning framework called NASNet-ViT, which effectively incorporates the convolution capability of NASNet with the global attention mechanism capability of Vision Transformer ViT. The proposed model will classify the lung conditions into five classes: Lung cancer, COVID-19, pneumonia, TB, and normal. A sophisticated multi-faceted preprocessing strategy called MixProcessing has been used to improve diagnostic accuracy. This preprocessing combines wavelet transform, adaptive histogram equalization, and morphological filtering techniques. The NASNet-ViT model performs at state of the art, achieving an accuracy of 98.9%, sensitivity of 0.99, an F1-score of 0.989, and specificity of 0.987, outperforming other state of the art architectures such as MixNet-LD, D-ResNet, MobileNet, and ResNet50. The model's efficiency is further emphasized by its compact size, 25.6 MB, and a low computational time of 12.4 seconds, hence suitable for real-time, clinically constrained environments. These results reflect the high-quality capability of NASNet-ViT in extracting meaningful features and recognizing various types of lung diseases with very high accuracy. This work contributes to medical image analysis by providing a robust and scalable solution for diagnostics in lung diseases.
Accurate 3D Grapevine Structure Extraction from High-Resolution Point Clouds
Authors: Harry Dobbs, Casey Peat, Oliver Batchelor, James Atlas, Richard Green
Date: 2025-02-26 00:00:00
Tasks: Management

Accurate 3D modelling of grapevines is crucial for precision viticulture, particularly for informed pruning decisions and automated management techniques. However, the intricate structure of grapevines poses significant challenges for traditional skeletonization algorithms. This paper presents an adaptation of the Smart-Tree algorithm for 3D grapevine modelling, addressing the unique characteristics of grapevine structures. We introduce a graph-based method for disambiguating skeletonization. Our method delineates individual cane skeletons, which are crucial for precise analysis and management. We validate our approach using annotated real-world grapevine point clouds, demonstrating improvement of 15.8% in the F1 score compared to the original Smart-Tree algorithm. This research contributes to advancing 3D grapevine modelling techniques, potentially enhancing both the sustainability and profitability of grape production through more precise and automated viticulture practices
End-to-End Deep Learning in Phase Noisy Coherent Optical Link
Authors: Omar Alnaseri, Yassine Himeur
Date: 2025-02-28 00:00:00

In coherent optical orthogonal frequency-division multiplexing (CO-OFDM) fiber communications, a novel end-to-end learning framework to mitigate Laser Phase Noise (LPN) impairments is proposed in this paper. Inspired by Autoencoder (AE) principles, the proposed approach trains a model to learn robust symbol sequences capable of combat LPN, even from low-cost distributed feedback (DFB) lasers with linewidths up to 2 MHz. This allows for the use of high-level modulation formats and large-scale Fast Fourier Transform (FFT) processing, maximizing spectral efficiency in CO-OFDM systems. By eliminating the need for complex traditional techniques, this approach offers a potentially more efficient and streamlined solution for CO-OFDM systems. The most significant achievement of this study is the demonstration that the proposed AE-based model can enhance system performance by reducing the bit error rate (BER) to below the threshold of forward error correction (FEC), even under severe phase noise conditions, thus proving its effectiveness and efficiency in practical deployment scenarios.
Joint Near-Field Sensing and Visibility Region Detection with Extremely Large Aperture Arrays
Authors: Huiping Huang, Alireza Pourafzal, Hui Chen, Musa Furkan Keskin, Mengting Li, Yu Ge, Fredrik Tufvesson, Henk Wymeersch, Xuesong Cai
Date: 2025-02-28 00:00:00
Tasks: parameter estimation

In this paper, we consider near-field localization and sensing with an extremely large aperture array under partial blockage of array antennas, where spherical wavefront and spatial non-stationarity are accounted for. We propose an Ising model to characterize the clustered sparsity feature of the blockage pattern, develop an algorithm based on alternating optimization for joint channel parameter estimation and visibility region detection, and further estimate the locations of the user and environmental scatterers. The simulation results confirm the effectiveness of the proposed algorithm compared to conventional methods.
Target Tracking using Robust Sensor Motion Control
Authors: Jingwei Hu, Dave Zachariah, Petre Stoica
Date: 2025-02-28 00:00:00

We consider the problem of tracking moving targets using mobile wireless sensors (of possibly different types). This is a joint estimation and control problem in which a tracking system must take into account both target and sensor dynamics. We make minimal assumptions about the target dynamics, namely only that their accelerations are bounded. We develop a control law that determines the sensor motion control signals so as to maximize target resolvability as the target dynamics evolve. The method is given a tractable formulation that is amenable to an efficient search method and is evaluated in a series of experiments involving both round-trip time based ranging and Doppler frequency shift measurements
Data-Importance-Aware Waterfilling for Adaptive Real-Time Communication in Computer Vision Applications
Authors: Chunmei Xu, Yi Ma, Rahim Tafazolli
Date: 2025-02-28 00:00:00

This paper presents a novel framework for importance-aware adaptive data transmission, designed specifically for real-time computer vision (CV) applications where task-specific fidelity is critical. An importance-weighted mean square error (IMSE) metric is introduced, assigning data importance based on bit positions within pixels and semantic relevance within visual segments, thus providing a task-oriented measure of reconstruction quality.To minimize IMSE under the total power constraint, a data-importance-aware waterfilling approach is proposed to optimally allocate transmission power according to data importance and channel conditions. Simulation results demonstrate that the proposed approach significantly outperforms margin-adaptive waterfilling and equal power allocation strategies, achieving more than $7$ dB and $10$ dB gains in normalized IMSE at high SNRs ($> 10$ dB), respectively. These results highlight the potential of the proposed framework to enhance data efficiency and robustness in real-time CV applications, especially in bandwidth-limited and resource-constrained environments.
Movable Antenna Aided Multiuser Communications: Antenna Position Optimization Based on Statistical Channel Information
Authors: Ge Yan, Lipeng Zhu, Rui Zhang
Date: 2025-02-28 00:00:00
Tasks: Position

The movable antenna (MA) technology has attracted great attention recently due to its promising capability in improving wireless channel conditions by flexibly adjusting antenna positions. To reap maximal performance gains of MA systems, existing works mainly focus on MA position optimization to cater to the instantaneous channel state information (CSI). However, the resulting real-time antenna movement may face challenges in practical implementation due to the additional time overhead and energy consumption required, especially in fast time-varying channel scenarios. To address this issue, we propose in this paper a new approach to optimize the MA positions based on the users' statistical CSI over a large timescale. In particular, we propose a general field response based statistical channel model to characterize the random channel variations caused by the local movement of users. Based on this model, a two-timescale optimization problem is formulated to maximize the ergodic sum rate of multiple users, where the precoding matrix and the positions of MAs at the base station (BS) are optimized based on the instantaneous and statistical CSI, respectively. To solve this non-convex optimization problem, a log-barrier penalized gradient ascent algorithm is developed to optimize the MA positions, where two methods are proposed to approximate the ergodic sum rate and its gradients with different complexities. Finally, we present simulation results to evaluate the performance of the proposed design and algorithms based on practical channels generated by ray-tracing. The results verify the performance advantages of MA systems compared to their fixed-position antenna (FPA) counterparts in terms of long-term rate improvement, especially for scenarios with more diverse channel power distributions in the angular domain.
Denoising bivariate signals via smoothing and polarization priors
Authors: Yusuf Yigit Pilavci, Jérémie Boulanger, Pierre-Antoine Thouvenin, Pierre Chainais
Date: 2025-02-28 00:00:00
Tasks: Denoising

We propose two formulations to leverage the geometric properties of bivariate signals for dealing with the denoising problem. In doing so, we use the instantaneous Stokes parameters to incorporate the polarization state of the signal. While the first formulation exploits the statistics of the Stokes representation in a Bayesian setting, the second uses a kernel regression formulation to impose locally smooth time-varying polarization properties. In turn, we obtain two formulations that allow us to use both signal and polarization domain regularization for denoising a bivariate signal. The solutions to them exploit the polarization information efficiently as demonstrated in the numerical simulations
A Quantum-Empowered SPEI Drought Forecasting Algorithm Using Spatially-Aware Mamba Network
Authors: Po-Wei Tang, Chia-Hsiang Lin, Jian-Kai Huang, Alfredo R. Huete
Date: 2025-02-28 00:00:00
Tasks: Mamba

Due to the intensifying impacts of extreme climate changes, drought forecasting (DF), which aims to predict droughts from historical meteorological data, has become increasingly critical for monitoring and managing water resources. Though drought conditions often exhibit spatial climatic coherence among neighboring regions, benchmark deep learning-based DF methods overlook this fact and predict the conditions on a region-by-region basis. Using the Standardized Precipitation Evapotranspiration Index (SPEI), we designed and trained a novel and transformative spatially-aware DF neural network, which effectively captures local interactions among neighboring regions, resulting in enhanced spatial coherence and prediction accuracy. As DF also requires sophisticated temporal analysis, the Mamba network, recognized as the most accurate and efficient existing time-sequence modeling, was adopted to extract temporal features from short-term time frames. We also adopted quantum neural networks (QNN) to entangle the spatial features of different time instances, leading to refined spatiotemporal features of seven different meteorological variables for effectively identifying short-term climate fluctuations. In the last stage of our proposed SPEI-driven quantum spatially-aware Mamba network (SQUARE-Mamba), the extracted spatiotemporal features of seven different meteorological variables were fused to achieve more accurate DF. Validation experiments across El Ni\~no, La Ni\~na, and normal years demonstrated the superiority of the proposed SQUARE-Mamba, remarkably achieving an average improvement of more than 9.8% in the coefficient of determination index (R^2) compared to baseline methods, thereby illustrating the promising roles of the temporal quantum entanglement and Mamba temporal analysis to achieve more accurate DF.
Multi-model Stochastic Particle-based Variational Bayesian Inference for Multiband Delay Estimation
Authors: Zhixiang Hu, An Liu, MinJian Zhao
Date: 2025-02-28 00:00:00
Tasks: Bayesian Inference, Model Selection, parameter estimation

Joint utilization of multiple discrete frequency bands can enhance the accuracy of delay estimation. Although some unique challenges of multiband fusion, such as phase distortion, oscillation phenomena, and high-dimensional search, have been partially addressed, further challenges remain. Specifically, under conditions of low signal-to-noise ratio (SNR), insufficient data, and closely spaced delay paths, accurately determining the model order-the number of delay paths-becomes difficult. Misestimating the model order can significantly degrade the estimation performance of traditional methods. To address joint model selection and parameter estimation under such harsh conditions, we propose a multi-model stochastic particle-based variational Bayesian inference (MM-SPVBI) framework, capable of exploring multiple high-dimensional parameter spaces. Initially, we split potential overlapping primary delay paths based on coarse estimates, generating several parallel candidate models. Then, an auto-focusing sampling strategy is employed to quickly identify the optimal model. Additionally, we introduce a hybrid posterior approximation to improve the original single-model SPVBI, ensuring overall complexity does not increase significantly with parallelism. Simulations demonstrate that our algorithm offers substantial advantages over existing methods.
Linear Model of RIS-Aided High-Mobility Communication System
Authors: Shuaijun Li, Jie Tang, Beixiong Zheng, Xiaokai Song, Guixin Pan, Kai-Kit Wong
Date: 2025-02-28 00:00:00

Reconfigurable intelligent surface (RIS)-aided vehicle-to-everything (V2X) communication has emerged as a crucial solution for providing reliable data services to vehicles on the road. However, in delay-sensitive or high-mobility communications, the rapid movement of vehicles can lead to random scattering in the environment and time-selective fading in the channel. In view of this, we investigate in this paper an innovative linear model with low-complexity transmitter signal design and receiver detection methods, which boost stability in fast-fading environments and reduce channel training overhead. Specifically, considering the differences in hardware design and signal processing at the receiving end between uplink and downlink communication systems, distinct solutions are proposed. Accordingly, we first integrate the Rician channel introduced by the RIS with the corresponding signal processing algorithms to model the RIS-aided downlink communication system as a Doppler-robust linear model. Inspired by this property, we design a precoding scheme based on the linear model to reduce the complexity of precoding. Then, by leveraging the linear model and the large-scale antenna array at the base station (BS) side, we improve the linear model for the uplink communication system and derive its asymptotic performance in closed-form. Simulation results demonstrate the performance advantages of the proposed RIS-aided high-mobility communication system compared to other benchmark schemes.
Reducing Complexity of Data-Aided Channel Estimation in RIS-Assisted Communications
Authors: Amarilton Lopes Magalhães, André Lima Férrer de Almeida, Gilderlan Tavares de Araújo
Date: 2025-02-28 00:00:00

We consider the data-aided channel estimation (CE) problem in a reconfigurable intelligent surface (RIS)-assisted wireless communication system, where the channel and information symbols are estimated jointly during the CE phase, differently from pure pilot-aided methods. We propose a two-stage semi-blind receiver that jointly estimates the combined channel and the data symbols, followed by channel decoupling. To this end, we derive a new modeling framework whose first stage recasts the received signal to allow for the joint estimation of the combined channel and transmitted symbols. In the second stage, channel decoupling is easily achieved via Khatri-Rao factorization, yielding a refined channel estimate. Our solution yields accurate estimates of the cascaded channel at lower computational complexity. Simulation results reveal a similar performance of the proposed method to that of the competitor while providing a substantially reduced computational cost.
Predicting Nonlinear Interference for Short-Blocklength 4D Probabilistic Shaping
Authors: Jingxin Deng, Bin Chen, Zhiwei Liang, Yi Lei, Gabriele Liga
Date: 2025-02-28 00:00:00

We derive a heuristic nonlinear interference model for 4D probabilistic shaping considering the polarization and time correlation of the 4D symbols. We demonstrate an average SNR prediction gap from split-step Fourier simulations of 0.15~dB.