Title: DiffSDA: Unsupervised Diffusion Sequential Disentanglement Across Modalities
Primary area: unsupervised, self-supervised, semi-supervised, and supervised representation learning
Keywords: Sequential Disentanglement, Diffusion Models, Unsupervised Learning

Abstract: Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on variational autoencoders and generative adversarial networks often rely on multiple loss terms, complicating the optimization process. Furthermore, sequential disentanglement methods face challenges when applied to real-world data, and there is currently no established evaluation protocol for assessing their performance in such settings. Recently, diffusion models have emerged as state-of-the-art generative models, but no theoretical formalization exists for their application to sequential disentanglement. In this work, we introduce the Diffusion Sequential Disentanglement Autoencoder (DiffSDA), a novel, modal-agnostic framework effective across diverse real-world data modalities, including time series, video, and audio. DiffSDA leverages a new probabilistic modeling, latent diffusion, and efficient samplers, while incorporating a challenging evaluation protocol for rigorous testing. Our experiments on diverse real-world benchmarks demonstrate that DiffSDA outperforms recent state-of-the-art methods in sequential disentanglement.

TL;DR: DiffSDA is a new diffusion-based, modality-agnostic framework that outperforms prior methods in unsupervised sequential disentanglement across real-world data like time series, video, and audio.