Omkar2118/datasets huggingface dataset:
V-D4RL

V-D4RL provides pixel-based analogues of the popular D4RL benchmarking tasks, derived from the dm_control suite, along with natural extensions of two state-of-the-art online pixel-based continuous control algorithms, DrQ-v2 and DreamerV2, to the offline setting.

Introducing paper: Challenges and Opportunities in Offline Reinforcement Learning from Visual Observations