GitHub repository: CeadeS/PyTorchH5Dataset
Primary language: Python
Created: 2022-01-07T18:00:18Z
Description: This project is an accelerated dataset for PyTorch. The dataset stores compressed batched data that is cropped while loading. By this, I/O operations and network traffic are reduced. Since the cropping is performed at loading time, the overall loaded data is reduced. Slow lossy jpeg encoding is dropped in favor of a lossless blosc compression. It comes with a function to create a dataset from a directory.